Comments on: NVIDIA BlueField-3 Self-Hosted Version https://www.servethehome.com/nvidia-bluefield-3-self-hosted-version-arm-dpu/ Server and Workstation Reviews Mon, 02 Dec 2024 07:27:10 +0000 hourly 1 https://wordpress.org/?v=6.7.1 By: NF https://www.servethehome.com/nvidia-bluefield-3-self-hosted-version-arm-dpu/#comment-593546 Mon, 02 Dec 2024 07:27:10 +0000 https://www.servethehome.com/?p=82357#comment-593546 @never_released – The BF2500 (516B / DPU controller) firmware and software is also not available. Only the endpoint cards have software available, which is unfortunate.

]]>
By: never_released https://www.servethehome.com/nvidia-bluefield-3-self-hosted-version-arm-dpu/#comment-593430 Sun, 01 Dec 2024 22:45:14 +0000 https://www.servethehome.com/?p=82357#comment-593430 @Daniel

They just have UEFI on them. You should be able to install a regular distribution w/o a separate BSP.

BlueField-1 never was really widely available. Was more of a trial balloon rather than the deployed product that BF2 onwards are. The latter has easily publicly available software.

]]>
By: fuzzyfuzzyfungus https://www.servethehome.com/nvidia-bluefield-3-self-hosted-version-arm-dpu/#comment-592984 Fri, 29 Nov 2024 19:07:26 +0000 https://www.servethehome.com/?p=82357#comment-592984 @Daniel: Nvidia has always been a bad company to be stuck with unless you are either big enough(I suspect that Nintendo’s Tegras did mostly end up working as intended and will probably continue to do so for life of product) or what you wanted to do happened to align with what they wanted to sell. Awkward, because they are sometimes quite good at a given thing; but they always held it close enough to their chest that if they lost interest your luck dried up rapidly.

Probably even worse now that ‘AI’ has hit; since the shiny new business area is so big and so high-value relative to the legacy stuff that they can probably make especially dramatic arguments about the cost of supporting legacy and non-core products.

Beyond just Nvidia, though, ‘DPU’ in general seems like an area ripe for hardware abandonment. A lot more going on than more typical NICs, so anywhere between “there’s a fairly punchy embedded ARM device just burning watts here” and “there’s a dangerously outdated Linux appliance grafted into my server’s brainstem” if nobody is keeping an eye on the firmware (not just the old “oh, yeah, XYZ 10-40GB NIC pulls are crazy cheap vs. the ones based on the other chipset because RoCEv2 is basically a lie never try to enable it unless you like crashes” type abandoned NIC problems); and since so many of the offerings are either relatively early days or very closely tied to some specific hyperscaler’s pet project there’s not necessarily a lot of support hammered out (whether in the form of a relatively generic Linux BSP or a project more specifically aimed at making hardware agnostic management easier like SONiC or OpenBMC) if a vendor has lost interest in a device or you aren’t the intended customer.

I’ll be interested to see whether that gets smoothed out over time, if it’s mostly just a maturity problem; or whether the people who actually buy these things are basically OK with it because adding some powerful offload capabilities and smooshing much of the management plane responsibilities of the BMC into the system’s biggest NIC is reducing the amount of complexity they have to deal with and the ability of the secondary market and small scale operators to deal with it is not their problem.

It will also be interesting to see how ‘silicon root of trust’ appearing on all the spec sheets ends up shaking out. I can understand why people want that; but, depending on implementation, that could either be some relatively light-touch measured boot stuff(or heavier touch all-signed secure boot stuff that gets wiped during decommissioning or ships in customer provisioning mode); or it could involve a lot of expensive hardware aging like an Android handset.

]]>
By: Daniel https://www.servethehome.com/nvidia-bluefield-3-self-hosted-version-arm-dpu/#comment-592858 Fri, 29 Nov 2024 03:14:23 +0000 https://www.servethehome.com/?p=82357#comment-592858 I have some BF1 boards and they are useless – no way to get software for it, or a BSP (board support package) to build an own distro – despite having much more capability than a regular desktop system. I really hate NV for producing new and new hw, and dropping support for previous generations so quickly. That is a brutally forced short update cycle, not seen anywhere else. Same goes with Tegra chips – they never achieved complete support of announced features before getting EOLed.

]]>
By: NF https://www.servethehome.com/nvidia-bluefield-3-self-hosted-version-arm-dpu/#comment-592782 Thu, 28 Nov 2024 17:13:00 +0000 https://www.servethehome.com/?p=82357#comment-592782 BF2500 also provided a root complex. In the STH BF2 ZFS article (with the JBOF backplane) it was very vague about the configuration and mentioned using BF2 516A parts. I always assumed it was possible Nvidia provided firmware or some enablement for root complex (turning 516A into 516B).

]]>
By: Chinesestunna https://www.servethehome.com/nvidia-bluefield-3-self-hosted-version-arm-dpu/#comment-592777 Thu, 28 Nov 2024 16:14:18 +0000 https://www.servethehome.com/?p=82357#comment-592777 I like the bottom right port with just the label “Black Cable”

]]>