NVIDIA NVL72人工智能工厂（英文）

nVIDIA.

NVIDIANVL72AlFactory

NVIDIAEnterpriseReferenceArchitecturewithNVIDIAGB300NVL72andNVIDIASpectrum-XNetworkingPlatform

2026-March

NVIDIAEnterpriseReferenceArchitectureNotice&Disclaimers

NVIDIAEnterpriseReferenceArchitecturedocumentationisNVIDIAconfidentialinformationandembodiessubstantialintellectualpropertyandengineeringknow-how.NVIDIAgrantsyoulimitedpermissionstouseNVIDIAEnterpriseReferenceArchitecturetocreateNVIDIAplatform-enableddatacenterclusterswithNVIDIAtechnologies.YoumaynotusetheNVIDIAEnterpriseReferenceArchitecturetodevelopcompetingproductsortechnologiesorassistingathirdpartyinsuchactivities.ExceptasexpresslystatedinthisNotice&Disclaimerstatement,nootherlicenseorrightisgrantedtoyoubyimplication,estoppelorotherwise.NVIDIAobjectstoandrejectsanyadditionalordifferenttermsyoumaypropose.

NVIDIAEnterpriseReferenceArchitectureissubjecttochangewithoutnotice.NVIDIAtechnologiesmayrequireenabledhardware,software,orserviceactivation.Yourcostsandresultsmayvary.Thisdocumentisnotacommitmenttodevelop,release,ordeliveranytechnology,code,orfunctionality.NVIDIAreservestherighttomakecorrections,modifications,enhancements,improvements,andanyotherchangestothisdocument,atanytimewithoutnotice.Itisyoursoleresponsibilitytoevaluateanddeterminetheapplicabilityofanyinformationcontainedinthisdocumentandensurethattheproductissuitableandfitfortheapplicationplannedbyyou.InformationpublishedbyNVIDIAregardingthird-partyproductsorservicesdoesnotconstitutealicensefromNVIDIAtousesuchproductsorservicesorawarrantyorendorsementthereof.UseofsuchinformationmayrequirealicensefromathirdpartyoralicensefromNVIDIA.

NVIDIAproductsorservicesaresubjecttotheapplicableNVIDIAproductorsalestermsandconditionsthatareprovidedinconjunctionwiththerelevantNVIDIAproductorservice.NVIDIA’sprovisionoftheseresourcesdoesnotexpandorotherwisealterNVIDIA’sapplicablewarrantiesorwarrantydisclaimersfortheNVIDIAproductsorservices.

YouwillnotusetheNVIDIAEnterpriseReferenceArchitectureorNVIDIA’sconfidentialinformationto:(i)identifyorsupportanassertionorpotentialassertionofanyintellectualpropertyrights(includingpatent,copyright,ortradesecret);or(ii)prepare,file,amend,orprosecuteanypatentapplications.YouagreetograntNVIDIAalimited,worldwide,nonexclusive,perpetual,irrevocable,non-sublicensable,nontransferable,royalty-free,fully-paidlicensetoanypatentclaimthatyoumayfileafteraccessingNVIDIAEnterpriseReferenceArchitecturethatcoversthesubjectmatterdisclosedherein.

WarrantyDisclaimer.NVIDIAEnterpriseReferenceArchitecturematerialsdisclosedareprovided“ASIS”.Tothemaximumextentpermittedbyapplicablelaw,NVIDIAdisclaimsallwarrantiesandrepresentationsofanykind,whetherexpress,implied,orstatutory,relatingtoorarisingunderthisagreement,including,withoutlimitation,thewarrantiesoftitle,noninfringement,merchantability,fitnessforaparticularpurpose,usageoftrade,andcourseofdealing.

LimitationofLiability.Tothemaximumextentpermittedbyapplicablelaw,innoeventwillNVIDIAbeliableforany(i)indirect,punitive,special,incidental,orconsequentialdamages,or(ii)damagesforthe(a)costofprocuringsubstitutegoodsor(b)lossofprofits,revenues,use,data,orgoodwillarisingoutoforrelatedtothisdocument,whetherbasedonbreachofcontract,tort(includingnegligence),strictliability,orotherwise,andevenifNVIDIAhasbeenadvisedofthepossibilityofsuchdamagesandevenifayourremediesfailtheiressentialpurpose.Additionally,tothemaximumextentpermittedbyapplicablelaw,NVIDIA’stotalcumulativeaggregateliabilityforanyandallliabilities,obligations,orclaimsarisingoutoforrelatedtothisdocumentwillnotexceedone-hundredU.S.dollars(US$100).

NVIDIA,NVIDIAHGX,NVIDIADGXSuperPOD,NVIDIADGXCloud,NVIDIAConnectX,NVIDIABlueField,NVIDIASpectrum,NVIDIANVLink,NVIDIABaseCommand,NVIDIACUDA,NVIDIAMagnumIO,NVIDIANetQ,andtheNVIDIAlogoaretrademarksand/orregisteredtrademarksofNVIDIACorporationintheU.S.andothercountries.Othercompanyandproductnamesmaybetrademarksoftherespectivecompanieswithwhichtheyareassociated.

©2025NVIDIACorporation&Affiliates.Allrightsreserved.

RichardHastie

ShashankSabhlok

NVIDIAEnterpriseRA2026March|i

NVIDIAEnterpriseRA2026March|ii

Abstract

TheNVIDIAEnterpriseReferenceArchitecture(EnterpriseRA)withNVIDIAGB300NVL72andNVIDIASpectrum-XNetworkingpowersenterprisedatacentersforAItrainingandinferenceatmassivescale,enablingreal-timeapplicationsandtrillion-parametermodels.

ThisEnterpriseRAisdesignedtosolvethemostchallengingcomputationalproblemsoftoday.Certifiedconfigurationsbasedonthisarchitecturecanbedeployedinenterprisedatacentersaroundtheworld.

ThisEnterpriseRAusesthefollowingNVIDIAtechnologies:

>NVIDIAGB300NVL7272>NVIDIABlueField®-3DPUs

>NVIDIAConnectX®-8SuperNICs

>NVIDIASpectrum™-XEthernetPlatforms>NVIDIAAIEnterpriseSoftware

>NVIDIAMissionControl

>NVIDIANVLinkandNVLinkSwitch

Thisdocumentdiscussesthecomponentsthatdefinethescalableandmodular

architectureoftheEnterpriseRA,whichisbuiltuponthebuildingblocksofscalable

units(SU),eachcontaining18computenodeswith72GPUs.ThisEnterpriseRAincludesdetailsregardingtheSUdesignandspecificsofEthernetfabrictopologies,NVLink

networking,andstoragesystemspecifications.

TheEnterpriseRAismanagedbyNVIDIAsolutionssuchasNVIDIAMissionControl,

NVIDIAAIEnterprise,NVIDIA®CUDA®,andNVIDIAMagnumIO™.Thesetechnologieshelpkeepthesystemrunningatthehighestlevelsofavailabilityandperformance.

NVIDIAEnterpriseRA2026March|iii

Contents

Overview 5

SystemHardware&Components 6

NVIDIAGB300NVLComputeTray 7

ControlPlane/ManagementNodes 8

NVIDIANVLinkFifth-Generation 9

NVIDIANVLinkFifth-GenerationSwitchTray 10

NVIDIAGB300NVL72Networking 10

Compute(NodeEast/West)EthernetNetworking 11

Converged(NodeNorth/South)EthernetNetworking 11

NetworkingHardware 13

NVIDIABlueField-3B3240DPU 13

NVIDIAMezzanineNetworkBoardwithConnectX-8 13

NVIDIAEthernetInterconnects 14

NVIDIASN5610Switch 14

NVIDIASN2201Switch 15

NetworkingPhysicalTopologies 16

Compute(NodeEast/West)Network 16

Multi-PlaneTopologyApproach 16

DualPlaneTopology 17

Converged(NodeNorth/South)Network 17

Out-of-BandManagement(Node)Network 18

NetworkLogicalArchitecture 19

EnterpriseRAScalableUnit(SU) 20

Spine-LeafNetworking 22

Out-of-Band(OOB)ManagementNetwork 22

OptimizedUseCase 22

ArchitectureDetails 22

Compute(NodeEast/West)FabricTable 24

Converged(NodeNorth/South)FabricTable 24

2Racks,36Trayswith144BlackwellUltraGPUs 25

NVIDIAEnterpriseRA2026March|iv

4Racks,72Trayswith288BlackwellUltraGPUs 26

8Racks,144Trayswith576BlackwellUltraGPUs 29

EnterpriseRASoftware 31

NVIDIAAIEnterprise 33

NVIDIANGC 33

NVIDIAAIEnterpriseLicensing 33

NVIDIAMissionControl 33

NVIDIAMissionControlLicensing 33

Kubernetes(K8s)andSlurm 33

NVIDIANetQ™ 33

Summary 33

AppendixA–Terminology 34

AppendixB–NodeConfigurations 35

ComputeNodes 35

SwitchesandCables 36

NVIDIAEnterpriseRA2026March|5

Overview

TheNVIDIAEnterpriseRAusing2-4-5-800(dualplane)nodearchitecturewithNVIDIAGB300NVL72andNVIDIASpectrum-XNetworkingoffersafullyintegrated,rack-scalesolutionoptimizedforthemostdemandingAIworkloads.Itdocumentsamodular

architecturebasedonNVIDIA-CertifiedNVL72GB300systems,eachwith72NVIDIABlackwellUltraGPUsand36NVIDIA®GraceCPUs.

Withaliquid-cooleddesign,eachScalableUnit(asingleNVL72rack)integrates18

computetraysconnectedviathefifthgenerationofNVLink.Whileeachtray(single

serverornode)canstilloperateindependentlyasneeded,theNVLinkinterconnect

enablesGPUstobedynamicallycombined,allowingthesystemtofunctionasasinglemulti-GPUunitofcomputeforlargerworkloads.Thedesignminimizessystem

bottlenecksthroughtightlycoupledconfigurationtoprovidethebestperformanceandapplicationscalability

Afullytestedsystemscalesupto8SUs(ScalableUnits).Largerclusterscanbebuiltbasedoncustomerrequirements.

Theracksolutionisdeliveredasapre-configuredsystemavailablethroughthe

fulfillmentofOEMalongwithHardwaresupport.SoftwaresupportfromNVIDIAisbasedonaperGPUpaidsubscriptionofNVIDIAAIEnterprise.WhilethisEnterpriseRA

documentmaymakethesolutionlooksimple,itishighlyrecommendedtoutilizeNVIDIAMissionControlforoperationoftheNVIDIAGB300NVL72.

TheNVIDIAGB300NVL72andNVIDIASpectrum-XPlatformRAhavebeendevelopedtosupportenterprise-gradeAIdeployments,withthefollowingusecases:

>Inferenceontoday’slargestAImodels,inreal-time

>Trainingandfinetuningoftrillion-parameterlanguagemodels>Dataanalyticsthat’sultra-fast,atmassivescale

>High-performancecomputingforsingleandmixedprecision

Forallusecases,thisarchitectureisidealformulti-user,singletenantworkloads.

Specifically,thelogicaldesignandsoftwareisstreamlinedfordeploymentand

maintenanceeasebytailoringtheconfigurationtoonewhereusersareallpartofthesameenterprise,andaccountingandaccesscontrolcanbeconsolidated.

ThisRAisarchitectedtosupportdeploymentofKubernetes,Slurm,andassociatedapplicationsandtoolsfornon‑virtualizedworkloads.

SystemHardware&Components

ThissectiondescribesthehardwareelementsoftheEnterpriseRA.

NVIDIAGB300NVL72TheNVIDIAGB300NVL72(Figure1)deliversbreakthroughAl

performanceandcandeliveruptoa50xoverallincreaseinAlfactoryoutput

performancecomparedtoNVIDIAHopper-basedplatforms.TheNVIDIABlackwellUltraGPUarchitectureprovidesthelatesttechnologiesthatbringmonthsofcomputationaleffortdowntodaysandhoursonsomeofthelargestAI/MLworkloads.

Figure1NVIDIAGB300NVL72

TopoftheRackSwitches2xNVIDIASN2201

4xPowerShelves

10xComputeTrays

9xNVLinkSwitchFith-Generation

8xComputeTrays

4xPowerShelves

Toaccommodatethemassivecomputepowerwithinalimitedspace,theGB300NVL72rackisliquidcooled,basedontheMGXarchitecture.SomekeyhighlightsoftheGB300NVL72computerackinclude:

NVIDIAEnterpriseRA2026March|6

NVIDIAEnterpriseRA2026March|7

>9NVSwitchtraysforfullnon-blockingP2Pconnectivityofall72BlackwellUltraGPUs,withatotalaggregatedbandwidthof130TB/s

>2SN2201OOBswitchesforintegratedmanagementaccessofrackcomponents.

TheGB300NVL72in-rackswitchesuseDCpowersincetheyareconnectedtotheDCbusbar;allotherSN2201switchesuseACpower

>Integratedtray-levelandrack-levelliquidleakagedetection

>8powershelvesof33kW,witheachshelfhavingsix5.5kWPSUs>Fullrackrequiringupto142kW

NVIDIAGB300NVLComputeTray

ThecomputebuildingblockfortheNVIDIAGB300NVL72istheGB300NVLcomputetray/node(Figure2),with4BlackwellUltraGPUsand2GraceCPUspertray.AlogicaldiagramisshowninFigure3.

Figure2NVIDIAGB300NVLComputeTray

ThecomputetrayisafullyintegratedNVLinkscale-outarchitecture,sothateachGPUintheentirerackisdirectlyconnectedtoeveryotherGPUviaNVLink.Forcompute

networkconnectivity,eachcomputetrayincludes2MezzanineNetworkBoardswith2ConnectX-8siliconchipsineach,foratotalof4ConnectX-8HostChannelAdapters

(HCA).Eachtrayalsoincludes1M.2NVMedeviceforOperatingSystem(OS)storageand4E1.SNVMestoragedevicestypicallyusedasafast,localcache.

NVIDIAEnterpriseRA2026March|8

CLinks

UptoPCleGen6x16

UptoPCleGen5x16

Blackwell

UltraGPUC2C

4xGen5x4

Gen6x16

Gen5x16

4xGen5x4

SuperNIC

2x400Gb/sDPUforstoragenetworkanduser/controlmanagementplane

NVMe

PClelocalstorage

2x400Gbps

Figure3Samplelogicaldesignforthecomputetray

Gen5×16

4xGen5x4

Gen6x16

Gen6x16

4xGen5x4

Gen5x16

Gen5x16

BlackwellUltraGPU

UptoPCleGen5x4NVLinkC2C

GraceCPU

GraceCPU

GPU

C2CUltra

UltraGPUC2C

M.2

SuperNIC

1xB00Gb/sSuperNICforGPUCompute(E-W)

Supportsbreakout2x400Gb/s

CX-8superNIC

(E-W)

Gen6x164xGen5x4

B3240

DPU

(N-S)

CX-8SuperNIC

CX-B

(E-W)

B3240DPU(N-S)

Storage

NVMe

NVMe

NVMe

800Gbps(2x400)

800Gbps

800Gbps

800Gbps

(2x400)

(2x400)

(2x400)

ToensurebalancedcomputeperformancewiththeGPUs,eachCPUispairedwithaNVIDIAConnectX-8MezzanineBoard.Additionally,tosupportadvancedstorage

acceleration,eachtrayincludesaNVIDIABluefield-3DPU.

Table1ComputeTrayComponents

Component

Quantity

NVIDIAGraceProcessor,withatotalof72ARMNeoverseV2cores,connectedviaNVLinkC2C,and1TBaggregatedLPDDR5CPUmainmemory

2

NVIDIAB300GPU,with1,152GBaggregatedHBM3memory

4

NVIDIAConnectX-8MezzanineBoards,with2ConnectX-8networkadapterseach

2

Dual-portQSFP112NVIDIABlueField-3B3240DPU

1

ControlPlane/ManagementNodes

ThecustomershouldhaveguidancefromtheOEMregardinganlaaS-managedcontrolplanenodes.TheHighAvailability(HA)featuresofthecontrolplanenodesshouldbe

enabledtoensurereliabilityfortheenterprisecustomer.InthisEnterpriseRA,we

assumeacontrolplanecomposedof12managementnodes,providingsufficient

capacityandHAforlargeenterprisedeployments.Table2outlinesthespecificationsofthex86ManagementNodeswhileTable3outlinesthespecificationsoftheARM

ManagementNodes.

Table2ManagementNodeComponents(x86controlnode)

Component

Configuration

CPUs

Intelbasedx862xSocket,32c

SystemMemory

512GB(8xDDR564GB)

BootDrive

OS2x960GBM.2orSATA/SASSSD/SWRAID1

DataCacheDrive

2x7.68TBNVMeSSD

Storage/in-bandNetworkAdapter

4xConnectX-7200Gsingle-port

PlatformSecurity

TPM2.0,SHA-256andsupportforsecureboot

BaseboardManagementController(BMC)

HostBMCwithdiscreteconnection,supports

Redfish1.4orabove,Serial-over-LANviaSSH,IPv6support,supportdiscoveryofBMCIPin-bandviaRedfish

ManagementNetwork

2x1Gb/sIn-bandport

HostUEFI

UEFI2.6compliantBIOSimplementationfor

HTTP(s)networkboot

Table3ManagementNodeComponents(ARMcontrolnode)

Component

Configuration

CPUs

2xNVIDIAGracewith72cores

SystemMemory

480GB(LPDDR5Xon-module)

BootDrive

OS2x960GBM.2orSATA/SASSSD/SWRAID1

DataCacheDrive

2x7.68TBNVMeSSD

Storage/in-bandNetworkAdapter

4xConnectX-7200Gsingle-port

PlatformSecurity

TPM2.0,SHA-256andsupportforsecureboot

BaseboardManagementController(BMC)

HostBMCwithdiscreteconnection,supports

Redfish1.4orabove,Serial-over-LANviaSSH,IPv6support,supportdiscoveryofBMCIPin-bandviaRedfish

ManagementNetwork

2x1Gb/sIn-bandport

HostUEFI

UEFI2.6compliantBIOSimplementationfor

HTTP(s)networkboot

NVIDIANVLink

TheNVIDIABlackwellarchitectureintroducesfifth-generationNVLink,deliveringupto1800GB/sperGPU–doublingthebandwidthofthepreviousgeneration.Anew

NVSwitchchipandNVLinkswitchhavealsobeenintroducedtoenableevenlarger

NVLinkdomainsizes.Together,theyenablehighbandwidthcommunicationbetween

BlackwellGPUsandunlocksignificantbenefitsforreal-time,cost-effectivelargemodelinferencing.

NVIDIAEnterpriseRA2026March|9

NVIDIAEnterpriseRA2026March|10

SincetheGB300NVL72integrates36NVIDIAGraceCPUswith72NVIDIABlackwellUltraGPUsinarack-scaledesign,thefifth-generationNVLinkenablesall72GPUstofunctionasasinglemulti-GPUunitofcomputeenabling30xfasterreal-timetrillion-parameterinferencecomparedtopriorgenerations.

NVIDIANVLinkSwitchTray

EachGB300NVL72rackincludes9NVLinkFifth-Generationswitchtrays,with2

NVSwitchASICspertray.EachGPUhas18NVLinkFifth-Generationlinks,oneperin-rackNVSwitchviathecopperbackplane.ThiswayasinglerackmayformafullyconnectedL1Domainwith72GPUs.TheNVLinkSwitchisamanagedswitchrunningtheNVOS

networkingoperatingsystem.

Figure4NVLinkSwitch

72GPUSNVLL1Domain

NVSwitch1NVSwitch18

GPU1GPU72

72×NVLFifthGenerationConnectionsperNVSwitch

18×NVLFifthGenerationConnectionsperGPU

NVIDIAGB300NVL72Networking

TheNVIDIAGB300NVL72platformnetworkingconfigurationenablestremendousAlperformanceandscale.ItleveragestheNVIDIAexpertiseinAlclouddatacentersandoptimizesnetworktrafficflow:

·East/WestEast/West(ComputeNetwork)traffic:Thisreferstotrafficbetweenthecomputenodes/trayswithintheGB300NVL72cluster,typicallyformulti-

nodeAltraining,HPCcollectiveoperations,andotherworkloads.

·North/South(CustomerandStorageNetwork)traffic:Thisinvolvestraffic

betweentheGB300NVL72andanyexternalresourcesincludingcloud

managementandorchestrationsystems,remotedatastoragenodes,andotherpartsofthedatacenterortheInternet.

NVIDIAEnterpriseRA2026March|11

TheGB300NVL72comespre-integratedwithacomprehensivenetworkingstackdesigntooptimizeEast/WestandNorth/Southtraffic.Eachcomputetrayisequippedwith

ConnectX-8networkinterfacecards(NICs)delivering800Gb/sandBlueField-3data

processingunits,deliveringupto400Gb/s.Thisconfigurationensureshigh-bandwidth,low-latencycommunicationacrossthe18computetraysandduringdataingressand

egressfromthesystem.Thisarchitecturesimplifiesdeploymentandensuresconsistentperformanceacrossthesystem.

Compute(NodeEast/West)EthernetNetworking

EachtraywithintheGB300NVL72rackhasfourdual-portConnectX-8SuperNICsfor

GPUtoGPU(East/West)traffic.EachConnectX-8SuperNICoffersupto800Gb/s,low-latencynetworkconnectivitybetweenGPUsintheAIcluster.ConnectX-8SuperNIC

offersupto800Gb/s,low-latencynetworkconnectivitybetweenGPUsintheAlcluster,featuringRDMAandRoCEacceleration,withNVIDIA®GPUDirect®andGPUDirect

Storagetechnologies.FordatacentersthatdeployEthernet,ConnectX-8offersarangeofadvancementsincludingRoCEoptimizationsandmulti-tenancy,whicharekeytoinAlcloudenvironments.Additionally,ConnectX-8offersadvancedhardwareoffloadsfor

overlaynetworkssuchasVXLANandNVGRE,whichhelpreduceCPUloadandimprovenetworkefficiency.

Beyondrawspeed,ConnectX-8enhancesnetworkperformancewithfeatureslike

advancedcongestioncontrol,telemetry-basedrouting,andqualityofservice(QoS)

capabilitiestomeetdiverseAIapplicationandtrainingrequirements.SecurityisbuiltinwithhardwareaccelerationforcryptographicprotocolslikeIPSecandMACSec,takingthesetasksoverfromtheCPUtomaintainperformance.

Multi-nodedeploymentswithanNVIDIAB300platformshouldadheretothefollowingtotalcomputenetworkbandwidthperGPUrecommendations:

TheConnectX-8SuperNICisintegratedontothebaseboard,maintaininga1:1GPU-to-NICratiotoensureoptimalbandwidthanddirectconnectivityforeachGPU.

TotalMinimumComputeNetworkBandwidth

•400GB/s(8x400Gb/sEthernetNICs)

TotalRecommendedComputeNetworkBandwidth

•800GB/s(16x400Gb/sEthernetNICsusingbreakout)

Converged(NodeNorth/South)EthernetNetworking

ThissectiondescribestheBlueField-3rolefortheNorth/South(North/South)EthernetnetworkintheGB300NVL72.EachtraywithintheGB300NVL72rackhasonedual-portNVIDIABlueField-3B3240DPUsforNorth/Southtraffic.TheNVIDIABlueField-3B3240isaPCIebaseddataprocessingunit(DPU)thatcanhandleanaggregatebandwidthofapproximately480Gb/s.TheBlueField-3DPUisoptimizedfortheNorth/Southnetwork

NVIDIAEnterpriseRA2026March|12

suchasstorage,complementingtheConnectX-8SuperNICwhichisoptimizedfortheEast/West,Alcomputefabric.

TheBlueField-3B3240DPUoffersseveralessentialcapabilitiesandbenefitswithintheNVIDIAGB300NVL72platform:

•OutofBandProvisioning:BlueField-3servesasanoptimizedcomputeplatformforthedatacentercontrol-plane,enablingautomatedprovisioningandelasticity.ThisempowersGB300NVL72toscaleresourcesdynamicallybasedon

fluctuatingdemand,ensuringefficientallocationofcomputingresourcesfortransientAlworkloads.

•StorageAcceleration:BlueField-3providesadvancedstorageacceleration

featuresthatoptimizedatastorageaccess.ItsinnovativeBlueFieldSNAP

technologyenablesremotestoragedevicestofunctionaslocal,improvingAlperformanceandstreamliningcloudoperations.

•SecureInfrastructure:BlueField-3operatesinahighlysecurezero-trustmodeandfunctionsindependentlyfromthehost,significantlyenhancingthesecurityoftheGB300NVL72platform.Inaddition,BlueField-3enablesawiderangeofacceleratedsecurityservices,includingnext-generationfirewallandmicro-

segmentation,bolsteringtheoverallsecuritypostureoftheinfrastructure.

BlueField-3B3240DPU'sintegrationintheNVIDIAGB300NVL72platformdelivers

crucialcapabilitiesthatenhanceresourcemanagement,performance,security,and

scalability,makingtheNVIDIAGB300NVL72platformanidealchoiceforAlworkloadsindatacenterenvironments.

TheBlueField-3DPUsupportsthreemodesofoperation,withtheEmbeddedFunction(ECPF)orDPUmodeusedinthisEnterpriseRA.Inthismode,theNICresourcesand

functionalityareownedandcontrolledbytheembeddedArmsubsystem.AllnetworkcommunicationtothehostflowsthroughavirtualswitchcontrolplanehostedontheDPUArmcores,andonlythenproceedstothehost.

TosecurelycontrolandmanagetheNVIDIAGB300NVL72platformthroughthe

BlueFieldDPU,NVIDIAhasintegratedanonboardBaseboardManagementController(BMC)intoitsBlueFieldproducts.TheonboardBlueFieldBMCenablestheprovisioningandmanagementoftheBlueFieldandNVIDIAGB300NVL72usingstandardtools,

includingRedfishAPIs.Itincludesanexternalroot-of-trusttoensurethattheBMCfirmwareissecured.ThemaininterfaceoftheBlueFieldBMCisa1Gb/sout-of-bandmanagementportthatconnectstothedatacenterandmanagementnetwork.

NetworkingHardware

ThissectiondescribesthenetworkinghardwareusedtoconnectcomponentsoftheEnterpriseRA

NVIDIABlueField-3B3240DPU

TheNVIDIABlueField-3B3240DPUwithtwo400Gb/sports(Fiqure5)isusedinthe

in--bandmanagementandstoragefabric.EventhoughtheB3240DPUsupports

400Gb/sperport,thecardonlysupportsanaggregatebandwidthacrossbothitsportsofapproximately480Gb/s.TheEnterpriseRArecommendstheuseofdualportsforthebestperformanceandflexibility.EachcomputetrayhasoneB3240DPUs.

Figure5NVIDIABluefield-3B3240DPU

NVIDIAMezzanineNetworkBoardwithConnectX-8

EachGB300computetrayhasaMezzanineNetworkBoard(Figure6)thatisusedforCompute(East/West)network.Thetrayhastwosuchboards,withtwoConnectX-8devicesoneachboard.

NVIDIAEnterpriseRA2026March|13

Figure6NVIDIAMezzanineNetworkBoardwithtwoConnectX-8ASICs

NVIDIAEthernetInterconnects

TheEnterpriseRAconfigurationsmustbeinstalledwithNVIDIAEthernetinterconnects.NVIDIAEthernetinterconnectsmakeextensiveuseofpluggableopticaltransceiversanddetachableopticalfibersforeasierinstallation,inspection,anddebugging.

NVIDIASN5610Switch

TheNVIDIASN5610switch(Fiqure7)bothoffer64totalportsof800GbpstoprovideconnectivityforCompute(East/West),CustomerandStorage(North/South),in-bandmanagement,andstorageintheEnterpriseRA.

Figure7.NVIDIASN5610Switch

TheNVIDIASN5610addstwoSFP28portsandmakesswitchtestingeasiersincetheportsareinpairs.

NVIDIAEnterpriseRA2026March|14

NVIDIAEnterpriseRA2026March|15

NVIDIASN2201Switch

TheNVIDIASN2201switch(Figure8)o