【方案】华为智能超算平台解决方案

Transforming

HPC：

华为智能超算平台解决方案持续创新，让计算变简单Innovationmakescomputation

simpleSAP

HANA一体机HPC大数据超融合基础设施Azure

Stack解决方案边缘计算视频分析解决方案网络与加速加速部件ACCNVMeSSDFPGAFPGANICIntelligent

NICFusionServerXFusionServer机架优化标准2S-8S

x86,为大中型企业优化设计传统模块化高密服务器面向大规模应用部署优化FusionServerE刀片系统融合基础设施，提供最大化效率FusionServerGGPU服务器面向需要GPU计算环境的HPC、视频和AI/DL等场景独特创新通用专用应用FDMDEMT创新芯片CPU:

Hi16xxAI芯片:

AscendNC:Hi

1503NIC:Hi

1822存储:

Hi

1812BMC:Hi

17102HPC未来3-5年变革的驱动力Drivingforcesfornext3-5yearsHPC

industry技术：E级计算商业模式：云化业务：智能化E级计算带来基础设施的创新和HPC的生态变化从HPC

forAI演进到AI

for

HPC业务智能化是大势所趋云已成为ICT基础设施的底座和标准商业模式3HPC技术演进：关注E级计算创新与其带来的商业HPC机会FocusonExascaleComputingInnovationsandHPCBusiness

Opportunities申威系统

–

本土自研处理器天河系统

–

本土自研处理器，基于ARM

ISA曙光系统

–

基于x86技术中国通过EPI计划提供本土处理器用于E级计算，基本确定为ARM

ISA技术日本已明确为基于自研处理器的Post-K系统，采用ARM

ISA技术美国已明确A21/Intel，Frontier/?，

EI

Capitan/?三套系统x86/Power/GPU肯定有一席之地有可能存在基于ARM

ISA的系统4HPC系统的衡量标准：HPL

vs.

HPCGvs.

真实应用表现HowtomeasurethevalueofHPCsystem:HPLvs.HPCGvs.

application0.1-1.0flopsper

byte1-2flopsper

byte>2flopsper

byteBLAS1,2 (PDEs)5SparseMVStencils

LatticeBoltzmannMethodsFFTs,SpectralMethodsParticle Dense

LinearMethods

Algebra(BLAS3)CFD,FEM

WRFMemory

boundArithmeticIntensityCompute

boundArithmetic

Intensity代表了每次内存操作后的双精度浮点操作次数Arithmetic

Intensity数值越低，代表应用偏向于内存受限型应用，如稀疏矩阵问题，可以用HPCG表征；数值越高，代表应用偏向于计算受限型应用，如稠密矩阵问题，可以用HPL表征；Roofline

modelHPC作业负载上云所面临的挑战ThechallengetorunHPCworkloadon

Cloud3D

design Pre-process solve Post

processvisualizationCollaborationData

analyticsSubnetWorkspace

accessgatewayPublicIP

addressVPCWorkspaceFirewallInternetMobiledevices

ClientsDBNodeLoginNodesSchedulerNodesLicenseNodesComputingNodesWorkstation(K6000)FatNodesComputing

…NodesGeneralNodesGeneralNodesPortal,

WorkflowFatNodesAltair

HyperworksStorageNodesStorageNodes…(Parallel)file

systemObjectStoragevGPU

accelerationRemotegraphicprotocolSecurity

isolationLowlatencycomputingnetwork

(InfiniBand)BaremetalwithfastprovisionwithZeroperformance

overheadHighperformanceparallelfile

system(support

GPFS,Lustre,BeeGFS)Largememorynodeforpre/post

processSecurity

isolationBigdata

solutionHeterogamouscompetingforinnovation

workloadNVIDIAP100/V100

withInfiniBandFPGA6IndustryProvenVDIsolutionon

CloudvGPUacceleration

withNvidiaM60

vGPURemotegraphicprotocol:Highperformance

RemoteDesktop

Protocol(HDP)>100,000useraround

theworld华为HPC

Cloud解决方案介绍HuaweiHPCCloudsolution

overviewHPCCloud

SpecifictionKVMbasedVMandBaremetalwithfast

provisionHighfrequencyCoreCPU，lowersoftwareLicenseCost(Xeon2667v48core

@3.2GHz)HighCorecountCPUforhighparallelapplication(Skylakev518core

@3.0GHz)10GEthernetand100GIBautomation,fast

provisionLocalNVMeSSD,twicefasterthan

SSDInfinibandbasedParallelfilesystem(GPFS,Lustre,BeeGFS,basedonHL1

Flavor)SecurityisolatedbyOpenStack

VPCGPU/FPGAforAI

workloadHPCCloud

EcosystemSupportLSF,SGE,Moabwithhybridmodel,and

PBSPro,UNIVA,SLURMrunningon

OTCPortingAltairCloud,ESICloudandDassaultCloudtoOTCSFSfile

system

EVSblock

Storage

IB

network…AS(Auto

Scaling)License

nodeLoginPortal

nodeDB

nodeJobSchedule

nodeMPINetwork&

SecurityComputinglayerService

nodeStorageLayerVPCCESEECECSCSS-CPUEECECSCSS-CPUEECECSCSS-CPUWorking

nodeHPCECS

PoolObjectStorageCloudPlatform(OpenStack

API)EVSLocal

diskJob

SchedulerOpenMPI Intel

MPISpectrum

MPIParallelfile

systemLSF PBS

Pro

UNIVA

SGESLURMSaaS

provider ……7HPC

Cloud：线上线下协同的独特价值UniqueValuesofOn-andOff-Premises

Collaboration③

公有云跨地域能力，协同工作提高效率，共享计算资源和数据HWSOn-premise

HPCHPC

Cloud保密数据与业务需要灵活性的业务科学计算AI工业仿真设计图形动画渲染……Core

ApplicationsUsually

deployedin

enterpriseinternallyNon-Core

ApplicationsPartiallydeployed

in

enterpriseinternallyMostlydeployedover

publiccloudCloud

BurstingPartiallydeployedover

publiccloudRarely

self-built

by

large

enterprise1PrivateOn

Premise3PublicCloud2 PrivateHosted*企业自有数据中心

+

管理服务服务商数据中心

+

托管服务公有云服务① 降低整体科研成本TCO，CAPEX转OPEX② 快速弹性伸缩，按需使用，应对计算高峰④ 安全合规、法规遵从Atlas

Server8xV100,

FPGA计算加速本地存储计算网络100G

Infiniband并行文件系统最大带宽

2TB/sNVMe

SSD80万

IOPS业界性能最优的云上超算8典型场景:

HPC

bursting,

AI

and

data

analysisHPCCloudtypicalscenarios:HPCbursting,AIanddata

analysisCloudDemandforHPC

resourceOn-premisesFixeddemandDynamicdemandMaximizingyour

investment(keepfixpartsmallandhighutilization,burstdynamicworkloadtocloud)Global

Collaboration(Engineeraroundtheworkcollaborateoncloud)DataanalyticsAIIOTNewbusiness

demandsTimeto

market(128core*10hours->1280core*

1hour)9智能超算：华为提供全场景AI计算力平台，驱动HPC与AI的融合Huawei’sfullstackIntelligentHPCsolutiondrivesHPCandAI

convergenceCPUFPGAGPUNPUCDM DPS DISMachine

Learning CharacterModeling ExploreTensorFlowCaffeSpeech

&SemanticVisualPerceptionGraphEngineSearch芯片SDK一键设备拓扑配置一键模型部署与生成EI云服务一站式AI业务发布系统芯片服务器AI一体机MRSCloudStreamDWSEI云服务高能物理精准气象基因大数据精准医疗……10智能HPC基础设施：Ascend芯片与板卡HuaweiIntelligentHPCInfrastructure：SoCand

Devices高效能灵活可编程支持多种精度统一架构同时支持训练和推理标准PCIe设备工业级SLA集成多个AI

SoC场景化的加速IPCPUFPGAGPUNPU12芯片智能HPC基础设施：服务器、一体机与HPC系统HuaweiIntelligentHPCInfrastructure：Server,ApplianceandHPC

System灵活性多种异构拓扑一键切换CPU最新一代英特尔至强处理器最新一代GPURDMA网卡GPU模块化模块化设计简化O&M支持CPU和GPU独立演进GPU-ReadyG560在一个4U机箱支持8块FHFL350W

GPU支持GPUDirect

RDMA和Peer-to-peer互连CPU1CPU2SWGPU GPU GPU GPUSWGPU GPU GPU GPUIO拓扑1：单RC-AI训练CPU1CPU2SWGPU GPUGPU GPUSWGPU

GPU GPU GPUIOIO拓扑2：均衡型–HPC&云服务器AI一体机HPC集群12智能HPC基础设施：HPC

Cloud与EI云服务HuaweiIntelligentHPC

Infrastructure：HPC

Cloud andEI

ServicesEnterprise

IntelligenceAI

generalservicesSpeechRecognitionOCR……VisualRecognitionReinforcementlearningDeep

learningMachinelearningGraphcomputingAIplatformservicesHPC

CloudInfrastructureCPUFPGAGPUAI-ASICAIservices

forspecific

industriesSmart

LogisticsSmartRecommendation……SmartRisk

ControlBaremetal

serviceBaremetal+

SDIShared

storageVMswithhigh

specifications128vCPU+4TBRAM100GIBServiceNetwork2μs,Low

LatencyFPGAdata

pre-processingOptimalcloudaccelerationanddata

pre-processingGPU

accelerationNvidiaP100GPU

AccelerationEI云服务封装各类AI框架，并提供更易使用的EI云服务；HPC

Cloud与EI云服务通过batch系统混合调度；13智能HPC软件中间件：NPU算力的释放与AI框架支持IntelligentHPCMiddleware：SoftwareStackforNPUandAI

Appliance开发调试容器调度平台TensorflowDockerMxNetDockerCaffeDockerGPU监控模型发布可视化训练深度学习服务人脸识别OCR车牌识别语音识别DockerDLSAPPSchedulerCPUNPUHardwareCCE-Accelerated

LibraryFrameworkToolkitServiceHostDevTensorFlow/TensorFlowLite/MXNet/Caffe/

Caffe2Matrix

Framework14GPUAI框架支持NPU

SDKGraphCommonRuntimeOpsDistributedRuntimeTVMStream

ExecutorJet2Graph

ParserQuantization

CalibratorInference

EnginecceDNNAPI/cceBLAS

APIQuantizationCompressionSparsityGraph

OptimizerAICore

KernelMapper AICPUKernel

MapperCCE

CRuntimeDeviceManagementMemoryManagementStreamManagementEventManagementExecutionControlDriverTaskScheduler智能HPC管理：简化计算力的获取IntelligentHPCManagement：SimplifyAcquirementofAIComputing

Power15ContainerVMBare

MetalHPCCompute

ResourcesAccelerator

ResourcesHPCStorageResourcesManagementPortal/

GUICluster

ManagerAI/DL

ApplicationHPCApplicationDLFramework,Library,

ToolsMPI,MathLibrary,

CompilerWorkloadManagementSoftware&Job

SchedulerBatch智能HPC

Portal：简化业务流程IntelligentHPCManagement：PortaltoSimplifyBusinessWork

Flow开箱即用预安装AI开发环境、底层软件库、开发框架，2小时开箱即用AutoDL自动生成模型，超级参数自动调优，模型一键部署极致性能在标准框架和编程环境之上，提供经过优化的AI环境极致性能的GPU调度算法，资源利用率提升15%以上集成管理完备的GPU使用率、健康监控、作业调度功能易用的WebUI界面，摆脱低效的命令行操作方式HPC+AI一体机深度学习

|

模型训练

|

推荐系统16创新：高性能领域的持续技术投资Innovation:long-termandstrategicinvestmentonHPC

technologyInfrastructuremiddlewareResource

manageHuawei

MPIApplicationsJob

schedulingHuaweiCompiler

&librariesWeather

&OceanmanufacturingEDALife-scienceAIProcessor,NewFabric-CCIX,

GENZNext-generationNAS

storagesystemInterconnection(IB,RoCE,dedicatedlow-latencytechnology)Oil&

GasHPCapplication

characterization,monitoringand

tuningUnifiedportal

forHPCworkflows6,

华为MPI5,

华为工具链HPCCloudwithcloudburstingorhybrid

cloudsystem1,

HPC领域专用处理器、加速器与下代服务器总线技术3,

RoCE技术与专用低时延互联2,

支