云计算转型下的数据中心产品与服务

1、云计算转型下的数据中心产品与服务技术创新 变革未来“数字化转型”驱动创新型社会传统 经济数字经济智能农业 .人工智能可穿戴式设备自动化仓库自动驾驶智能零售PwC:2017年投入研发的情况https:/innovation1000 .PwC:2017年投入研发的情况 .PwC:2017年投入研发的情况（中国企业，上市企业） .PwC:2017年投入研发的情况（中国企业，上市企业） .IT敏捷性支撑“数字转型”CapEx vs OpEx开发运营日常需求，自建支持 高峰动态需求：租用应用开发测试云传统生产系统IT基本应用,文件 门户服务 .IaaS会超过SaaS .信息平台的新选择混合 (Hybri

2、d)远端部署 / 就地部署各种云部署的方式公有 多租户私有 - 单租户Software as a ServiceOn-demand B2C & B2B services delivered by cloudPlatform as a ServiceDev environment: hosting, CICD, databases, etc.Infrastructure as a ServiceVirtualized HW (compute, storage, network) delivered as codeAnalytics Serviceswith AWS*Other names and

3、 brands may be claimed as the property of others.FusionCloud OmniLakeCrest .基础架构的一致性至关重要Intel does not control or audit the design or implementation of third party benchmark data or Web sites referenced in this document. Intel encourages all of its customers to visit thereferenced Web sites or other

4、s where similar performance benchmark data are reported and confirm whether the referenced benchmark data are accurate and reflect performance ofsystems available for purchase.2. /system/files/2017-07/EPYC-Offers-x86-Compatibility.pdf.英特尔架构的“云”均已优化，支持各种“云”间的动态迁移Non-Intel ArchitectureIntel 云计算产品与服务 .

5、EC2：构建在Intel技术之上 .AWSInstance TypeHigh Memory X1Compute Optimized C5Compute Optimized C4Storage Optimized D2General Purpose M4Memory Optimize dR3Bare Metal I3.metalBurstable Performan ce T2Intel ProcessorIntel XeonE7-8880 v3Xeon SP: Platinum 8158Gold 6154/6136Custom IntelXeon E5-2666v3Custom IntelXe

6、on E5-2676v3Custom Intel Xeon E5-2676v3Intel XeonE5-2670v2E5-2686v4Intel XeonFamilyIntel AVXAVX 2.0AVX-512AVX 2.0AVX 2.0AVX 2.0YesAVX 2.0YesIntel AES-NIYesYesYesYesYesYesYesNoIntel Turbo BoostYesYesYesYesYesYesYesYesIntel TSXYesNoNoNoNoNoNoNoSSD StorageEBSOptimized by defaultEBS Optimized by default

7、EBS Optimized by defaultNoEBSOptimized by defaultYesYesEBS only应用负载分类决策支持/ 高级分析科学计算 业务流程 网络 Web站点视频/音频处理 业务协作计算密集度内存密集度Front End WebOLTPERPMolecular Dynamics& CAEFile and PrintAppServersEmailRemote VisualizationCRMData Analysis/ MiningAITrainingEnergy SimulationGovt R&DBig Data AnalyticsFinancial Ri

8、skSearchData WarehousingLife Sciences & GenomicsNetwork SecurityWeatherSpeech & AudioImage & Video AnalyticsSimulation WirelessAIInferenceFinancial TradingIn-Memory DatabasesMedia Delivery Graphics&Transcode RenderingPacket Processing中I/O 密集度高中高低Nat/Ind. Security .*气泡大小表示计算强度基于Xeon的EC2完美支持各种工作负载 .“S

9、kylake”144 GiB memoryC512 Gbps to EBS72 vCPUs2X vCPUsAVX 5122X performance3X throughput2.4X memoryC436 vCPUs“Haswell”4 Gbps to EBS60 GiB memoryEC2 C5: 新一代的计算优化实例，第 一款基于Intel Xeon 可扩展处理 器的实例。适合AI、机器学习和HPC。 .最新的AWS EC2 C5“Together with Intel, weve optimized deep learning engines with the latest versio

10、n of the Intel Math Kernel Library, and the Intel Xeon Scalable processors available on the new C5 instance family, to increase inference performance by over 100X.”- Dr. Matt Wood, GM of Artificial Intelligence, AWSEC2 C5实例C5 实例基于至强可扩展处理器，EC2的软件协议栈：网络、存储、安全、监控和管理都卸载至专用 硬件。定制化的KVM，为CPU专门优化 .Amazon EC

11、2裸金属实例：i3.Metal .Amazon EC2裸金属实例：i3.Metal .实例I3.metal典型配置 .CPU 2*E5-2686 v4 （2.3 GHz）, 72个逻辑核内存 512 GiB存储 15.2 TB NVMe存储网络 25 Gbps 基于ENA高性能网络云计算的核心：英特尔 至强 可扩展处理器Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system har

12、dware or software design or configuration may affect actual performance. Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components

13、, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other product

14、s. For more information go to /performance/datacenter.全方位提升虚拟化:全新内核、缓存、芯片上互连、内存控制，以及更多功能Up to4.28XMore VMs per server vs. 4 year old Intel Xeon processor E5-26902更多虚拟机更强虚拟化Up to2.42XFaster SSL web proxy performance vs. previous gen. Intel Xeon processor E5 v4 family3云方案业务持续Up to1.65XAverage generati

15、onal gains on 2S servers cross 12 industry standard workloads1更强性能更多功能现代化平台架构运行现代化“云方案” .Xeon SP：全新的内部结构Xeon SP: 全型号都采用可扩展的Xeon E5v4: 24 Core SKU 两个环 网状结构CBOID ICoreCore BoCache Bo SADLLC2.5MBCBOIDI/QPIIIDICoreCore BoCache Bo SADLLC2.5MBCBOD NIDIU PCoreCore BoCache Bo SADLLC2.5MBCBOD NIDI/QPIIIDIU P

16、CoreCore BoCache Bo SADLLC2.5MBCBOID ICoreCoreBoCache Bo SADLLC2.5MBCBOIDI/QPIIIDICoreCoreBoCache Bo SADLLC2.5MBCBODNIDIUPCoreCoreBoCache Bo SADLLC2.5MBCBODNIDI/QPIIIDIUPCoreCoreBoCache Bo SADLLC2.5MBUP DNU DP NU DP NCBOID ICoreCoreBoCache Bo SADLLC2.5MBCBOIDI/QPII IDI/QPII IDI/QPIIID ICoreCoreBoCac

17、he Bo SADLLC2.5MBCBOID ICoreCore BoCache Bo SADLLC2.5MBCBOIDI/QPII IDI/QPII IDI/QPIIID ICoreCoreBoCache Bo SADLLC2.5MBCBOIDI/QPIIIDICoreCoreBoCache Bo SADLLC2.5MBCBOIDI/QPIIIDICoreCoreBoCache Bo SADLLC2.5MBCBOIDI/QPIIIDICoreCore BoCache Bo SADLLC2.5MBCBOIDI/QPIIIDICoreCoreBoCache Bo SADLLC2.5MBCBODN

18、IDIUPCoreCoreBoCache Bo SADLLC2.5MBCBODNIDI/QPII IDI/QPII IDI/QPIIIDIUPCoreCoreBoCache Bo SADLLC2.5MBCBOD NIDIU PCoreCore BoCache Bo SADLLC2.5MBCBODNIDI/QPII IDI/QPII IDI/QPIIIDIUPCoreCoreBoCache Bo SADLLC2.5MBCBODNIDI/QPIIIDIUPCoreCoreBoCache Bo SADLLC2.5MBCBODNIDI/QPIIIDIUPCoreCoreBoCache Bo SADLL

19、C2.5MBCBOD NIDI/QPIIIDIU PCoreCore BoCache Bo SADLLC2.5MBCBODNIDI/QPIIIDIUPCoreCoreBoCache Bo SADLLC2.5MBQPI AgentQPILinkQPILinkR3QPIIIOR2PCIPCI-E X16IOAPICCB DMAPCI-E X16PCI-E X8PCI-EX4 (ESI)UBo xPCUDDRHome AgentDDRMem CtlrDDRHome AgentDDRMem CtlrMesh ：更高带宽、更低时延、更易扩展2xUPI16xPCIe16xPCIe4x DMI CBDMA1

20、6xOnPkgPCIe1xUPI16xPCIeHA/CA/SF/LLCSKX CoreMCMCMCHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreMCHA/CA/SF/

21、LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreHA/CA/SF/LLCSKX CoreMCMC1x16/

22、2x8/4x4PCIe Gen31x16/2x8/4x4 PCIe Gen3 x4 DMI2x20 10.4GTUPI1x20 10.4GTUPI1x16/2x8/4x4PCIe Gen33x DDR4 2666DDRT 24003x DDR4 2666DDRT 2400PCU .Xeon SP：缓存架构调整Shared LLCUp to 2.5MB/core (inclusive)CoreMLC(256kBprivate)CoreMLC(256kBprivate)CoreMLC(256kBprivate)Shared LLCUp to 1.375MB/core (non-inclusive)

23、CoreMLC(1 MBprivate)CoreMLC(1 MBprivate)CoreMLC(1 MBprivate)再平衡4倍的 MLC（1MB/core）提升性能 .云计算平台的最佳选择至强 可扩展处理器 .云计算平台的最佳选择至强 可扩展处理器 .Intel 人工智能产品与服务 .AWS机器学习软件栈Frameworks & InterfacesPlatform ServicesApplication ServicesInfrastructureEC2 GPUsEC2 CPUsIoTEdgeAWS Deep Learning AMIsCaffe2CNTKChainerApache MX

24、NetPyTorchTensorFlowTorchKerasGluon .AWS机器学习底层平台Tesla V100 GPUsP3AWS Deep Learning AMI5,120 tensor cores128 GB of memory1 petaflop of computeNVLink 2.014X faster than P2C5144 GB of memory .72 vCPUs3.0 GHz Intel Xeon (Skylake) processorsAdvanced Vector Extension (AVX) 512Nitro Hypervisor25% improveme

25、nt in price/perf. than C4 2017, Amazon Web .Intel Atom 处理器英特尔第九代显卡引擎Ubuntu OS- 16.04 LTS100 GFLOPS performanceDual band Wi-Fi8-GB RAM16GB 内存 (可扩展)32-GB SD card4 MP camera with MJPEGH.264 encoding at 1080p resolution2 USB portsMicro HDMIAudio outAWS Greengrass preconfiguredclDNN-optimized for MXNetKe

26、y Differentiators/TechnologiesIntel cLDNN Library optimized for MXNetIntel Deep Learning Deployment ToolkitAWS 深度学习摄影机 技术规格人工智能机器从经验中学习，无需显 式编程，以执行与人类心智 相关的认知功能的能力人工智能机器学习算法性能随着可接触到的 数据增多而提高 .深度学习机器学习的一个子集 多层神经网络从大量 数据中学习人工智能主要方法机器学习深度学习推理用更多数据提供 更好洞察力的算法从大型密集数据集中推断含义的多层神经网络分析与人工智能技术的混合 旨在找到不同数据集中的含

27、义回归 (线性/逻辑)分类 (支持向量机/SVM，朴素贝叶斯)聚类 (层次，贝叶斯，K-Means， DBSCAN)决策树 (随机森林)外推 (隐马尔可夫模型/HMM)其它 图像识别 (卷积神经网络/CNN, 单次检测器/SSD)语音识别 (递归神经网络/RNN)自然语言处理 (长短时记忆模型/LSTM)数据生成 (生成对抗网络/GAN) 推荐系统 (多层感知机/MLP) 时间序数分析 (LSTM, RNN) 强化学习 (CNN, RNN)其它 联想记忆 (英特尔 Saffron AI 记忆库) 参见: 机器学习和深度学习技术 其它 .深度学习突破0%人类2010现在机器在图像和语音识别方面达

28、到或超过人类水平图像识别0%2000现在语音识别错误率错误率人类30%30%23%97%人23%15%15%8%8%99%“播放歌曲”Source: ILSVRC ImageNet winning entry classification error rate each year 2010-2016 (Left), https:/en-us/research/blog/microsoft-researchers-achieve-new-conversational-speech-recognition-milestone/ (Right)肿瘤检测文档分类油气勘探语音助手缺陷检测基因测序例如 .

29、业界最全面的计算平台，助力人工智能硬件从多用途到定制支持从云到设备的人工智能计算社区合作伙伴生态系统在金融，健康，零售，工业等领域促进人工智能数据英特尔分析 生态系统使 数据从集成 到分析做好 准备未来通过领先研 发、投资和 政策领导推 动人工智能 发展工具 .提供软件工具组合以加速解决方案开发周期 Formerly the Intel Computer Vision SDK*Other names and brands may be claimed as the property of others.Developer personas show above represent the pr

30、imary user base for each row, but are not mutually-exclusiveAll products, computer systems, dates, and figures are preliminary based on current expectations, and are subject to change without notice.工具包应用 开发者深度学习 (推断)OpenVINO 英特尔 Movidius开源视觉推断和神经网络优化工具包 用于CPU/GPU/FPGA上推断开发，支持TensorFlow*, Caffe* & M

31、XNet*SDK英特尔VPU上的 优化推断开发支持TensorFlow* 和 Caffe*库数据 科学家基础 库 开发者已完成CPU优化深度学习框架优化正在进行中MXNet*Caffe*BigDLTensorFlow* (Spark)*Caffe2*PyTorch*CNTK* PaddlePaddle*深度学习英特尔 深度学习Studio压缩深度学习开发周期的 开源工具推理 英特尔 SaffronAICPU上的认知解决方案 用于反洗钱预测性维护等*FOR*机器学习库PythonScikit- learnPandasNumPyRCartRandom Foreste1071分布式MlLib (on

32、 Spark)Mahout分析, 机器及深度学习基元Python针对机器学习 优化的英特尔 分发版DAAL英特尔 数据分析 加速库(包括机器学习)MKL-DNNclDNNCPU和集显 深度神经网络 基础函数深度学习图编译器 英特尔 nGraph 编译器 (Alpha)为来自多个框架的针对多种设备优化的深度学习模型计算 开源编译器工具软件工具组合加速解决方案开发 .All products, computer systems, dates, and figures are preliminary based on current expectations, and are subject to

33、change without notice.深度学习训练推断AI硬件主流高强度多用途到定制从云到设备AI计算Intel GNA (IP)其它主要 .1GNA=Gaussian Mixture Model and Neural Network AcceleratorAll products, computer systems, dates, and figures are preliminary based on current expectations, and are subject to change without notice. Images are examples of inten

34、ded applications but not an exhaustive list.Intel GNA (IP)集成显卡内置的深度学习推断Intel MovidiusVPU低功耗计算机 视觉和推断IntelGNA IP1超低功耗语音 和音频推断IntelMobileye EyeQ自动驾驶 推断平台IntelFPGA自定义深度学习推断数据中心边缘 小规模集群和少量本地服务器和工作站设备 通常具有较低能耗要求的用户触摸终端设备深度学习推断加速器 .英特尔 Movidius 视觉处理器针对终端设备的高能效图像处理，计算机视觉和深度学习无人机服务机器人导 航 三维体映射 多模态感知 监控检测和分类

35、 身份识别 多 节点系统 多 模态感知 视频、图像采集 可穿戴检测、跟踪 识 别 视频、图像、会话采集 感知和避障GPS定位悬停像素标记视频、图像采集AR-VR 头戴显示器6自由度姿态、位置、映射视线、眼动跟踪手势跟踪、识别透视相机智能家居检测、跟踪周边、状态监视识别、分类多节点系统多模态感知视频、图像采集All products, computer systems, dates, and figures are preliminary based on current expectations, and are subject to change without notice. .英特尔 M

36、ovidius 软件开发包 .面向视频处理单元的综合软件开发套件快速原型开发使用内置的有向图框架降低时间和 复杂性灵活开发从C/C+到使用丰富工具套件进行图形化开发更多信息: /1463156704-2016-04-29_MDK_ProductBrief.pdfAll products, computer systems, dates, and figures are preliminary based on current expectations, and are subject to change without notice.海康威视智能 摄像头大疆“Prosumer” 无人机宇视 I

37、P 摄像头大华工业相机摩托罗拉 360 度 相机大疆 Spark无人机谷歌 AIY 视觉套件谷歌 Clips 智能相机* Other names and brands may be claimed as the property of others采用英特尔 Movidius 技术的智能设备 .Intel AI 框架主流AI框架全面优化See installation guides at /framework-optimizations/TM*FOR .BigDLSpark Core基于CPU的高性能的深度学习数据处理BigDL 是Apache Spark*的一个分布式深度学习库, 可以在现有

38、的 Spark or Apache Hadoop* 集群上直接运行，直 接访问数据，保留已有的流程和工具。/bigdl并已经登录AWS的应用市场1Open-source software is available for download at no cost; free is also contingent upon running on existing idle CPU infrastructure where the operating cost is treated as a sunk cost .Up to198xIntel Xeon Platinum 8180 Processor

39、higher Intel optimized Caffe GoogleNet v1 with Intel MKL inference throughput compared toIntel Xeon Processor E5-2699 v3 with BVLC-CaffeUp to127xIntel Xeon Platinum 8180 Processor higher Intel Optimized Caffe AlexNet with Intel MKLtraining throughput compared toIntel Xeon Processor E5-2699 v3 with B

40、VLC-CaffeInference and training throughput uses FP32 instructionsDeliver significant AI performance with hardware and software optimizations on Intel Xeon Scalable FamilyUp to 191X Intel Xeon Platinum 8180 Processor higher Intel optimized Caffe Resnet50 with Intel MKL inference throughput compared t

41、o Intel Xeon Processor E5-2699 v3 with BVLC-Caffe Up to 93X Intel Xeon Platinum 8180 Processor higher Intel optimized Caffe Resnet50 with Intel MKL training throughput compared to Intel Xeon Processor E5-2699 v3 with BVLC-CaffePerformance estimates were obtained prior to implementation of recent sof

42、tware patches and firmware updates intended to address exploits referred to as Spectre and Meltdown. Implementation of these updates may make these results inapplicable to your device or system./performanceAI平台的又一选择至强 可扩展处理器软硬一体的优化方案推断性能训练性能Optimized FrameworksOptimized IntelMKL LibrariesIntel 物联网产品

43、与服务 .英特尔技术助力工业物联网及工业4.0built with interfaces and APIs that enable integration with legacy systems and devicesand with platforms frommultiple vendors.开放平台is designed into IA CPUs to offer backward compatibility to help SW and application reusethus reducing developmenttime and resources.互操作性that enables near-real-time analytics, local decision making, and tighter process controls.边缘计算的性能for trusted data from edge to cloud and protection from costly attacks.先进的安全保证for varying levels of gateway perform