configure-and-use-matlab-in-the-cloud-to-develop-scale- 在云中配置并使用 matlab 来开发规模

ConfigureandUseMATLABintheCloudtoDevelop,ScaleandDeployAIApplications

HishamEl-Masry

SeniorProductManager

PAGE

10

Cloudenablesaccesstolargedatasetsandcomputeresources

FileStorage

Multi-coreCPU

GPU

Cloudenablesaccesstolargedatasetsandcomputeresources

FileStorage

MATLAB

Multi-coreCPU

GPU

Clusters

Todaywewilllookattwomaintopicsaboutthecloud

HowtoconfigureMATLABinyourCloudenvironment

HowtouseMATLABinyourCloudworkflow

HowtoconfigureMATLABinyourCloudenvironment

FourPrimaryWaystoUseMATLABintheCloud

AWS

AZURE

PublicClouds On-Premise/PrivateCloud HostingProvider MathWorksCloud

Whateveryourcloudenvironment,MATLABcanworkandscale

AWS

AZURE

PublicClouds On-Premise/PrivateCloud HostingProvider MathWorksCloud

ReferenceArchitectures

SetupMATLABonAWSorAzureeasilywithreferencearchitectures

AWS

AZURE

SupportsAzureAWSandMicrosoftAzure

IncludesCloudtemplates,Architecturediagram,Step-by-stepinstructions

/mathworks-ref-arch

Whateveryourcloudenvironment,MATLABcanworkandscale

AWS

AZURE

PublicClouds On-Premise/PrivateCloud HostingProvider MathWorksCloud

ReferenceArchitectures

CloudDataServices

DataServices

Supportprovidedby

SupportProvidedBy:

DataServices

AZURE

AccessyourclouddatawithconnectorsforMATLAB

Datastore

BlobStorage

(read,outofmemorydata)

DatabaseToolbox

AzureSQLDatabase

AzureDatabasefor

SQLDataWarehouse

SQLServerStretch

(standardODBC/JDBC)

MySQL/PostgreSQL

Database

BlobStorage:Blob,

DataLake

CosmosDB:MongoDB,

SupportPackages

Table,File

(read/write/delete,

encryption,accesscontrol)

(read/write/delete,encryption,accesscontrol)

Cassandra,Tableinterfaces

Datastore

AmazonS3

(read,outofmemorydata)

DatabaseToolbox

(standardODBC/JDBC)

AmazonAurora

AmazonRDSforPostreSQL/MySQL/MariaDB/Oracle/SQL

Server

SupportPackages

AmazonS3

(read/write/delete,encryption,accesscontrol)

AmazonEFS

(NFS/Linux)

AmazonAthena

(QueryofS3data)

AWS

Forthecompletelist,goto

/cloud.html

Whateveryourcloudenvironment,MATLABcanworkandscale

AWS

AZURE

PublicClouds On-Premise/PrivateCloud HostingProvider MathWorksCloud

ReferenceArchitectures

CloudDataServices

CloudCenter

CreateandmanageyourAWSclusterwithCloudCenter

Whateveryourcloudenvironment,MATLABcanworkandscale

AWS

AZURE

PublicClouds On-Premise/PrivateCloud HostingProvider MathWorksCloud

ReferenceArchitectures

CloudDataServices

CloudCenter

MATLABDockerfile

DeepLearningContainer

CreateaMATLABcontainerimagewiththeMATLABDockerfilereferencearchitecture

/mathworks-ref-arch/matlab-dockerfile

MATLABDeepLearningContainerforNVIDIAGPUCloud

PreconfiguredDockercontainer

MATLAB+9ToolboxesforDeepLearning

SeveralPretrainedConvolutionalNeuralNetworks

NVIDIAGPUCloud

containerregistry

SSH

VNC

VirtualMachine

AZURE

AWS

AWSp3orAzureNC-series

/catalog/containers/partners:matlab

ReferenceArchitectures

MATLABDockerfile

CloudCenter

CloudDataServices

DeepLearningContainer

Whateveryourcloudenvironment,MATLABcanworkandscale

AWS

AZURE

PublicClouds On-Premise/PrivateCloud HostingProvider MathWorksCloud

ReferenceArchitectures

MATLABDockerfile

CloudCenter

CloudDataServices

MATLABOnline

MATLABDrive

DeepLearningContainer

Whateveryourcloudenvironment,MATLABcanworkandscale

AWS

AZURE

PublicClouds On-Premise/PrivateCloud HostingProvider MathWorksCloud

ReferenceArchitectures

MATLABDockerfile

CloudCenter

CloudDataServices

MATLABOnline

MATLABDrive

DeepLearningContainer

MATLABOnlineServer

Whateveryourcloudenvironment,MATLABcanworkandscale

AWS

AZURE

PublicClouds On-Premise/PrivateCloud HostingProvider MathWorksCloud

HowtouseMATLABinyourCloudworkflow

TechnicalComputingArtificialIntelligenceWorkflow

AccessandExplore

Data

PreprocessData

DevelopPredictiveModels

IntegrateAnalyticswith

Systems

Files

Databases

Sensors

WorkingwithMessyData

DataReduction/Transformation

FeatureExtraction

ModelCreatione.g.

MachineLearning

ParameterOptimization

Model

Validation

Apps

EnterpriseSystems

AWS

AZURE

Files

Databases

Sensors

AccessandExplore

Data

LeveragedatastorestohandlebigdataonpubliccloudssuchasAzureBlobsorAmazonS3buckets

setenv('AWS_ACCESS_KEY_ID',access_key_id);

setenv('AWS_SECRET_ACCESS_KEY',access_key);

ds=imageDatastore(fileLoc);

[trainDS,valDS,testDS]=splitEachlabel(ds,…

0.7,0.15,0.15,‘randomized’);

Net=trainNetwork(trainDS,layers,trainOpts);

PreprocessData

WorkingwithMessyData

DataReduction/Transformation

FeatureExtraction

UsingMATLABreferencearchitecturetodevelopanalyticsoncloudstoreddata

MathWorksHostedLicenseManager

Usecasesinthecloud:

RemoteDesktop

AWS

AZURE

VirtualNetwork

VirtualMachine

Dataanalyticsoncloud-storeddata

Accesstohigh-endmulti-coreVMs,

GPUs,FPGAs

PrototypingparallelalgorithmsandmodelsononeVMbeforescalingtoacluster

Useacomputeclusterforpreprocessingofdatalargesetsofdata

/mathworks-ref-arch/matlab-on-aws

/mathworks-ref-arch/matlab-on-azure

DevelopPredictive

Models

ModelCreatione.g.

MachineLearning

ParameterOptimization

Model

Validation

Core4

Core3

Core4

Core3

ParallelComputingParadigm

Core1

Core2

Core1

Core2

Core4

Core3

Core4

Core3

Core2

Core1

Core2

Core1

MATLABDesktop(client)

Clusterofcomputers

Speedupyourparametersweepsandsimulationruns

ClientwithMATLABandParallelComputingToolbox

LicenseManager

AWS

AZURE

ComputenodeVMs

HeadnodeVM

withMATLABjobscheduler

VirtualNetwork

MATLABParallelServerCloudReferenceArchitecture

Usecasesinthecloud:

Parametersweeps

MonteCarloruns

Optimization

Distributedarraycalculations

/mathworks-ref-arch/matlab-parallel-server-on-aws

/mathworks-ref-arch/matlab-parallel-server-on-azure

IntegrateAnalyticswithSystems

Apps

Enterprise

Systems

AWS

AZURE

Deploy,scale,andintegrateyouranalyticswithoperational

systems

Cloudconsole

MATLAB

ProductionServerrequestendpoint

https://hostname:9920/app/predictload

AWS

AZURE

MATLABProductionServerVMs

LoadBalancer

Management/

LicenseServerVM

VirtualNetwork

MATLABProductionServerCloudReferenceArchitecture

Usecasesinthecloud:

DeployAImodelsoralgorithmsasmicroserviceAPIs

Scalabled