双活数据中心与灾备解决方案-技术部分

双活数据中心与灾备解决方案 技术部分 臧铁军 VMware GCHCOE云架构师 议程 2 基于虚拟化技术的业务连续性解决方案概览 本地站点 灾备站点 基于虚拟化层的异步复制基于硬件设备的同异步复制自动化应用切换管理城域集群 应用感知的高可用性关键应用零停机保护在线迁移虚拟机 动态调配计算与存储资源VMotionandStorageVMotion 高效的数据备份与恢复可通过运行计划与脚本实现自动化操作 灾难恢复 本地高可用 数据保护 方案特点与应用程序和操作系统无关与硬件设备无关完善的保护简单 经济 3 议程 4 双活数据中心在各个级别上全面保障可用性 5 双活数据中心总体架构 双活存储集群 站点A 站点B 延伸的vSphere集群 200km 行为与单个vSphere相同延伸距离最大200KM 通常小于50KM通过VMwareHA与vMotion实现自动的DR保护需要双活存储集群 如EMC的vPlex NetApp的MetroCluster等 6 计算资源设计 MakinganApplicationServiceHighlyAvailable vSphereHAvSphereAppHA 8 VMwarevFabric tcServer vSphereAppHA Policy based Protectoff the shelfapps 9 FaultTolerancevs HighAvailability FaulttoleranceAbilitytorecoverfromcomponentlossExample HarddrivefailureHighavailability X 10 支持多vCPU的容错技术 InstantaneousFailover 4vCPU 4vCPU vSphere Primary Secondary FastCheckpointing 11 长距离vMotion vSphere6 0支持跨三层网络和跨vCenterServer的vMotions 12 vCenterAvailability RunvCenterServerapplicationinaVMRunvCenterServerdatabaseinaVMRunbothinsameVM ProtectwithvSphereHAvCenterandDBVMrestartprioritysettoHighEnableguestOSandAppmonitoringAppHAcanprotectSQLServerdatabaseBackupvCenterServerVManddatabaseImage levelbackupforvCenterServerVMApp levelbackupusingagentfordatabasebackup 13 网络资源设计 双活数据中心网络架构 15 NSXvSphereMulti SiteUseCases NSXforvSpheresupports3differentMulti SiteDeploymentModelsVXLANwithStretchedClusters vSphereMetroStorageCluster VXLANwithSeparateClustersL2VPNAllsolutionsprovideL2extensionoveranL3network enablingworkload IPmobilitywithouttheneedtostretchVLANsLocalegressissupported howeveritdoesaddcomplexityTheappropriatedeploymentmodelwilldependoncustomerrequirementsandtheirenvironment NSX利用层叠网络实现双活数据中心 双活存储vSphere城域存储集群 数据存储1 数据存储2 vCenterServer 三层网络 站点A 站点B 17 VMwareNSXMulti SiteSingleVC StretchedCluster SolutionDetailRequiresasupportedvSphereMetroStorageClusterconfigurationInavMSCdeployment storageisActive Activeandspansbothsites ExamplesofActive Activestorageare EMCVPLEX NetAppMetroCluster seeVMwareHCLformoreinformation StretchedclusterssupportLivevMotionofworkloadsUseL3forallVMkernelnetworks Management vMotion IPStorageAllmanagementcomponentssuchasvCenterServer NSXManagerandControllersarelocatedinSiteALatencyandbandwidthrequirementsaredictatedbyvMSCstoragevendor eg10msRTTforVPLEXwhichalsoalignswithvMotionusingEnterprisePlusvMSCenablesdisasteravoidanceandbasicDisasterRecovery withouttheorchestrationortestingcapabilitiesofSRM LossofeitherNSXComponentsortheDatacenterInterconnectwillresultsinafallbacktodataplanebasedlearningusingexistingnetworkstate ThereforethereisnooutagetodataforwardingandwithoutvCenterServer therearenoVMprovisioningormigrationoperationsNSXandvMSCarecomplimentarytechnologiesthatfitasweetspotforNSX SinglevCenterServer VMwareNSXMulti SiteSingleVC StretchedCluster ClusterConfigurationvMSCenablesstretchedclustersacrosstwophysicalsitesInanNSXdeploymentManagement EdgeandWorkloadclustersareallstretchedUndernormalconditionsallManagementComponentsruninaSiteAandareprotectedbyvSphereHATheyareautomaticallyrestartedatSiteBintheeventofasiteoutage ThemanagementnetworkisnotstretchedandmustbeenabledonSiteBaspartoftherecoveryrunbookDependentondesign NSXEdgeServicesGatewaysareeitheractiveinbothsitesorasinglesiteandcanalsoleverageHAVMsintheWorkloadClustersareautomaticallyrecovered 19 VMwareNSXMulti SiteSingleVC StretchedCluster InavMSCenvironment DRSisusedtobalanceresourceutilization providesiteaffinity improvedavailabilityandensureoptimaltrafficflowUseShouldrules ratherthanMustasthisallowsvSphereHAtotakeprecedenceExampleDRSGroups RulesandSettingsforNSXEdges VMwareNSXMulti SiteSingleVC StretchedCluster NSXConfiguration Option1 Preferred TransportZonespansbothSitesandVXLANLogicalSwitchesprovideL2connectivitytoVMsDistributedLogicalRoutingisusedforallVMstoprovideconsistentdefaultgatewayvMACLocalEgressisprovidedbyusingseparateUplinkLIFsandEdgeGWspersite HostsonSiteAhaveDLRdefaultgatewayconfiguredviaSiteAEdgeGWusingnet vdrCLI WhileSiteBDLRdefaultgatewayisviaSiteBEdgeGWCaveat DynamicRoutingcannotbeenabledonDLR orastaticroutesetviaNSXManagerNSXEdgeGatewayswillhaveastaticrouteforanynetworksdirectlyconnectedtoDLR ConsistentIPaddressingwillsimplifyroutingbyallowingasupernettobeusedDFWprovidesvNICpolicyenforcementindependentoftheVMslocation VM1 VM2 VM3 WebLogicalSwitch172 16 10 0 24 SiteA SiteB DistributedLogicalRouter VM4 VM5 AppLogicalSwitch172 16 20 0 24 SiteANSXEdgeGW192 168 10 1 SiteBNSXEdgeGW192 168 20 1 UplinkNetA192 168 10 0 29UplinkALIF192 168 10 2 UplinkNetB192 168 20 0 29UplinkBLIF192 168 20 2 VM6 VM7 DBLogicalSwitch172 16 30 0 24 InternalLIFs 1 VMwareNSXMulti SiteSingleVC StretchedCluster NSXConfiguration Option2 AsperOption1TransportZonespansbothSitesandVXLANLogicalSwitchesprovideL2connectivityforVMsNSXEdgeGatewaysaredeployedpersitewiththesameinternalIPaddressNSXDFWL2EthernetRulesaredefinedtoblockARPtotheremoteGWusingMACSets whichprovidesLocalEgressasonlythesitelocalEdgeGWislearnt FutureenhancementplannedtoenableESXihostobjectforDFW Caveats TrafficflowbetweenapplicationtiersmaybeasymmetriciftheyaresplitacrosssitesandDRSrulesaren tusedDoesnotleverageDistributedLogicalRoutingandislimitedto10vNICsperEdgevMotionwillresultinnetworkinterruptionasVMARPcacheentryforsitespecificGWneedstotimeoutCanbeusedifOption1isn tafit eg requireDynamicRoutingorvSphere5 1support SiteA SiteB VM1 VM2 VM3 VM3 LogicalSwitch192 168 10 0 24 VMwareNSXMulti SiteSingleVC SeparateClusters 2 Datastore1 Datastore2 vCenterServer L3Network SiteA SiteB StoragevMotionRequiredforVMMobility 23 VMwareNSXMulti SiteSingleVC SeparateClusters SolutionDetailSeparatevSphereClustersareusedateachsite thereforeDRSrules groupsarenotrequiredStorageislocaltoasiteEnhancedvMotion simultaneousvMotionandsvMotion canprovidelivevMotionwithoutsharedstorageUseL3forallVMkernelnetworks Management vMotion IPStorageAllmanagementcomponentssuchasvCenterServer NSXManagerandControllersarelocatedinSiteASupportedlatencyrequirementforEnhancedvMotionis100msRTT vSphere6 vMotionrequires250MbpsofbandwidthperconcurrentvMotionThissolutionprovidesDisasterAvoidancewherelivevMotionissupported byenablingworkloadstobemovedproactivelybetweensitesDoesnotprovideautomatedDisasterRecovery VMwareNSXMulti SiteSingleVC SeparateClusters ClusterConfigurationClustersdonotspanbeyondaphysicalsiteAllManagementComponentsruninSiteA andwillnotbeautomaticallyrecoveredintheeventofasiteoutage StoragereplicationtoastandbyClusterinSiteBandamanualrecoveryprocesscouldbeimplementedSeparateEdgeandWorkloadsClustersareusedpersiteNSXEdgeServicesGatewaysareactiveinasinglesite withHAislocaltothesiteWorkloadsareactiveacrossbothsitesandcanoptionallysupportlivevMotionDRSaffinityrulesforworkloadsarenotrequired 25 VMwareNSXMulti SiteSingleVC SeparateClusters NSXConfigurationOption1withDistributedLogicalRoutingisunchangedfromStretchedClusterconfigurationandisstillrecommendedForoption2 asvCenterobjectsarenotsharedwecanleverageNSXDFWL2EthernetRuleswithascopeoftheDatacentertoprovideLocalEgress asonlythesitelocalEdgeGWislearnt NoenhancementsrequiredSamecaveatswithOption2forStretchedClustersalsoapply SiteA SiteB VM1 VM2 VM3 VM3 LogicalSwitch192 168 10 0 24 ToLocalEgress Ingressornotto Asafirststep askthecustomeriftheyhavestatefulservicesfortrafficenteringandexitingtheDatacenter ThisisgenerallythecaseandifsotheywillrequireasolutiontoprovideLocalIngressfortheirapplications Eg NATGSLBAnycastLISP RHIetcIftheycanaddressthis thenaMulti SiteNSXsolutionprovidingLocalEgressisagoodfitIftheydonot otherquestionstoaskare Dotheyhavehighbandwidthbetweensites andisreducingoperationalcomplexityagoal AnactiveNSXEdgeGatewayatonesite withfailovertothesecondarysitemaymeetthecustomersrequirementsandismuchsimplerthanprovidingLocalEgress Ingress VMwareNSXMulti SiteL2VPN 3 Datastore1 Datastore2 vCenterServer SiteAorOnPrem SiteBorOffPrem vCenterServer SSL SSL 28 存储资源设计 存储需求 SiteA SiteB DarkFiber 200km MetroCluster DWDM DWDM AggrXPlex1 时延要求 vSphere要求RTT 100ms存储同步复制要求RTT 5ms 30 MetroStorage的两种实现方式 Uniform与Non Uniform 31 vSphereMetroStorageCluster工作原理 vSphereHACluster Stretchedacrosscampusormetroarea vMSCCertifiedStorage MetroCluster Arraybasedsynchronousreplication Plex0 Plex0 32 vSphereMetroStorageCluster工作原理 StandardvMotionofVirtualMachines vMotion vMSCCertifiedStorage MetroCluster Arraybasedsynchronousreplication Plex0 vSphereHACluster Plex0 33 vSphereMetroStorageCluster工作原理 vSphereHACluster vMSCCertifiedStorage MetroCluster Plex1 Plex0 Plex0 Siteshutdownformaintenance 34 vSphereMetroStorageCluster工作原理 vSphereHACluster vMSCCertifiedStorage MetroCluster Plex0 Plex1 Plex0 Automaticresync Maintenanceperformed siterestored 35 vSphereMetroStorageCluster工作原理 vSphereHACluster vMSCCertifiedStorage NetAppMetroCluster Plex0 Plex1 Plex0 36 存储设备选型 兼容性网站 六类MetroClusterStorage1 iSCSI2 FC3 NFS4 iSCSI SVD5 FC SVD6 NFS SVD 37 EMCVPLEXforStretchedMetroClusters Roadmap StretchedvSphereCluster SiteA Active SiteB Active 10ms IPorFC vCenter EstablishedVPLEXActive ActiveSolutionInstantvMotionacrossdistanceVMwareHAautomaticallyrestartsVMsateithersiteforsystemorsitefailureBalanceworkloadsacrossbothsiteswithVMwareDRSSupportsVMwareFToutoftheboxAdditionalflexibilityofVPLEXMetroDoesn tRequireFCCross ConnectChooseIPorFCConnectivitybetweensitesThirdSite IPconnectivitytoWitnessVMNoSPOF IfyouloseaDirector nolossofaccessatanysite VPLEX VPLEX DualSiteDRS DualSiteHA InstantvMotion SiteC OptionalWitness VPLEXDistributedVirtualVolumes 38 StretchedStoragewithIBMSANVolumeController Singlesystemimageacrosstwositesprovidessinglepaneofglassmanagementforday to daystoragemanagementactivitySimplifymanagementofyourenvironmentatsametimeasdeployingactive activestorageBaseduponarichandmatureplatformProvideReal timeCompression EasyTier Non disruptivemigrations Longdistancereplication40 000enginesinstalledworldwide 11yearsfieldexperience250 storagedevicessupportedtoprovideback endcapacityRetainyourexistinginvestmentinstoragedevicesKeepflexibilityforthefutureActivequorumdeviceenablesautomaticfailoverNoexternalmanagementsoftwarePreventssplit brainSupportsrecoveryincaseoffullunplannedsitefailurescenarios Quorum StoragePool1 StoragePool2 Site1 Site1 Site2 Site2 Site3 SVCStretchedCluster 39 来自存储厂商的参考指南 ImplementingVMwarevSphereMetroStorageClusterwithHPLeftHandMulti SitestorageIBMSANandSVCStretchedClusterandVMwareSolutionImplementation 40 VSANforMetroCluster2015Q3 计划 SiteA FaultDomainA FaultDomainB FaultDomainC VirtualSANCluster SiteC SIteB vmdk witness vmdk vmdk witness vmdk 从机架感知升级到站点感知 1 迷你容错站点专用于witness2 优先从本地站点读取数据以提升性能 41 议程 42 RTO RPO andMTD RecoveryTimeObjective RTO HowlongitshouldtaketorecoverRecoveryPointObjective RPO AmountofdatalossthatcanbeincurredMaximumTolerableDowntime MTD DowntimethatcanoccurbeforesignificantlossisincurredExamples Financial reputation 43 TheThreeBuildingBlocksForDisasterRecovery vSphere VirtualSAN Ecosystem VDPAdvanced vSphereReplication SiteRecoveryManager VMware Array based Backupcopies ExternalStorage Storage Compute BackupandRecovery Replication DROrchestration 44 异地 同城 灾备解决方案总体架构 45 异地 同城 灾备解决方案 多种映射关系 主备式切换 双活切换 双向切换 双活数据中心 Production Recovery Production Recovery Production Production 最常见的场景花销较大 灾备架构主要用于测试 开发和培训等非生产应用有效降低开销 两个站点均有生产应用每个站点为对方提供容灾支持 两个站点的应用可以跨站点自由移动计划内事件零停机限制在城域范围内 Site1 Site2 Production 46 网络资源设计 Protected Site Recovery Site Storage Storage VMFS NFS VMFS NFS Storage VMFS NFS VMFS NFS Replication SRMwithNSXforvSphere FirewallRules SecurityGroups 48 SRMwithNSXforvSphere WhathasbeenvalidatedSRMcanmapVMsfromoneVXLANLogicalSwitchonthePrimarySitetoadifferentLogicalSwitchontheRecoverySiteTheseLogicalSwitchescanbeconnectedtopre createdNSXDistributedLogicalRoutersorNSXEdgeServicesGWsPlaceholderVMscanbeaddedtoSecurityGroupsandinaDRevent whentheseVMsbecomeactivetheyareprotectedbyDFWDynamicRoutingcanbeusedtoadvertisenetworksontheprimarysite Usingmetric weightthesenetworkscanbere advertisedontherecoverysiteifthereisasitefailoverThismapsverycloselytothevCACdeploymentmodelforpre creatednetworkswhichisusedforproductionworkloads Test Devworkloadsusingon demandnetworkingdonottypicallyrequireDRCurrentlybeingtestedAutomatesynchronizationofNSXDistributedFirewallRulesetandSecurityGroupsbetweentwoNSXManagersTieintoSRM soatthetimeVMsareaddedtoaProtectionGrouptheplaceholderVMsareautomaticallyaddedtotheappropriateSecurityGroupsWorkingcloselywithEMCaspartoftheirEnterprisePrivateCloudReferenceArchitectureprojecttoturnthisintoaproductizedsolutionincludingvCAC LogicalArchitectureView 192 168 0 0 24 192 168 0 1 2 2 2 2 2 2 2 0 28 192 168 0 0 24 3 3 3 0 28 NoNetworkReaddressing DynamicRouting VXLAN VXLAN VLAN VLAN vCenter SRM vCenter SRM DistributedLogicalRouter DynamicRouting OSPF BGP PrimaryVMs PlaceholderVMs 192 168 10 2 192 168 10 1 192 168 0 1 3 3 3 3 DistributedLogicalRouter DynamicRouting OSPF BGP 192 168 10 2 192 168 10 1 VMFS VMFS Protected Site Recovery Site 50 PrimaryVMs SRMwithNSXforvSphere 192 168 0 0 24 2 2 2 0 28 192 168 0 0 24 3 3 3 0 28 NoNetworkReaddressing DynamicRouting VXLAN VXLAN VLAN VLAN vCenter SRM vCenter SRM DynamicRouting OSPF BGP PrimaryVMs PlaceholderVMs 192 168 0 1 3 3 3 3 DistributedLogicalRouter DynamicRouting OSPF BGP 192 168 10 2 192 168 10 1 SG Prod 01 SG Dev 01 SG Prod 01 SG Dev 01 SiteBNSXEdgeGW 51 SRMwithNSXforvSphere CurrentChallengesBoththeprimaryandrecoverysitesneedtobepreparedforNSXinandnetworksneedtobecreatedonbothsitesfortheSRMmappingDynamicallycreatednetworksandport groupsontheprotectedsitearenotcreatedontherecoverysiteautomaticallyandwillneedtobedonemytheadministratorDRsiteconfigurationverificationandremediationprocessestomaintainsynchronizationiscurrentandmatchingonboththesitesServicecomposerfeaturesaredependentonUUIDandVDSuniqueidentity s currentlynotsupported OutoftheBoxsupportfromSRMFutureDevelopmentScopeAcceptablePreparationstep shouldbepartofarunbookAutomateSRMPort GroupmappingviaVCO AutomatesynchronizationofNSXDistributedFirewallRulesetandSecurityGroupsbetweentwoNSXManagersusingVCOworkflowsandtheNSX VCOpluginEnhanceVCOtosupport2 waysynchronization InvestigatingremovalofserviceComposerVDSthumbprintdependenciesTieintoSRM soatthetimeVMsareaddedtoaProtectionGrouptheplaceholderVMsareautomaticallyaddedtotheappropriateSecurityGroups Q2 2015 52 Protected Site Recovery Site Storage Storage VMFS NFS VMFS NFS VMFS NFS NSXWorkflowforManualSynchronization WhenanobjectiscreatedontheprimarySite thesameobjectneedstobedeployedontherecoverysitetomaintainconsistency Duplicatenetworksegmentsandsubnetscanexistonboththeprotectedandtherecoverysite thisistomaintainIPaddresses 53 Protected Site Recovery Site Storage Storage VMFS NFS VMFS NFS VMFS NFS NSXVCOWorkflowforSynchronization 54 存储资源设计 软件定义存储在BC DR解决方案中的独特价值 56 基于存储策略的管理 虚拟卷管理 VirtualDatastore VirtualDatastore 低成本的存储解决方案快速 面向应用的置备不依赖硬件便于采用非对称设计不需要管理LUNs Vols在线变更策略无需数据迁移 数据保护方案设计 DataProtectionTechniques 58 HIGH LOW SLOW FAST PotentialforDataLoss RPO TimetoRecover RTO SynchronousReplication TapeBackup AsynchronousReplication Snapshots DiskBackup Howmuchdatacanyouaffordtolose Howlongcanyouaffordtobewithoutthedataorservice DataProtectionUseCases 59 选择正确的数据保护方案 60 可实现零数据丢失存储合作伙伴解决方案 RPO 同步 分钟 小时 天 RPO从15分钟到24小时基于虚拟机层 虚拟机级别 RPO最小1天备份数据复制 VDP VDPAdvanced Simple EfficientBackupandReplicationwithPredictableRecovery Whatisit vSphereDataProtectionisabackupandreplicationsolutionforsimplifyingandoptimizingdataprotectioninvSphereenvironmentsKeyFeaturesAgent less disk basedvirtualmachinebackupsApplication aware granular agent baseddataprotectionforphysicalandvirtualapplicationsEnd to endintegrationwithvSphereandmanagedthroughvSphereWebClientSingle steprecoverySelf serviceFile LevelRecoveryPoweredbyEMCAvamar 61 4xMoreStorage efficientand6xFasterforRecovery Uniquevariable lengthdedupe 60KsavingsonstorageTCOperyear 4x Source ESGLabValidationReport vSphereDataProtection February2013 6x UniqueCBTRestoretechnologyRecoverVMstoproductioninminutes Forrealbackups VMwareoffersvSphereDataProtection VDP thededuplicationlevelsareamazing TrevorPott TheRegister ManagewithEase aSimpleWaytoHandleBackups UsingvSphereDataProtectionallowsustohavethemanageabilitythatwedidn thavebefore thiswasano brainerforus SeniorITArchitect LargeEnterpriseComputerServicesSource TechValidate TVID 07A 32C 7F2 63 DataProtection BackupandRestore Agents NoAgents Both Noagentsformajorityofworkloads keepitsimpleAgentsforcertainappsvSphereDataProtection VDP AdvancedBackupandrecoveryforVMware fromVMwareBasedonproven matureEMCAvamar Agent lessVMbackupandrestoreAgentsforgranulartier 1applicationprotection 64 ApplicationAwarenessforMission CriticalAppsBackupforVirtualandPhysicalApplications InVDPAdvancedOnlyAgentsforExchange SQL SharePointDatabase levelbackupandrecoveryforExchange SQL SharePointMailbox levelrecoveryforExchangeBackupfornon virtualizedExchange SQL SharePointappsSupportforMSExchangeDAGs SQLServerClusters KeyBenefitsApplicationconsistencyClient sidededuplicationGranularbackupandrestoreLogmanagement 65 VDPAdvanced KeepInMind EngineeredforSMBenvironmentsUsesVADP VMsnapshots CBTUtilizesWindowsVSSinVMwareToolsWorksfinewithHA notwithFTRDM virtualyes physicalnoIsitDR Maybe dependsonRTO RPONeedsreplicationoffsite right seeBCO2629andBCO2760 BestPracticesPrepopulateDNS alwaysuseFQDNManageVMsnapshotsAvoiddeployingtoslowstorageDonotpower off alwaysshutdowngracefullyDonotschedulebackupsduringmaintenancewindow 66 数据复制方式的选择 67 vSphereReplication VR Hypervisor basedReplicationforvSphereVMs 68 vSphere SiteA vSphere vSphereReplication SAN NAS VirtualSAN VirtualSAN NAS SAN SiteB Multiplepoint in timeIncludedwithvSphereEssentialsPlusorhighereditions SolutionDescriptionVRisVMware sproprietarytechnologyforhypervisor basedreplicationofvSpherevirtualmachinesKeyFeaturesVM centric storage independentFlexibleRPO 15min to24hrs MPIT 1 recovery upto24replicas Network efficient light weightdelta replicationKeyBenefitsSimplifiesreplicationofvirtualmachinesReducesstorageandbandwidthinvestmentsIntegratedwiththeVMwareproductstackIncludedwithvSphere 2 atnoadditionalcost Full initialSyncStartfreshorwithseedviaphysicalmediaComparesdiskIDsCalculateschecksumofallblocksatsource targetExchangesandcompareschecksumstodeterminedeltaReplicatesa