V4ACIG_vPOD_nvermand_v3

INSBUMarketing,GRelease,ACIvPod,vPodallowsnetworkadminstocreateavirtualACIPodconnectingbacktoanexistingphysicalACIfabricvPodrunsremotelyindatacentersthatdonthaveACIhardwareUsecasesinclude:BMcloudextensionsMigrationfromtraditional3tierarchitecturetoACIpolicymodel(Brownfield)ServiceProvider(Colocation),BusinessGoal,ColocationDC,ACIMainDC,IPNetwork,Usecases,vSpine(x2):vSphereVMwith2vCPUs,8GBRAMand80GBstoragevLeaf(x2):vSphereVMwith2vCPUs,8GBRAMand80GBstorageAVE(oneperESXihost):VMwith2vCPUs,4GBRAMand8GBstorageDeploymentofthecomponentscanbemanagedthroughACIvCenterpluginorusingtheprovidedpythonandPowerShellscriptsRoleisselectedinaccordancewithAPICFabricMembershipsettings,vPodcomponents,vSphereManagementclustertorunvSpineandvLeafpairsvSpherePayloadClustertorunESXihostwithAVE(oneAVEperhost)Note:VVDreferencearchitectureforvSphere:,Prerequisites,SupportedSpinesFixedSpine:N9364CN9332CModularSpineLC:(C9504/C9508/C95016)N9732C-EXwithFMN9K-C950 x-FM-E(2)N9736C-FXwithFMN9K-C950 x-FM-E(2)APIC4.0onwards,VMwarevCenter6.0orlater2hostsforManagementCluster2hostsforPayloadClusterESXi6.0orlaterACIvCenterpluginorvPodpython/PowerShelldeploymentscripts,SoftwareandHardwareRequirements,On-PremisesDatacenter,vPodDatacenter,Architecture,vSpine-01,vSpine-02,ESXi-mgmt-01,ESXi-mgmt-02,vLeaf-02,VDS,vLeaf-01,vPODInfraVLAN(locallysignificant)*,MgmtVLAN,ESXi-payload-01,ESXi-payload-02,AVE-esxi-01,AVE-VMM,AVEInternal,L2/L3,On-PremisesDatacenter,vPodDatacenter,AVE-esxi-02,VTEPPoolsubnetGW,IPN,ManagementCluster,PayloadCluster,WAN,*AVEscanresidesindifferentsubnets.EachsubnetwillhaveanassociatedTEPpool.,vPodControlPlane,vSpine,COOPresolver,BGPRR,vLeaf,BGPRRclient,Opflexproxy,AVE,OpflexClient,COOPcitizen,PhysicalPod(pPod),BGPVXLANEVPN,Tobeverified,TEPaddressesforvPodinpPod(externalTEPsubnet),Minimum/29subnet(writeformula)UnicastTEP(ucastTEP)OneAnycastTEPaddresssharedbyallspinesinaphysicalPod(pPod)Isusedasdestinationforallknownunicasttraffic(excepttrafficdestinedtoL3Out)comingfromvPodUsedassourcefromallUnicasttrafficfrompPodtovPod(sourceisre-writtenbySpine)MulticastTEP(mcastTEP)OneAnycastTEPaddresssharedbyallspinesinaFabric/SiteUsedasdestinationforallBUMtrafficoriginatingfromavPodControlPlaneTEPOneTEPaddressperphysicalSpineUsedforcontrolplane(BGP)betweenpPodandvPod,TEPaddressesforvPodinvPod,Minimum/28subnet(/24recommended)AVETEPOneTEPaddressforeachAVEUsedassourceforalltrafficcomingfromaspecificAVEinavPodUsedasdestinationfromallknownUnicasttrafficintherestoftheFabric/SiteMulticastTEP2HREPaddressesallocatedto2electedAVEsinavPodUsedasdestinationforallBUMtrafficoriginatingfromapPodorfromanothervPodElectedAVEsareresponsibleforreplicationtoallAVEsinthevPodEachBDwillbeassociatedwithoneofthetwoMulticastHREPaddressesControlPlaneTEPOneTEPaddresspervirtualSpine(allocatedfromuserreservedsubnet)Usedforcontrolplane(BGP)betweenpPodandvPod,vPodDiscovery,L3,L4,vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,L1,L2,WAN,IPN,Step-0:TEPpoolhasbeencreatedforvLeaf,vSpineandAVEvSpine/vLeafsendsDHCPdiscoverGWforwardsrequesttoAPICAPICallocatesIPfromTEPpoolandsendsGWinformation(routerthathasforwardedtheDHCPrequests)GWforwardsDHCPresponsetovSpine/vLeafvSpine/vLeafconfiguresIPandsetsGWIPCertificatesaregeneratedvLeafdownloadstheTEPpoolrangeforAVEsasitwillbeactingastheDHCPserverforthem.AVEcanbeinthesameorinadifferentsubnet.,GW,1,2,3,4,WaitingforQAscaleresults,originalrequestedscalewas:,Scalability,Tobeverified,Forlatency,needtodoublecheckwithQAbutwewereplanningon150msor300ms(similartoRLQA)ForMTUForControlPlaneweusetheglobalsettingusedforMultipodForDataPlaneweneedtheclassic50bytesmorethanusertraffic(wesupportuptoJumbo),MTUandLatencyRequirements,Tobeverified,PacketWalks,vPodAVEimplementsahybridproxymodeanddisregardtheBDproxymodesettingIfdestination(L2/L3)isunknowntoAVE,AVEwillqueryCOOPdatabaseFloodedtrafficfollowstheMulticastpath:OnecopyofthepacketissenttopPodMulticastTEP(mcastTEP,sharedbyallpPodinaSite)ThereceivingphysicalspinereplicatestoeachpPodusingMulti-PodBUMmechanismEachpPodreplicatestoallleafsinthepPodusingBDGIPoaddressOnecopyissenttoeachAVEinthesamevPodwheretheBDexistsOnecopyissenttoothervPodsMulticastTEP(mcastTEP)wheretheBDexistsIfdestinationisknown,packetdirectlygoestothedestinationTEP,BDhybridproxymode,WhenL3destinationtrafficisunknown,packetsaredroppeduntilCOOPqueryissuccessfulARPGleaningistriggeredtoenableEPdiscovery(silenthost)andsubnetmustbedefinedunderBDGleanpacketissenttoeveryAVEinlocalvPodandtoothervPodsmcastTEPpPodmcastTEP,L3ForwardingandARPGleaning,Tobeverified,ForlocallygeneratedBUMinvPod:VMsendsBUMpackettoAVELocalAVEsendsthepackettoallotherAVEsinlocalvPodItalsosendsthepackettoothervPodmcastTEPelectedforthatBDReceivingAVEreplicatesthetraffictoallvPodlocalAVEsPacketsreceivedfrompPodorothervPodsPacketcomeswithmcastTEPasdestinationReceivingAVEreplicatestolocalAVEswherethatBDexists,BUMHandlingwithinvPodandacrossPods,PacketsdestinedtoendpointslocatedinaphysicalPodinwilluseucastTEPofremotePodasnext-hop,vPodUnicastPacketFlows,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH2IP,AVE,H1,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearning,L1,L3,L4,H3,1,L2,IPN,WAN,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH2IP,AVE,H1,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearningCOOPupdateandexporttoBGP,COOPDB,COOPDB,L1,L3,L4,L2,H3,2,2,IPN,WAN,IPN,WAN,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH2IP,AVE,H1,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearningCOOPupdateandexporttoBGPPacketsenttoL2PacketsenttomcastTEP,SIPoL1,DIPomcastTEP,COOPDB,COOPDB,L1,L3,L4,L2,H3,3,4,IPN,WAN,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH2IP,AVE,H1,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearningCOOPupdateandexporttoBGPPacketsenttoL2PacketsenttomcastTEPL2VTEPmappingisupdated,SIPoL1,DIPomcastTEP,COOPDB,COOPDB,L1,L3,L4,L2,H3,5,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH2IP,AVE,H1,L1,L3,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearningCOOPupdateandexporttoBGPPacketsenttoL2PacketsenttomcastTEPL2VTEPmappingisupdatedPacketsenttoBD-GIPo,SIPoL1,DIPoBD-GIPo,COOPDB,L4,L2,H3,COOPDB,6,IPN,WAN,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH2IP,AVE,H1,L1,L3,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearningCOOPupdateandexporttoBGPPacketsenttoL2PacketsenttomcastTEPL2VTEPmappingisupdatedPacketsenttoBD-GIPoL3VTEPmappingisupdated(H3isinthesameBDasH1andH2),COOPDB,L4,L2,H3,COOPDB,IPN,WAN,7,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH2IP,AVE,H1,L1,L3,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearningCOOPupdateandexporttoBGPPacketsenttoL2PacketsenttomcastTEPL2VTEPmappingisupdatedPacketsenttoBD-GIPoL3VTEPmappingisupdated(H3isinthesameBDasH1andH2)PacketreachesH2,COOPDB,L4,L2,H3,COOPDB,8,IPN,WAN,SMACH1,DMACFFFFFFFF,TargetIPH2IP,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,L1,L3,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearning,COOPDB,L4,L2,SMACH2,DMACH1,DIPH1IP,H3,SIPH2IP,COOPDB,9,IPN,WAN,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,L1,L3,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearningCOOPupdateandexporttoBGP,COOPDB,L4,L2,SMACH2,DMACH1,DIPH1IP,H3,SIPH2IP,COOPDB,IPN,WAN,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,L1,L3,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearningCOOPupdateandexporttoBGPPacketissenttoL1,COOPDB,L4,L2,SMACH2,DMACH1,DIPH1IP,H3,SIPH2IP,COOPDB,11,IPN,WAN,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,L1,L3,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearningCOOPupdateandexporttoBGPPacketissenttoL1L1VTEPmappingisupdated,COOPDB,L4,L2,SMACH2,DMACH1,DIPH1IP,H3,SIPH2IP,COOPDB,12,IPN,WAN,vPodDataplane(H1toH2,samevPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,L1,L3,H2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearningCOOPupdateandexporttoBGPPacketissenttoL1L1VTEPmappingisupdatedPacketissenttoH1,COOPDB,L4,L2,SMACH2,DMACH1,DIPH1IP,H3,SIPH2IP,COOPDB,13,IPN,WAN,SMACH2,DMACH1,DIPH1IP,SIPH2IP,vPodDataplane(H1toH3,vPodtopPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),LocalEPlearning,H3,L1,L3,L4,L2,1,IPN,WAN,H2,vPodDataplane(H1toH3,vPodtopPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),COOPDB,COOPDB,LocalEPlearningCOOPupdateandexporttoBGP,H3,L1,L3,L4,L2,2,2,IPN,WAN,H2,vPodDataplane(H1toH3,vPodtopPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),COOPDB,COOPDB,LocalEPlearningCOOPupdateandexporttoBGPPacketsenttomcastTEPandL2,H3,L1,L3,L4,L2,IPN,WAN,H2,vSpine/vLeaf,SIPoL1,DIPomcastTEP,3,vPodDataplane(H1toH3,vPodtopPod,bridged),vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),COOPDB,COOPDB,LocalEPlearningCOOPupdateandexporttoBGPPacketsenttomcastTEPandL2L2VTEPmappingisupdated,H3,L1,L3,L4,L2,IPN,WAN,H2,4,vSpine/vLeaf,vPodDataplane(H1toH3,vPodtopPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),COOPDB,COOPDB,LocalEPlearningCOOPupdateandexporttoBGPPacketsenttomcastTEPandL2L2VTEPmappingisupdatedPacketsenttoBD-GIPo,SIPoL1,DIPoBD-GIPo,H3,L1,L3,L4,L2,5,IPN,WAN,H2,vPodDataplane(H1toH3,vPodtopPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),COOPDB,COOPDB,LocalEPlearningCOOPupdateandexporttoBGPPacketsenttomcastTEPandL2L2VTEPmappingisupdatedPacketsenttoBD-GIPoL3VTEPmappingupdatedPacketreachesH3,H3,SMACH1,DMACFFFFFFFF,TargetIPH3IP,L1,L3,L4,L2,6,7,IPN,WAN,H2,vPodDataplane(H1toH3,vPodtopPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,H3,LocalEPlearning,COOPDB,COOPDB,SMACH3MAC,DMACH1MAC,DIPH1IP,SIPH3IP,L1,L3,L4,L2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),8,IPN,WAN,H2,vPodDataplane(H1toH3,vPodtopPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,H3,LocalEPlearningCOOPupdateandexporttoBGP.InvPodDC,COOPVTEPischangedtopPoducastTEP,COOPDB,COOPDB,L1,L3,L4,L2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),SMACH3MAC,DMACH1MAC,DIPH1IP,SIPH3IP,9,9,IPN,WAN,H2,vPodDataplane(H1toH3,vPodtopPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,H3,LocalEPlearningCOOPupdateandexporttoBGP.InvPodDC,COOPVTEPischangedtopPoducastTEPPacketsenttoL1(AVE),COOPDB,COOPDB,SIPopPoducastTEP,DIPoL1,L1,L3,L4,L2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),SMACH3MAC,DMACH1MAC,DIPH1IP,SIPH3IP,IPN,WAN,H2,SpinerewritesSIPo,10,vPodDataplane(H1toH3,vPodtopPod,bridged),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,H3,LocalEPlearningCOOPupdateandexporttoBGP.InvPodDC,COOPVTEPischangedtopPoducastTEPPacketsenttoL1(AVE)L1VTEPmappingupdatedPacketsenttoH1,COOPDB,COOPDB,L1,L3,L4,L2,vPodDatacenter(pod2),On-PremisesDatacenter(pod1),SMACH3MAC,DMACH1MAC,DIPH1IP,SIPH3IP,SMACH2MAC,DMACH1MAC,DIPH1IP,SIPH3IP,IPN,WAN,H2,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,1,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearning,IPN,WAN,Site1,Site1,Site1,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearningCOOPupdateandexporttoBGP,IPN,WAN,COOPDB,COOPDB,COOPDB,Site1,Site1,Site1,2,2,2,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearningCOOPupdateandexporttoBGPPacketsenttomcastTEPandL2,IPN,WAN,COOPDB,COOPDB,COOPDB,SIPoL1,DIPomcastTEP,Site1,Site1,Site1,3,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearningCOOPupdateandexporttoBGPPacketsenttomcastTEPandL2L2VTEPmappingisupdated,IPN,WAN,COOPDB,COOPDB,COOPDB,Site1,Site1,Site1,4,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearningCOOPupdateandexporttoBGPPacketsenttomcastTEPandL2L2VTEPmappingisupdatedPacketsenttoBD-GIPo,IPN,WAN,COOPDB,COOPDB,COOPDB,Site1,Site1,Site1,5,SIPoL1,DIPoBD-GIPo,SIPoL1,DIPoBD-GIPo,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearningCOOPupdateandexporttoBGPPacketsenttomcastTEPandL2L2VTEPmappingisupdatedPacketsenttoBD-GIPoL5VTEPmappingisupdated,IPN,WAN,COOPDB,COOPDB,COOPDB,Site1,Site1,Site1,6,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,SMACH1,DMACFFFFFFFF,TargetIPH3IP,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearningCOOPupdateandexporttoBGPPacketsenttomcastTEPandL2L2VTEPmappingisupdatedPacketsenttoBD-GIPoL5VTEPmappingisupdatedPacketissenttoH3,IPN,WAN,COOPDB,COOPDB,COOPDB,Site1,Site1,Site1,7,SMACH1,DMACFFFFFFFF,TargetIPH3IP,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearning,IPN,WAN,COOPDB,COOPDB,COOPDB,Site1,Site1,Site1,8,SMACH3,DMACH1,DIPIPH1IP,SIPIPH3IP,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearningCOOPupdateandexporttoBGP,IPN,WAN,COOPDB,COOPDB,COOPDB,Site1,Site1,Site1,9,SMACH3,DMACH1,DIPIPH1IP,SIPIPH3IP,9,9,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearningCOOPupdateandexporttoBGPPacketissenttoL1,IPN,WAN,COOPDB,COOPDB,COOPDB,Site1,Site1,Site1,SMACH3,DMACH1,DIPIPH1IP,SIPIPH3IP,SIPoP3ucastTEP,DIPoL1,10,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearningCOOPupdateandexporttoBGPPacketissenttoL1L1VTEPmappingisupdated,IPN,WAN,COOPDB,COOPDB,COOPDB,Site1,Site1,Site1,SMACH3,DMACH1,DIPIPH1IP,SIPIPH3IP,11,vPodDataplane(H1toH3,vPodtoMultipodpPod),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,H2,vPodDatacenter(pod2),Pod1(on-prem),L1,L3,L4,L2,Pod3(on-prem),L5,L6,H3,LocalEPlearningCOOPupdateandexporttoBGPPacketissenttoL1L1VTEPmappingisupdatedPacketissenttoH1,IPN,WAN,COOPDB,COOPDB,COOPDB,Site1,Site1,Site1,SMACH3,DMACH1,DIPIPH1IP,SIPIPH3IP,12,vPod-vPodDataplane,samesite(H1toH2),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,vPodDatacenter(pod2),L1,L2,Site1,vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H2,L5,L6,Site1,IPN,WAN,L3,L4,Site1,L7,L8,Site1,vPodDatacenter(pod4),Pod1(on-prem),Pod3(on-prem),WAN,ElectedHREP,vPod-vPodDataplane,samesite(H1toH2),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,vPodDatacenter(pod2),L1,L2,Site1,vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H2,L5,L6,Site1,IPN,WAN,L3,L4,Site1,L7,L8,Site1,vPodDatacenter(pod4),Pod1(on-prem),Pod3(on-prem),WAN,LocalEPlearning,1,SMACH1,DMACFFFFFFFF,TargetIPH2IP,ElectedHREP,vPod-vPodDataplane,samesite(H1toH2),vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H1,vPodDatacenter(pod2),L1,L2,Site1,vSpine/vLeaf,vSpine/vLeaf,AVE,AVE,H2,L5,L6,Site1,IPN,WAN,L3,L4,Site1,L7,L8,Site1,vPodDatacenter(pod4),Pod1(on-prem),Pod3(on-prem),WAN,LocalEPlearningCOOPupdateandexporttoBGP,2,SMACH1,DMACFFFFFFFF,TargetIPH2IP,COOPDB,COOPDB,COOPDB,2,2,COOPDB,2,ElectedHREP,vPod-vPodDataplane,samesite(H1toH2),vSpine/vLeaf,vSpine/vLeaf,AVE,H1,vPodDatacenter(pod2),L1,L2,Site1,vSpine/vLeaf,vSpine/vLeaf,AVE,H2,L5,L6,Site1,IPN,WAN,L3,L4,Site1,L7,L8,Site1,vPodDatacenter(pod4),Pod1(on-prem),Pod3(on-prem),WAN,LocalEPlearningCOOPupdateandexporttoBGPPacketissenttomcastTEPinpPodandvPod,SMACH1,DMACFFFFFFFF,TargetIPH2IP,COOPDB,COOPDB,COOPDB,3,AVE,AVE,3,SIPoL1,DIPomcastTEP,SIPoL1,DIPoHREP,COOPDB,ElectedHREP,vPod-vPodDataplane,samesite(H1toH2),vSpine/vLeaf,vSpine/vLeaf,AVE,H1,vPodDatacenter(pod2),L1,L2,Site1,vSpine/vLeaf,vSpine/vLeaf,AVE,H2,L5,L6,Site1,IPN,WAN,L3,L4,Site1,L7,L8,Site1,vPodDatacenter(pod4),Pod1(on-prem),Pod3(on-prem),WAN,LocalEPlearningCOOPupdateandexporttoBGPPacketissenttomcastTEPinpPodandvPodAsL5iselectedHREP,itreplicatespackettoeveryAVEinthatBDandalsosendspackettoH2.L5VTEPmappingisupdated,SMACH1,DMACFFFFFFFF,TargetIPH2IP,COOPDB,COOPDB,COOPDB,AVE,AVE,SMACH1,DMACFFFFFFFF,TargetIPH2IP,COOPDB,ElectedHREP,4,vPod-vPodDataplane,samesite(H1toH2),vSpine/vLeaf,vSpine/vLeaf,AVE,H1,vPodDatacenter(pod2),L1,L2,Site1,vSpine/vLeaf,vSpine/