Verified Scalability Guide for Cisco APIC, Release 2.3(1e) and Cisco Nexus 9000 Series ACI-Mode

16 Pages·2017·1 MB·English

VerifiedScalabilityGuideforCiscoAPIC,Release2.3(1e)andCiscoNexus
9000 Series ACI-Mode Switches, Release 12.3(1e)
Overview 2
GeneralScalabilityLimits 2
FabricTopology,SPAN,Tenants,Contexts,ExternalEPGs,BridgeDomains,Endpoints,andContractsScalability
Limits 4
MultipleFabricOptionsScalabilityLimits 12
VMMScalabilityLimits 12
Layer4-Layer7ScalabilityLimits 14
AD,TACACS,RBACScalabilityLimits 15
QoSScalabilityLimits 15
Revised:May11,2022
Overview
ThisguidecontainsthemaximumverifiedscalabilitylimitsforACIparametersfortheCiscoAPICRelease2.3.1eandCiscoNexus
9000SeriesACI-ModeSwitches,Release12.3.1e.Thesevaluesarebasedonaprofilewhereeachfeaturewasscaledtothenumbers
specifiedinthetables.ThesenumbersdonotrepresentthetheoreticallypossibleACIfabricscale.
General Scalability Limits
•L2Fabric:InLegacymodethereisnorouting,L3context,norcontractenabledintheL2fabricprofile. Atenantinthisprofile
doesnotneedtobemappedtoonededicatedACItenant. AtenantcanberepresentedbyasetofEPGsinstead.Toimprovethe
loadsharingamongAPICcontrollernodes,youmustdistributeEPGsandBDsacrossanACItenant.
•L3Fabric:TheACIL3fabricsolutionprovidesafeature-richhighlyscalablesolutionforpubliccloudandlargeenterprise.
Withthisdesign,almostallsupportedfeaturesaredeployedatthesametimeandaretestedasasolution.Thescalabilitynumbers
listedinthissectionaremulti-dimensionalscalabilitynumbers.Thefabricscalabilitynumbersrepresenttheoverallnumberof
objectscreatedonthefabric.Theper-leafscalenumbersaretheobjectscreatedandpresentedonanindividualleafswitch.The
fabriclevelscalabilitynumbersrepresentAPICclusterscalabilityandthetestedupperlimits.Someoftheper-leafscalability
numbersaresubjecttohardwarerestrictions.Theper-leafscalabilitynumbersarethemaximumlimitstestedandsupportedby
leafswitchhardware.Thisdoesnotnecessarilymeanthateveryleafswitchinthefabricwastestedwithmaximumscalenumbers.
•StretchedFabric:Stretchedfabricallowsmultiplefabrics(upto3)distributedinmultiplelocationstobeconnectedasasingle
fabricwithasinglemanagementdomain.Thescalefortheentirestretchedfabricremainsthesameasforasinglesitefabric.
ForexampleaL3stretchedfabricwillsupportupto200leafstotalwhichisthemaximumnumberofleafssupportedonasingle
sitefabric.Parametersonlyrelevanttostretchedfabricarementionedinthetablesbelow.
•Multi-Pod:Multipodenablesprovisioningamorefault-tolerantfabriccomprisedofmultiplepodswithisolatedcontrolplane
protocols.Also,multipodprovidesmoreflexibilitywithregardtothefullmeshcablingbetweenleafandspineswitches.For
example,ifleafswitchesarespreadacrossdifferentfloorsordifferentbuildings,multipodenablesprovisioningmultiplepods
perfloororbuildingandprovidingconnectivitybetweenpodsthroughspineswitches.
MultipodusesasingleAPICclusterforallthepods;allthepodsactasasinglefabric.IndividualAPICcontrollersareplaced
acrossthepodsbuttheyareallpartofasingleAPICcluster.
NOTE:Themaximumnumberofleafswitchesoverallis400perfabricscaleandthemaximumnumberofphysicalportsis19,200
perfabric.
Feature L2Fabric L3Fabric LargeL3Fabric
NumberofAPICcontrollers 3 Minimum3(4also 5
supported)
Numberofleafswitches 80 80 200
Numberofspines Maximumspinesperpod:6. Maximumspinesperpod:6. Maximumspinesperpod:6.
Totalspines16. Totalspines16. Totalspines16.
NumberofFEXs N/A 20FEXesperleaf,320FEX N/A
ports/leaf,650FEXesper
fabric.
2
Feature L2Fabric L3Fabric LargeL3Fabric
Numberoftenants N/A 1000 3000
NumberofLayer3(L3)contexts N/A 1000 3000
Numberofcontracts/filters N/A •2000contracts •2000contracts
•10,000filters •10,000filters
Numberofendpointgroups(EPGs) 21,000(500maximumper 15,000(500maximumper 15,000(500maximumper
tenant) tenant) tenant)
NumberofIsolationenabledEPGs 250 250 250
Numberofendpoints(EPs) 180,000 180,000 180,000
Numberofbridgedomains(BDs) 21,000 15,000 15,000
NumberofIPlongestprefixmatches N/A •IPv4;40,000 •IPv4;40,000
(IPLPMs)(forexternalconnection)
•IPv6;20,000 •IPv6;20,000
Note Thislimitexistsacrossall
protocols/transitscenarios •PerLeafIPv4andIPv6; •PerLeafIPv4andIPv6;
10,000total 10,000total
NumberofBGP+numberofOSPF N/A 1,200 1,200
sessions+EIGRP(forexternal
connection)
NumberofMulticastgroups N/A 8000 8000
NumberofMulticastgroupsperVRF N/A 8000 8000
Numberofstaticroutestoasingle N/A 5,000 10,000
SVI/VRF
Numberofstaticroutesonasingleleaf N/A 5,000 10,000
switch
NumberofvCenters N/A •200 •200
•50AVS •50AVS
NumberofServiceChains N/A 1000 1000
NumberofL4-L7devices N/A 30physical,1,200virtual 30physical,1,200virtual
(1200maximumperfabric) (1500maximumperfabric)
NumberofESXihosts-VDS N/A 3200 3200
NumberofESXihosts-AVS N/A 3200(Only1AVSinstance 3200(Only1AVSinstance
perhost) perhost)
NumberofVMs N/A Dependsuponserverscale Dependsuponserverscale
3
Feature L2Fabric L3Fabric LargeL3Fabric
Numberofconfigurationzonesper 30 30 30
fabric
NumberofBFDsessionsperleaf 256 256 256
switch
MinimumBFDtimer MinimumBFDtimer MinimumBFDtimerrequired
requiredtosupportthisscale: requiredtosupportthisscale: tosupportthisscale:
•minTx:50 •minTx:50 •minTx:50
•minRx:50 •minRx:50 •minRx:50
•multiplier:3 •multiplier:3 •multiplier:3
Multi-Pod 3*or4nodeAPICcluster,6 3*or4nodeAPICcluster,6 •5*or6nodeAPIC
pods,80leafswitchesoverall pods,80leafswitchesoverall cluster,6pods,200leaf
NOTE:*=preferredclustersize
switchesmaxperpod,
300leafswitchesmax
overall
•7nodeAPICcluster,10
pods,200leafswitches
maxperpod,400leaf
switchesmaxoverall
L3eVPNServicesoverFabricWAN N/A 1000VRFs,1000L3outs, 1000VRFs,60,000routesin
(withandwithoutOpFlex) 60,000routesinafabric afabric
Layer3Multicastroutes N/A 8,000 8,000
NumberofRoutesinOverlay-1VRF 1,000 1,000 1,000
FabricTopology,SPAN,Tenants,Contexts,ExternalEPGs,BridgeDomains,
Endpoints, and Contracts Scalability Limits
ConfigurableOptions PerLeafScale PerFabricScale
FabricTopology
NumberofPCs,vPCs 320(withFEXHIF) N/A
Numberofencapsperaccessport,PC,vPC(non 1750 N/A
FEXHIF)
NumberofencapsperFEXHIF,PC,vPC 20 N/A
NumberofmemberlinksperPC,vPC* 8 N/A
*vPCtotalports=16,8perleaf
4
ConfigurableOptions PerLeafScale PerFabricScale
NumberofportsxVLANS(globalscopeandno 64,000 N/A
FEXHIF)
168,000(whenusinglegacyBDmode)
NumberofportsxVLANS(FEXHIFsand/orlocal ForALEv1andv2:9,000 N/A
scope)
ForLSEandLSE2:
10,000
Numberofstaticportbindings ForALEv1andv2:30,000 400,000
ForLSEandLSE2:
60,000
STP AllVLANs N/A
Mis-CablingProtocol(MCP) 256VLANsperinterface N/A
2000logicalports(portxVLAN)per
leaf
Maximumnumberofendpoints(EPs) ForALEv1andv2: 180,000
•IPv4:12,000or
•IPv6:6000or
•IPv4:4000,IPv6;4000
ForLSEandLSE2:
•MAC:24,000
•IPv4:24,000
•IPv6:12,000
NumberofMACEPGs N/A 125
NumberofMulticastGroups 8000 8000
NumberofMulticastGroupsperVRF 8000 8000
NumberofIPsperMAC 1024 1024
5
ConfigurableOptions PerLeafScale PerFabricScale
SPAN ALEbasedToRs: N/A
•4uni-directionalor2bi-directional
access/tenantsessions
•4uni-directionalor2bi-directional
fabricsessions
LSEbasedToRs:
•8uni-directionalor4bi-directional
sessions(fabric,access,ortenant)
NumberofportsperSPANsession •Allleafaccessportscouldbeinone N/A
session
•Allleaffabricportscouldbeinone
session
NOTE:ForLSE/LSE2only:30(total
numberofuniqueports(fabric+access)
acrossalltypesofspansessions)
NumberofsourceEPGsintenantSPANsessions ALE-basedToRswitches: N/A
Note Thenumberslistedinthisrowassume •230ingressdirection+50egress
thatonlytenantSPANisconfigured. direction
Ifboth,AccessandTenantSPANare
LSE-basedToRswitches:
configured,thefollowingformula
appliesforbothingressandegress •230bidirectional
SPAN:
•460unidirectional(230ingress+
E + P + E*P + EPP + v6FePP + 230egress)
0.5*v4FePP <= 230
Where:
•E—NumberofsourceEPGsin
TenantSPAN
•P—NumberofsourcePortsin
accessSPANwithoutanyfilters
•EPP—Numberof(Epg,Port)Pairs
inaccessSPANwithEPGfilter
only(nofiltergroup)
•v4FePP—Numberof(v4filter
entry,Port)PairsinaccessSPAN
withfiltergroup
•v6FePP—Numberof(v6Filter
entry,Port)PairsinaccessSPAN
withfiltergroup
6
ConfigurableOptions PerLeafScale PerFabricScale
Commonpervasivegateway 256virtualIPsperBridgeDomain N/A
MaximumnumberofDataPlanepolicers ALE: N/A
•64ingresspolicers
•64egresspolicers
LSEandLSE2:
•7ingresspolicers
•3egresspolicers
MaximumnumberofSNMPtrapreceivers 10 10
MaximumnumberofQ-in-Qtunnels 1980 N/A
(bothQinQcoreandedgecombined)
MaximumnumberofTEP-to-TEPatomiccounters N/A 1600
Tenants
NumberofContextspertenant 50 50
Numberofapplicationprofilespertenant(orper N/A N/A
Context)
Contexts(Allnumbersapplicabletodualstackunlessexplicitlycalledout)
MaximumnumberofContext 400 N/A
NumberofVRFspertenant N/A 50
NumberofBDsperVRF N/A 1750
NumberofisolatedEPGs N/A 250
BorderLeafsperL3Out N/A 8
MaximumnumberofLPMPrefixesforExternal 1000IPv4 N/A
EPGClassification
MaximumnumberofvzAnyProvidedContracts 16perCtx N/A
MaximumnumberofvzAnyConsumedContracts 16perCtx N/A
Numberofservicegraphsperdevicecluster N/A 500
L3Outpercontext -- 400
7
ConfigurableOptions PerLeafScale PerFabricScale
MaximumnumberofRouted,Routed •8forRoutedandRouted •8forRoutedandRouted
Sub-interface,orSVIsperL3Out sub-interface sub-interface
•1000forSVI •1000forSVI
MaximumnumberofBGPneighbors 400 2400
MaximumnumberofBGPneighborswith 150 N/A
authenticationenabled
MaximumnumberofOSPFneighbors 300 N/A
(MaximumnumberofVRFswithan
l3outwhereOSPFistheonlyrouting
protocolenabled,cannotexceed142)
MaximumnumberofEIGRPneighbors 16 N/A
MaximumnumberofStaticRoutes •IPv4;10,000or •IPv4;40,000or
•IPv6;6000or •IPv6;20,000or
•IPv4;4000,IPv6;4000 •IPv4;10,000,IPv6;10,000
MaximumnumberofExternalRoutes ForALEv1andv2: •IPv4;40,000or
•IPv4;10,000or •IPv6;20,000or
•IPv6;5000or •IPv4;10,000,IPv6;10,000
ForLSEandLSE2:
•IPv4;20,000or
•IPv6;10,000
MaximumnumberofSecondaryaddressesper 1 1
logicalinterface
MaximumnumberofL3interfacesperContext •200forSVI •400forSVI
(SVIsandsub-interfaces)
•32forsubinterfaces •32forsubinterfaces
MaximumnumberofARPentriesforL3Outs 7500 N/A
SharedL3Out •IPv4:2000or •IPv4:6000or
•IPv6:1000 •IPv6:3000
ConfigurableOptions perLeafscale perFabricscale
MaximumnumberofL3Outs 400(perleafscale) 2400(single-stack)
1800(dual-stack)
8
ConfigurableOptions PerLeafScale PerFabricScale
ExternalEPGs
NumberofExternalEPGs 600 2400(singlestack)
NumberofExternalEPGsperL3out 250 400
BridgeDomain
MaximumnumberofBDs 1750;iflegacymode,3,500; 15,000
ifMulticastoptimizedmodethen50
MaximumnumberofBDswithUnicastRouting 256 N/A
perContext(VRF)
MaximumnumberofsubnetsperBD 512(cannotbeforallBDs) 512perBD
MaximumnumberofEPGsperBD 3499(cannotexceed3,500total) 3499
3499issupportedinhardwarebutplease
refertotheperfabricscaleforthe
effectivesoftwaresupportforthis
release.
NumberofL2OutsperBD 1 1
NumberofBDswithCustomMACAddress 1750;iflegacymode,3500; 1750;iflegacymode,3500;
IfMulticastoptimizedmodeisused,then IfMulticastoptimizedmodeisused,
50 then50
NumberofMulticastgroups 8000 8000
MaximumnumberofEPGs+L3Outsper 128 128
MulticastGroup
MaximumnumberofBDswithL3Multicast 1750 1750
enabled
MaximumnumberofVRFswithL3Multicast 64 64
enabled
MaximumnumberofL3OutsperBD 4 N/A
DHCPrelayaddressesperBDacrossalllabels 16 N/A
NumberofexternalEPGsperL2out 1 1
MaximumnumberofPIMNeighbors 1000 1000
MaximumnumberofPIMNeighborsperVRF 64 64
MaximumnumberofL3Outphysicalinterfaces 32 N/A
withPIMenabled
9
ConfigurableOptions PerLeafScale PerFabricScale
EndpointGroups(UnderAppProfiles)
MaximumamountofEPGs Normally1750;iflegacymode3500 15,000
MaximumamountofencapsperEPG 1Staticleafbinding,plus10Dynamic N/A
VMM
MaximumPathencapbindingperEPG Equalstonumberofportsontheleaf N/A
MaximumamountofencapsperEPGperport One(pathorleafbinding) N/A
Maximumnumberofdomains(physical,L2,L3) •10static(L2,L3,physical) N/A
•10dynamic
MaximumnumberofVMMdomains •200vDS N/A
•50AVS
Maximumamountofnativeencaps •1perport(ifaVLANisusedasa Applicabletoeachleafindependently
nativeVLAN)
•IfthereisadifferentnativeVLAN
perportthenitequalsthenumber
ofports
Maximumamountof802.1pencaps •1,ifpathbindingthenequals Applicabletoeachleafindependently
numberofports
•IfthereisadifferentnativeVLAN
perportthenitequalsthenumber
ofports
Canencapbetaggedanduntagged? No N/A
MaximumnumberofStaticendpointsperEPG Maximumendpoints N/A
MaximumnumberofSubnetsforInter-context 4000 N/A
accesspertenant
MaximumnumberofTabooContractsperEPG 2 N/A
IP-basedEPG 4000 N/A
Contracts
10