fabricpath: ce to fp vlan communication case study · 2018. 3. 21. · cisco systems fabricpath: ce...
TRANSCRIPT
Advanced Services
Cisco Systems
Fabricpath: CE to FP VLAN Communication Case study
V0.2 (Draft)
Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 CISCO PUBLIC
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL
STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT
WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED
WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED
WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to
part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This
equipment generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio
communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required to correct the interference at their own
expense.
The following information is for FCC compliance of Class B devices: The equipment described in this manual generates and may radiate radio-frequency energy. If it is not installed
in accordance with Cisco’s installation instructions, it may cause interference with radio and television reception. This equipment has been tested and found to comply with the limits
for a Class B digital device in accordance with the specifications in part 15 of the FCC rules. These specifications are designed to provide reasonable protection against such
interference in a residential installation. However, there is no guarantee that interference will not occur in a particular installation.
You can determine whether your equipment is causing interference by turning it off. If the interference stops, it was probably caused by the Cisco equipment or one of its peripheral
devices. If the equipment causes interference to radio or television reception, try to correct the interference by using one or more of the following measures:
Turn the television or radio antenna until the interference stops.
Move the equipment to one side or the other of the television or radio.
Move the equipment farther away from the television or radio.
Plug the equipment into an outlet that is on a different circuit from the television or radio. (That is, make certain the equipment and the television or radio are on circuits controlled
by different circuit breakers or fuses.)
Modifications to this product not authorized by Cisco Systems, Inc. could void the FCC approval and negate your authority to operate the product.
The following third-party software may be included with your product and will be subject to the software license agreement:
CiscoWorks software and documentation are based in part on HP OpenView under license from the Hewlett-Packard Company. HP OpenView is a trademark of the Hewlett-Packard
Company. Copyright 1992, 1993 Hewlett-Packard Company.
The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain
version of the UNIX operating system. All rights reserved. Copyright 1981, Regents of the University of California.
Network Time Protocol (NTP). Copyright 1992, David L. Mills. The University of Delaware makes no representations about the suitability of this software for any purpose.
Point-to-Point Protocol. Copyright 1989, Carnegie-Mellon University. All rights reserved. The name of the University may not be used to endorse or promote products derived
from this software without specific prior written permission.
The Cisco implementation of TN3270 is an adaptation of the TN3270, curses, and termcap programs developed by the University of California, Berkeley (UCB) as part of the UCB’s
public domain version of the UNIX operating system. All rights reserved. Copyright 1981-1988, Regents of the University of California.
Cisco incorporates Fastmac and TrueView software and the RingRunner chip in some Token Ring products. Fastmac software is licensed to Cisco by Madge Networks Limited, and
the RingRunner chip is licensed to Cisco by Madge NV. Fastmac, RingRunner, and TrueView are trademarks and in some jurisdictions registered trademarks of Madge Networks
Limited. Copyright 1995, Madge Networks Limited. All rights reserved.
Xremote is a trademark of Network Computing Devices, Inc. Copyright 1989, Network Computing Devices, Inc., Mountain View, California. NCD makes no representations
about the suitability of this software for any purpose.
The X Window System is a trademark of the X Consortium, Cambridge, Massachusetts. All rights reserved.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL
FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE
OF MERCHANTABILITY, FITNESS FOR A PRACTICAL PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE
PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING,
WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR
ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
AccessPath, AtmDirector, Browse with Me, CCDE, CCIP, CCSI, CD-PAC, CiscoLink, the Cisco NetWorks logo, the Cisco Powered Network logo, Cisco Systems Networking
Academy, Fast Step, Follow Me Browsing, FormShare, FrameShare, GigaStack, IGX, Internet Quotient, IP/VC, iQ Breakthrough, iQ Expertise, iQ FastTrack, the iQ logo, iQ Net
Readiness Scorecard, MGX, the Networkers logo, Packet, RateMUX, ScriptBuilder, ScriptShare, SlideCast, SMARTnet, TransPath, Unity, Voice LAN, Wavelength Router, and
WebViewer are trademarks of Cisco Systems, Inc.; Changing the Way We Work, Live, Play, and Learn, Discover All That’s Possible, and Empowering the Internet Generation, are
service marks of Cisco Systems, Inc.; and Aironet, ASIST, BPX, Catalyst, CCDA, CCDP, CCIE, CCNA, CCNP, Cisco, the Cisco Certified Internetwork Expert Logo, Cisco IOS,
the Cisco IOS logo, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Enterprise/Solver, EtherChannel, EtherSwitch, FastHub, FastSwitch, IOS, IP/TV, LightStream,
MICA, Network Registrar, PIX, Post-Routing, Pre-Routing, Registrar, StrataView Plus, Stratm, SwitchProbe, TeleRouter, and VCO are registered trademarks of Cisco Systems, Inc.
and/or its affiliates in the U.S. and certain other countries.
All other trademarks mentioned in this document or Web site are the property of their respective owners. The use of the word partner does not imply a partnership relationship
between Cisco and any other company. (0105R)
INTELLECTUAL PROPERTY RIGHTS:
THIS DOCUMENT CONTAINS VALUABLE TRADE SECRETS AND CONFIDENTIAL INFORMATION OF CISCO SYSTEMS, INC. AND IT’S SUPPLIERS, AND SHALL
NOT BE DISCLOSED TO ANY PERSON, ORGANIZATION, OR ENTITY UNLESS SUCH DISCLOSURE IS SUBJECT TO THE PROVISIONS OF A WRITTEN NON-
DISCLOSURE AND PROPRIETARY RIGHTS AGREEMENT OR INTELLECTUAL PROPERTY LICENSE AGREEMENT APPROVED BY CISCO SYSTEMS, INC. THE
DISTRIBUTION OF THIS DOCUMENT DOES NOT GRANT ANY LICENSE IN OR RIGHTS, IN WHOLE OR IN PART, TO THE CONTENT, THE PRODUCT(S),
TECHNOLOGY OF INTELLECTUAL PROPERTY DESCRIBED HEREIN.
Fabricpath: CE to FP VLAN Communication Case study V0.2
Copyright 2010, Cisco Systems, Inc.
All rights reserved.
COMMERCIAL IN CONFIDENCE.
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
3 (Draft) V0.2
A printed copy of this document is considered uncontrolled
1. Contents
1. Contents 3
2. Figures 5
3. Tables 6
4. Document Information 7
4.1. Review and Distribution 7
4.2. Modification History 7
5. Introduction 8
5.1. Preface 8
5.2. Audience 8
5.3. Scope 8
5.4. FP Implementation Requirements 8
5.5. Assumptions 9
5.6. Related Documents 9
5.7. References 9
6. Fabricpath Technology Introduction 10
7. Fabricpath Terminologies 11
8. FP VLAN Design Considerations 12
9. Lab Topology 14
10. Hardware and Software Details 15
11. Hardware & Software Verification 16
12. Scenario-1: Extending CE VLAN on FP Domain 17
12.1. Device Configurations 18 12.1.1. N7K-1 18 12.1.2. N7K-2 19 12.1.3. N55K-1 21 12.1.4. N55K-2 22
12.2. Configuration Verification 23 12.2.5. N7K-1 23 12.2.6. N7K-2 26 12.2.7. N55K-1 29 12.2.8. N55K-2 30
12.3. Test Result 31 12.3.9. CE VLAN on N55K-1 Reaching the CE VLAN on N55K-2 31
Contents
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
4 (Draft) V0.2
A printed copy of this document is considered uncontrolled
13. Scenario 2: FP to CE VLAN Routed Traffic 32
13.1. Device Configurations 33 13.1.1. N7K-1 33 13.1.2. N7K-2 35 13.1.3. N55K-1 37 13.1.4. N55K-2 38
13.2. Configuration Verification 39 13.2.5. N7K-1 39 13.2.6. N7K-2 43 13.2.7. N55K-1 47 13.2.8. N55K-2 48
13.3. Test Result 49 13.3.9. CE VLAN on N55K-2 Reaching the FP VLAN on N55K-1 49 13.3.10. FP VLAN on N55K-1 Reaching the CE VLAN on N55K-2 50
14. Scenario 3: FP to CE VLAN Routed traffic to the Single homed edge device 51
14.1. Device Configurations 52 14.1.1. N7K-1 52 14.1.2. N7K-2 53 14.1.3. N55K-1 55 14.1.4. N55K-2 56
14.2. Configuration Verification 57 14.2.5. N7K-1 57 14.2.6. N7K-2 61 14.2.7. N55K-1 64 14.2.8. N55K-2 65
14.3. Test Result 66 14.3.9. FP VLAN on N55K-1 Reaching the CE VLAN on N55K-2 66 14.3.10. CE VLAN on N55K-2 Reaching the FP VLAN on N55K-1 66
15. Scenario 4: FP VLAN Routed traffic to Single homed FP edge Device 67
15.1. Device Configurations 68 15.1.1. N7K-1 68 15.1.2. N7K-2 69 15.1.3. N55K-1 71 15.1.4. N55K-2 72
15.2. Configuration Verification 73 15.2.5. N7K-1 73 15.2.6. N7K-2 77 15.2.7. N55K-1 80 15.2.8. N55K-2 82
15.3. Test Result 82 15.3.9. FP VLAN on N55K-1 Reaching N55K-2 FP edge device 82 15.3.10. Single Homed N55K-2 Reaching the N55K-1 part of FP VLAN 83
16. Summary 84
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
5 (Draft) V0.2
A printed copy of this document is considered uncontrolled
2. Figures
Figure 1 CE and FP Vlan in Fabric Path 12 Figure 2 Base Topology 14 Figure 3 Extending CE VLAN over vPC+ doamin 17 Figure 4 FP to CE inter vlan Communication 32 Figure 5 FP VLAN talking to the Single homed CE VLAN device 51 Figure 6 FP VLAN talking to the Single homed FP VLAN device 67
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
6 (Draft) V0.2
A printed copy of this document is considered uncontrolled
3. Tables
Table 1 Equipment details. 15 Table 2 Nexus 7010 Slot Allocation 15 Table 3 Software Details 15
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
7 (Draft) V0.2
A printed copy of this document is considered uncontrolled
4. Document Information
Author: Muhammed M Change Authority: Advanced Services Change Forecast: High Template Version: 5.2 (09-Sep-2010)
4.1. Review and Distribution Organisation Name Title
4.2. Modification History Rev Date Originator Status Comment 0.1 29-July-2012 Muhammed M Draft/Release Initial version
0.2 07-Aug-2012 Bijoy Antony Draft/Release Added FP Implementation Requirement
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
8 (Draft) V0.2
A printed copy of this document is considered uncontrolled
5. Introduction
5.1. Preface The purpose of this document is to provide the information necessary to carry out the fabricpath design and implementation and testing in an enterprise environment. The main focus for this document is to provide a tested result of Classical ethernet vlan (CE) interaction with the Fabric path VLAN in a mixed environment. Please note that scenario considered in this document may not be as per the best practices however instead it is convering some of the possible scenarios based on the customer requirement
5.2. Audience This document is intended for use by network engineers who are familiar with Cisco Fabricpath technology and Cisco Nexus platform. It is recommended to use this document as a baseline and do further testing based on customer specific scenarios.
5.3. Scope The scope of this document will cover topology based case study of Fabricpath vlan interacting to the classical ethernet vlan. Also provide various test result based on the given topology. Fabricpath is now supported on wider number of platforms including Neuxs 7000 (F1 card or F2 Card), Nexus 5500, Nexus 2000 attached to Nexus 5500 or Nexus 7000 with F2 card. Particular scope of this document covers only Nexus 7000 with F2 module and Nexus 5500 in a specific LAB setup.
5.4. FP Implementation Requirements
FabricPath requires L2 enhanced Lience one per chassis. Minimum NX-OS support for fabricpath with F2 module is NX-OS 6.0 F2 Lince Card needs to be its own VDC. Please note that it is not recommended to mix
F1 or M1 with F2 in the same VDC. When running FP Core and CE Edge ports must be on an F1/F2 modules or Nexus 5500 FabricPath mode VLANs can only be enabled on F1/F2 modules or Nexus 5500. It is mandatory to enable the same FP mode VLAN EVERYWHERE on all the switches in
the FP Fabric otherwise, FP multidestination trees will be incorrectly built)
Introduction
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
9 (Draft) V0.2
A printed copy of this document is considered uncontrolled
5.5. Assumptions It is assumed that whoever reading this document has a basic understanding of Network concepts and also has basic idea of fabric path technology.
5.6. Related Documents [1] Stick a list of related documents here such as other design info [2] Client Service Descriptions… [3] The [x] will automatically increment
5.7. References [2] Place references to relevant technical documents [3] And standards …. The [REF-x] will automatically increment
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
10 (Draft) V0.2
A printed copy of this document is considered uncontrolled
6. Fabricpath Technology Introduction
Cisco FabricPath technology on the Cisco Nexus 7000 Series Switches introduces new capabilities and design options that allow customers to create Ethernet fabrics that increase bandwidth availability, provide design flexibility, and simplify and reduce the costs of network and application deployment and operation. Cisco FabricPath uses many of the best characteristics of traditional Layer 2 and Layer 3 technologies, combining them into a new control-plane and data-plane implementation that combines the immediately operational “plug-and-play” deployment model of a bridged spanning-tree environment with the stability, reconvergence characteristics, and ability to use multiple parallel paths typical of a Layer 3 routed environment. The result is a scalable, flexible, and highly available Ethernet fabric suitable for even the most demanding data center environments. FabricPath do not have limitations which spanning tree has. In fact FabricPath is using benefits from both layer 2 and 3 technologies. It is first time when layer 2 protocols uses well known routing protocol (ISIS) to forward frames. At the same time FabricPath limits number of the MAC addresses stored on each device on the network. That is done with the FabricPath feature called “conversational learning”. FabricPath allow building and easily expanding large layer 2 domain. With FabricPath, Layer 2 domain could be built ones and do not require any significant changes for long period of time. Having “flat” network will allow us to utilize network port capacity in most effective and flexible way.
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
11 (Draft) V0.2
A printed copy of this document is considered uncontrolled
7. Fabricpath Terminologies
Cisco FabricPath domain – is layer 2 domain, formed by interconnected fabric path core interfaces and carrying fabricpath VLANs traffic. All traffic in Cisco FabricPath domain is Cisco FabricPath encapsulated. Cisco FabricPath core port – Interface connected another FabricPath Device. FabricPath Core ports sends/receives traffic with FabricPath header. FabricPatch Core Ports does not participate in spanning tree. FabricPatch Core Ports does not perform MAC learning instead it exchange topology info through L2 ISIS adjacency. FabricPatch forwarding is based on “Swtich ID Table” FabricPath core interface carry traffic encapsulated into Cisco FabricPath frame and could also be referred as FabricPath (FP) port. FabricPath core port must be connected to another FabricPath core port. FabricPath core port carries all FabricPath VLANs and therefore can conceptually consider as a trunk port. Cisco FabricPath edge port - Interface at the edge of the Cisco FabricPath domain or Interface connected to traditional network device. FabricPath Edge ports sends/receives traffic in standard 802.3 Ethernet frame format & participate in STP domain. FabricPatch Edge Por forwarding is based on MAC table. CE Edge port can be configured as switchport mode access or switchport mode trunk. FabricPath edge port may be connected to any standard Ethernet port. Cisco FabricPath edge port will be used to attach any regular Ethernet device to the Cisco FabricPath domain. FabricPath vlan – vlan allowed crossing Cisco FabricPath domain. Classical Ethernet vlan – vlan which will not be allowed to cross Cisco FabricPath domain, but will be allowed to exist on the edge interfaces of the Cisco FabricPath attached device. Spine – switch configured as part of fabricpath domain with all interfaces configured in fabricpath mode Leaf – switch configured as part of fabricpath domain with some interfaces configured in fabricpath mode and other interfaces configured in classical Ethernet mode FTAG – (forwarding tag) is the 10-bit field in fabricpath encapsulation identifying topology and/or distribution tree
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
12 (Draft) V0.2
A printed copy of this document is considered uncontrolled
8. FP VLAN Design Considerations
Once the feature FabricPath is enabled, Vlans should be define as Fabricpath mode Vlans and put the relevant interface in fabricpath mode. If the VLAN is defined as mode FP, same vlan can be extended across the switching domain with vpc+ or a non vPC configuration. By default, when you create Vlan on Nexus 7k, the vlan operates in Classic Ethernet or CE mode. Only Fabricpath-mode vlans are carried over FP interfaces. However that fabricpath edge ports (i.e., CE interfaces or 802.1q trunk ports) can be part of Fabric path domain if the vlan defined as FP vlan. The mode (CE or FabricPath) of a given VLAN has only VDC-local significance. Other VDC’s or other switches in the network have no knowledge of the mode of a VLAN on any other switches. If there is a range of Vlans on CE switch and then you connect that switch to a Fabricpath edge port, the FP switch will have the same VLAN IDs defined but it should be defined as mode fabricpath show in the following figure:
Figure 1 CE and FP Vlan in Fabric Path
vPC+
Vlan 10,20 Vlan 10,20
F2
F2
F2
F2
802.1Q trunk 802.1Q trunk
Fabricpath Core Port
VLAN 10,20
All VLANs that are meant to be forwarded across FabricPath cloud must be defined as FabricPath VLANs. By default, all VLANs are in CE mode. These CE VLANs are not brought up on FabricPath links. They can be forwarded on the FabricPath edge ports (802.1q trunk ports) locally or to other Classic Ethernet switches.
Ingress FabricPath switch determines destination Switch ID and imposes FabricPath header to the normal Frame.
Destination Switch ID used to make routing decisions through FabricPath core
No MAC learning or lookups required inside core
Egress FabricPath switch removes FabricPath header and forwards to CE
FP VLAN Design Considerations
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
13 (Draft) V0.2
A printed copy of this document is considered uncontrolled
In a mixed environment the import difference between a CE and FP VLAN is where the traffic flooded is, a packet arriving on a port (FP VLAN) is flooded across the fabric, a packet on another port (CE VLAN) is forwarded locally but not flooded across the fabric
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
14 (Draft) V0.2
A printed copy of this document is considered uncontrolled
9. Lab Topology
The Figure 2 is the baseline topology used for testing the deffernt FP to CE communication scenarios. The scope of this figure is to help reader about the physical connectivity between the devices. The logical topology including the VLAN and IP details will be covered in each scenarios sperately.
Figure 2 Base Topology
N7010-1 N7010-2
8/1
8/2
8/1
8/2
8/3
8/4
8/3
8/4
8/98/10
1/2 1/21/1
1/1
8/10 8/9
N5548-01 N5548-02
Po120(Non-vPC trunk)
Po110 (Peer-link)
10 Gig Interface
As shown in the figure there are two port-channels connected back to back between the Nexus 7010 switches .The vPC peer-link is configured as fabricpath core port to pass all the fabric path mode vlans. The non-vPC trunk port is used to allow the vlans defined as CE and also to pass vPC keep-alive traffic.
Note The physical connectivity details including vPC peer-link, NonvPC trunk Link and Port-channel configuration between the Nexus 7010 switches shown in the above figure will be common for all the topologies.
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
15 (Draft) V0.2
A printed copy of this document is considered uncontrolled
10. Hardware and Software Details
Table 1 Equipment details.
Platform Details Qty
Nexus7000 C7010 (10 Slot) Chassis 2
N7K-SUP1 4
N7K-F248XP-25 2
N7K-C7010-FAB-2 10
Nexus5548 Chassis 2
Table 2 Nexus 7010 Slot Allocation
Slot Product Description
5 Sup1(N7K-SUP1)
6 Sup1(N7K-SUP1)
7 Empty
8 N7K-F248XP-25
9 Empty
10 Empty
Table 3 Software Details
Platform Software version/Feature Set/License Image Name
Nexus 7010 6.0(3) n7000-s1-dk9.6.0.3.bin
n7000-s1-kickstart.6.0.3.bin
Nexus 7000 Advanced LAN Enterprise License (VDC, CTS ONLY)
Enhanced Layer 2 License ( FabricPath)
Nexus 5548 5.1(3)N2(1) n5000-uk9.5.1.3.N2.1.bin
n5000-uk9-kickstart.5.1.3.N2.1.bin
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
16 (Draft) V0.2
A printed copy of this document is considered uncontrolled
11. Hardware & Software Verification
The status details of the Hardware modules and software version used on the Nexus 7010 boxes are given below. The
same modules and software are utilized on both Nexus 7010 chassis
!
N7K-1
N7K-1# sh module
Mod Ports Module-Type Model Status
--- ----- ----------------------------------- ------------------ ----------
4 48 10/100/1000 Mbps Ethernet Module N7K-M148GT-11 ok
5 0 Supervisor module-1X N7K-SUP1 ha-standby
6 0 Supervisor module-1X N7K-SUP1 active *
8 48 1/10 Gbps Ethernet Module N7K-F248XP-25 ok
Mod Sw Hw
--- -------------- ------
4 6.0(3) 1.4
5 6.0(3) 1.6
6 6.0(3) 1.6
8 6.0(3) 1.0
------------------------------
N7K-2
N7K-2(config-if)# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 200 f866.f206.fb43 dynamic 0 F F Po120
N7K-2(config-if)# sh module
Mod Ports Module-Type Model Status
--- ----- ----------------------------------- ------------------ ----------
4 48 10/100/1000 Mbps Ethernet Module N7K-M148GT-11 ok
5 0 Supervisor module-1X N7K-SUP1 active *
6 0 Supervisor module-1X N7K-SUP1 ha-standby
8 48 1/10 Gbps Ethernet Module N7K-F248XP-25 ok
Mod Sw Hw
--- -------------- ------
4 6.0(3) 1.4
5 6.0(3) 1.6
6 6.0(3) 1.6
8 6.0(3) 1.0
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
17 (Draft) V0.2
A printed copy of this document is considered uncontrolled
12. Scenario-1: Extending CE VLAN on FP Domain
In this scenario the focus is to demonstrate how the CE vlan can be extended across fabric path domain. As shown in
figure 3: Vlan 20 is configured as CE vlan on Nexus 5500 access switches, where as the same vlan is configured as
fabricpath vlan on both Nexus 7010 switches.
The connectivity between the Nexus 7010 and Nexus 5500 switches are configured as normal trunk/Farbric edge port.
Figure 3 Extending CE VLAN over vPC+ doamin
SVI 20: 20.1.1.1 SVI 20: 20.1.1.2
vPC+
N55K-1 N55K-2
vPC peer-link
vPC keep-alive Link
FP VLAN 20 FP VLAN 20
CE VLAN 20CE VLAN 20
N7K-1N7K-2
Po 51Po 52
USE CASE:
The above topology is relevant when non-fabric path device need to connect to the fabric path domain. I.e the same
vlan need to be available across the fabricpath enable devices and non fabricpath devices.
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
18 (Draft) V0.2
A printed copy of this document is considered uncontrolled
12.1. Device Configurations
12.1.1. N7K-1
!Command: show running-config
!Time: Fri Aug 3 17:43:06 2012
version 6.0(3)
feature-set fabricpath
hostname N7K-1
feature tacacs+
cfs eth distribute
feature interface-vlan
feature hsrp
feature lacp
feature vpc
feature lldp
username admin password 5 $1$auCnf9aG$Z0neTlzasmESXCAVlRgD// role vdc-admin
vlan 1
vlan 20
mode fabricpath
name N5K-SERVER-VLAN
vlan 200
name vPC-keepalive
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967 priority 8192
vpc domain 30
role priority 20
peer-keepalive destination 200.1.1.3 source 200.1.1.4 vrf KA
auto-recovery
fabricpath switch-id 3
interface Vlan200
no shutdown
vrf member KA
ip address 200.1.1.4/24
interface port-channel51
Description To_N55K-1
switchport
switchport mode trunk
switchport trunk allowed vlan 20
vpc 51
interface port-channel52
Description To_N55K-2
switchport
switchport mode trunk
switchport trunk allowed vlan 20
vpc 52
interface port-channel110
Description vPC-peer-link
switchport
switchport mode fabricpath
vpc peer-link
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
19 (Draft) V0.2
A printed copy of this document is considered uncontrolled
interface port-channel120
Description Non-vPC-trunk
switchport
switchport mode trunk
switchport trunk allowed vlan 200
interface Ethernet8/1
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/2
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/3
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/4
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/9
switchport
switchport mode trunk
switchport trunk allowed vlan 30
channel-group 52 mode active
no shutdown
interface Ethernet8/10
switchport
switchport mode trunk
switchport trunk allowed vlan 30
channel-group 51 mode active
no shutdown
fabricpath domain default
root-priority 254
fabricpath switch-id 124
12.1.2. N7K-2
!
!Command: show running-config
!Time: Fri Aug 3 14:40:26 2012
version 6.0(3)
feature-set fabricpath
hostname N7K-2
feature tacacs+
cfs eth distribute
feature interface-vlan
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
20 (Draft) V0.2
A printed copy of this document is considered uncontrolled
feature hsrp
feature lacp
feature vpc
feature lldp
username admin password 5 $1$tEWzhPMP$cHBm2mrwkag1Yqpz4gCSC. role vdc-admin
ip domain-lookup
vlan 1
vlan 20
mode fabricpath
name N5K-SERVER-VLAN
vlan 200
name vPC-keepalive
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967 priority 8192
vpc domain 30
role priority 10
peer-keepalive destination 200.1.1.4 source 200.1.1.3 vrf KA
auto-recovery
fabricpath switch-id 3
interface Vlan200
no shutdown
vrf member KA
ip address 200.1.1.3/24
interface port-channel51
Description To_N55K-1
switchport
switchport mode trunk
switchport trunk allowed vlan 20
vpc 51
interface port-channel52
Description To_N55K-2
switchport
switchport mode trunk
switchport trunk allowed vlan 30
vpc 52
interface port-channel110
Description vPC-peer-link
switchport
switchport mode fabricpath
vpc peer-link
interface port-channel120
Description Non-vPC-Trunk
switchport
switchport mode trunk
switchport trunk allowed vlan 200
interface Ethernet8/1
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/2
switchport
switchport mode fabricpath
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
21 (Draft) V0.2
A printed copy of this document is considered uncontrolled
channel-group 110 mode active
no shutdown
interface Ethernet8/3
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/4
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/9
switchport
switchport mode trunk
switchport trunk allowed vlan 30
channel-group 52 mode active
no shutdown
interface Ethernet8/10
switchport
switchport mode trunk
switchport trunk allowed vlan 20
channel-group 51 mode active
no shutdown
line vty
fabricpath domain default
root-priority 255
fabricpath switch-id 123
N7K-1#
12.1.3. N55K-1
!
!Command: show running-config
!Time: Fri Aug 3 05:33:47 2012
version 5.1(3)N2(1)
hostname N55K-1
feature telnet
feature tacacs+
cfs eth distribute
feature interface-vlan
feature lacp
feature lldp
username admin password 5 $1$up6VlJix$8E/6RphXw8ehWHx0Pf9UG0 role network-admin
username Cisco.123 password 5 ! role network-admin
username Cisco@123 password 5 $1$Hv6f0NFz$hE3qBt7958S9M/IB5I0Ps0 role network-admi
ssh key rsa 2048
ip domain-lookup
vlan 20
name N5K-SERVER-VLAN
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
22 (Draft) V0.2
A printed copy of this document is considered uncontrolled
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967,4048-4093 priority 61440
interface Vlan20
no shutdown
ip address 20.1.1.1/24
interface port-channel51
Description To_N7K-1&N7K-2
switchport mode trunk
interface Ethernet1/1
switchport
switchport mode trunk
switchport trunk allowed vlan 20
channel-group 51 mode active
no shutdown
interface Ethernet1/2
switchport
switchport mode trunk
switchport trunk allowed vlan 20
channel-group 51 mode active
no shutdown
boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N2.1.bin
boot system bootflash:/n5000-uk9.5.1.3.N2.1.bin
!
!
12.1.4. N55K-2
!
!Command: show running-config
!Time: Thu Apr 9 12:05:48 2009
version 5.1(3)N2(1)
hostname N55K-2
feature telnet
feature tacacs+
cfs eth distribute
feature interface-vlan
feature lacp
username admin password 5 $1$tt6xvpX8$Lgh9CgRYnzc8Hfh.tHYrk1 role network-admin
ssh key rsa 2048
ip domain-lookup
vlan 20
name N5K-SERVER-VLAN
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967,4048-4093 priority 61440
interface Vlan20
no shutdown
ip address 20.1.1.2/24
interface port-channel52
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
23 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Description To_N7K-1&N7K-2
switchport mode trunk
switchport trunk allowed vlan 20
interface Ethernet1/1
switchport mode trunk
switchport trunk allowed vlan 20
channel-group 52 mode active
interface Ethernet1/2
switchport mode trunk
switchport trunk allowed vlan 20
channel-group 52 mode active
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N2.1.bin
boot system bootflash:/n5000-uk9.5.1.3.N2.1.bin
logging logfile syslog.log 5
logging timestamp milliseconds
no logging console
N55K-2#
12.2. Configuration Verification
12.2.5. N7K-1
!
Configuration terminal
VLAN verification:
N7K-1# sh vlan
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
1 default active
20 N55K-SERVER-VLAN active Po51, Po52, Po110, Eth8/1
Eth8/2, Eth8/9, Eth8/10
200 vPC-keepalive active Po120, Eth8/3, Eth8/4
VLAN Type Vlan-mode
---- ----- ----------
1 enet CE
20 enet FABRICPATH
200 enet CE
Remote SPAN VLANs
-------------------------------------------------------------------------------
Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------
vPC verification:
N7K-1# sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 30
vPC+ switch id : 3
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
24 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
vPC fabricpath status : peer is reachable through fabricpath
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : primary, operational secondary
Number of vPCs configured : 2
Peer Gateway : Disabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled (timeout = 240 seconds)
Fabricpath load balancing : Disabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po110 up 20
vPC status
----------------------------------------------------------------------------
id Port Status Consistency Reason Active vlans vPC+ Attribute
-- ---- ------ ----------- ------ ------------ --------------
51 Po51 up success success 20 DF: No, FP
MAC:
3.12.65535
52 Po52 up success success 20 DF: No, FP
MAC:
3.11.65535
Port-channel verification:
N7K-1# sh por
port-channel port-profile
N7K-1# sh port-channel summary
Flags: D - Down P - Up in port-channel (members)
I - Individual H - Hot-standby (LACP only)
s - Suspended r - Module-removed
S - Switched R - Routed
U - Up (port-channel)
M - Not in use. Min-links not met
--------------------------------------------------------------------------------
Group Port- Type Protocol Member Ports
Channel
--------------------------------------------------------------------------------
51 Po51(SU) Eth LACP Eth8/10(P)
52 Po52(SU) Eth LACP Eth8/9(P)
110 Po110(SU) Eth LACP Eth8/1(P) Eth8/2(P)
120 Po120(SU) Eth LACP Eth8/3(P) Eth8/4(P)
N7K-1#
FP Topology verification:
N7K-1# sh fabricpath topology
Topo-Description Topo-ID Topo-State
-------------------------------- ---------- --------------------
0 0 Up
N7K-1# sh fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
FabricPath Unicast Route Table for Topology-Default
0/3/11, number of next-hops: 1
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
25 (Draft) V0.2
A printed copy of this document is considered uncontrolled
via Po52, [80/0], 0 day/s 03:07:06, vpcm
0/3/12, number of next-hops: 1
via Po51, [80/0], 0 day/s 00:44:34, vpcm
0/123/0, number of next-hops: 0
via ---- , [60/0], 2 day/s 19:01:20, local
1/3/0, number of next-hops: 0
via ---- , [60/0], 2 day/s 19:00:56, local
1/124/0, number of next-hops: 1
via Po110, [115/20], 0 day/s 03:07:07, isis_fabricpath-default
2/3/0, number of next-hops: 0
via ---- , [60/0], 2 day/s 19:00:56, local
ISIS Adjacency Verification:
N7K-1# sh fabricpath isis adjacency
Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:
System ID SNPA Level State Hold Time Interface
18ef.63e3.dcc3 N/A 1 UP 00:00:27 port-channel110
N7K-1#
Fabricpath Switchid Verification:
N7K-1# show fabricpath switch-id
FABRICPATH SWITCH-ID TABLE
Legend: '*' - this system
=========================================================================
SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED
----------+----------------+------------+-----------+--------------------
3 18ef.63e3.dcc3 Primary Confirmed No Yes
3 f866.f206.fb43 Primary Confirmed No Yes
*123 f866.f206.fb43 Primary Confirmed Yes No
124 18ef.63e3.dcc3 Primary Confirmed Yes No
Total Switch-ids: 4
N7K-1# show fabricpath isis switch-id
Fabricpath IS-IS domain: default
Fabricpath IS-IS Switch-ID Database
Legend: C - Confirmed, T - tentative, W - swap
S - sticky, E - Emulated Switch
'*' - this system
System-ID Primary Secondary Reachable Bcast-Priority
MT-0
18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]
18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]
f866.f206.fb43* 123 [C] 0[C] Yes 255 [S]
f866.f206.fb43* 3 [C] 0[C] Yes 0 [E]
N7K-1# show fabricpath isis interface brief
Fabricpath IS-IS domain: default
Interface Type Idx State Circuit MTU Metric Priority Adjs/AdjsUp
--------------------------------------------------------------------------------
port-channel110 P2P 1 Up/Ready 0x01/L1 1500 20 64 1/1
Fabricpath ISIS protocol Verification:
N7K-1# sh fabricpath isis trees
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 1, Swid routing table
3, L1
via port-channel110, metric 20
124, L1
via port-channel110, metric 20
Topology 0, Tree 2, Swid routing table
124, L1
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
26 (Draft) V0.2
A printed copy of this document is considered uncontrolled
via port-channel110, metric 0
MAC Address Details:
N7K-1# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 20 547f.ee90.1501 dynamic 1590 F F Po52
* 20 547f.ee93.61bc dynamic 1590 F F Po51
* 200 18ef.63e3.dcc3 dynamic 0 F F Po120
N7K-1#
12.2.6. N7K-2
!
VLAN Verification:
N7K-2(config-if)# sh vlan
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
1 default active
20 N55K-SERVER-VLAN active Po51, Po52, Po110, Eth8/1
Eth8/2, Eth8/9, Eth8/10
200 vPC-keepalive active Po120, Eth8/3, Eth8/4
VLAN Type Vlan-mode
---- ----- ----------
1 enet CE
20 enet FABRICPATH
200 enet CE
Remote SPAN VLANs
-------------------------------------------------------------------------------
Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------
vPC verification:
N7K-2(config-if)# sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 30
vPC+ switch id : 3
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
vPC fabricpath status : peer is reachable through fabricpath
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : secondary, operational primary
Number of vPCs configured : 2
Peer Gateway : Disabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
27 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Auto-recovery status : Enabled (timeout = 240 seconds)
Fabricpath load balancing : Disabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po110 up 20
vPC status
----------------------------------------------------------------------------
id Port Status Consistency Reason Active vlans vPC+ Attribute
-- ---- ------ ----------- ------ ------------ --------------
51 Po51 up success success 20 DF: Yes, FP
MAC:
3.12.65535
52 Po52 up success success 20 DF: Yes, FP
MAC:
3.11.65535
Port-channel verification:
N7K-2(config-if)# sh port
port-channel port-profile
N7K-2(config-if)# sh port-channel summary
Flags: D - Down P - Up in port-channel (members)
I - Individual H - Hot-standby (LACP only)
s - Suspended r - Module-removed
S - Switched R - Routed
U - Up (port-channel)
M - Not in use. Min-links not met
--------------------------------------------------------------------------------
Group Port- Type Protocol Member Ports
Channel
--------------------------------------------------------------------------------
51 Po51(SU) Eth LACP Eth8/10(P)
52 Po52(SU) Eth LACP Eth8/9(P)
110 Po110(SU) Eth LACP Eth8/1(P) Eth8/2(P)
120 Po120(SU) Eth LACP Eth8/3(P) Eth8/4(P)
N7K-2(config-if)#
FP Topology Verification:
N7K-2(config-if)# sh fabricpath topology
Topo-Description Topo-ID Topo-State
-------------------------------- ---------- --------------------
0 0 Up
N7K-2(config-if)# sh fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
FabricPath Unicast Route Table for Topology-Default
0/3/11, number of next-hops: 1
via Po52, [80/0], 14 day/s 04:30:40, vpcm
0/3/12, number of next-hops: 1
via Po51, [80/0], 0 day/s 00:50:40, vpcm
0/124/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 10:15:59, local
1/3/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 10:11:34, local
1/123/0, number of next-hops: 1
via Po110, [115/20], 0 day/s 03:13:04, isis_fabricpath-default
2/3/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 10:11:34, local
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
28 (Draft) V0.2
A printed copy of this document is considered uncontrolled
ISIS adjacency verification:
N7K-2(config-if)# sh fabricpath isis adjacency
Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:
System ID SNPA Level State Hold Time Interface
f866.f206.fb43 N/A 1 UP 00:00:28 port-channel110
N7K-2(config-if)#
FP Switch-ID Verification:
N7K-2(config-if)# show fabricpath switch-id
FABRICPATH SWITCH-ID TABLE
Legend: '*' - this system
=========================================================================
SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED
----------+----------------+------------+-----------+--------------------
3 18ef.63e3.dcc3 Primary Confirmed No Yes
3 f866.f206.fb43 Primary Confirmed No Yes
123 f866.f206.fb43 Primary Confirmed Yes No
*124 18ef.63e3.dcc3 Primary Confirmed Yes No
Total Switch-ids: 4
N7K-2(config-if)#
N7K-2(config-if)# show fabricpath isis switch-id
Fabricpath IS-IS domain: default
Fabricpath IS-IS Switch-ID Database
Legend: C - Confirmed, T - tentative, W - swap
S - sticky, E - Emulated Switch
'*' - this system
System-ID Primary Secondary Reachable Bcast-Priority
MT-0
18ef.63e3.dcc3* 124 [C] 0[C] Yes 254 [S]
18ef.63e3.dcc3* 3 [C] 0[C] Yes 0 [E]
f866.f206.fb43 123 [C] 0[C] Yes 255 [S]
f866.f206.fb43 3 [C] 0[C] Yes 0 [E]
N7K-2(config-if)# sh fabricpath isis trees
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 1, Swid routing table
123, L1
via port-channel110, metric 0
Topology 0, Tree 2, Swid routing table
3, L1
via port-channel110, metric 20
123, L1
via port-channel110, metric 20
MAC address details:
N7K-2(config-if)# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 200 f866.f206.fb43 dynamic 0 F F Po120
N7K-2(config-if)#
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
29 (Draft) V0.2
A printed copy of this document is considered uncontrolled
12.2.7. N55K-1
!
IP address verification:
N55K-1# sh ip int brief | ex unas
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan20 20.1.1.1 protocol-up/link-up/admin-up
Port-channel verification:
N55K-1# sh port-channel summary
Flags: D - Down P - Up in port-channel (members)
I - Individual H - Hot-standby (LACP only)
s - Suspended r - Module-removed
S - Switched R - Routed
U - Up (port-channel)
M - Not in use. Min-links not met
--------------------------------------------------------------------------------
Group Port- Type Protocol Member Ports
Channel
--------------------------------------------------------------------------------
51 Po51(SU) Eth LACP Eth1/1(P) Eth1/2(P)
VLAN verification:
N55K-1# sh vlan id 20
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
20 N5K-SERVER-VLAN active Po51
VLAN Type Vlan-mode
---- ----- ----------
20 enet CE
Remote SPAN VLAN
----------------
Disabled
Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------
N55K-1#
MAC address details:
N55K-2# sh interfa vlan 20 | in Hardw
Hardware is EtherSVI, address is 547f.ee90.1501
N55K-2# sh mac add dyn
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 20 547f.ee93.61bc dynamic 140 F F Po52
N55K-2#
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
30 (Draft) V0.2
A printed copy of this document is considered uncontrolled
12.2.8. N55K-2
!
IP address verification:
N55K-2# sh ip int brief | ex unas
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan20 20.1.1.2 protocol-up/link-up/admin-up
Port-channel verification:
N55K-2# sh port-channel summary
Flags: D - Down P - Up in port-channel (members)
I - Individual H - Hot-standby (LACP only)
s - Suspended r - Module-removed
S - Switched R - Routed
U - Up (port-channel)
M - Not in use. Min-links not met
--------------------------------------------------------------------------------
Group Port- Type Protocol Member Ports
Channel
--------------------------------------------------------------------------------
52 Po52(SU) Eth LACP Eth1/1(P) Eth1/2(P)
VLAN verification:
N55K-2# sh vlan id 20
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
20 N5K-SERVER-VLAN active Po52
VLAN Type Vlan-mode
---- ----- ----------
20 enet CE
Remote SPAN VLAN
----------------
Disabled
Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------
N55K-2#
MAC address details:
N55K-1# sh inter vlan 20 | in Hard
Hardware is EtherSVI, address is 547f.ee93.61bc
N55K-1# sh mac add dyn
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 20 547f.ee90.1501 dynamic 50 F F Po51
N55K-1#
Scenario-1: Extending CE VLAN on FP Domain
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
31 (Draft) V0.2
A printed copy of this document is considered uncontrolled
12.3. Test Result
12.3.9. CE VLAN on N55K-1 Reaching the CE VLAN on N55K-2
!
N55K-1# ping 20.1.1.2
PING 20.1.1.2 (20.1.1.2): 56 data bytes
64 bytes from 20.1.1.2: icmp_seq=0 ttl=254 time=3.116 ms
64 bytes from 20.1.1.2: icmp_seq=1 ttl=254 time=4.908 ms
64 bytes from 20.1.1.2: icmp_seq=2 ttl=254 time=4.972 ms
64 bytes from 20.1.1.2: icmp_seq=3 ttl=254 time=4.978 ms
64 bytes from 20.1.1.2: icmp_seq=4 ttl=254 time=4.983 ms
--- 20.1.1.2 ping statistics ---
5 packets transmitted, 5 packets received, 0.00% packet loss
round-trip min/avg/max = 3.116/4.591/4.983 ms
N55K-1#
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
32 (Draft) V0.2
A printed copy of this document is considered uncontrolled
13. Scenario 2: FP to CE VLAN Routed Traffic
This scenario is used for demonstrating how the CE and FP intervlan communication happens. As shown in Figure 4:
Vlan 100 is configured as CE vlan on N55K-1 access switch and Vlan 30 is configured as CE vlan on N55K-2; where
as the same vlans are configured as fabricpath vlan on both Nexus 7010 switches.
The connectivity between the Nexus 7010 and Nexus N55K-1 switch is configured as fabricpath core ports and the
connectivity between the Nexus 7010 switches and Nexus N55K-2 is configured as fabricpath edge port/normal trunk
interfaces
Figure 4 FP to CE inter vlan Communication
SVI 20: 100.1.1.2 SVI 20: 30.1.1.5
vPC+
N55K-1 N55K-2
vPC peer-link
vPC keep-alive Link
FP VLAN 100: 100.1.1.3
FP VLAN 30: 30.1.1.4
CE VLAN 100CE VLAN 30
Fabricpath Link
802.1Q Trunk
N7K-1 N7K-1
Po 52
FP VLAN 30: 30.1.1.3
FP VLAN 100: 30.1.1.4
( HSRP VIP=.1)
USE CASE:
This scenario is relevant when two defferent CE vlan on the non fabricpath device have their default gateway
configured on the fabricpath enabled switches.
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
33 (Draft) V0.2
A printed copy of this document is considered uncontrolled
13.1. Device Configurations
13.1.1. N7K-1
!Command: show running-config
!Time: Fri Aug 3 17:43:06 2012
version 6.0(3)
feature-set fabricpath
hostname N7K-1
feature tacacs+
cfs eth distribute
feature interface-vlan
feature hsrp
feature lacp
feature vpc
feature lldp
username admin password 5 $1$auCnf9aG$Z0neTlzasmESXCAVlRgD// role vdc-admin
vlan 100
mode fabricpath
name N55K-1-SERVER-VLAN
vlan 30
mode fabricpath
name N55K-2-SERVER-VLAN
vlan 200
name vPC-keepalive
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967 priority 8192
vpc domain 30
role priority 20
peer-keepalive destination 200.1.1.3 source 200.1.1.4 vrf KA
auto-recovery
fabricpath switch-id 3
interface Vlan30
no shutdown
ip address 30.1.1.4/24
hsrp 30
priority 120
preempt
ip 30.1.1.1
interface Vlan100
no shutdown
ip address 100.1.1.4/24
hsrp 10
priority 120
preempt
ip 100.1.1.1
interface Vlan200
no shutdown
vrf member KA
ip address 200.1.1.4/24
interface port-channel52
Description To_N55K-2
switchport
switchport mode trunk
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
34 (Draft) V0.2
A printed copy of this document is considered uncontrolled
switchport trunk allowed vlan 30
vpc 52
interface port-channel110
Description vPC-peer-link
switchport
switchport mode fabricpath
vpc peer-link
interface port-channel120
Description Non-vPC-trunk
switchport
switchport mode trunk
switchport trunk allowed vlan 200
interface Ethernet8/1
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/2
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/3
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/4
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/9
switchport
switchport mode trunk
switchport trunk allowed vlan 30
channel-group 52 mode active
no shutdown
interface Ethernet8/10
Description To-N55K-1
switchport
switchport mode fabricpath
no shutdown
fabricpath domain default
root-priority 254
fabricpath switch-id 124
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
35 (Draft) V0.2
A printed copy of this document is considered uncontrolled
13.1.2. N7K-2
!
!Command: show running-config
!Time: Fri Aug 3 14:40:26 2012
version 6.0(3)
feature-set fabricpath
hostname N7K-2
feature tacacs+
cfs eth distribute
feature interface-vlan
feature hsrp
feature lacp
feature vpc
feature lldp
username admin password 5 $1$tEWzhPMP$cHBm2mrwkag1Yqpz4gCSC. role vdc-admin
ip domain-lookup
vlan 100
mode fabricpath
name N55K-1-SERVER-VLAN
vlan 30
mode fabricpath
name N55K-2-SERVER-VLAN
vlan 200
name vPC-keepalive
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967 priority 8192
vpc domain 30
role priority 10
peer-keepalive destination 200.1.1.4 source 200.1.1.3 vrf KA
auto-recovery
fabricpath switch-id 3
interface Vlan30
no shutdown
ip address 30.1.1.3/24
hsrp 30
priority 120
ip 30.1.1.1
interface Vlan100
no shutdown
ip address 100.1.1.3/24
hsrp 10
ip 100.1.1.1
interface Vlan200
no shutdown
vrf member KA
ip address 200.1.1.3/24
interface port-channel52
Description To_N55K-2
switchport
switchport mode trunk
switchport trunk allowed vlan 30
vpc 52
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
36 (Draft) V0.2
A printed copy of this document is considered uncontrolled
interface port-channel110
Description vPC-peer-link
switchport
switchport mode fabricpath
vpc peer-link
interface port-channel120
Description Non-vPC-trunk
switchport
switchport mode trunk
switchport trunk allowed vlan 200
interface Ethernet8/1
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/2
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/3
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/4
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/9
switchport
switchport mode trunk
switchport trunk allowed vlan 30
channel-group 52 mode active
no shutdown
interface Ethernet8/10
switchport
switchport mode fabricpath
line vty
fabricpath domain default
root-priority 255
fabricpath switch-id 123
N7K-1#
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
37 (Draft) V0.2
A printed copy of this document is considered uncontrolled
13.1.3. N55K-1
!
!Command: show running-config
!Time: Fri Aug 3 05:33:47 2012
version 5.1(3)N2(1)
install feature-set fabricpath
feature-set fabricpath
hostname N55K-1
feature telnet
no feature http-server
feature tacacs+
cfs eth distribute
feature interface-vlan
feature lacp
feature lldp
username admin password 5 $1$up6VlJix$8E/6RphXw8ehWHx0Pf9UG0 role network-admin
username Cisco.123 password 5 ! role network-admin
username Cisco@123 password 5 $1$Hv6f0NFz$hE3qBt7958S9M/IB5I0Ps0 role network-
admi
ssh key rsa 2048
ip domain-lookup
vlan 100
mode fabricpath
name N55K-1-SERVER-VLAN
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967,4048-4093 priority 61440
interface Vlan100
no shutdown
ip address 100.1.1.2/24
interface port-channel51
switchport mode trunk
interface port-channel52
speed 10000
interface Ethernet1/1
Description To_N7K-1
switchport mode fabricpath
interface Ethernet1/2
Description To_N7K-2
switchport mode fabricpath
boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N2.1.bin
boot system bootflash:/n5000-uk9.5.1.3.N2.1.bin
ip route 0.0.0.0/0 100.1.1.1
!
fabricpath domain default
!
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
38 (Draft) V0.2
A printed copy of this document is considered uncontrolled
13.1.4. N55K-2
!
!Command: show running-config
!Time: Thu Apr 9 12:05:48 2009
version 5.1(3)N2(1)
install feature-set fabricpath
hostname N55K-2
feature telnet
no feature http-server
feature tacacs+
cfs eth distribute
feature interface-vlan
feature lacp
username admin password 5 $1$tt6xvpX8$Lgh9CgRYnzc8Hfh.tHYrk1 role network-admin
ssh key rsa 2048
ip domain-lookup
vlan 30
name N55K-2-Server-VLAN
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967,4048-4093 priority 61440
interface Vlan30
no shutdown
ip address 30.1.1.5/24
interface port-channel52
Description To_N7K-1&N7K-2
switchport mode trunk
switchport trunk allowed vlan 30
interface Ethernet1/1
switchport mode trunk
switchport trunk allowed vlan 30
channel-group 52 mode active
interface Ethernet1/2
switchport mode trunk
switchport trunk allowed vlan 30
channel-group 52 mode active
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N2.1.bin
boot system bootflash:/n5000-uk9.5.1.3.N2.1.bin
ip route 0.0.0.0/0 3.1.1.1
logging logfile syslog.log 5
logging timestamp milliseconds
no logging console
N55K-2#
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
39 (Draft) V0.2
A printed copy of this document is considered uncontrolled
13.2. Configuration Verification
13.2.5. N7K-1
!
Configuration terminal
VLAN verification:
N7K-1# sh vlan
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
1 default active
30 N55K2-SERVER-VLAN active Po52, Po110, Eth8/1, Eth8/2
Eth8/9
100 N55K1-SERVER-VLAN active Po110, Eth8/1, Eth8/2
200 vPC-keepalive active Po120, Eth8/3, Eth8/4
VLAN Type Vlan-mode
---- ----- ----------
1 enet CE
30 enet FABRICPATH
100 enet FABRICPATH
200 enet CE
Remote SPAN VLANs
-------------------------------------------------------------------------------
Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------
N7K-1#
vPC verification:
N7K-1# sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 30
vPC+ switch id : 3
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
vPC fabricpath status : peer is reachable through fabricpath
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : primary, operational secondary
Number of vPCs configured : 1
Peer Gateway : Disabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled (timeout = 240 seconds)
Fabricpath load balancing : Disabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po110 up 30,100
vPC status
----------------------------------------------------------------------------
id Port Status Consistency Reason Active vlans vPC+ Attribute
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
40 (Draft) V0.2
A printed copy of this document is considered uncontrolled
-- ---- ------ ----------- ------ ------------ --------------
52 Po52 up success success 30 DF: No, FP
MAC:
3.11.65535
IP address verification:
N7K-1# sh ip int brief
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan30 30.1.1.3 protocol-up/link-up/admin-up
Vlan100 100.1.1.3 protocol-up/link-up/admin-up
N7K-1#
HSRP verification:
N7K-1# sh hsrp
Vlan30 - Group 30 (HSRP-V1) (IPv4)
Local state is Active, priority 120 (Cfged 120), may preempt
Forwarding threshold(for vPC), lower: 1 upper: 120
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 1.946000 sec(s)
Virtual IP address is 30.1.1.1 (Cfged)
Active router is local
Standby router is 30.1.1.4 , priority 100 expires in 1.957000 sec(s)
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac1e (Default MAC)
2 state changes, last state change 00:01:43
IP redundancy name is hsrp-Vlan30-30 (default)
Vlan100 - Group 10 (HSRP-V1) (IPv4)
Local state is Active, priority 120 (Cfged 120), may preempt
Forwarding threshold(for vPC), lower: 1 upper: 120
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 0.566000 sec(s)
Virtual IP address is 100.1.1.1 (Cfged)
Active router is local
Standby router is 100.1.1.4 , priority 100 expires in 6.377000 sec(s)
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac0a (Default MAC)
2 state changes, last state change 00:58:11
IP redundancy name is hsrp-Vlan100-10 (default)
N7K-1#
FP Topology verifications:
N7K-1# sh fabricpath topology
Topo-Description Topo-ID Topo-State
-------------------------------- ---------- --------------------
0 0 Up
N7K-1# sh fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
FabricPath Unicast Route Table for Topology-Default
0/3/11, number of next-hops: 1
via Po52, [80/0], 0 day/s 01:25:39, vpcm
0/123/0, number of next-hops: 0
via ---- , [60/0], 2 day/s 17:19:53, local
1/3/0, number of next-hops: 0
via ---- , [60/0], 2 day/s 17:19:29, local
1/124/0, number of next-hops: 1
via Po110, [115/20], 0 day/s 01:25:40, isis_fabricpath-default
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
41 (Draft) V0.2
A printed copy of this document is considered uncontrolled
1/2768/0, number of next-hops: 1
via Po110, [115/60], 0 day/s 01:25:40, isis_fabricpath-default
2/3/0, number of next-hops: 0
via ---- , [60/0], 2 day/s 17:19:29, local
ISIS adjacency verifications:
N7K-1# sh fabricpath isis adjacency
Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:
System ID SNPA Level State Hold Time Interface
18ef.63e3.dcc3 N/A 1 UP 00:00:28 port-channel110
N7K-1#
FP Switch-ID verification
N7K-1# show fabricpath switch-id
FABRICPATH SWITCH-ID TABLE
Legend: '*' - this system
=========================================================================
SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED
----------+----------------+------------+-----------+--------------------
3 18ef.63e3.dcc3 Primary Confirmed No Yes
3 f866.f206.fb43 Primary Confirmed No Yes
*123 f866.f206.fb43 Primary Confirmed Yes No
124 18ef.63e3.dcc3 Primary Confirmed Yes No
2768 547f.ee93.61bc Primary Confirmed No No
Total Switch-ids: 5
N7K-1#
N7K-1# show fabricpath isis switch-id
Fabricpath IS-IS domain: default
Fabricpath IS-IS Switch-ID Database
Legend: C - Confirmed, T - tentative, W - swap
S - sticky, E - Emulated Switch
'*' - this system
System-ID Primary Secondary Reachable Bcast-Priority
MT-0
18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]
18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]
547f.ee93.61bc 2768[C] 0[C] Yes 64
f866.f206.fb43* 123 [C] 0[C] Yes 255 [S]
f866.f206.fb43* 3 [C] 0[C] Yes 0 [E]
N7K-1# show fabricpath isis protocol
Fabricpath IS-IS domain : default
System ID : f866.f206.fb43 IS-Type : L1
SAP : 432 Queue Handle : 11
Maximum LSP MTU: 1492
Graceful Restart enabled. State: Inactive
Last graceful restart status : none
Metric-style : advertise(wide), accept(wide)
Start-Mode: Complete [Start-type configuration]
Area address(es) :
00
Process is up and running
CIB ID: 3
Interfaces supported by Fabricpath IS-IS :
port-channel110
Level 1
Authentication type and keychain not configured
Authentication check specified
MT-0 Ref-Bw: 400000
Address family Swid unicast :
Number of interface : 1
Distance : 115
L1 Next SPF: Inactive
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
42 (Draft) V0.2
A printed copy of this document is considered uncontrolled
FP Interface Verification:
N7K-1# show fabricpath isis interface brief
Fabricpath IS-IS domain: default
Interface Type Idx State Circuit MTU Metric Priority Adjs/AdjsUp
--------------------------------------------------------------------------------
port-channel110 P2P 1 Up/Ready 0x01/L1 1500 20 64 1/1
N7K-1# show fabricpath isis trees multidestination 1
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 1, Swid routing table
3, L1
via port-channel110, metric 20
124, L1
via port-channel110, metric 20
2768, L1
via port-channel110, metric 60
N7K-1# show fabricpath isis trees multidestination 2
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 2, Swid routing table
124, L1
via port-channel110, metric 0
2768, L1
via port-channel110, metric 40
N7K-1#
FP ISIS protocol Verification
N7K-1(config)# sh fabricpath isis trees
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 1, Swid routing table
3, L1
via port-channel110, metric 20
124, L1
via port-channel110, metric 20
2768, L1
via port-channel110, metric 60
Topology 0, Tree 2, Swid routing table
124, L1
via port-channel110, metric 0
2768, L1
via port-channel110, metric 40
N7K-1(config)#
MAC Details Verification:
N7K-1(config)# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
43 (Draft) V0.2
A printed copy of this document is considered uncontrolled
---------+-----------------+--------+---------+------+----+------------------
* 30 547f.ee90.1501 dynamic 30 F F Po52
* 200 18ef.63e3.dcc3 dynamic 0 F F Po120
N7K-1(config)#
N7K-1(config)# sh inter vla 100 | in Hardware
Hardware is EtherSVI, address is f866.f206.fb43
N7K-1(config)# sh inter vla 30 | in Hardware
Hardware is EtherSVI, address is f866.f206.fb43
N7K-1(config)#
13.2.6. N7K-2
!
VLAN verifications:
N7K-2# sh vlan
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
1 default active
30 N55K2-SERVER-VLAN active Po52, Po110, Eth8/1, Eth8/2
Eth8/9, Eth8/10
100 N55K-1-SERVER-VLAN active Po110, Eth8/1, Eth8/2, Eth8/10
200 vPC-keepalive active Po120, Eth8/3, Eth8/4
300 VLAN0300 active Eth8/10
VLAN Type Vlan-mode
---- ----- ----------
1 enet CE
30 enet FABRICPATH
100 enet FABRICPATH
200 enet CE
300 enet FABRICPATH
Remote SPAN VLANs
-------------------------------------------------------------------------------
Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------
vPC verifications:
N7K-2# sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 30
vPC+ switch id : 3
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
vPC fabricpath status : peer is reachable through fabricpath
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : secondary, operational primary
Number of vPCs configured : 1
Peer Gateway : Disabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled (timeout = 240 seconds)
Fabricpath load balancing : Disabled
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
44 (Draft) V0.2
A printed copy of this document is considered uncontrolled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po110 up 30,100
vPC status
----------------------------------------------------------------------------
id Port Status Consistency Reason Active vlans vPC+ Attribute
-- ---- ------ ----------- ------ ------------ --------------
52 Po52 up success success 30 DF: Yes, FP
MAC:
3.11.65535
HSRP verifications:
N7K-2# sh hsrp
Vlan30 - Group 30 (HSRP-V1) (IPv4)
Local state is Standby, priority 100 (Cfged 100)
Forwarding threshold(for vPC), lower: 1 upper: 100
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 0.545000 sec(s)
Virtual IP address is 30.1.1.1 (Cfged)
Active router is 30.1.1.3, priority 120 expires in 1.797000 sec(s)
Standby router is local
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac1e (Default MAC)
4 state changes, last state change 00:06:32
IP redundancy name is hsrp-Vlan30-30 (default)
Vlan100 - Group 10 (HSRP-V1) (IPv4)
Local state is Standby, priority 100 (Cfged 100)
Forwarding threshold(for vPC), lower: 1 upper: 100
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 1.925000 sec(s)
Virtual IP address is 100.1.1.1 (Cfged)
Active router is 100.1.1.3, priority 120 expires in 4.757000 sec(s)
Standby router is local
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac0a (Default MAC)
4 state changes, last state change 01:03:00
IP redundancy name is hsrp-Vlan100-10 (default)
N7K-2#
IP address verifications:
N7K-2# sh ip int brief
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan30 30.1.1.4 protocol-up/link-up/admin-up
Vlan100 100.1.1.4 protocol-up/link-up/admin-up
N7K-2#
FP Topology Verification:
N7K-2# show fabricpath topology
Topo-Description Topo-ID Topo-State
-------------------------------- ---------- --------------------
0 0 Up
N7K-2# sh f
fabricpath feature-set fips forwarding
feature file flow
N7K-2# sh fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
45 (Draft) V0.2
A printed copy of this document is considered uncontrolled
FabricPath Unicast Route Table for Topology-Default
0/3/11, number of next-hops: 1
via Po52, [80/0], 14 day/s 02:44:59, vpcm
0/124/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 08:30:18, local
1/3/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 08:25:53, local
1/123/0, number of next-hops: 1
via Po110, [115/20], 0 day/s 01:27:23, isis_fabricpath-default
1/2768/0, number of next-hops: 1
via Eth8/10, [115/40], 13 day/s 23:52:37, isis_fabricpath-default
2/3/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 08:25:53, local
ISIS Adjacency verifications:
N7K-2# show fabricpath isis adjacency
Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:
System ID SNPA Level State Hold Time Interface
f866.f206.fb43 N/A 1 UP 00:00:33 port-channel110
547f.ee93.61bc N/A 1 UP 00:00:31 Ethernet8/10
N7K-2#
FP Switch-ID Verification:
N7K-2# show fabricpath switch-id
FABRICPATH SWITCH-ID TABLE
Legend: '*' - this system
=========================================================================
SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED
----------+----------------+------------+-----------+--------------------
3 18ef.63e3.dcc3 Primary Confirmed No Yes
3 f866.f206.fb43 Primary Confirmed No Yes
123 f866.f206.fb43 Primary Confirmed Yes No
*124 18ef.63e3.dcc3 Primary Confirmed Yes No
2768 547f.ee93.61bc Primary Confirmed No No
Total Switch-ids: 5
N7K-2# show fabricpath isis switch-id
Fabricpath IS-IS domain: default
Fabricpath IS-IS Switch-ID Database
Legend: C - Confirmed, T - tentative, W - swap
S - sticky, E - Emulated Switch
'*' - this system
System-ID Primary Secondary Reachable Bcast-Priority
MT-0
18ef.63e3.dcc3* 124 [C] 0[C] Yes 254 [S]
18ef.63e3.dcc3* 3 [C] 0[C] Yes 0 [E]
547f.ee93.61bc 2768[C] 0[C] Yes 64
f866.f206.fb43 123 [C] 0[C] Yes 255 [S]
f866.f206.fb43 3 [C] 0[C] Yes 0 [E]
N7K-2#
N7K-2# show fabricpath isis protocol
Fabricpath IS-IS domain : default
System ID : 18ef.63e3.dcc3 IS-Type : L1
SAP : 432 Queue Handle : 11
Maximum LSP MTU: 1492
Graceful Restart enabled. State: Inactive
Last graceful restart status : none
Metric-style : advertise(wide), accept(wide)
Start-Mode: Complete [Start-type configuration]
Area address(es) :
00
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
46 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Process is up and running
CIB ID: 3
Interfaces supported by Fabricpath IS-IS :
port-channel110
Ethernet8/10
Level 1
Authentication type and keychain not configured
Authentication check specified
MT-0 Ref-Bw: 400000
Address family Swid unicast :
Number of interface : 2
Distance : 115
L1 Next SPF: Inactive
N7K-2#
FP internface verifications:
N7K-2# show fabricpath isis interface brief
Fabricpath IS-IS domain: default
Interface Type Idx State Circuit MTU Metric Priority Adjs/AdjsUp
--------------------------------------------------------------------------------
port-channel110 P2P 1 Up/Ready 0x01/L1 1500 20 64 1/1
Ethernet8/10 P2P 2 Up/Ready 0x01/L1 1500 40 64 1/1
N7K-2#
N7K-2# show fabricpath isis topology summary
Fabricpath IS-IS domain: default FabricPath IS-IS Topology Summary
MT-0
Configured interfaces: port-channel110 Ethernet8/10
Number of trees: 2
Tree id: 1, ftag: 1, root system: f866.f206.fb43, 123
Tree id: 2, ftag: 2 [transit-traffic-only], root system: 18ef.63e3.dcc3, 124
N7K-2#
N7K-2# show fabricpath isis trees multidestination 1
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 1, Swid routing table
123, L1
via port-channel110, metric 0
2768, L1
via Ethernet8/10, metric 60
N7K-2# show fabricpath isis trees multidestination 2
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 2, Swid routing table
3, L1
via port-channel110, metric 20
123, L1
via port-channel110, metric 20
2768, L1
via Ethernet8/10, metric 40
N7K-2#
N7K-2# sh fabricpath isis trees
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
47 (Draft) V0.2
A printed copy of this document is considered uncontrolled
MT-0
Topology 0, Tree 1, Swid routing table
123, L1
via port-channel110, metric 0
2768, L1
via Ethernet8/10, metric 60
Topology 0, Tree 2, Swid routing table
3, L1
via port-channel110, metric 20
123, L1
via port-channel110, metric 20
2768, L1
via Ethernet8/10, metric 40
N7K-2#
MAC Details Verification:
N7K-2# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 30 547f.ee90.1501 dynamic 30 F F Po52
100 547f.ee93.61bc dynamic 30 F F 2768.0.0
* 200 f866.f206.fb43 dynamic 0 F F Po120
N7K-2#
N7K-2# sh inter vlan 100 | in Hardwa
Hardware is EtherSVI, address is 18ef.63e3.dcc3
N7K-2# sh inter vlan 30 | in Hardwa
Hardware is EtherSVI, address is 18ef.63e3.dcc3
N7K-2#
13.2.7. N55K-1
!
IP Address verifications:
N55K-1# sh ip int brief | ex unas
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan100 100.1.1.2 protocol-up/link-up/admin-up
N55K-1#
N55K-1# sh fabricpath topology
Topo-Description Topo-ID Topo-State
-------------------------------- ---------- --------------------
0 0 Up
N55K-1# sh fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
FabricPath Unicast Route Table for Topology-Default
0/2768/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 02:37:03, local
1/3/0, number of next-hops: 1
via Eth1/2, [115/40], 13 day/s 23:28:46, isis_fabricpath-default
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
48 (Draft) V0.2
A printed copy of this document is considered uncontrolled
1/123/0, number of next-hops: 1
via Eth1/2, [115/60], 0 day/s 01:04:17, isis_fabricpath-default
1/124/0, number of next-hops: 1
via Eth1/2, [115/40], 13 day/s 23:28:46, isis_fabricpath-default
N55K-1#
MAC Details Verification:
N55K-1# sh interface vlan 100 | in Hardware
Hardware is EtherSVI, address is 547f.ee93.61bc
FP ISIS protocol verification:
N55K-1(config)# show fabricpath isis trees
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 1, Swid routing table
3, L1
via Ethernet1/2, metric 20
123, L1
via Ethernet1/2, metric 0
124, L1
via Ethernet1/2, metric 20
Topology 0, Tree 2, Swid routing table
3, L1
via Ethernet1/2, metric 20
123, L1
via Ethernet1/2, metric 20
124, L1
via Ethernet1/2, metric 0
N55K-1(config)#
MAC Details:
N55K-1(config)# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 100 0000.0c07.ac0a dynamic 0 F F 3.0.2047
* 100 18ef.63e3.dcc3 dynamic 0 F F 124.0.1054
* 100 f866.f206.fb43 dynamic 0 F F 123.0.2047
N55K-1(config)#
13.2.8. N55K-2
!
Configuration terminal
VLAN verifications:
N55K-2# sh vlan | in 30
Eth1/29, Eth1/30, Eth1/31
30 VLAN0030 active Po52
30 enet CE
N55K-2# sh ip int brief | ex unas
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
49 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Vlan30 30.1.1.5 protocol-up/link-up/admin-up
Port-channel verifications:
N55K-2# sh port-channel summary
Flags: D - Down P - Up in port-channel (members)
I - Individual H - Hot-standby (LACP only)
s - Suspended r - Module-removed
S - Switched R - Routed
U - Up (port-channel)
M - Not in use. Min-links not met
--------------------------------------------------------------------------------
Group Port- Type Protocol Member Ports
Channel
--------------------------------------------------------------------------------
52 Po52(SU) Eth LACP Eth1/1(P) Eth1/2(P)
N55K-2#
MAC Address of Vlan 30
N55K-2# sh interface vlan 30 | in Hardware
Hardware is EtherSVI, address is 547f.ee90.1501
N55K-2#
MAC Table:
N55K-2# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 30 0000.0c07.ac1e dynamic 10 F F Po52
* 30 18ef.63e3.dcc3 dynamic 10 F F Po52
N55K-2#
13.3. Test Result
13.3.9. CE VLAN on N55K-2 Reaching the FP VLAN on N55K-1
!
Configuration terminal
N55K-2# ping 100.1.1.2
PING 100.1.1.2 (100.1.1.2): 56 data bytes
64 bytes from 100.1.1.2: icmp_seq=0 ttl=253 time=3.104 ms
64 bytes from 100.1.1.2: icmp_seq=1 ttl=253 time=4.912 ms
64 bytes from 100.1.1.2: icmp_seq=2 ttl=253 time=4.986 ms
64 bytes from 100.1.1.2: icmp_seq=3 ttl=253 time=15.744 ms
64 bytes from 100.1.1.2: icmp_seq=4 ttl=253 time=4.972 ms
--- 100.1.1.2 ping statistics ---
5 packets transmitted, 5 packets received, 0.00% packet loss
round-trip min/avg/max = 3.104/6.743/15.744 ms
N55K-2#
Scenario 2: FP to CE VLAN Routed Traffic
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
50 (Draft) V0.2
A printed copy of this document is considered uncontrolled
13.3.10. FP VLAN on N55K-1 Reaching the CE VLAN on N55K-2
!
Configuration terminal
N55K-1# ping 30.1.1.5
PING 30.1.1.5 (30.1.1.5): 56 data bytes
64 bytes from 30.1.1.5: icmp_seq=0 ttl=253 time=3.09 ms
64 bytes from 30.1.1.5: icmp_seq=1 ttl=253 time=4.916 ms
64 bytes from 30.1.1.5: icmp_seq=2 ttl=253 time=4.978 ms
64 bytes from 30.1.1.5: icmp_seq=3 ttl=253 time=4.979 ms
64 bytes from 30.1.1.5: icmp_seq=4 ttl=253 time=4.982 ms
--- 30.1.1.5 ping statistics ---
5 packets transmitted, 5 packets received, 0.00% packet loss
round-trip min/avg/max = 3.09/4.589/4.982 ms
N55K-1#
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
51 (Draft) V0.2
A printed copy of this document is considered uncontrolled
14. Scenario 3: FP to CE VLAN Routed traffic to the Single homed edge device
This scenario is used for demonstrating how the CE and FP intervlan communication happens when it co-exist on the
Nexus 7010 swiches. As shown in Figure 5: Vlan 20 is configured as FP vlan on N55K-1 access switch and Vlan 40
is configured as CE vlan on N55K-2; where as the vlan 40 is defined as CE vlan on Nexus 7010 switches and Vlan 20
is configured as FP vlan.
The connectivity between the Nexus 7010 switches and Nexus N55K-1 switch is configured as fabricpath core ports
and the connectivity between the N7K-2 switch and Nexus N55K-2 is configured as fabricpath edge port/normal
trunk interfaces.
Figure 5 FP VLAN talking to the Single homed CE VLAN device
SVI 20: 20.1.1.1 SVI 20: 40.1.1.1
vPC+
N5548-01 N5548-02
vPC peer-link
Non-vPC Trunk
FP VLAN 20: 20.1.1.2 FP VLAN 20:20.1.1.3
FP VLAN 20CE VLAN 40
CE VLAN 40: 40.1.1.2 CE VLAN 40:40.1.1.3HSRP VIP= . 4
802.1Q Trunk
USE CASE:
In a multi vendor environment there could be a possibility that the services hosted on the network is single homed to
the aggregation layer and the traffic from fabricpth get routed to the CE vlan which is part of the third party device.
Also note that the VLAN which is for the Single homed services may not be making use of the peer-link because of
some potential failure scenario consideration in vPC environment. Eg: vPC peer link failure
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
52 (Draft) V0.2
A printed copy of this document is considered uncontrolled
14.1. Device Configurations
14.1.1. N7K-1
!Command: show running-config
!Time: Fri Aug 3 17:43:06 2012
version 6.0(3)
feature-set fabricpath
hostname N7K-1
feature tacacs+
cfs eth distribute
feature ospf
feature interface-vlan
feature hsrp
feature lacp
feature vpc
feature lldp
username admin password 5 $1$auCnf9aG$Z0neTlzasmESXCAVlRgD// role vdc-admin
vlan 20
mode fabricpath
name N5K1-SERVER-VLAN
vlan 40
name N5K2-SERVER-VLAN
vlan 200
name vPC-keepalive
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967 priority 8192
vpc domain 30
role priority 20
peer-keepalive destination 200.1.1.3 source 200.1.1.4 vrf KA
auto-recovery
fabricpath switch-id 3
interface Vlan20
no shutdown
ip address 20.1.1.2/24
hsrp 20
priority 120
preempt
ip 20.1.1.4
interface Vlan40
no shutdown
ip address 40.1.1.2/24
hsrp 40
priority 120
preempt
ip 40.1.1.4
interface Vlan200
no shutdown
vrf member KA
ip address 200.1.1.4/24
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
53 (Draft) V0.2
A printed copy of this document is considered uncontrolled
interface port-channel110
Description vPC-peer-link
switchport
switchport mode fabricpath
vpc peer-link
interface port-channel120
Description Non-vPC-trunk
switchport
switchport mode trunk
switchport trunk allowed vlan 40,200
interface Ethernet8/1
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/2
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/3
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/4
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/9
switchport
shutdown
interface Ethernet8/10
Description To_N55K-1
switchport
switchport mode fabricpath
no shutdown
fabricpath domain default
root-priority 254
fabricpath switch-id 124
14.1.2. N7K-2
!
!Command: show running-config
!Time: Fri Aug 3 14:40:26 2012
version 6.0(3)
feature-set fabricpath
hostname N7K-2
feature tacacs+
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
54 (Draft) V0.2
A printed copy of this document is considered uncontrolled
cfs eth distribute
feature ospf
feature interface-vlan
feature hsrp
feature lacp
feature vpc
feature lldp
username admin password 5 $1$tEWzhPMP$cHBm2mrwkag1Yqpz4gCSC. role vdc-admin
ip domain-lookup
vlan 20
mode fabricpath
name N5K1-SERVER-VLAN
vlan 40
name N5K2-SERVER-VLAN
vlan 200
name vPC-keepalive
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967 priority 8192
vpc domain 30
role priority 10
peer-keepalive destination 200.1.1.4 source 200.1.1.3 vrf KA
auto-recovery
fabricpath switch-id 3
interface Vlan20
no shutdown
ip address 20.1.1.3/24
hsrp 20
ip 20.1.1.4
interface Vlan40
no shutdown
ip address 40.1.1.3/24
hsrp 40
ip 40.1.1.4
interface Vlan200
no shutdown
vrf member KA
ip address 200.1.1.3/24
interface port-channel110
Description vPC-peer-link
switchport
switchport mode fabricpath
vpc peer-link
interface port-channel120
Description Non-vPC-trunk
switchport
switchport mode trunk
switchport trunk allowed vlan 40,200
interface Ethernet8/1
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/2
switchport
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
55 (Draft) V0.2
A printed copy of this document is considered uncontrolled
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/3
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/4
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/9
Description To_N55K-2
switchport
switchport mode trunk
switchport trunk allowed vlan 40
no shutdown
interface Ethernet8/10
Description To_N55K-1
switchport
switchport mode fabricpath
no shutdown
line vty
fabricpath domain default
root-priority 255
fabricpath switch-id 123
N7K-1#
14.1.3. N55K-1
!
!Command: show running-config
!Time: Fri Aug 3 05:33:47 2012
version 5.1(3)N2(1)
install feature-set fabricpath
feature-set fabricpath
hostname N55K-1
feature telnet
no feature http-server
feature tacacs+
cfs eth distribute
feature interface-vlan
feature lacp
feature lldp
username admin password 5 $1$up6VlJix$8E/6RphXw8ehWHx0Pf9UG0 role network-admin
username Cisco.123 password 5 ! role network-admin
username Cisco@123 password 5 $1$Hv6f0NFz$hE3qBt7958S9M/IB5I0Ps0 role network-admi
ssh key rsa 2048
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
56 (Draft) V0.2
A printed copy of this document is considered uncontrolled
ip domain-lookup
vlan 20
mode farbripath
name N5K1-SERVER-VLAN
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967,4048-4093 priority 61440
interface Vlan20
no shutdown
ip address 20.1.1.1/24
interface port-channel51
switchport mode trunk
interface Ethernet1/1
Description To_N7K-1
switchport
switchport mode fabricpath
interface Ethernet1/2
Description To_N7K-2
switchport
switchport mode fabricpath
no shutdown
boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N2.1.bin
boot system bootflash:/n5000-uk9.5.1.3.N2.1.bin
ip route 0.0.0.0 0.0.0.0 20.1.1.4
!
!
14.1.4. N55K-2
!
!Command: show running-config
!Time: Thu Apr 9 12:05:48 2009
version 5.1(3)N2(1)
hostname N55K-2
feature telnet
no feature http-server
feature tacacs+
cfs eth distribute
feature interface-vlan
feature lacp
username admin password 5 $1$tt6xvpX8$Lgh9CgRYnzc8Hfh.tHYrk1 role network-admin
ssh key rsa 2048
ip domain-lookup
vlan 40
name N5K2-SERVER-VLAN
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967,4048-4093 priority 61440
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
57 (Draft) V0.2
A printed copy of this document is considered uncontrolled
interface Vlan40
no shutdown
ip address 40.1.1.1/24
interface Ethernet1/1
shutdown
interface Ethernet1/2
Description To_N7K-2
switchport mode trunk
switchport trunk allowed vlan 40
no shutdown
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N2.1.bin
boot system bootflash:/n5000-uk9.5.1.3.N2.1.bin
ip route 0.0.0.0 0.0.0.0 40.1.1.4
logging logfile syslog.log 5
logging timestamp milliseconds
no logging console
N55K-2#
14.2. Configuration Verification
14.2.5. N7K-1
!
Configuration terminal
VLAN verifications:
N7K-1(config)# sh vlan
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
1 default active
20 N55K1-SERVER-VLAN active Po51, Po52, Po110, Eth8/1
Eth8/2, Eth8/10
40 N55K2-SERVER-VLAN active Po120, Eth8/3, Eth8/4
200 vPC-keep-alive active Po120, Eth8/3, Eth8/4
VLAN Type Vlan-mode
---- ----- ----------
1 enet CE
20 enet FABRICPATH
40 enet CE
200 enet CE
Remote SPAN VLANs
-------------------------------------------------------------------------------
Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
58 (Draft) V0.2
A printed copy of this document is considered uncontrolled
vPC verifications:
N7K-1(config)# sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 30
vPC+ switch id : 3
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
vPC fabricpath status : peer is reachable through fabricpath
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : primary, operational secondary
Number of vPCs configured : 0
Peer Gateway : Disabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled (timeout = 240 seconds)
Fabricpath load balancing : Disabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po110 up 20
N7K-1(config)# sh ip int brief
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan20 20.1.1.2 protocol-up/link-up/admin-up
Vlan40 40.1.1.2 protocol-up/link-up/admin-up
HSRP verifications:
N7K-1(config)# sh hsrp
Vlan20 - Group 20 (HSRP-V1) (IPv4)
Local state is Standby, priority 120 (Cfged 120), may preempt
Forwarding threshold(for vPC), lower: 1 upper: 120
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 2.528000 sec(s)
Virtual IP address is 20.1.1.4 (Cfged)
Active router is 20.1.1.3, priority 120 expires in 4.489000 sec(s)
Standby router is local
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac14 (Default MAC)
4 state changes, last state change 00:27:54
IP redundancy name is hsrp-Vlan20-20 (default)
Vlan40 - Group 40 (HSRP-V1) (IPv4)
Local state is Standby, priority 120 (Cfged 120), may preempt
Forwarding threshold(for vPC), lower: 1 upper: 120
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 2.528000 sec(s)
Virtual IP address is 40.1.1.4 (Cfged)
Active router is 40.1.1.3, priority 120 expires in 4.488000 sec(s)
Standby router is local
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac28 (Default MAC)
4 state changes, last state change 00:27:23
IP redundancy name is hsrp-Vlan40-40 (default)
N7K-1(config)# sh inter vlan 20 | in Hardwa
Hardware is EtherSVI, address is f866.f206.fb43
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
59 (Draft) V0.2
A printed copy of this document is considered uncontrolled
N7K-1(config)# sh inter vlan 40 | in Hardwa
Hardware is EtherSVI, address is f866.f206.fb43
MAC Address verifications:
N7K-1(config)# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
20 547f.ee93.61bc dynamic 5 F F 2768.0.0
* 40 18ef.63e3.dcc3 dynamic 1740 F F Po120
* 40 547f.ee90.1501 dynamic 990 F F Po120
* 200 18ef.63e3.dcc3 dynamic 0 F F Po120
N7K-1(config)#
FP Topology verifications:
N7K-1(config)# sh fabricpath topology
Topo-Description Topo-ID Topo-State
-------------------------------- ---------- --------------------
0 0 Up
N7K-1(config)# sh fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
FabricPath Unicast Route Table for Topology-Default
0/123/0, number of next-hops: 0
via ---- , [60/0], 2 day/s 22:05:07, local
1/3/0, number of next-hops: 0
via ---- , [60/0], 2 day/s 22:04:43, local
1/124/0, number of next-hops: 1
via Po110, [115/20], 0 day/s 06:10:54, isis_fabricpath-default
1/2768/0, number of next-hops: 1
via Eth8/10, [115/40], 0 day/s 00:22:10, isis_fabricpath-default
2/3/0, number of next-hops: 0
via ---- , [60/0], 2 day/s 22:04:43, local
N7K-1(config)#
ISIS Adjacency verifications:
N7K-1(config)# sh fabricpath isis adjacency
Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:
System ID SNPA Level State Hold Time Interface
18ef.63e3.dcc3 N/A 1 UP 00:00:27 port-channel110
547f.ee93.61bc N/A 1 UP 00:00:26 Ethernet8/10
N7K-1(config)#
FP Switch-ID verification:
N7K-1(config)# show fabricpath switch-id
FABRICPATH SWITCH-ID TABLE
Legend: '*' - this system
=========================================================================
SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED
----------+----------------+------------+-----------+--------------------
3 18ef.63e3.dcc3 Primary Confirmed No Yes
3 f866.f206.fb43 Primary Confirmed No Yes
*123 f866.f206.fb43 Primary Confirmed Yes No
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
60 (Draft) V0.2
A printed copy of this document is considered uncontrolled
124 18ef.63e3.dcc3 Primary Confirmed Yes No
2768 547f.ee93.61bc Primary Confirmed No No
Total Switch-ids: 5
N7K-1(config)# show fabricpath isis switch-id
Fabricpath IS-IS domain: default
Fabricpath IS-IS Switch-ID Database
Legend: C - Confirmed, T - tentative, W - swap
S - sticky, E - Emulated Switch
'*' - this system
System-ID Primary Secondary Reachable Bcast-Priority
MT-0
18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]
18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]
547f.ee93.61bc 2768[C] 0[C] Yes 64
f866.f206.fb43* 123 [C] 0[C] Yes 255 [S]
f866.f206.fb43* 3 [C] 0[C] Yes 0 [E]
N7K-1(config)# show fabricpath isis protocol
Fabricpath IS-IS domain : default
System ID : f866.f206.fb43 IS-Type : L1
SAP : 432 Queue Handle : 11
Maximum LSP MTU: 1492
Graceful Restart enabled. State: Inactive
Last graceful restart status : none
Metric-style : advertise(wide), accept(wide)
Start-Mode: Complete [Start-type configuration]
Area address(es) :
00
Process is up and running
CIB ID: 3
Interfaces supported by Fabricpath IS-IS :
port-channel110
Ethernet8/10
Level 1
Authentication type and keychain not configured
Authentication check specified
MT-0 Ref-Bw: 400000
Address family Swid unicast :
Number of interface : 2
Distance : 115
L1 Next SPF: Inactive
N7K-1(config)# show fabricpath isis interface brief
Fabricpath IS-IS domain: default
Interface Type Idx State Circuit MTU Metric Priority Adjs/AdjsUp
--------------------------------------------------------------------------------
port-channel110 P2P 1 Up/Ready 0x01/L1 1500 20 64 1/1
Ethernet8/10 P2P 2 Up/Ready 0x01/L1 1500 40 64 1/1
N7K-1(config)# sh fabricpath isis trees
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 1, Swid routing table
3, L1
via port-channel110, metric 20
124, L1
via port-channel110, metric 20
2768, L1
via Ethernet8/10, metric 40
Topology 0, Tree 2, Swid routing table
124, L1
via port-channel110, metric 0
2768, L1
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
61 (Draft) V0.2
A printed copy of this document is considered uncontrolled
via port-channel110, metric 40
N7K-1(config)#
14.2.6. N7K-2
!
VLAN verifications:
N7K-2(config)# sh vlan
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
1 default active
20 N55K1-SERVER-VLAN active Po110, Eth8/1, Eth8/2, Eth8/10
40 N55K2-SERVER-VLAN active Po120, Eth8/3, Eth8/4, Eth8/9
200 vPC-keep-alive active Po120, Eth8/3, Eth8/4
VLAN Type Vlan-mode
---- ----- ----------
1 enet CE
20 enet FABRICPATH
40 enet CE
200 enet CE
Remote SPAN VLANs
-------------------------------------------------------------------------------
Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------
vPC verifications:
N7K-2(config)# sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 30
vPC+ switch id : 3
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
vPC fabricpath status : peer is reachable through fabricpath
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : secondary, operational primary
Number of vPCs configured : 0
Peer Gateway : Disabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled (timeout = 240 seconds)
Fabricpath load balancing : Disabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po110 up 20
IP Address verifications:
N7K-2(config)# sh ip int brief
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan20 20.1.1.3 protocol-up/link-up/admin-up
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
62 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Vlan40 40.1.1.3 protocol-up/link-up/admin-up
HSRP verifications:
N7K-2(config)# show hsrp
Vlan20 - Group 20 (HSRP-V1) (IPv4)
Local state is Active, priority 120 (Cfged 120), may preempt
Forwarding threshold(for vPC), lower: 1 upper: 120
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 0.457000 sec(s)
Virtual IP address is 20.1.1.4 (Cfged)
Active router is local
Standby router is 20.1.1.2 , priority 120 expires in 3.687000 sec(s)
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac14 (Default MAC)
1 state changes, last state change 00:37:02
IP redundancy name is hsrp-Vlan20-20 (default)
Vlan40 - Group 40 (HSRP-V1) (IPv4)
Local state is Active, priority 120 (Cfged 120), may preempt
Forwarding threshold(for vPC), lower: 1 upper: 120
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 0.457000 sec(s)
Virtual IP address is 40.1.1.4 (Cfged)
Active router is local
Standby router is 40.1.1.2 , priority 120 expires in 3.687000 sec(s)
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac28 (Default MAC)
1 state changes, last state change 00:36:31
IP redundancy name is hsrp-Vlan40-40 (default)
N7K-2(config)# sh interf vla 20 | in Hard
Hardware is EtherSVI, address is 18ef.63e3.dcc3
N7K-2(config)# sh interf vla 40 | in Hard
Hardware is EtherSVI, address is 18ef.63e3.dcc3
N7K-2(config)# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
20 547f.ee93.61bc dynamic 420 F F 2768.0.0
* 40 547f.ee90.1501 dynamic 5 F F Eth8/9
* 40 f866.f206.fb43 dynamic 0 F F Po120
* 200 f866.f206.fb43 dynamic 0 F F Po120
FP Topology Verification:
N7K-2(config)# show fabricpath topology
Topo-Description Topo-ID Topo-State
-------------------------------- ---------- --------------------
0 0 Up
N7K-2(config)# show fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
FabricPath Unicast Route Table for Topology-Default
0/124/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 13:20:12, local
1/3/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 13:15:47, local
1/123/0, number of next-hops: 1
via Po110, [115/20], 0 day/s 06:17:17, isis_fabricpath-default
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
63 (Draft) V0.2
A printed copy of this document is considered uncontrolled
1/2768/0, number of next-hops: 1
via Eth8/10, [115/40], 0 day/s 00:28:25, isis_fabricpath-default
2/3/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 13:15:47, local
N7K-2(config)# show fabricpath isis adjacency
Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:
System ID SNPA Level State Hold Time Interface
f866.f206.fb43 N/A 1 UP 00:00:26 port-channel110
547f.ee93.61bc N/A 1 UP 00:00:27 Ethernet8/10
N7K-2(config)#
FP Switch-ID Verification
N7K-2(config)# sh fabricpath switch-id
FABRICPATH SWITCH-ID TABLE
Legend: '*' - this system
=========================================================================
SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED
----------+----------------+------------+-----------+--------------------
3 18ef.63e3.dcc3 Primary Confirmed No Yes
3 f866.f206.fb43 Primary Confirmed No Yes
123 f866.f206.fb43 Primary Confirmed Yes No
*124 18ef.63e3.dcc3 Primary Confirmed Yes No
2768 547f.ee93.61bc Primary Confirmed No No
Total Switch-ids: 5
N7K-2(config)# sh fabricpath isis switch-id
Fabricpath IS-IS domain: default
Fabricpath IS-IS Switch-ID Database
Legend: C - Confirmed, T - tentative, W - swap
S - sticky, E - Emulated Switch
'*' - this system
System-ID Primary Secondary Reachable Bcast-Priority
MT-0
18ef.63e3.dcc3* 124 [C] 0[C] Yes 254 [S]
18ef.63e3.dcc3* 3 [C] 0[C] Yes 0 [E]
547f.ee93.61bc 2768[C] 0[C] Yes 64
f866.f206.fb43 123 [C] 0[C] Yes 255 [S]
f866.f206.fb43 3 [C] 0[C] Yes 0 [E]
ISIS Protocol verifications:
N7K-2(config)# sh fabricpath isis protocol
Fabricpath IS-IS domain : default
System ID : 18ef.63e3.dcc3 IS-Type : L1
SAP : 432 Queue Handle : 11
Maximum LSP MTU: 1492
Graceful Restart enabled. State: Inactive
Last graceful restart status : none
Metric-style : advertise(wide), accept(wide)
Start-Mode: Complete [Start-type configuration]
Area address(es) :
00
Process is up and running
CIB ID: 3
Interfaces supported by Fabricpath IS-IS :
port-channel110
Ethernet8/10
Level 1
Authentication type and keychain not configured
Authentication check specified
MT-0 Ref-Bw: 400000
Address family Swid unicast :
Number of interface : 2
Distance : 115
L1 Next SPF: Inactive
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
64 (Draft) V0.2
A printed copy of this document is considered uncontrolled
ISIS Tree verifications:
N7K-2(config)# sh fabricpath isis trees
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 1, Swid routing table
123, L1
via port-channel110, metric 0
2768, L1
via port-channel110, metric 40
Topology 0, Tree 2, Swid routing table
3, L1
via port-channel110, metric 20
123, L1
via port-channel110, metric 20
2768, L1
via Ethernet8/10, metric 40
N7K-2(config)#
14.2.7. N55K-1
!
IP Address verifications:
N55K-1(config)# sh ip int brief | ex unas
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan20 20.1.1.1 protocol-up/link-up/admin-up
N55K-1(config)# sh vlan | in FABRIC
20 enet FABRICPATH
100 enet FABRICPATH
N55K-1(config)# sh int vlan 20 | in Hard
Hardware is EtherSVI, address is 547f.ee93.61bc
MAC Address verifications:
N55K-1(config)# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 20 0000.0c07.ac14 dynamic 0 F F 3.0.2047
* 20 f866.f206.fb43 dynamic 0 F F 123.0.1054
ISIS Adjacency verifications:
N55K-1(config)# sh fabricpath isis adjacency
Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:
System ID SNPA Level State Hold Time Interface
f866.f206.fb43 N/A 1 UP 00:00:27 Ethernet1/1
18ef.63e3.dcc3 N/A 1 UP 00:00:23 Ethernet1/2
FP Switch-ID verifications:
N55K-1(config)# sh fabricpath isis switch-id
Fabricpath IS-IS domain: default
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
65 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Fabricpath IS-IS Switch-ID Database
Legend: C - Confirmed, T - tentative, W - swap
S - sticky, E - Emulated Switch
'*' - this system
System-ID Primary Secondary Reachable Bcast-Priority
MT-0
18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]
18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]
547f.ee93.61bc* 2768[C] 0[C] Yes 64
f866.f206.fb43 123 [C] 0[C] Yes 255 [S]
f866.f206.fb43 3 [C] 0[C] Yes 0 [E]
N55K-1(config)# sh fabricpath switch-id
FABRICPATH SWITCH-ID TABLE
Legend: '*' - this system
=========================================================================
SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED
----------+----------------+------------+-----------+--------------------
3 18ef.63e3.dcc3 Primary Confirmed No Yes
3 f866.f206.fb43 Primary Confirmed No Yes
123 f866.f206.fb43 Primary Confirmed Yes No
124 18ef.63e3.dcc3 Primary Confirmed Yes No
*2768 547f.ee93.61bc Primary Confirmed No No
Total Switch-ids: 5
FP Route-table verifications:
N55K-1(config)# sh fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
FabricPath Unicast Route Table for Topology-Default
0/2768/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 07:55:26, local
1/3/0, number of next-hops: 2
via Eth1/1, [115/40], 0 day/s 00:33:57, isis_fabricpath-default
via Eth1/2, [115/40], 0 day/s 00:33:49, isis_fabricpath-default
1/123/0, number of next-hops: 1
via Eth1/1, [115/40], 0 day/s 00:33:57, isis_fabricpath-default
1/124/0, number of next-hops: 1
via Eth1/2, [115/40], 0 day/s 00:33:49, isis_fabricpath-default
N55K-1(config)#
14.2.8. N55K-2
!
VLAN verifications:
N55K-2(config)# sh vlan | in 40
40 VLAN0040 active Eth1/2
40 enet CE
N55K-2(config)# sh ip int brief | ex un
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan40 40.1.1.1 protocol-up/link-up/admin-up
Trunk verifications:
N55K-2(config)# sh interface trunk | in 40
Eth1/2 40
Scenario 3: FP to CE VLAN Routed traffic to the
Single homed edge device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
66 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Eth1/2 40
MAC Address verifications:
N55K-2(config)# sh inter vla 40 | in Hard
Hardware is EtherSVI, address is 547f.ee90.1501
N55K-2(config)# sh mac add dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 40 0000.0c07.ac28 dynamic 10 F F Eth1/2
* 40 f866.f206.fb43 dynamic 10 F F Eth1/2
N55K-2(config)#
14.3. Test Result
14.3.9. FP VLAN on N55K-1 Reaching the CE VLAN on N55K-2
!
N55K-1(config)# ping 40.1.1.1
PING 40.1.1.1 (40.1.1.1): 56 data bytes
64 bytes from 40.1.1.1: icmp_seq=0 ttl=253 time=3.072 ms
64 bytes from 40.1.1.1: icmp_seq=1 ttl=253 time=4.912 ms
64 bytes from 40.1.1.1: icmp_seq=2 ttl=253 time=4.974 ms
64 bytes from 40.1.1.1: icmp_seq=3 ttl=253 time=4.98 ms
64 bytes from 40.1.1.1: icmp_seq=4 ttl=253 time=4.972 ms
--- 40.1.1.1 ping statistics ---
5 packets transmitted, 5 packets received, 0.00% packet loss
round-trip min/avg/max = 3.072/4.582/4.98 ms
N55K-1(config)#
14.3.10. CE VLAN on N55K-2 Reaching the FP VLAN on N55K-1
!
N55K-2(config)# ping 20.1.1.1
PING 20.1.1.1 (20.1.1.1): 56 data bytes
64 bytes from 20.1.1.1: icmp_seq=0 ttl=253 time=3.063 ms
64 bytes from 20.1.1.1: icmp_seq=1 ttl=253 time=4.917 ms
64 bytes from 20.1.1.1: icmp_seq=2 ttl=253 time=4.975 ms
64 bytes from 20.1.1.1: icmp_seq=3 ttl=253 time=4.981 ms
64 bytes from 20.1.1.1: icmp_seq=4 ttl=253 time=4.982 ms
--- 20.1.1.1 ping statistics ---
5 packets transmitted, 5 packets received, 0.00% packet loss
round-trip min/avg/max = 3.063/4.583/4.982 ms
N55K-2(config)#
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
67 (Draft) V0.2
A printed copy of this document is considered uncontrolled
15. Scenario 4: FP VLAN Routed traffic to Single homed FP edge Device
This scenario is used for demonstrating how the FP intervlan communication happens when it co-exist on the Nexus
7010 swiches. As shown in Figure 6: Vlan 20 is configured as FP vlan on N55K-1 access switch and Vlan 40 is
configured as CE vlan on N55K-2; where as the vlan 20 & 40 is defined as FP vlan on Nexus 7010 switches.
The connectivity between the Nexus 7010 switches and Nexus N55K-1 switch is configured as fabricpath core ports
and the connectivity between the N7K-2 switch and Nexus N55K-2 is configured as fabricpath edge port/normal
trunk interfaces
Figure 6 FP VLAN talking to the Single homed FP VLAN device
SVI 20: 20.1.1.1 SVI 20: 40.1.1.1
vPC+
N55K-1 N55K-2
vPC peer-link
Vpc Keep-alive
FP VLAN 20: 20.1.1.2 FP VLAN 20:20.1.1.2
FP VLAN 20CE VLAN 40
FP VLAN 40: 40.1.1.2 FP VLAN 40:40.1.1.3HSRP VIP= . 1
802.1Q Trunk
N7K-1 N7K-2
USE CASE:
In a multi vendor environment, single homed devices (Eg: Third party FW) may need to be connected to the
aggregation switch where all the VLANs are defined as Fabricpath.
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
68 (Draft) V0.2
A printed copy of this document is considered uncontrolled
15.1. Device Configurations
15.1.1. N7K-1
!Command: show running-config
!Time: Fri Aug 3 17:43:06 2012
version 6.0(3)
feature-set fabricpath
hostname N7K-1
feature tacacs+
cfs eth distribute
feature ospf
feature interface-vlan
feature hsrp
feature lacp
feature vpc
feature lldp
username admin password 5 $1$auCnf9aG$Z0neTlzasmESXCAVlRgD// role vdc-admin
vlan 20
mode fabricpath
name N55K-1-SERVER-VLAN
vlan 40
mode fabricpath
name N55K-2-SERVER-VLAN
vlan 200
name vPC-keepalive
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967 priority 8192
vpc domain 30
role priority 20
peer-keepalive destination 200.1.1.3 source 200.1.1.4 vrf KA
auto-recovery
fabricpath switch-id 3
interface Vlan20
no shutdown
ip address 20.1.1.2/24
hsrp 20
priority 120
preempt
ip 20.1.1.4
interface Vlan40
no shutdown
ip address 40.1.1.2/24
hsrp 40
priority 120
preempt
ip 40.1.1.4
interface Vlan200
no shutdown
vrf member KA
ip address 200.1.1.4/24
interface port-channel110
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
69 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Description vPC-peer-link
switchport
switchport mode fabricpath
vpc peer-link
interface port-channel120
Description Non-vPC-trunk
switchport
switchport mode trunk
switchport trunk allowed vlan 200
interface Ethernet8/1
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/2
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/3
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/4
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/9
switchport
shutdown
interface Ethernet8/10
Description To_N55K-1
switchport
switchport mode fabricpath
no shutdown
fabricpath domain default
root-priority 254
fabricpath switch-id 124
15.1.2. N7K-2
!
!Command: show running-config
!Time: Fri Aug 3 14:40:26 2012
version 6.0(3)
feature-set fabricpath
hostname N7K-2
feature tacacs+
cfs eth distribute
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
70 (Draft) V0.2
A printed copy of this document is considered uncontrolled
feature ospf
feature interface-vlan
feature hsrp
feature lacp
feature vpc
feature lldp
username admin password 5 $1$tEWzhPMP$cHBm2mrwkag1Yqpz4gCSC. role vdc-admin
ip domain-lookup
vlan 1
vlan 20
mode fabricpath
name N55K-1-SERVER-VLAN
vlan 40
mode fabricpath
name N55K-2-SERVER-VLAN
vlan 200
name vPC-keepalive
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967 priority 8192
vpc domain 30
role priority 10
peer-keepalive destination 200.1.1.4 source 200.1.1.3 vrf KA
auto-recovery
fabricpath switch-id 3
interface Vlan20
no shutdown
ip address 20.1.1.3/24
hsrp 20
ip 20.1.1.4
interface Vlan40
no shutdown
ip address 40.1.1.3/24
hsrp 40
ip 40.1.1.4
interface Vlan200
no shutdown
vrf member KA
ip address 200.1.1.3/24
interface port-channel110
Description vPC-peer-link
switchport
switchport mode fabricpath
vpc peer-link
interface port-channel120
Description Non-vPC-trunk
switchport
switchport mode trunk
switchport trunk allowed vlan 200
interface Ethernet8/1
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
71 (Draft) V0.2
A printed copy of this document is considered uncontrolled
interface Ethernet8/2
switchport
switchport mode fabricpath
channel-group 110 mode active
no shutdown
interface Ethernet8/3
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/4
switchport
switchport mode trunk
switchport trunk allowed vlan 200
channel-group 120 mode active
no shutdown
interface Ethernet8/9
Description To_N55K-2
switchport
switchport mode trunk
switchport trunk allowed vlan 40
no shutdown
interface Ethernet8/10
Description To_N55K-1
switchport
switchport mode fabricpath
no shutdown
line vty
fabricpath domain default
root-priority 255
fabricpath switch-id 123
N7K-1#
15.1.3. N55K-1
!
!Command: show running-config
!Time: Fri Aug 3 05:33:47 2012
version 5.1(3)N2(1)
install feature-set fabricpath
feature-set fabricpath
hostname N55K-1
feature telnet
no feature http-server
feature tacacs+
cfs eth distribute
feature interface-vlan
feature lacp
feature lldp
username admin password 5 $1$up6VlJix$8E/6RphXw8ehWHx0Pf9UG0 role network-admin
username Cisco.123 password 5 ! role network-admin
username Cisco@123 password 5 $1$Hv6f0NFz$hE3qBt7958S9M/IB5I0Ps0 role network-admi
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
72 (Draft) V0.2
A printed copy of this document is considered uncontrolled
ssh key rsa 2048
ip domain-lookup
vlan 20
mode farbripath
name N55K-1-SERVER-VLAN
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967,4048-4093 priority 61440
interface Vlan20
no shutdown
ip address 20.1.1.1/24
interface port-channel51
switchport mode trunk
interface Ethernet1/1
Description To_N7K-1
switchport
switchport mode fabricpath
interface Ethernet1/2
Description To_N7K-2
switchport
switchport mode fabricpath
no shutdown
boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N2.1.bin
boot system bootflash:/n5000-uk9.5.1.3.N2.1.bin
ip route 0.0.0.0 0.0.0.0 20.1.1.4
!
!
15.1.4. N55K-2
!
!Command: show running-config
!Time: Thu Apr 9 12:05:48 2009
version 5.1(3)N2(1)
hostname N55K-2
feature telnet
no feature http-server
feature tacacs+
cfs eth distribute
feature interface-vlan
feature lacp
username admin password 5 $1$tt6xvpX8$Lgh9CgRYnzc8Hfh.tHYrk1 role network-admin
ssh key rsa 2048
ip domain-lookup
vlan 40
name N55K-2-SERVER-VLAN
spanning-tree pathcost method long
spanning-tree port type edge bpduguard default
spanning-tree vlan 1-3967,4048-4093 priority 61440
interface Vlan40
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
73 (Draft) V0.2
A printed copy of this document is considered uncontrolled
no shutdown
ip address 40.1.1.1/24
interface Ethernet1/1
shutdown
interface Ethernet1/2
Description To_N7K-2
switchport mode trunk
switchport trunk allowed vlan 40
no shutdown
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N2.1.bin
boot system bootflash:/n5000-uk9.5.1.3.N2.1.bin
ip route 0.0.0.0 0.0.0.0 40.1.1.4
logging logfile syslog.log 5
logging timestamp milliseconds
no logging console
N55K-2#
15.2. Configuration Verification
15.2.5. N7K-1
!
Configuration terminal
VLAN verifications:
N7K-1(config)# sh vlan
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
1 default active
20 N55K1-SERVER-VLAN active Po51, Po52, Po110, Eth8/1
Eth8/2, Eth8/10
40 N55K2-SERVER-VLAN active Po120, Eth8/3, Eth8/4
200 vPC-keepalive active Po120, Eth8/3, Eth8/4
VLAN Type Vlan-mode
---- ----- ----------
1 enet CE
20 enet FABRICPATH
40 enet FABRICPATH
200 enet CE
Remote SPAN VLANs
-------------------------------------------------------------------------------
Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------
vPC verifications:
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
74 (Draft) V0.2
A printed copy of this document is considered uncontrolled
N7K-1(config)# sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 30
vPC+ switch id : 3
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
vPC fabricpath status : peer is reachable through fabricpath
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : primary, operational secondary
Number of vPCs configured : 0
Peer Gateway : Disabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled (timeout = 240 seconds)
Fabricpath load balancing : Disabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po110 up 20,40
IP Address verifications:
N7K-1(config)# sh ip int brief
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan20 20.1.1.2 protocol-up/link-up/admin-up
Vlan40 40.1.1.2 protocol-up/link-up/admin-up
HSRP verifications:
N7K-1(config)# sh hsrp
Vlan20 - Group 20 (HSRP-V1) (IPv4)
Local state is Standby, priority 120 (Cfged 120), may preempt
Forwarding threshold(for vPC), lower: 1 upper: 120
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 2.528000 sec(s)
Virtual IP address is 20.1.1.4 (Cfged)
Active router is 20.1.1.3, priority 120 expires in 4.489000 sec(s)
Standby router is local
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac14 (Default MAC)
4 state changes, last state change 00:27:54
IP redundancy name is hsrp-Vlan20-20 (default)
Vlan40 - Group 40 (HSRP-V1) (IPv4)
Local state is Standby, priority 120 (Cfged 120), may preempt
Forwarding threshold(for vPC), lower: 1 upper: 120
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 2.528000 sec(s)
Virtual IP address is 40.1.1.4 (Cfged)
Active router is 40.1.1.3, priority 120 expires in 4.488000 sec(s)
Standby router is local
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac28 (Default MAC)
4 state changes, last state change 00:27:23
IP redundancy name is hsrp-Vlan40-40 (default)
MAC address verifications:
N7K-1(config-if)# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
75 (Draft) V0.2
A printed copy of this document is considered uncontrolled
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
20 547f.ee93.61bc dynamic 990 F F 2768.0.0
40 547f.ee90.1501 dynamic 840 F F 124.0.45
40 547f.ee93.61bc dynamic 150 F F 2768.0.0
* 200 18ef.63e3.dcc3 dynamic 0 F F Po120
N7K-1(config-if)# sh int vl 20 | in Hard
Hardware is EtherSVI, address is f866.f206.fb43
N7K-1(config-if)# sh int vl 40 | in Hard
Hardware is EtherSVI, address is f866.f206.fb43
N7K-1(config-if)#
FP Topology verification:
N7K-1(config-if)# sh fabricpath topology
Topo-Description Topo-ID Topo-State
-------------------------------- ---------- --------------------
0 0 Up
N7K-1(config-if)# sh fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
FabricPath Unicast Route Table for Topology-Default
0/123/0, number of next-hops: 0
via ---- , [60/0], 3 day/s 17:39:45, local
1/3/0, number of next-hops: 0
via ---- , [60/0], 3 day/s 17:39:21, local
1/124/0, number of next-hops: 1
via Po110, [115/20], 1 day/s 01:45:32, isis_fabricpath-default
1/2768/0, number of next-hops: 1
via Eth8/10, [115/40], 0 day/s 19:56:48, isis_fabricpath-default
2/3/0, number of next-hops: 0
via ---- , [60/0], 3 day/s 17:39:21, local
N7K-1(config-if)# sh fabricpath isis adjacency
Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:
System ID SNPA Level State Hold Time Interface
18ef.63e3.dcc3 N/A 1 UP 00:00:27 port-channel110
547f.ee93.61bc N/A 1 UP 00:00:32 Ethernet8/10
N7K-1(config-if)#
FP Switch-ID Verification:
N7K-1(config-if)# show fabricpath switch-id
FABRICPATH SWITCH-ID TABLE
Legend: '*' - this system
=========================================================================
SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED
----------+----------------+------------+-----------+--------------------
3 18ef.63e3.dcc3 Primary Confirmed No Yes
3 f866.f206.fb43 Primary Confirmed No Yes
*123 f866.f206.fb43 Primary Confirmed Yes No
124 18ef.63e3.dcc3 Primary Confirmed Yes No
2768 547f.ee93.61bc Primary Confirmed No No
Total Switch-ids: 5
N7K-1(config-if)# show fabricpath isis switch-id
Fabricpath IS-IS domain: default
Fabricpath IS-IS Switch-ID Database
Legend: C - Confirmed, T - tentative, W - swap
S - sticky, E - Emulated Switch
'*' - this system
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
76 (Draft) V0.2
A printed copy of this document is considered uncontrolled
System-ID Primary Secondary Reachable Bcast-Priority
MT-0
18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]
18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]
547f.ee93.61bc 2768[C] 0[C] Yes 64
f866.f206.fb43* 123 [C] 0[C] Yes 255 [S]
f866.f206.fb43* 3 [C] 0[C] Yes 0 [E]
ISIS Protocol verifications:
N7K-1(config-if)# show fabricpath isis protocol
Fabricpath IS-IS domain : default
System ID : f866.f206.fb43 IS-Type : L1
SAP : 432 Queue Handle : 11
Maximum LSP MTU: 1492
Graceful Restart enabled. State: Inactive
Last graceful restart status : none
Metric-style : advertise(wide), accept(wide)
Start-Mode: Complete [Start-type configuration]
Area address(es) :
00
Process is up and running
CIB ID: 3
Interfaces supported by Fabricpath IS-IS :
port-channel110
Ethernet8/10
Level 1
Authentication type and keychain not configured
Authentication check specified
MT-0 Ref-Bw: 400000
Address family Swid unicast :
Number of interface : 2
Distance : 115
L1 Next SPF: Inactive
N7K-1(config-if)# show fabricpath isis tr
traffic trees
N7K-1(config-if)# show fabricpath isis trees
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 1, Swid routing table
3, L1
via port-channel110, metric 20
124, L1
via port-channel110, metric 20
2768, L1
via Ethernet8/10, metric 40
Topology 0, Tree 2, Swid routing table
124, L1
via port-channel110, metric 0
2768, L1
via port-channel110, metric 40
N7K-1(config-if)#
!
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
77 (Draft) V0.2
A printed copy of this document is considered uncontrolled
15.2.6. N7K-2
!
VLAN verifications:
N7K-2(config)# sh vlan
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
1 default active
20 N55K1-SERVER-VLAN active Po110, Eth8/1, Eth8/2, Eth8/10
40 N55K2-SERVER-VLAN active Po120, Eth8/3, Eth8/4, Eth8/9
200 vPC-keepalive active Po120, Eth8/3, Eth8/4
VLAN Type Vlan-mode
---- ----- ----------
1 enet CE
20 enet FABRICPATH
40 enet FABRICPATH
200 enet CE
Remote SPAN VLANs
-------------------------------------------------------------------------------
Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------
vPC verifications:
N7K-2(config)# sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 30
vPC+ switch id : 3
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
vPC fabricpath status : peer is reachable through fabricpath
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : secondary, operational primary
Number of vPCs configured : 0
Peer Gateway : Disabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled (timeout = 240 seconds)
Fabricpath load balancing : Disabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po110 up 20,40
IP Address verifications:
N7K-2(config)# sh ip int brief
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan20 20.1.1.3 protocol-up/link-up/admin-up
Vlan40 40.1.1.3 protocol-up/link-up/admin-up
HSRP verifications:
N7K-2(config)# show hsrp
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
78 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Vlan20 - Group 20 (HSRP-V1) (IPv4)
Local state is Active, priority 120 (Cfged 120), may preempt
Forwarding threshold(for vPC), lower: 1 upper: 120
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 0.457000 sec(s)
Virtual IP address is 20.1.1.4 (Cfged)
Active router is local
Standby router is 20.1.1.2 , priority 120 expires in 3.687000 sec(s)
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac14 (Default MAC)
1 state changes, last state change 00:37:02
IP redundancy name is hsrp-Vlan20-20 (default)
Vlan40 - Group 40 (HSRP-V1) (IPv4)
Local state is Active, priority 120 (Cfged 120), may preempt
Forwarding threshold(for vPC), lower: 1 upper: 120
Hellotime 3 sec, holdtime 10 sec
Next hello sent in 0.457000 sec(s)
Virtual IP address is 40.1.1.4 (Cfged)
Active router is local
Standby router is 40.1.1.2 , priority 120 expires in 3.687000 sec(s)
Authentication text "cisco"
Virtual mac address is 0000.0c07.ac28 (Default MAC)
1 state changes, last state change 00:36:31
IP redundancy name is hsrp-Vlan40-40 (default)
MAC Address verifications:
N7K-2(config-if)# show mac add dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
20 547f.ee93.61bc dynamic 0 F F 2768.0.0
* 40 547f.ee90.1501 dynamic 90 F F Eth8/9
40 547f.ee93.61bc dynamic 90 F F 2768.0.0
* 200 f866.f206.fb43 dynamic 0 F F Po120
N7K-2(config-if)# sh int vl 20 | in Hard
Hardware is EtherSVI, address is 18ef.63e3.dcc3
N7K-2(config-if)# sh int vl 40 | in Hard
Hardware is EtherSVI, address is 18ef.63e3.dcc3
N7K-2(config-if)#
FP Topology Verification:
N7K-2(config-if)# sh fabricpath topology
Topo-Description Topo-ID Topo-State
-------------------------------- ---------- --------------------
0 0 Up
FP Route-table verifications:
N7K-2(config-if)# sh fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
FabricPath Unicast Route Table for Topology-Default
0/124/0, number of next-hops: 0
via ---- , [60/0], 15 day/s 08:54:09, local
1/3/0, number of next-hops: 0
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
79 (Draft) V0.2
A printed copy of this document is considered uncontrolled
via ---- , [60/0], 15 day/s 08:49:44, local
1/123/0, number of next-hops: 1
via Po110, [115/20], 1 day/s 01:51:14, isis_fabricpath-default
1/2768/0, number of next-hops: 1
via Eth8/10, [115/40], 0 day/s 20:02:22, isis_fabricpath-default
2/3/0, number of next-hops: 0
via ---- , [60/0], 15 day/s 08:49:44, local
ISIS Adjacency verifications:
N7K-2(config-if)# sh fabricpath isis adjacency
Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:
System ID SNPA Level State Hold Time Interface
f866.f206.fb43 N/A 1 UP 00:00:30 port-channel110
547f.ee93.61bc N/A 1 UP 00:00:31 Ethernet8/10
N7K-2(config-if)#
FP Switch-ID Verification:
N7K-2(config-if)# show fabricpath switch-id
FABRICPATH SWITCH-ID TABLE
Legend: '*' - this system
=========================================================================
SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED
----------+----------------+------------+-----------+--------------------
3 18ef.63e3.dcc3 Primary Confirmed No Yes
3 f866.f206.fb43 Primary Confirmed No Yes
123 f866.f206.fb43 Primary Confirmed Yes No
*124 18ef.63e3.dcc3 Primary Confirmed Yes No
2768 547f.ee93.61bc Primary Confirmed No No
Total Switch-ids: 5
N7K-2(config-if)# show fabricpath isis switch-id
Fabricpath IS-IS domain: default
Fabricpath IS-IS Switch-ID Database
Legend: C - Confirmed, T - tentative, W - swap
S - sticky, E - Emulated Switch
'*' - this system
System-ID Primary Secondary Reachable Bcast-Priority
MT-0
18ef.63e3.dcc3* 124 [C] 0[C] Yes 254 [S]
18ef.63e3.dcc3* 3 [C] 0[C] Yes 0 [E]
547f.ee93.61bc 2768[C] 0[C] Yes 64
f866.f206.fb43 123 [C] 0[C] Yes 255 [S]
f866.f206.fb43 3 [C] 0[C] Yes 0 [E]
N7K-2(config-if)#
ISIS Protocol verifications:
N7K-2(config-if)# show fabricpath isis protocol
Fabricpath IS-IS domain : default
System ID : 18ef.63e3.dcc3 IS-Type : L1
SAP : 432 Queue Handle : 11
Maximum LSP MTU: 1492
Graceful Restart enabled. State: Inactive
Last graceful restart status : none
Metric-style : advertise(wide), accept(wide)
Start-Mode: Complete [Start-type configuration]
Area address(es) :
00
Process is up and running
CIB ID: 3
Interfaces supported by Fabricpath IS-IS :
port-channel110
Ethernet8/10
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
80 (Draft) V0.2
A printed copy of this document is considered uncontrolled
Level 1
Authentication type and keychain not configured
Authentication check specified
MT-0 Ref-Bw: 400000
Address family Swid unicast :
Number of interface : 2
Distance : 115
L1 Next SPF: Inactive
ISIS Tree verifications:
N7K-2(config-if)# show fabricpath isis trees
Fabricpath IS-IS domain: default
Note: The metric mentioned for multidestination tree is from the root of that tr
ee to that switch-id
MT-0
Topology 0, Tree 1, Swid routing table
123, L1
via port-channel110, metric 0
2768, L1
via port-channel110, metric 40
Topology 0, Tree 2, Swid routing table
3, L1
via port-channel110, metric 20
123, L1
via port-channel110, metric 20
2768, L1
via Ethernet8/10, metric 40
N7K-2(config-if)#
15.2.7. N55K-1
!
IP address verifications:
N55K-1(config)# sh ip int brief | ex unas
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan20 20.1.1.1 protocol-up/link-up/admin-up
VLAN verifications:
N55K-1(config)# sh vlan | in FABRIC
20 enet FABRICPATH
100 enet FABRICPATH
N55K-1(config)# sh int vlan 20 | in Hard
Hardware is EtherSVI, address is 547f.ee93.61bc
MAC Address verifications:
N55K-1(config)# sh mac address-table dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 20 0000.0c07.ac14 dynamic 0 F F 3.0.2047
* 20 f866.f206.fb43 dynamic 0 F F 123.0.1054
ISIS Adjacency verifications:
N55K-1(config)# sh fabricpath isis adjacency
Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
81 (Draft) V0.2
A printed copy of this document is considered uncontrolled
System ID SNPA Level State Hold Time Interface
f866.f206.fb43 N/A 1 UP 00:00:27 Ethernet1/1
18ef.63e3.dcc3 N/A 1 UP 00:00:23 Ethernet1/2
FP Switch-ID verifications:
N55K-1(config)# sh fabricpath isis switch-id
Fabricpath IS-IS domain: default
Fabricpath IS-IS Switch-ID Database
Legend: C - Confirmed, T - tentative, W - swap
S - sticky, E - Emulated Switch
'*' - this system
System-ID Primary Secondary Reachable Bcast-Priority
MT-0
18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]
18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]
547f.ee93.61bc* 2768[C] 0[C] Yes 64
f866.f206.fb43 123 [C] 0[C] Yes 255 [S]
f866.f206.fb43 3 [C] 0[C] Yes 0 [E]
N55K-1(config)# sh fabricpath switch-id
FABRICPATH SWITCH-ID TABLE
Legend: '*' - this system
=========================================================================
SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED
----------+----------------+------------+-----------+--------------------
3 18ef.63e3.dcc3 Primary Confirmed No Yes
3 f866.f206.fb43 Primary Confirmed No Yes
123 f866.f206.fb43 Primary Confirmed Yes No
124 18ef.63e3.dcc3 Primary Confirmed Yes No
*2768 547f.ee93.61bc Primary Confirmed No No
Total Switch-ids: 5
FP Route table verifications:
N55K-1(config)# sh fabricpath route
FabricPath Unicast Route Table
'a/b/c' denotes ftag/switch-id/subswitch-id
'[x/y]' denotes [admin distance/metric]
ftag 0 is local ftag
subswitch-id 0 is default subswitch-id
FabricPath Unicast Route Table for Topology-Default
0/2768/0, number of next-hops: 0
via ---- , [60/0], 14 day/s 07:55:26, local
1/3/0, number of next-hops: 2
via Eth1/1, [115/40], 0 day/s 00:33:57, isis_fabricpath-default
via Eth1/2, [115/40], 0 day/s 00:33:49, isis_fabricpath-default
1/123/0, number of next-hops: 1
via Eth1/1, [115/40], 0 day/s 00:33:57, isis_fabricpath-default
1/124/0, number of next-hops: 1
via Eth1/2, [115/40], 0 day/s 00:33:49, isis_fabricpath-default
N55K-1(config)#
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
82 (Draft) V0.2
A printed copy of this document is considered uncontrolled
15.2.8. N55K-2
!
VLAN verifications:
N55K-2(config)# sh vlan | in 40
40 VLAN0040 active Eth1/2
40 enet CE
IP address verifications:
N55K-2(config)# sh ip int brief | ex un
IP Interface Status for VRF "default"(1)
Interface IP Address Interface Status
Vlan40 40.1.1.1 protocol-up/link-up/admin-up
Trunk verifications:
N55K-2(config)# sh interface trunk | in 40
Eth1/2 40
Eth1/2 40
MAC Address verifications:
N55K-2(config)# sh inter vla 40 | in Hard
Hardware is EtherSVI, address is 547f.ee90.1501
N55K-2(config)# sh mac add dynamic
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link
VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
* 40 0000.0c07.ac28 dynamic 10 F F Eth1/2
* 40 f866.f206.fb43 dynamic 10 F F Eth1/2
N55K-2(config)#
15.3. Test Result
15.3.9. FP VLAN on N55K-1 Reaching N55K-2 FP edge device
!
N55K-1(config)# ping 40.1.1.1
PING 40.1.1.1 (40.1.1.1): 56 data bytes
64 bytes from 40.1.1.1: icmp_seq=0 ttl=253 time=3.072 ms
64 bytes from 40.1.1.1: icmp_seq=1 ttl=253 time=4.912 ms
64 bytes from 40.1.1.1: icmp_seq=2 ttl=253 time=4.974 ms
64 bytes from 40.1.1.1: icmp_seq=3 ttl=253 time=4.98 ms
64 bytes from 40.1.1.1: icmp_seq=4 ttl=253 time=4.972 ms
--- 40.1.1.1 ping statistics ---
5 packets transmitted, 5 packets received, 0.00% packet loss
round-trip min/avg/max = 3.072/4.582/4.98 ms
N55K-1(config)#
Scenario 4: FP VLAN Routed traffic to Single
homed FP edge Device
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study
CISCO PUBLIC
83 (Draft) V0.2
A printed copy of this document is considered uncontrolled
15.3.10. Single Homed N55K-2 Reaching the N55K-1 part of FP VLAN
!
N55K-2(config)# ping 20.1.1.1
PING 20.1.1.1 (20.1.1.1): 56 data bytes
64 bytes from 20.1.1.1: icmp_seq=0 ttl=253 time=3.063 ms
64 bytes from 20.1.1.1: icmp_seq=1 ttl=253 time=4.917 ms
64 bytes from 20.1.1.1: icmp_seq=2 ttl=253 time=4.975 ms
64 bytes from 20.1.1.1: icmp_seq=3 ttl=253 time=4.981 ms
64 bytes from 20.1.1.1: icmp_seq=4 ttl=253 time=4.982 ms
--- 20.1.1.1 ping statistics ---
5 packets transmitted, 5 packets received, 0.00% packet loss
round-trip min/avg/max = 3.063/4.583/4.982 ms
N55K-2(config)#
Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC
84 (Draft) V0.2
A printed copy of this document is considered uncontrolled
16. Summary
Cisco fabric path toplogy is extensively flexible and can be adopted for L2 extension even in the mixed vendor
environment. Thourough analysis must be made to ensure that L2 domains are extended properly in the production
environment to avoid any kind of traffic blackholes.
Corporate Headquarters
Cisco Systems, Inc.
170 West Tasman Drive San Jose, CA 95134-1706
USA
www.cisco.com Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 526-4100
European Headquarters
Cisco Systems Europe
11 Rue Camille Desmoulins 92782 Issy-Les-Moulineaux
Cedex 9
France www-europe.cisco.com
Tel: 33 1 58 04 60 00
Fax: 33 1 58 04 61 00
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive San Jose, CA 95134-1706
USA
www.cisco.com Tel: 408 526-7660
Fax: 408 527-0883
Asia Pacific Headquarters
Cisco Systems Australia, Pty., Ltd
Level 9, 80 Pacific Highway P.O. Box 469
North Sydney
NSW 2060 Australia www.cisco.com
Tel: +61 2 8448 7100
Fax: +61 2 9957 4350
Cisco Systems has more than 200 offices in the following countries and regions. Addresses, phone numbers, and fax numbers are listed on the
Cisco Web site at www.cisco.com/go/offices.
Argentina • Australia • Austria • Belgium • Brazil • Bulgaria • Canada • Chile • China • Colombia • Costa Rica • Croatia • Czech Republic Denmark • Dubai, UAE Finland •
France • Germany • Greece • Hong Kong SAR • Hungary • India • Indonesia • Ireland • Israel • Italy • Japan • Korea • Luxembourg • Malaysia • Mexico
The Netherlands • New Zealand • Norway • Peru • Philippines • Poland • Portugal • Puerto Rico • Romania • Russia • Saudi Arabia • Singapore • Slovakia • Slovenia South
Africa • Spain • Sweden • Switzerland • Taiwan • Thailand • Turkey • Ukraine • United Kingdom • United States • Venezuela • Vietnam • Zimbabwe