Cisco Systems DSC9148D8G48PK9 PortChannel Modes

6-6

Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide

OL-29284-01, Release 6.x

Chapter 6 Configuring PortChannels

Information About PortChannels

Figure 6-5 SID1, DID1, and Exchange-Based Load Balancing

For more information on configuring load balancing and in-order delivery features, see the Cisco MDS

9000 Family NX-OS Fabric Configuration Guide.

PortChannel Modes

You can configure each PortChannel with a channel group mode parameter to determine the PortChannel

protocol behavior for all member ports in this channel group. The possible values for a channel group

mode are as follows:

• ON (default)—The member ports only operate as part of a PortChannel or remain inactive. In this

mode, the PortChannel protocol is not initiated. However, if a PortChannel protocol frame is

received from a peer port, the software indicates its nonnegotiable status. This mode is backward

compatible with the existing implementation of PortChannels in releases prior to Release 2.0(1b),

where the channel group mode is implicitly assumed to be ON. In Cisco MDS SAN-OS Releases

1.3 and earlier, the only available PortChannel mode was the ON mode. PortChannels configured in

the ON mode require you to explicitly enable and disable the PortChannel member ports at either

end if you add or remove ports from the PortChannel configuration. You must physically verify that

the local and remote ports are connected to each other.

• ACTIVE—The member ports initiate PortChannel protocol negotiation with the peer port(s)

regardless of the channel group mode of the peer port. If the peer port, while configured in a channel

group, does not support the PortChannel protocol, or responds with a nonnegotiable status, it will

default to the ON mode behavior. The ACTIVE PortChannel mode allows automatic recovery

without explicitly enabling and disabling the PortChannel member ports at either end.

Frame 1

Frame 2

Frame 3

Frame 1

Frame 2

Frame 3

Frame n

Frame n

SID1, DID1,

Exchange 1

SID1, DID1,

Exchange 2

Link 1

Link 2

Link 1

Link 2

79531

Contents

Main Page CONTENTS Page Page Page Page Page Page Page Page Page New and Changed Information Page Preface Audience Organization Document Conventions Related Documentation Release Notes Regulatory Compliance and Safety Information Compatibility Information Hardware Installation Obtaining Documentation and Submitting a Service Request Interfaces Overview Trunks and PortChannels Fibre Channel Port Rate Limiting Extended Credits N Port Virtualization FlexAttach Page Page Configuring Interfaces Information About Interfaces Interface Description Interface Modes E Port F Port FL Port NP Ports TL Port TE Port TF Port TNP Port SD Port ST Port Fx Port B Port Interface States Administrative States Operational States Reason Codes Page Page Graceful Shutdown Port Administrative Speeds Autosensing Frame Encapsulation Beacon LEDs Speed LEDs Bit Error Thresholds 2 1 43 SFP Transmitter Types TL Ports TL Port ALPA Caches Port Guard Port Monitor Port Monitor Port Guard Port Group Monitor Local Switching Slow Drain Device Detection and Congestion Avoidance Management Interfaces VSAN Interfaces Prerequisites for Interfaces Generation 1 Interface Configuration Guidelines Private Loop Configuration Guidelines VSAN Interface Configuration Guidelines Configuring Interfaces Configuring Fibre Channel Interfaces Setting the Interface Administrative State Configuring Interface Modes Configuring System Default Port Mode F Configuring ISL between Two Switches Configuring 10-Gbps FC Mode Configuring Port Administrative Speeds Configuring Port Speed Group Configuring the Interface Description Specifying a Port Owner Configuring Beacon Mode Disabling Bit Error Threshold Configuring Switch Port Attribute Default Values Configuring TL Ports Manually Inserting Entries into the ALPA Cache Clearing the ALPA Cache Configuring Port Guard Configuring Port Monitor Enabling Port Monitor Configuring a Port Monitor Policy 2-33 Command Purpose Step 10 switch(config-port-monitor)# counter Step 11 switch(config-port-monitor)# counter Specifies the delta protocol error poll interval in seconds, the thresholds in percentage, and the Configuring a Port Monitor Port Guard Configuring Port Group Monitor Enabling Port Group Monitor Configuring a Port Group Monitor Policy 2-36 Reverting to the Default Policy for a Specific Counter Turning Off the Monitoring of Specific Counter Activating a Port Group Monitor Policy Configuring Management Interfaces Creating VSAN Interfaces Configuring Congestion Frame Timeout Value Configuring Stuck Frame Timeout Value Configuring No-Credit Timeout Value Configuring Credit Loss Recovery Threshold and Action Configuring Average Credit Nonavailable Duration Threshold and Action Verifying Interfaces Configuration 2-42 Displaying Interface Information Example 2-3 Displays All Interfaces 2-43 2-44 Example 2-5 Displays a Specific Interface 2-45 Example 2-6 Displays Port Description Example 2-7 Displays Interface Information in a Brief Format 2-46 Example 2-8 Displays Interface Counters 2-47 2-48 if the SFP is present (see Example 2-10). Example 2-10 Displays Transceiver Information Example 2-11 Displays the Running Configuration for All Interfaces 2-49 Example 2-12 Displays the Running Configuration for a Specified Interface 2-50 Displaying TL Port Information Example 2-17 Displays the TL Ports in All VSANs Displaying the ALPA Cache Contents Displaying Port Monitor Status and Policies 2-52 2-53 Displaying Port Group Monitor Status and Policies The following commands display information about port group monitor: 2-54 2-55 Displaying Management Interface Configuration To display the management interface configuration, use the show interface mgmt 0 command. Displaying VSAN Interface Information To display VSAN interface information, use the show interface vsan command. Page Configuring Fibre Channel Interfaces Information About Fibre Channel Interfaces Generations of Modules and Switches Page Port Groups Page Port Rate Modes Page Dedicated Rate Mode Shared Rate Mode Dedicated Rate Mode Configurations for the 8-Gbps Modules Port Speed Dynamic Bandwidth Management Out-of-Service Interfaces Oversubscription Ratio Restrictions Page 3-13 3-14 3-15 3-16 Bandwidth Fairness Upgrade or Downgrade Scenario Combining Generation 1, Generation 2, Generation 3, and Generation 4 Modules Local Switching Limitations Port Index Limitations Page PortChannel Limitations Page Page Page Page Configuring Fibre Channel Interfaces Task Flow for Migrating Interfaces from Shared Mode to Dedicated Mode Task Flow for Migrating Interfaces from Dedicated Mode to Shared Mode Task Flow for Configuring 12-Port 4-Gbps Module Interfaces Task Flow for Configuring 4-Port 10-Gbps Module Interfaces Configuring Port Speed Configuring Rate Mode Displaying the Rate Mode Configuration for Interfaces 3-32 This example shows the port rate mode configuration for interfaces on a 48-port 8-Gbps module: 3-33 3-34 This example shows the port rate mode configuration for interfaces on a 4/44-port 8-Gbps module: 3-35 Configuring Local Switching Disabling Restrictions on Oversubscription Ratios 3-38 Step 3 Display the interface status to confirm the shutdown of all shared ports. Enabling Restrictions on Oversubscription Ratios Enabling Bandwidth Fairness Disabling Bandwidth Fairness Taking Interfaces Out of Service Releasing Shared Resources in a Port Group Disabling ACL Adjacency Sharing for System Image Downgrade Verifying Fibre Channel Interfaces Configuration Displaying Interface Capabilities 3-45 Displaying SFP Diagnostic Information Configuration Examples for Fibre Channel Interfaces This section describes example configurations and includes the following sections: Configuration Example for 48-Port 8-Gbps Module Interfaces Configuration Example for 24-Port 8-Gbps Module Interfaces Configuration Example for 4/44-Port 8-Gbps Module Interfaces Configuration Example for 48-Port 4-Gbps Module Interfaces Configuration Example for 24-Port 4-Gbps Module Interfaces Page Configuring Interface Buffers Information About Interface Buffers Buffer-to-Buffer Credits Performance Buffers Buffer Pools 4-3 4-4 BB_Credit Buffers for Switching Modules Configuring Buffer Credits on a Generation 2, Generation 3 or Generation 4 Module 48-Port 8-Gbps Advanced Fibre Channel Module BB_Credit Buffers 48-Port 8-Gbps Fibre Channel Module 24-Port 8-Gbps Fibre Channel Module 4/44-Port 8-Gbps Host-Optimized Fibre Channel Module BB_Credit Buffers 48-Port 4-Gbps Fibre Channel Module 4-11 Module Interfaces section on page 3-48. 24-Port 4-Gbps Fibre Channel Module BB_Credit Buffers 18-Port Fibre Channel/4-Port Gigabit Ethernet Multiservice Module BB_Credit Buffers 12-Port 4-Gbps Switching Module BB_Credit Buffers Page 4-Port 10-Gbps Switching Module BB_Credit Buffers BB_Credit Buffers for Fabric Switches Cisco MDS 9148 Fabric Switch BB_Credit Buffers Cisco MDS 9134 Fabric Switch BB_Credit Buffers Cisco MDS 9124 Fabric Switch BB_Credit Buffers Cisco MDS 9222i Multiservice Modular Switch BB_Credit Buffers Extended BB_Credits Extended BB_credits on Generation 1 Switching Modules Extended BB_credits on Generation 2 and Generation 3 Switching Modules Buffer-to-Buffer Credit Recovery Buffer-to-Buffer State Change Number Receive Data Field Size Configuring Interface Buffers Configuring Buffer-to-Buffer Credits Configuring Performance Buffers Configuring Extended BB_credits Enabling Buffer-to-Buffer Credit Recovery Enabling the Buffer-to-Buffer State Change Number Configuring Receive Data Field Size Verifying BB_Credit Configuration 4-26 Configuring Trunking Information About Trunking Trunking E Ports Trunking F Ports 1a 2 4 3 5 1b Key Concepts Trunking Protocols Trunk Modes Trunk-Allowed VSAN Lists and VF_IDs Page General Guidelines and Limitations Upgrade and Downgrade Limitations Difference Between TE Ports and TF-TNP Ports 5-9 Trunking Misconfiguration Examples Configuring Trunking Enabling the Cisco Trunking and Channeling Protocols Enabling the F Port Trunking and Channeling Protocol Configuring Trunk Mode Configuring an Allowed-Active List of VSANs Verifying Trunking Configuration 5-14 Example 5-2 Displays the Trunking Protocol Example 5-3 Displays Per VSAN Information on Trunk Ports Configuration Example for F Port Trunking Step 1 Enable the F port trunking and channeling protocol on the MDS core switch: Step 2 Enable NPIV on the MDS core switch: Step 3 Configure the port mode to auto, F, or Fx on the MDS core switch: Step 4 Configure the trunk mode to ON on the MDS core switch: Page Page Configuring PortChannels Information About PortChannels PortChannels Overview E PortChannels F and TF PortChannels PortChanneling and Trunking Load Balancing 6-5 PortChannel Modes PortChannel Deletion Interfaces in a PortChannel Interface Addition to a PortChannel Compatibility Check Suspended and Isolated States Forcing an Interface Addition Interface Deletion from a PortChannel PortChannel Protocols Channel Group Creation Autocreation Manually Configured Channel Groups Prerequisites for PortChannels General Guidelines and Limitations Generation 1 PortChannel Limitations F and TF PortChannel Limitations Valid and Invalid PortChannel Examples 6-16 Table 6-3 lists the default settings for PortChannels. Configuring PortChannels Configuring PortChannels Using the WizardCreating a PortChannel Configuring the PortChannel Mode Deleting PortChannels Adding an Interface to a PortChannel Forcing an Interface Addition Deleting an Interface from a PortChannel Enabling and Configuring Autocreation Converting to Manually Configured Channel Groups Verifying PortChannel Configuration Page 6-22 The show port-channel consistency command has two options: without details and with details. Example 6-4 Displays the Consistency Status without Details Example 6-5 Displays the Consistency Status with Details 6-23 The show port-channel usage command displays details of the used and unused PortChannel numbers. Example 6-6 Displays the PortChannel Usage Example 6-7 Displays the PortChannel Compatibility Example 6-8 Displays Autocreated PortChannels Configuration Examples for F and TF PortChannels Step 1 Enable the F port trunking and channeling protocol on the MDS core switch. Step 2 Enable NPIV on the MDS core switch: Step 3 Create the PortChannel on the MDS core switch: Step 4 Configure the PortChannel member interfaces on the core switch: Page 6-26 Step 6 Configure the PortChannel member interfaces on the NPV switch in dedicated mode: NPV switch to ON: Configuring N Port Virtualization Information About N Port Virtualization NPV Overview N Port Identifier Virtualization N Port Virtualization 7-3 NPV Mode NP Ports NP Links Internal FLOGI Parameters Default Port Numbers NPV CFS Distribution over IP NPV Traffic Management Auto Traffic Map Disruptive Multiple VSAN Support NPV Guidelines and Requirements NPV Traffic Management Guidelines DPVM Configuration Guidelines NPV and Port Security Configuration Guidelines Configuring N Port Virtualization Enabling N Port Identifier Virtualization Configuring NPV Page Configuring NPV Traffic Management Configuring List of External Interfaces per Server Interface Enabling the Global Policy for Disruptive Load Balancing Verifying NPV Configuration 7-14 Verifying NPV 7-15 Verifying NPV Traffic Management To display the NPV traffic map, enter the show npv traffic-map command. To display the NPV internal traffic details, enter the show npv internal info traffic-map command. Page Configuring FlexAttach Virtual pWWN Information About FlexAttach Virtual pWWN FlexAttach Virtual pWWN Difference Between San Device Virtualization and FlexAttach Port Virtualization FlexAttach Virtual pWWN CFS Distribution Security Settings for FlexAttach Virtual pWWN Configuring FlexAttach Virtual pWWN Automatically Assigning FlexAttach Virtual pWWN Manually Assigning FlexAttach Virtual pWWN Mapping pWWN to Virtual pWWN Verifying FlexAttach Virtual pWWN Configuration Verifying the End Device Monitoring FlexAttach Virtual pWWN Page Page Configuring Port Tracking Information About Port Tracking Page Configuring Port Tracking Enabling Port Tracking Information About Configuring Linked Ports Binding a Tracked Port Operationally Information About Tracking Multiple Ports Tracking Multiple Ports Information About Monitoring Ports in a VSAN Monitoring Ports in a VSAN Information AboutForceful Shutdown Forcefully Shutting Down a Tracked Port Displaying Port Tracking Information 9-7 Example 9-2 Displays a Tracked Port Configuration for a Fibre Channel Interface Example 9-3 Displays a Tracked Port Configuration for a PortChannel Interface 9-8 Example 9-4 Displays a Forced Shutdown Configuration INDEX Symbols Numerics A B C D E F G I L M N O P R S T V W Z