Cisco Systems DSC9148D8G48PK9 PortChannel Limitations

3-21

Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide

OL-29284-01, Release 6.x

Chapter 3 Configuring Fibre Channel Interfaces

Guidelines and Limitations

13 68-ef-bd-a8-40-00 to 68-ef-bd-a8-40-04 JAF1450BMBP

Xbar Ports Module-Type Model Status

--- ----- ----------------------------------- ------------------ ----------

1 0 Fabric Module 3 DS-13SLT-FAB3 ok

2 0 Fabric Module 3 DS-13SLT-FAB3 ok

Xbar Sw Hw World-Wide-Name(s) (WWN)

--- -------------- ------ --------------------------------------------------

1 NA 0.4 --

2 NA 0.4 --

Xbar MAC-Address(es) Serial-Num

--- -------------------------------------- ----------

1 NA JAF1451AMHG

2 NA JAF1451AMHN

* this terminal session

The running configuration is updated when modules are installed. If you save the running configuration

to the startup configuration (using the copy running-config startup-config command), during reboot

the switch powers up the same set of modules as before the reboot regardless of the sequence in which

the modules initialize. You can use the show port index-allocation startup command to display the

index allocation the switch uses at startup.

switch# show port index-allocation startup

Startup module index distribution:

------------------------------------------------------+

Slot | Allowed | Alloted indices info |

| range | Total | Index values |

-----|---------|-------|------------------------------|

1 | ----- | 34 | 0-31,80-81 |

2 | ----- | 32 | 32-63 |

3 | ----- | 16 | 64-79 |(Slot 1 shares 80-81)

4 | ----- | 48 | 96-127,224-239 |

SUP | 253-255 | 3 | 253-255 |

Note The output of the show port index-allocation startup command does not display anything in the

Allowed range column because the command extracts the indices from the persistent storage service

(PSS) and displaying an allowed range for startup indices is meaningless.

If a module fails to power up, you can use the show module slot recovery-steps command to display

the reason.

For information on recovering a module powered-down because port indexes are not available, refer to

the Cisco MDS 9000 Family Troubleshooting Guide.

Tip Whenever using mixed Generation 1 and Generation 2 modules, power up the Generation 1 modules

first. During a reboot of the entire switch, the Generation 1 modules power up first (default behavior).

PortChannel Limitations

PortChannels have the following restrictions:

Contents

Main Page CONTENTS Page Page Page Page Page Page Page Page Page New and Changed Information Page Preface Audience Organization Document Conventions Related Documentation Release Notes Regulatory Compliance and Safety Information Compatibility Information Hardware Installation Obtaining Documentation and Submitting a Service Request Interfaces Overview Trunks and PortChannels Fibre Channel Port Rate Limiting Extended Credits N Port Virtualization FlexAttach Page Page Configuring Interfaces Information About Interfaces Interface Description Interface Modes E Port F Port FL Port NP Ports TL Port TE Port TF Port TNP Port SD Port ST Port Fx Port B Port Interface States Administrative States Operational States Reason Codes Page Page Graceful Shutdown Port Administrative Speeds Autosensing Frame Encapsulation Beacon LEDs Speed LEDs Bit Error Thresholds 2 1 43 SFP Transmitter Types TL Ports TL Port ALPA Caches Port Guard Port Monitor Port Monitor Port Guard Port Group Monitor Local Switching Slow Drain Device Detection and Congestion Avoidance Management Interfaces VSAN Interfaces Prerequisites for Interfaces Generation 1 Interface Configuration Guidelines Private Loop Configuration Guidelines VSAN Interface Configuration Guidelines Configuring Interfaces Configuring Fibre Channel Interfaces Setting the Interface Administrative State Configuring Interface Modes Configuring System Default Port Mode F Configuring ISL between Two Switches Configuring 10-Gbps FC Mode Configuring Port Administrative Speeds Configuring Port Speed Group Configuring the Interface Description Specifying a Port Owner Configuring Beacon Mode Disabling Bit Error Threshold Configuring Switch Port Attribute Default Values Configuring TL Ports Manually Inserting Entries into the ALPA Cache Clearing the ALPA Cache Configuring Port Guard Configuring Port Monitor Enabling Port Monitor Configuring a Port Monitor Policy 2-33 Command Purpose Step 10 switch(config-port-monitor)# counter Step 11 switch(config-port-monitor)# counter Specifies the delta protocol error poll interval in seconds, the thresholds in percentage, and the Configuring a Port Monitor Port Guard Configuring Port Group Monitor Enabling Port Group Monitor Configuring a Port Group Monitor Policy 2-36 Reverting to the Default Policy for a Specific Counter Turning Off the Monitoring of Specific Counter Activating a Port Group Monitor Policy Configuring Management Interfaces Creating VSAN Interfaces Configuring Congestion Frame Timeout Value Configuring Stuck Frame Timeout Value Configuring No-Credit Timeout Value Configuring Credit Loss Recovery Threshold and Action Configuring Average Credit Nonavailable Duration Threshold and Action Verifying Interfaces Configuration 2-42 Displaying Interface Information Example 2-3 Displays All Interfaces 2-43 2-44 Example 2-5 Displays a Specific Interface 2-45 Example 2-6 Displays Port Description Example 2-7 Displays Interface Information in a Brief Format 2-46 Example 2-8 Displays Interface Counters 2-47 2-48 if the SFP is present (see Example 2-10). Example 2-10 Displays Transceiver Information Example 2-11 Displays the Running Configuration for All Interfaces 2-49 Example 2-12 Displays the Running Configuration for a Specified Interface 2-50 Displaying TL Port Information Example 2-17 Displays the TL Ports in All VSANs Displaying the ALPA Cache Contents Displaying Port Monitor Status and Policies 2-52 2-53 Displaying Port Group Monitor Status and Policies The following commands display information about port group monitor: 2-54 2-55 Displaying Management Interface Configuration To display the management interface configuration, use the show interface mgmt 0 command. Displaying VSAN Interface Information To display VSAN interface information, use the show interface vsan command. Page Configuring Fibre Channel Interfaces Information About Fibre Channel Interfaces Generations of Modules and Switches Page Port Groups Page Port Rate Modes Page Dedicated Rate Mode Shared Rate Mode Dedicated Rate Mode Configurations for the 8-Gbps Modules Port Speed Dynamic Bandwidth Management Out-of-Service Interfaces Oversubscription Ratio Restrictions Page 3-13 3-14 3-15 3-16 Bandwidth Fairness Upgrade or Downgrade Scenario Combining Generation 1, Generation 2, Generation 3, and Generation 4 Modules Local Switching Limitations Port Index Limitations Page PortChannel Limitations Page Page Page Page Configuring Fibre Channel Interfaces Task Flow for Migrating Interfaces from Shared Mode to Dedicated Mode Task Flow for Migrating Interfaces from Dedicated Mode to Shared Mode Task Flow for Configuring 12-Port 4-Gbps Module Interfaces Task Flow for Configuring 4-Port 10-Gbps Module Interfaces Configuring Port Speed Configuring Rate Mode Displaying the Rate Mode Configuration for Interfaces 3-32 This example shows the port rate mode configuration for interfaces on a 48-port 8-Gbps module: 3-33 3-34 This example shows the port rate mode configuration for interfaces on a 4/44-port 8-Gbps module: 3-35 Configuring Local Switching Disabling Restrictions on Oversubscription Ratios 3-38 Step 3 Display the interface status to confirm the shutdown of all shared ports. Enabling Restrictions on Oversubscription Ratios Enabling Bandwidth Fairness Disabling Bandwidth Fairness Taking Interfaces Out of Service Releasing Shared Resources in a Port Group Disabling ACL Adjacency Sharing for System Image Downgrade Verifying Fibre Channel Interfaces Configuration Displaying Interface Capabilities 3-45 Displaying SFP Diagnostic Information Configuration Examples for Fibre Channel Interfaces This section describes example configurations and includes the following sections: Configuration Example for 48-Port 8-Gbps Module Interfaces Configuration Example for 24-Port 8-Gbps Module Interfaces Configuration Example for 4/44-Port 8-Gbps Module Interfaces Configuration Example for 48-Port 4-Gbps Module Interfaces Configuration Example for 24-Port 4-Gbps Module Interfaces Page Configuring Interface Buffers Information About Interface Buffers Buffer-to-Buffer Credits Performance Buffers Buffer Pools 4-3 4-4 BB_Credit Buffers for Switching Modules Configuring Buffer Credits on a Generation 2, Generation 3 or Generation 4 Module 48-Port 8-Gbps Advanced Fibre Channel Module BB_Credit Buffers 48-Port 8-Gbps Fibre Channel Module 24-Port 8-Gbps Fibre Channel Module 4/44-Port 8-Gbps Host-Optimized Fibre Channel Module BB_Credit Buffers 48-Port 4-Gbps Fibre Channel Module 4-11 Module Interfaces section on page 3-48. 24-Port 4-Gbps Fibre Channel Module BB_Credit Buffers 18-Port Fibre Channel/4-Port Gigabit Ethernet Multiservice Module BB_Credit Buffers 12-Port 4-Gbps Switching Module BB_Credit Buffers Page 4-Port 10-Gbps Switching Module BB_Credit Buffers BB_Credit Buffers for Fabric Switches Cisco MDS 9148 Fabric Switch BB_Credit Buffers Cisco MDS 9134 Fabric Switch BB_Credit Buffers Cisco MDS 9124 Fabric Switch BB_Credit Buffers Cisco MDS 9222i Multiservice Modular Switch BB_Credit Buffers Extended BB_Credits Extended BB_credits on Generation 1 Switching Modules Extended BB_credits on Generation 2 and Generation 3 Switching Modules Buffer-to-Buffer Credit Recovery Buffer-to-Buffer State Change Number Receive Data Field Size Configuring Interface Buffers Configuring Buffer-to-Buffer Credits Configuring Performance Buffers Configuring Extended BB_credits Enabling Buffer-to-Buffer Credit Recovery Enabling the Buffer-to-Buffer State Change Number Configuring Receive Data Field Size Verifying BB_Credit Configuration 4-26 Configuring Trunking Information About Trunking Trunking E Ports Trunking F Ports 1a 2 4 3 5 1b Key Concepts Trunking Protocols Trunk Modes Trunk-Allowed VSAN Lists and VF_IDs Page General Guidelines and Limitations Upgrade and Downgrade Limitations Difference Between TE Ports and TF-TNP Ports 5-9 Trunking Misconfiguration Examples Configuring Trunking Enabling the Cisco Trunking and Channeling Protocols Enabling the F Port Trunking and Channeling Protocol Configuring Trunk Mode Configuring an Allowed-Active List of VSANs Verifying Trunking Configuration 5-14 Example 5-2 Displays the Trunking Protocol Example 5-3 Displays Per VSAN Information on Trunk Ports Configuration Example for F Port Trunking Step 1 Enable the F port trunking and channeling protocol on the MDS core switch: Step 2 Enable NPIV on the MDS core switch: Step 3 Configure the port mode to auto, F, or Fx on the MDS core switch: Step 4 Configure the trunk mode to ON on the MDS core switch: Page Page Configuring PortChannels Information About PortChannels PortChannels Overview E PortChannels F and TF PortChannels PortChanneling and Trunking Load Balancing 6-5 PortChannel Modes PortChannel Deletion Interfaces in a PortChannel Interface Addition to a PortChannel Compatibility Check Suspended and Isolated States Forcing an Interface Addition Interface Deletion from a PortChannel PortChannel Protocols Channel Group Creation Autocreation Manually Configured Channel Groups Prerequisites for PortChannels General Guidelines and Limitations Generation 1 PortChannel Limitations F and TF PortChannel Limitations Valid and Invalid PortChannel Examples 6-16 Table 6-3 lists the default settings for PortChannels. Configuring PortChannels Configuring PortChannels Using the WizardCreating a PortChannel Configuring the PortChannel Mode Deleting PortChannels Adding an Interface to a PortChannel Forcing an Interface Addition Deleting an Interface from a PortChannel Enabling and Configuring Autocreation Converting to Manually Configured Channel Groups Verifying PortChannel Configuration Page 6-22 The show port-channel consistency command has two options: without details and with details. Example 6-4 Displays the Consistency Status without Details Example 6-5 Displays the Consistency Status with Details 6-23 The show port-channel usage command displays details of the used and unused PortChannel numbers. Example 6-6 Displays the PortChannel Usage Example 6-7 Displays the PortChannel Compatibility Example 6-8 Displays Autocreated PortChannels Configuration Examples for F and TF PortChannels Step 1 Enable the F port trunking and channeling protocol on the MDS core switch. Step 2 Enable NPIV on the MDS core switch: Step 3 Create the PortChannel on the MDS core switch: Step 4 Configure the PortChannel member interfaces on the core switch: Page 6-26 Step 6 Configure the PortChannel member interfaces on the NPV switch in dedicated mode: NPV switch to ON: Configuring N Port Virtualization Information About N Port Virtualization NPV Overview N Port Identifier Virtualization N Port Virtualization 7-3 NPV Mode NP Ports NP Links Internal FLOGI Parameters Default Port Numbers NPV CFS Distribution over IP NPV Traffic Management Auto Traffic Map Disruptive Multiple VSAN Support NPV Guidelines and Requirements NPV Traffic Management Guidelines DPVM Configuration Guidelines NPV and Port Security Configuration Guidelines Configuring N Port Virtualization Enabling N Port Identifier Virtualization Configuring NPV Page Configuring NPV Traffic Management Configuring List of External Interfaces per Server Interface Enabling the Global Policy for Disruptive Load Balancing Verifying NPV Configuration 7-14 Verifying NPV 7-15 Verifying NPV Traffic Management To display the NPV traffic map, enter the show npv traffic-map command. To display the NPV internal traffic details, enter the show npv internal info traffic-map command. Page Configuring FlexAttach Virtual pWWN Information About FlexAttach Virtual pWWN FlexAttach Virtual pWWN Difference Between San Device Virtualization and FlexAttach Port Virtualization FlexAttach Virtual pWWN CFS Distribution Security Settings for FlexAttach Virtual pWWN Configuring FlexAttach Virtual pWWN Automatically Assigning FlexAttach Virtual pWWN Manually Assigning FlexAttach Virtual pWWN Mapping pWWN to Virtual pWWN Verifying FlexAttach Virtual pWWN Configuration Verifying the End Device Monitoring FlexAttach Virtual pWWN Page Page Configuring Port Tracking Information About Port Tracking Page Configuring Port Tracking Enabling Port Tracking Information About Configuring Linked Ports Binding a Tracked Port Operationally Information About Tracking Multiple Ports Tracking Multiple Ports Information About Monitoring Ports in a VSAN Monitoring Ports in a VSAN Information AboutForceful Shutdown Forcefully Shutting Down a Tracked Port Displaying Port Tracking Information 9-7 Example 9-2 Displays a Tracked Port Configuration for a Fibre Channel Interface Example 9-3 Displays a Tracked Port Configuration for a PortChannel Interface 9-8 Example 9-4 Displays a Forced Shutdown Configuration INDEX Symbols Numerics A B C D E F G I L M N O P R S T V W Z