Nortel Networks L2/3 GbESM troubleshooting methodology | IBM

9.2 Nortel Networks L2/3 GbESM troubleshooting methodology

In this section, we discuss general troubleshooting techniques and offer options for getting started.

9.2.1 General comments on troubleshooting

Because of the highly integrated nature of the Nortel Networks L2/3 GbESM within the IBM Eserver BladeCenter, it is usually necessary to engage several teams for anything

beyond basic hardware troubleshooting. Experience has shown that the greater the communication between administrative groups, the more likely an issue can be resolved sooner rather than later.

Where do you start when troubleshooting? How do you determine whether it is a hardware or configuration issue and not a software bug?

The only true answer is experience.

Rather than attempting to list step-by-step procedures for every possible troubleshooting issue (which could fill several volumes and still not be complete), this section offers information about what to gather and commands that can be useful. The information here assumes that the person doing the troubleshooting has experience in such matters.

Chapter 9. Nortel Networks Layer 2/3 GbE Switch Module troubleshooting

157

Image 171

IBM manual Nortel Networks L2/3 GbESM troubleshooting methodology, General comments on troubleshooting

Contents

Redpaper Page International Technical Support Organization First Edition September Contents Page Troubleshooting tools Page Vii Trademarks Team that wrote this Redpaper Preface IBM RTP Become a published author Comments welcome Page Executive summary Page IBM Eserver BladeCenter overview IBM Eserver BladeCenter product family IBM Eserver BladeCenter and blade modules IBM Eserver BladeCenter storage solutions IBM Eserver BladeCenter architecture IBM Eserver BladeCenter system managementMidplane IBM BladeCenter Midplane Management Module Ethernet interface Management Module Ethernet Gigabit Ethernet path Gigabit Ethernet path IBM Eserver HS20 architecture PXH-D Stand-alone configuration tools Web interface Page Nortel Networks Layer 2/3 GbE Switch Modules Nortel Networks L2/3 GbESM connections Product description Nortel Networks Layer 2/3 GbE Switch Modules Competitive advantage Leadership features and functionValue proposition Product strength Supported hardware Product shipment groupSupported platforms Page Nortel Networks Layer 2/3 GbE Switch Module architecture Nortel Networks L2/3 GbESM architecture overview Nortel GbESM architecture overview GbESM2 Nortel Networks L2/3 GbESM block diagram Nortel Networks L2/3 GbESM block diagram Connections on the Nortel GbESM Nortel Networks L2/3 GbESM ports specific roles INT1 Nortel Networks Layer 2/3 GbE Switch Module architecture Page Nortel Networks L2/3 GbESM management and administration Management paths to the Nortel Networks L2/3 GbESM Nortel Networks L2/3 GbESM management connectivity Management Module Path Out-of-band management In-band management Serial port PathExternal Ethernet ports Path 3A In-band management considerations Internal Ethernet ports Path 3B IBM Eserver BladeCenter Management Module and I2C Command-line interfaceMain Menu commands Nortel Networks L2/3 GbESM user interface CLI Main Menu Global commands Navigation commands Configuration control commandsAdditional commands Upgrading the firmware Display of a firmware update using CLI Example 5-1 Example configuration file dump Capturing the current configuration Description of default user accounts Configuring user accounts Browser Based Interface Snmp management IBM Director Switch information using BBI Multiple Nortel Networks L2/3 GbESMs in a BladeCenter IBM Eserver BladeCenter system initial setup Management Module firmware IBM Eserver BladeCenter system Accessing the Management Module Web interface Management Module network interfaceEstablishing a physical connection to the Management Module Management Module External Network Interface window Configuring the Management Module network interfaces 3 I/O module management tasks Nortel Networks L2/3 GbESM setup and configuration I/O Module Tasks Management advanced setup Nortel Networks L2/3 GbESM firmware download Determining the level of Nortel switch software Blade server initial configuration Firmware updateUpdateXpress Firmware update Operating systems Microsoft Windows 2003 Broadcom driver installation Red Hat Linux Broadcom driver installation Broadcom Advanced Control Suite installation Select Control Suite and Basp Firmware and device drivers used in this example Page Copyright IBM Corp . All rights reserved Spanning Tree 802.1D, 802.1w, 802.1s Standards and technologiesVlan tagging 802.1Q Link Aggregation and Lacp 802.3ad Open Shortest Path First Ospf RFC1257, RFC2328, and others Routing Information Protocol RFC1058 and RFC2453 Virtual Router Redundancy Protocol Vrrp RFC Summary of sample configurationsWhere standards originate and how to get them Basic Layer 2 configuration Advanced Layer 2 configurations Layer 3 configuration static routingLayer 3 configurations dynamic routing Configuration Introduction to High AvailabilityIntroduction to trunk failover What trunk failover can protect against Introduction to NIC Teaming Vrrp Priority Introduction to Vrrp Cable type selection cross-over or straight-through Guidelines for attaching the BladeCenter to a networkSome important rules for ensuring High Availability Guidelines and comments Fiber connections Base configurations for examples in this documentIBM Eserver BladeCenter configuration Hardware and software used for lab environment Additional hardware used during the experiments Preconfiguration preparationCisco 3560G switch Nortel Networks L2/3 GbESM IP address and Vlan scheme Base configuration common to all examplesManagement Module settings for Nortel GbESMs Blade server configuration with Basp Basic Layer 2 entry topology Blade server 2 Basp configuration Layer 2 configuration with 802.1Q tagging and trunk failover Cisco 3560G switch configuration Example 7-2 Verifying the Vlan setupExample 7-1 Create the VLANs and IP interfaces first Example 7-3 Create IP addresses Said MTU Example 7-4 Links Nortel Networks L2/3 GbESM switch configuration Example 7-6 PVIDs set Example 7-7 Verifying the Vlan setup of the Nortel GbESM Example 7-7shows what has been configured so far Complete configuration snapshots Re-enable the ports INT2 INT3 EXT1 EXT2 Page Page Basic topology conclusions Advanced Layer 2 topology sample configurations 0.0 G0/24 Cisco 3560G G0/23 Core Dynamic link aggregation Ieee 802.3ad Lacp Port EXT5 tag ena pvid Port EXT6 tag ena pvid Common Spanning Tree configuration Ieee 802.1D and Pvst Configure the Cisco Core1 and Core2 for tagged Lacp trunksVerify the Lacp trunk status Enter apply to execute the configuration changes Reenable the ports Verify the Spanning Tree statusExample 7-11 Verifying port status and Vlan assignment Example 7-12 Verifying the Spanning Tree status 300 Ffff-0011f936b700 8004 Design or topology remarks Full configuration snapshots Def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM2 Page Page Page Rapid Spanning Tree Ieee 802.1w Configure the Cisco Core1 and Core2 for Rapid-PVST Design remarks Full configuration snapshots Def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM2 Page Page Multi-Spanning Tree Ieee 802.1s Configurations for use of MST Example 7-17 Mstp Information Display GbESM Key configuration commands to verify Mstp FWD Example 7-18 Mstp Information Display Cisco Example 7-19 Sample Mstp Configuration GbESMPage Example 7-20 Sample Mstp Configuration Cisco Page Implications of using Layer Layer 3 topology sample configurations Reasons for choosing a Layer 3 design Layer 3 sample configuration with static routing and Vrrp Merits of this configuration Summary of IP Addressing used in this sample Layer 3 sample configuration static routing, Vrrp Example 7-21 Layer 3 VLANs and ports for GbESM switches Configure VLANs and subnets for the uplink portsPage Configuration for Core1 address Example 7-22 Layer 3 VLANs and ports for Core switches Example 7-23 Vrrp Configuration for GbESMs Vrrp configuration Example 7-24 Vrrp Hot-standby configuration Configuration of Hot-standby for Vrrp Verifying operation of the configuration Reconnect procedure when configuration is ready Name Example 7-26 Verifying Vrrp status INT2 INT3 EXT3 Page Page Page Page Dynamic routing options OSPF/RIP 2summarizes the IP addresses in use. -7also shows these Configure additional VLANs and subnets for the uplink ports Page Example 7-30 Additional VLANs and Subnets Core switches Example 7-32 RIP configuration for the Core switches Configuring RIPConfiguring Ospf Example 7-31 RIP configuration for the GbESMs Example 7-36 GbESM commands to verify RIP Verifying operation of this configurationExample 7-34 Configuration for Core switch Example 7-35 Configuration for Core switch Example 7-37 Cisco commands to verify RIP RIP User Configuration Example 7-38 GbESM commands to verify Ospf GbESM commands to verify OspfPage Ospf Example 7-39 Cisco commands to verify Ospf Cisco commands to verify Ospf Userid L3/vrrp/on /c/l3/vrrp/vr Page Page Page Page Example 7-42 Extreme switch configuration Configuration for Extreme switchesPage Page Page Page Page Page Page Serial over LAN feature description and configuration General rules to establish an SOL connection SOL overview SOL use during Nortel Networks L2/3 GbESM experiments Configuring SOL for use with the Nortel GbESMPage Nortel Networks Layer 2/3 GbE Switch Module troubleshooting Basic rules Basic rules and unique symptoms General comments on troubleshooting Nortel Networks L2/3 GbESM troubleshooting methodology Systematic approach Problem definition Details from affected users Nortel GbESM Alteon OS switch dumpsData collection Test connectivity Observation of results Data analysisAction plan creation Action plan implementation Traceroute Troubleshooting toolsProblem resolution Ping Difference tool Tftp serverSyslog server Protocol analyzer Web load generator GbE Switch documents GbE Switch software imagesNetwork monitors or management systems Service and support Online services Placing a call to IBMOrdering information Listed here are other helpful Web sites Other support sitesPage Abbreviations and acronyms Pvid IBM Redbooks Other publicationsOnline resources Page Help from IBM How to get IBM RedbooksPage Page Nortel Networks L2/3