First Edition September | IBM L2/3 guide

Note: Before using this information and the product it supports, read the information in “Notices” on page vii.

First Edition (September 2005)

This edition applies to Nortel Networks Layer 2/3 Copper and Fiber GbE Switch Modules for IBM Eserver BladeCenter.

© Copyright International Business Machines Corporation 2005. All rights reserved.

Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Image 4

IBM L2/3 manual First Edition September

Contents

Redpaper Page International Technical Support Organization First Edition September Contents Page Troubleshooting tools Page Vii Trademarks Preface Team that wrote this Redpaper Become a published author IBM RTP Comments welcome Page Executive summary Page IBM Eserver BladeCenter overview IBM Eserver BladeCenter product family IBM Eserver BladeCenter storage solutions IBM Eserver BladeCenter and blade modules IBM Eserver BladeCenter system management IBM Eserver BladeCenter architectureMidplane IBM BladeCenter Midplane Management Module Ethernet Management Module Ethernet interface Gigabit Ethernet path IBM Eserver HS20 architecture Gigabit Ethernet path PXH-D Stand-alone configuration tools Web interface Page Nortel Networks Layer 2/3 GbE Switch Modules Product description Nortel Networks L2/3 GbESM connections Nortel Networks Layer 2/3 GbE Switch Modules Leadership features and function Value propositionProduct strength Competitive advantage Product shipment group Supported hardwareSupported platforms Page Nortel Networks Layer 2/3 GbE Switch Module architecture Nortel GbESM architecture overview Nortel Networks L2/3 GbESM architecture overview GbESM2 Nortel Networks L2/3 GbESM block diagram Nortel Networks L2/3 GbESM block diagram Nortel Networks L2/3 GbESM ports specific roles Connections on the Nortel GbESM INT1 Nortel Networks Layer 2/3 GbE Switch Module architecture Page Nortel Networks L2/3 GbESM management and administration Nortel Networks L2/3 GbESM management connectivity Management paths to the Nortel Networks L2/3 GbESM Out-of-band management Management Module Path Serial port Path In-band managementExternal Ethernet ports Path 3A Internal Ethernet ports Path 3B In-band management considerations Command-line interface Main Menu commandsNortel Networks L2/3 GbESM user interface IBM Eserver BladeCenter Management Module and I2C Global commands CLI Main Menu Configuration control commands Navigation commandsAdditional commands Display of a firmware update using CLI Upgrading the firmware Capturing the current configuration Example 5-1 Example configuration file dump Configuring user accounts Description of default user accounts Browser Based Interface Switch information using BBI Snmp management IBM Director Multiple Nortel Networks L2/3 GbESMs in a BladeCenter IBM Eserver BladeCenter system initial setup IBM Eserver BladeCenter system Management Module firmware Management Module network interface Accessing the Management Module Web interfaceEstablishing a physical connection to the Management Module Configuring the Management Module network interfaces Management Module External Network Interface window Nortel Networks L2/3 GbESM setup and configuration 3 I/O module management tasks I/O Module Tasks Management advanced setup Determining the level of Nortel switch software Nortel Networks L2/3 GbESM firmware download Firmware update Blade server initial configurationUpdateXpress Firmware update Microsoft Windows 2003 Broadcom driver installation Operating systems Broadcom Advanced Control Suite installation Red Hat Linux Broadcom driver installation Select Control Suite and Basp Firmware and device drivers used in this example Page Copyright IBM Corp . All rights reserved Standards and technologies Vlan tagging 802.1QLink Aggregation and Lacp 802.3ad Spanning Tree 802.1D, 802.1w, 802.1s Routing Information Protocol RFC1058 and RFC2453 Open Shortest Path First Ospf RFC1257, RFC2328, and others Summary of sample configurations Where standards originate and how to get themBasic Layer 2 configuration Virtual Router Redundancy Protocol Vrrp RFC Layer 3 configuration static routing Advanced Layer 2 configurationsLayer 3 configurations dynamic routing Introduction to High Availability ConfigurationIntroduction to trunk failover Introduction to NIC Teaming What trunk failover can protect against Introduction to Vrrp Vrrp Priority Guidelines for attaching the BladeCenter to a network Some important rules for ensuring High AvailabilityGuidelines and comments Cable type selection cross-over or straight-through Base configurations for examples in this document IBM Eserver BladeCenter configurationHardware and software used for lab environment Fiber connections Preconfiguration preparation Cisco 3560G switchNortel Networks L2/3 GbESM Additional hardware used during the experiments Base configuration common to all examples Management Module settings for Nortel GbESMsBlade server configuration with Basp IP address and Vlan scheme Blade server 2 Basp configuration Basic Layer 2 entry topology Layer 2 configuration with 802.1Q tagging and trunk failover Example 7-2 Verifying the Vlan setup Cisco 3560G switch configurationExample 7-1 Create the VLANs and IP interfaces first Said MTU Example 7-3 Create IP addresses Nortel Networks L2/3 GbESM switch configuration Example 7-4 Links Example 7-6 PVIDs set Example 7-7shows what has been configured so far Example 7-7 Verifying the Vlan setup of the Nortel GbESM Re-enable the ports Complete configuration snapshots INT2 INT3 EXT1 EXT2 Page Page Advanced Layer 2 topology sample configurations Basic topology conclusions 0.0 G0/24 Cisco 3560G G0/23 Core Dynamic link aggregation Ieee 802.3ad Lacp Port EXT5 tag ena pvid Port EXT6 tag ena pvid Configure the Cisco Core1 and Core2 for tagged Lacp trunks Common Spanning Tree configuration Ieee 802.1D and PvstVerify the Lacp trunk status Enter apply to execute the configuration changes Verify the Spanning Tree status Reenable the portsExample 7-11 Verifying port status and Vlan assignment Example 7-12 Verifying the Spanning Tree status 300 Ffff-0011f936b700 8004 Full configuration snapshots Design or topology remarks Def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM2 Page Page Page Configure the Cisco Core1 and Core2 for Rapid-PVST Rapid Spanning Tree Ieee 802.1w Design remarks Full configuration snapshots Def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM2 Page Page Configurations for use of MST Multi-Spanning Tree Ieee 802.1s Key configuration commands to verify Mstp Example 7-17 Mstp Information Display GbESM FWD Example 7-19 Sample Mstp Configuration GbESM Example 7-18 Mstp Information Display CiscoPage Example 7-20 Sample Mstp Configuration Cisco Page Layer 3 topology sample configurations Implications of using Layer Layer 3 sample configuration with static routing and Vrrp Reasons for choosing a Layer 3 design Merits of this configuration Layer 3 sample configuration static routing, Vrrp Summary of IP Addressing used in this sample Configure VLANs and subnets for the uplink ports Example 7-21 Layer 3 VLANs and ports for GbESM switchesPage Example 7-22 Layer 3 VLANs and ports for Core switches Configuration for Core1 address Vrrp configuration Example 7-23 Vrrp Configuration for GbESMs Configuration of Hot-standby for Vrrp Example 7-24 Vrrp Hot-standby configuration Reconnect procedure when configuration is ready Verifying operation of the configuration Name Example 7-26 Verifying Vrrp status INT2 INT3 EXT3 Page Page Page Page Dynamic routing options OSPF/RIP 2summarizes the IP addresses in use. -7also shows these Configure additional VLANs and subnets for the uplink ports Page Example 7-30 Additional VLANs and Subnets Core switches Configuring RIP Configuring OspfExample 7-31 RIP configuration for the GbESMs Example 7-32 RIP configuration for the Core switches Verifying operation of this configuration Example 7-34 Configuration for Core switchExample 7-35 Configuration for Core switch Example 7-36 GbESM commands to verify RIP RIP User Configuration Example 7-37 Cisco commands to verify RIP GbESM commands to verify Ospf Example 7-38 GbESM commands to verify OspfPage Ospf Cisco commands to verify Ospf Example 7-39 Cisco commands to verify Ospf Userid L3/vrrp/on /c/l3/vrrp/vr Page Page Page Page Configuration for Extreme switches Example 7-42 Extreme switch configurationPage Page Page Page Page Page Page Serial over LAN feature description and configuration SOL overview General rules to establish an SOL connection Configuring SOL for use with the Nortel GbESM SOL use during Nortel Networks L2/3 GbESM experimentsPage Nortel Networks Layer 2/3 GbE Switch Module troubleshooting Basic rules and unique symptoms Basic rules Nortel Networks L2/3 GbESM troubleshooting methodology General comments on troubleshooting Problem definition Systematic approach Nortel GbESM Alteon OS switch dumps Data collectionTest connectivity Details from affected users Data analysis Action plan creationAction plan implementation Observation of results Troubleshooting tools Problem resolutionPing Traceroute Tftp server Difference toolSyslog server Web load generator Protocol analyzer GbE Switch software images GbE Switch documentsNetwork monitors or management systems Service and support Placing a call to IBM Online servicesOrdering information Other support sites Listed here are other helpful Web sitesPage Abbreviations and acronyms Pvid Other publications IBM RedbooksOnline resources Page How to get IBM Redbooks Help from IBMPage Page Nortel Networks L2/3