Executive summary | IBM L2/3 manual

1

Chapter 1. Executive summary

IBM and Nortel Networks are committed to collaborating on the design and development of server and networking technology to address customer requirements by establishing a joint

development center. The Nortel Networks Layer 2/3 Copper and Fiber GbE Switch Modules for IBM Eserver BladeCenter (Nortel Networks L2/3 GbESM and Nortel GbESM) represents

a new height in this alliance.

The BladeCenter switch module offers BladeCenter customers Nortel’s latest fiber and copper Gigabit Ethernet switching technology which is integrated into the BladeCenter chassis. It further enhances the BladeCenter value proposition by seamlessly interfacing to a customer’s existing data network using six external multimode fiber or copper GbE interfaces.

When installed in the BladeCenter chassis, Nortel Networks L2/3 GbESM provides both full L2 switching and L3 routing capabilities and significant added value not found in commodity switching solutions. This value includes:

VLAN tagging - 802.1Q

Link Aggregation and LACP - 802.3ad and 802.3-2002

Spanning Tree - 802.1D, 802.1w, 802.1s

Routing Information Protocol - RFC1058 and RFC2453

Open Shortest Path First (OSPF) - RFC1257, RFC2328, and others

Virtual Router Redundancy Protocol (VRRP) - RFC 3768

Each Nortel Networks L2/3 GbESM provides one Gigabit per second Ethernet (GbE)

connectivity to each of the 14 blade slots and six GbE uplink interfaces external to the IBM Eserver BladeCenter. The customer can install as few as one Nortel Networks L2/3

GbESM or as many as four Nortel Networks L2/3 GbESMs in one BladeCenter chassis. With four Nortel Networks L2/3 GbESMs installed, you can obtain 24 GbE uplink interfaces as well as 56 GbE internal switching capability. The flexibility of the Nortel Networks L2/3 GbESM allows you to address a variety of performance and redundancy needs.

© Copyright IBM Corp. 2005. All rights reserved.

1

Image 15

IBM L2/3 manual Executive summary

Contents

Redpaper Page International Technical Support Organization First Edition September Contents Page Troubleshooting tools Page Vii Trademarks Team that wrote this Redpaper Preface IBM RTP Become a published author Comments welcome Page Executive summary Page IBM Eserver BladeCenter overview IBM Eserver BladeCenter product family IBM Eserver BladeCenter and blade modules IBM Eserver BladeCenter storage solutions IBM Eserver BladeCenter architecture IBM Eserver BladeCenter system managementMidplane IBM BladeCenter Midplane Management Module Ethernet interface Management Module Ethernet Gigabit Ethernet path Gigabit Ethernet path IBM Eserver HS20 architecture PXH-D Stand-alone configuration tools Web interface Page Nortel Networks Layer 2/3 GbE Switch Modules Nortel Networks L2/3 GbESM connections Product description Nortel Networks Layer 2/3 GbE Switch Modules Competitive advantage Leadership features and functionValue proposition Product strength Supported hardware Product shipment groupSupported platforms Page Nortel Networks Layer 2/3 GbE Switch Module architecture Nortel Networks L2/3 GbESM architecture overview Nortel GbESM architecture overview GbESM2 Nortel Networks L2/3 GbESM block diagram Nortel Networks L2/3 GbESM block diagram Connections on the Nortel GbESM Nortel Networks L2/3 GbESM ports specific roles INT1 Nortel Networks Layer 2/3 GbE Switch Module architecture Page Nortel Networks L2/3 GbESM management and administration Management paths to the Nortel Networks L2/3 GbESM Nortel Networks L2/3 GbESM management connectivity Management Module Path Out-of-band management In-band management Serial port PathExternal Ethernet ports Path 3A In-band management considerations Internal Ethernet ports Path 3B IBM Eserver BladeCenter Management Module and I2C Command-line interfaceMain Menu commands Nortel Networks L2/3 GbESM user interface CLI Main Menu Global commands Navigation commands Configuration control commandsAdditional commands Upgrading the firmware Display of a firmware update using CLI Example 5-1 Example configuration file dump Capturing the current configuration Description of default user accounts Configuring user accounts Browser Based Interface Snmp management IBM Director Switch information using BBI Multiple Nortel Networks L2/3 GbESMs in a BladeCenter IBM Eserver BladeCenter system initial setup Management Module firmware IBM Eserver BladeCenter system Accessing the Management Module Web interface Management Module network interfaceEstablishing a physical connection to the Management Module Management Module External Network Interface window Configuring the Management Module network interfaces 3 I/O module management tasks Nortel Networks L2/3 GbESM setup and configuration I/O Module Tasks Management advanced setup Nortel Networks L2/3 GbESM firmware download Determining the level of Nortel switch software Blade server initial configuration Firmware updateUpdateXpress Firmware update Operating systems Microsoft Windows 2003 Broadcom driver installation Red Hat Linux Broadcom driver installation Broadcom Advanced Control Suite installation Select Control Suite and Basp Firmware and device drivers used in this example Page Copyright IBM Corp . All rights reserved Spanning Tree 802.1D, 802.1w, 802.1s Standards and technologiesVlan tagging 802.1Q Link Aggregation and Lacp 802.3ad Open Shortest Path First Ospf RFC1257, RFC2328, and others Routing Information Protocol RFC1058 and RFC2453 Virtual Router Redundancy Protocol Vrrp RFC Summary of sample configurationsWhere standards originate and how to get them Basic Layer 2 configuration Advanced Layer 2 configurations Layer 3 configuration static routingLayer 3 configurations dynamic routing Configuration Introduction to High AvailabilityIntroduction to trunk failover What trunk failover can protect against Introduction to NIC Teaming Vrrp Priority Introduction to Vrrp Cable type selection cross-over or straight-through Guidelines for attaching the BladeCenter to a networkSome important rules for ensuring High Availability Guidelines and comments Fiber connections Base configurations for examples in this documentIBM Eserver BladeCenter configuration Hardware and software used for lab environment Additional hardware used during the experiments Preconfiguration preparationCisco 3560G switch Nortel Networks L2/3 GbESM IP address and Vlan scheme Base configuration common to all examplesManagement Module settings for Nortel GbESMs Blade server configuration with Basp Basic Layer 2 entry topology Blade server 2 Basp configuration Layer 2 configuration with 802.1Q tagging and trunk failover Cisco 3560G switch configuration Example 7-2 Verifying the Vlan setupExample 7-1 Create the VLANs and IP interfaces first Example 7-3 Create IP addresses Said MTU Example 7-4 Links Nortel Networks L2/3 GbESM switch configuration Example 7-6 PVIDs set Example 7-7 Verifying the Vlan setup of the Nortel GbESM Example 7-7shows what has been configured so far Complete configuration snapshots Re-enable the ports INT2 INT3 EXT1 EXT2 Page Page Basic topology conclusions Advanced Layer 2 topology sample configurations 0.0 G0/24 Cisco 3560G G0/23 Core Dynamic link aggregation Ieee 802.3ad Lacp Port EXT5 tag ena pvid Port EXT6 tag ena pvid Common Spanning Tree configuration Ieee 802.1D and Pvst Configure the Cisco Core1 and Core2 for tagged Lacp trunksVerify the Lacp trunk status Enter apply to execute the configuration changes Reenable the ports Verify the Spanning Tree statusExample 7-11 Verifying port status and Vlan assignment Example 7-12 Verifying the Spanning Tree status 300 Ffff-0011f936b700 8004 Design or topology remarks Full configuration snapshots Def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM2 Page Page Page Rapid Spanning Tree Ieee 802.1w Configure the Cisco Core1 and Core2 for Rapid-PVST Design remarks Full configuration snapshots Def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM2 Page Page Multi-Spanning Tree Ieee 802.1s Configurations for use of MST Example 7-17 Mstp Information Display GbESM Key configuration commands to verify Mstp FWD Example 7-18 Mstp Information Display Cisco Example 7-19 Sample Mstp Configuration GbESMPage Example 7-20 Sample Mstp Configuration Cisco Page Implications of using Layer Layer 3 topology sample configurations Reasons for choosing a Layer 3 design Layer 3 sample configuration with static routing and Vrrp Merits of this configuration Summary of IP Addressing used in this sample Layer 3 sample configuration static routing, Vrrp Example 7-21 Layer 3 VLANs and ports for GbESM switches Configure VLANs and subnets for the uplink portsPage Configuration for Core1 address Example 7-22 Layer 3 VLANs and ports for Core switches Example 7-23 Vrrp Configuration for GbESMs Vrrp configuration Example 7-24 Vrrp Hot-standby configuration Configuration of Hot-standby for Vrrp Verifying operation of the configuration Reconnect procedure when configuration is ready Name Example 7-26 Verifying Vrrp status INT2 INT3 EXT3 Page Page Page Page Dynamic routing options OSPF/RIP 2summarizes the IP addresses in use. -7also shows these Configure additional VLANs and subnets for the uplink ports Page Example 7-30 Additional VLANs and Subnets Core switches Example 7-32 RIP configuration for the Core switches Configuring RIPConfiguring Ospf Example 7-31 RIP configuration for the GbESMs Example 7-36 GbESM commands to verify RIP Verifying operation of this configurationExample 7-34 Configuration for Core switch Example 7-35 Configuration for Core switch Example 7-37 Cisco commands to verify RIP RIP User Configuration Example 7-38 GbESM commands to verify Ospf GbESM commands to verify OspfPage Ospf Example 7-39 Cisco commands to verify Ospf Cisco commands to verify Ospf Userid L3/vrrp/on /c/l3/vrrp/vr Page Page Page Page Example 7-42 Extreme switch configuration Configuration for Extreme switchesPage Page Page Page Page Page Page Serial over LAN feature description and configuration General rules to establish an SOL connection SOL overview SOL use during Nortel Networks L2/3 GbESM experiments Configuring SOL for use with the Nortel GbESMPage Nortel Networks Layer 2/3 GbE Switch Module troubleshooting Basic rules Basic rules and unique symptoms General comments on troubleshooting Nortel Networks L2/3 GbESM troubleshooting methodology Systematic approach Problem definition Details from affected users Nortel GbESM Alteon OS switch dumpsData collection Test connectivity Observation of results Data analysisAction plan creation Action plan implementation Traceroute Troubleshooting toolsProblem resolution Ping Difference tool Tftp serverSyslog server Protocol analyzer Web load generator GbE Switch documents GbE Switch software imagesNetwork monitors or management systems Service and support Online services Placing a call to IBMOrdering information Listed here are other helpful Web sites Other support sitesPage Abbreviations and acronyms Pvid IBM Redbooks Other publicationsOnline resources Page Help from IBM How to get IBM RedbooksPage Page Nortel Networks L2/3