IBM Eserver HS20 architecture, Gigabit Ethernet path | IBM L2/3

IBM ^ BladeCenter™ -
Gigabit Ethernet path
		SW Module 1	SW Module 3
		1………..14	1………..14
SERDES	LAN 1	Midplane (Upper Section)
Ethernet	LAN 3
	LAN 3
Network
Interface
Daughter	LAN 4
Card
SERDES	LAN 2
Ethernet		Midplane (Lower Section)
Processor blade		1………..14	1………..14
#1		SW Module 2	SW Module 4
		SW Module 2	SW Module 4

Figure 2-5 Gigabit Ethernet path

2.3 IBM Eserver HS20 architecture

In this section, we discuss the architectural design of the IBM Eserver BladeCenter HS20. This is presented as just one example of the blade design for a typical dual-processor server.

10Nortel Networks L2/3 Ethernet Switch Module for IBM Eserver BladeCenter

Image 24

IBM L2/3 manual IBM Eserver HS20 architecture, Gigabit Ethernet path

Contents

Redpaper Page International Technical Support Organization First Edition September Contents Page Troubleshooting tools Page Vii Trademarks Preface Team that wrote this Redpaper Become a published author IBM RTP Comments welcome Page Executive summary Page IBM Eserver BladeCenter overview IBM Eserver BladeCenter product family IBM Eserver BladeCenter storage solutions IBM Eserver BladeCenter and blade modules IBM Eserver BladeCenter architecture IBM Eserver BladeCenter system managementMidplane IBM BladeCenter Midplane Management Module Ethernet Management Module Ethernet interface Gigabit Ethernet path IBM Eserver HS20 architecture Gigabit Ethernet path PXH-D Stand-alone configuration tools Web interface Page Nortel Networks Layer 2/3 GbE Switch Modules Product description Nortel Networks L2/3 GbESM connections Nortel Networks Layer 2/3 GbE Switch Modules Leadership features and function Value propositionProduct strength Competitive advantage Supported hardware Product shipment groupSupported platforms Page Nortel Networks Layer 2/3 GbE Switch Module architecture Nortel GbESM architecture overview Nortel Networks L2/3 GbESM architecture overview GbESM2 Nortel Networks L2/3 GbESM block diagram Nortel Networks L2/3 GbESM block diagram Nortel Networks L2/3 GbESM ports specific roles Connections on the Nortel GbESM INT1 Nortel Networks Layer 2/3 GbE Switch Module architecture Page Nortel Networks L2/3 GbESM management and administration Nortel Networks L2/3 GbESM management connectivity Management paths to the Nortel Networks L2/3 GbESM Out-of-band management Management Module Path In-band management Serial port PathExternal Ethernet ports Path 3A Internal Ethernet ports Path 3B In-band management considerations Command-line interface Main Menu commandsNortel Networks L2/3 GbESM user interface IBM Eserver BladeCenter Management Module and I2C Global commands CLI Main Menu Navigation commands Configuration control commandsAdditional commands Display of a firmware update using CLI Upgrading the firmware Capturing the current configuration Example 5-1 Example configuration file dump Configuring user accounts Description of default user accounts Browser Based Interface Switch information using BBI Snmp management IBM Director Multiple Nortel Networks L2/3 GbESMs in a BladeCenter IBM Eserver BladeCenter system initial setup IBM Eserver BladeCenter system Management Module firmware Accessing the Management Module Web interface Management Module network interfaceEstablishing a physical connection to the Management Module Configuring the Management Module network interfaces Management Module External Network Interface window Nortel Networks L2/3 GbESM setup and configuration 3 I/O module management tasks I/O Module Tasks Management advanced setup Determining the level of Nortel switch software Nortel Networks L2/3 GbESM firmware download Blade server initial configuration Firmware updateUpdateXpress Firmware update Microsoft Windows 2003 Broadcom driver installation Operating systems Broadcom Advanced Control Suite installation Red Hat Linux Broadcom driver installation Select Control Suite and Basp Firmware and device drivers used in this example Page Copyright IBM Corp . All rights reserved Standards and technologies Vlan tagging 802.1QLink Aggregation and Lacp 802.3ad Spanning Tree 802.1D, 802.1w, 802.1s Routing Information Protocol RFC1058 and RFC2453 Open Shortest Path First Ospf RFC1257, RFC2328, and others Summary of sample configurations Where standards originate and how to get themBasic Layer 2 configuration Virtual Router Redundancy Protocol Vrrp RFC Advanced Layer 2 configurations Layer 3 configuration static routingLayer 3 configurations dynamic routing Configuration Introduction to High AvailabilityIntroduction to trunk failover Introduction to NIC Teaming What trunk failover can protect against Introduction to Vrrp Vrrp Priority Guidelines for attaching the BladeCenter to a network Some important rules for ensuring High AvailabilityGuidelines and comments Cable type selection cross-over or straight-through Base configurations for examples in this document IBM Eserver BladeCenter configurationHardware and software used for lab environment Fiber connections Preconfiguration preparation Cisco 3560G switchNortel Networks L2/3 GbESM Additional hardware used during the experiments Base configuration common to all examples Management Module settings for Nortel GbESMsBlade server configuration with Basp IP address and Vlan scheme Blade server 2 Basp configuration Basic Layer 2 entry topology Layer 2 configuration with 802.1Q tagging and trunk failover Cisco 3560G switch configuration Example 7-2 Verifying the Vlan setupExample 7-1 Create the VLANs and IP interfaces first Said MTU Example 7-3 Create IP addresses Nortel Networks L2/3 GbESM switch configuration Example 7-4 Links Example 7-6 PVIDs set Example 7-7shows what has been configured so far Example 7-7 Verifying the Vlan setup of the Nortel GbESM Re-enable the ports Complete configuration snapshots INT2 INT3 EXT1 EXT2 Page Page Advanced Layer 2 topology sample configurations Basic topology conclusions 0.0 G0/24 Cisco 3560G G0/23 Core Dynamic link aggregation Ieee 802.3ad Lacp Port EXT5 tag ena pvid Port EXT6 tag ena pvid Common Spanning Tree configuration Ieee 802.1D and Pvst Configure the Cisco Core1 and Core2 for tagged Lacp trunksVerify the Lacp trunk status Enter apply to execute the configuration changes Reenable the ports Verify the Spanning Tree statusExample 7-11 Verifying port status and Vlan assignment Example 7-12 Verifying the Spanning Tree status 300 Ffff-0011f936b700 8004 Full configuration snapshots Design or topology remarks Def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM2 Page Page Page Configure the Cisco Core1 and Core2 for Rapid-PVST Rapid Spanning Tree Ieee 802.1w Design remarks Full configuration snapshots Def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM2 Page Page Configurations for use of MST Multi-Spanning Tree Ieee 802.1s Key configuration commands to verify Mstp Example 7-17 Mstp Information Display GbESM FWD Example 7-19 Sample Mstp Configuration GbESM Example 7-18 Mstp Information Display CiscoPage Example 7-20 Sample Mstp Configuration Cisco Page Layer 3 topology sample configurations Implications of using Layer Layer 3 sample configuration with static routing and Vrrp Reasons for choosing a Layer 3 design Merits of this configuration Layer 3 sample configuration static routing, Vrrp Summary of IP Addressing used in this sample Configure VLANs and subnets for the uplink ports Example 7-21 Layer 3 VLANs and ports for GbESM switchesPage Example 7-22 Layer 3 VLANs and ports for Core switches Configuration for Core1 address Vrrp configuration Example 7-23 Vrrp Configuration for GbESMs Configuration of Hot-standby for Vrrp Example 7-24 Vrrp Hot-standby configuration Reconnect procedure when configuration is ready Verifying operation of the configuration Name Example 7-26 Verifying Vrrp status INT2 INT3 EXT3 Page Page Page Page Dynamic routing options OSPF/RIP 2summarizes the IP addresses in use. -7also shows these Configure additional VLANs and subnets for the uplink ports Page Example 7-30 Additional VLANs and Subnets Core switches Configuring RIP Configuring OspfExample 7-31 RIP configuration for the GbESMs Example 7-32 RIP configuration for the Core switches Verifying operation of this configuration Example 7-34 Configuration for Core switchExample 7-35 Configuration for Core switch Example 7-36 GbESM commands to verify RIP RIP User Configuration Example 7-37 Cisco commands to verify RIP GbESM commands to verify Ospf Example 7-38 GbESM commands to verify OspfPage Ospf Cisco commands to verify Ospf Example 7-39 Cisco commands to verify Ospf Userid L3/vrrp/on /c/l3/vrrp/vr Page Page Page Page Configuration for Extreme switches Example 7-42 Extreme switch configurationPage Page Page Page Page Page Page Serial over LAN feature description and configuration SOL overview General rules to establish an SOL connection Configuring SOL for use with the Nortel GbESM SOL use during Nortel Networks L2/3 GbESM experimentsPage Nortel Networks Layer 2/3 GbE Switch Module troubleshooting Basic rules and unique symptoms Basic rules Nortel Networks L2/3 GbESM troubleshooting methodology General comments on troubleshooting Problem definition Systematic approach Nortel GbESM Alteon OS switch dumps Data collectionTest connectivity Details from affected users Data analysis Action plan creationAction plan implementation Observation of results Troubleshooting tools Problem resolutionPing Traceroute Difference tool Tftp serverSyslog server Web load generator Protocol analyzer GbE Switch documents GbE Switch software imagesNetwork monitors or management systems Service and support Online services Placing a call to IBMOrdering information Other support sites Listed here are other helpful Web sitesPage Abbreviations and acronyms Pvid IBM Redbooks Other publicationsOnline resources Page How to get IBM Redbooks Help from IBMPage Page Nortel Networks L2/3