Layer 3 topology sample configurations | IBM L2/3 specification

!

interface Vlan10

ip address 172.16.10.10 255.255.255.0

!

ip classless ip http server

ip http secure-server

!

control-plane

!

line con 0 line vty 0 4 password c login

line vty 5 15 no login

!

end

7.8 Layer 3 topology sample configurations

The configuration samples in this section use Layer 3 switching (routing) in addition to Layer 2 switching (bridging, forwarding). They are based on the simple configuration that was introduced in 7.6, “Basic Layer 2 entry topology” on page 69.

Implications of using Layer 3

These Layer 3 configurations are different from the Layer 2 configurations in the following ways:

802.1q trunking is not required on the connections to the Core switches. Traffic from the VLANs used for the server blades (VLAN 10, VLAN 20) is sent on the uplink trunks as routed traffic and identified by its source and destination IP addresses. There is no need to identify its VLAN association.

Additional VLANs and associated subnets are required for the connections to the Core switches. The uplink connections do not share the VLANs (10, 20) or subnets (10.10.x.x, 10.20.x.x) used for the blade servers. In some of the examples that follow only VLANs 35 and 46 are used. The VLANs and subnets used are:

–VLAN 35: 10.35.x.x, used to connect GbESM 1 to upstream routers

–VLAN 36: 10.36.x.x, used to connect GbESM 1 to upstream router Core2

–VLAN 45: 10.45.x.x, used to connect GbESM 2 to upstream router Core1

–VLAN 46: 10.46.x.x, used to connect GbESM 2 to upstream routers

Upstream routers must be able to find the route to the blade servers. This requires either the use of explicitly configured (static) routes or the use of a dynamic routing protocol. Dynamic routing protocols enable routers to share route information with their neighbors. Examples of the use of static and dynamic routing are included in this section.

High Availability designs using Layer 3 require different techniques than those using solely Layer 2. Examples of HA designs are included in this section.

108Nortel Networks L2/3 Ethernet Switch Module for IBM Eserver BladeCenter

Image 122

IBM L2/3 manual Layer 3 topology sample configurations, Implications of using Layer

Contents

Redpaper Page International Technical Support Organization First Edition September Contents Page Troubleshooting tools Page Vii Trademarks Preface Team that wrote this Redpaper Become a published author IBM RTP Comments welcome Page Executive summary Page IBM Eserver BladeCenter overview IBM Eserver BladeCenter product family IBM Eserver BladeCenter storage solutions IBM Eserver BladeCenter and blade modules Midplane IBM Eserver BladeCenter architectureIBM Eserver BladeCenter system management IBM BladeCenter Midplane Management Module Ethernet Management Module Ethernet interface Gigabit Ethernet path IBM Eserver HS20 architecture Gigabit Ethernet path PXH-D Stand-alone configuration tools Web interface Page Nortel Networks Layer 2/3 GbE Switch Modules Product description Nortel Networks L2/3 GbESM connections Nortel Networks Layer 2/3 GbE Switch Modules Product strength Leadership features and functionValue proposition Competitive advantage Supported platforms Supported hardwareProduct shipment group Page Nortel Networks Layer 2/3 GbE Switch Module architecture Nortel GbESM architecture overview Nortel Networks L2/3 GbESM architecture overview GbESM2 Nortel Networks L2/3 GbESM block diagram Nortel Networks L2/3 GbESM block diagram Nortel Networks L2/3 GbESM ports specific roles Connections on the Nortel GbESM INT1 Nortel Networks Layer 2/3 GbE Switch Module architecture Page Nortel Networks L2/3 GbESM management and administration Nortel Networks L2/3 GbESM management connectivity Management paths to the Nortel Networks L2/3 GbESM Out-of-band management Management Module Path External Ethernet ports Path 3A In-band managementSerial port Path Internal Ethernet ports Path 3B In-band management considerations Nortel Networks L2/3 GbESM user interface Command-line interfaceMain Menu commands IBM Eserver BladeCenter Management Module and I2C Global commands CLI Main Menu Additional commands Navigation commandsConfiguration control commands Display of a firmware update using CLI Upgrading the firmware Capturing the current configuration Example 5-1 Example configuration file dump Configuring user accounts Description of default user accounts Browser Based Interface Switch information using BBI Snmp management IBM Director Multiple Nortel Networks L2/3 GbESMs in a BladeCenter IBM Eserver BladeCenter system initial setup IBM Eserver BladeCenter system Management Module firmware Establishing a physical connection to the Management Module Accessing the Management Module Web interfaceManagement Module network interface Configuring the Management Module network interfaces Management Module External Network Interface window Nortel Networks L2/3 GbESM setup and configuration 3 I/O module management tasks I/O Module Tasks Management advanced setup Determining the level of Nortel switch software Nortel Networks L2/3 GbESM firmware download UpdateXpress Blade server initial configurationFirmware update Firmware update Microsoft Windows 2003 Broadcom driver installation Operating systems Broadcom Advanced Control Suite installation Red Hat Linux Broadcom driver installation Select Control Suite and Basp Firmware and device drivers used in this example Page Copyright IBM Corp . All rights reserved Link Aggregation and Lacp 802.3ad Standards and technologiesVlan tagging 802.1Q Spanning Tree 802.1D, 802.1w, 802.1s Routing Information Protocol RFC1058 and RFC2453 Open Shortest Path First Ospf RFC1257, RFC2328, and others Basic Layer 2 configuration Summary of sample configurationsWhere standards originate and how to get them Virtual Router Redundancy Protocol Vrrp RFC Layer 3 configurations dynamic routing Advanced Layer 2 configurationsLayer 3 configuration static routing Introduction to trunk failover ConfigurationIntroduction to High Availability Introduction to NIC Teaming What trunk failover can protect against Introduction to Vrrp Vrrp Priority Guidelines and comments Guidelines for attaching the BladeCenter to a networkSome important rules for ensuring High Availability Cable type selection cross-over or straight-through Hardware and software used for lab environment Base configurations for examples in this documentIBM Eserver BladeCenter configuration Fiber connections Nortel Networks L2/3 GbESM Preconfiguration preparationCisco 3560G switch Additional hardware used during the experiments Blade server configuration with Basp Base configuration common to all examplesManagement Module settings for Nortel GbESMs IP address and Vlan scheme Blade server 2 Basp configuration Basic Layer 2 entry topology Layer 2 configuration with 802.1Q tagging and trunk failover Example 7-1 Create the VLANs and IP interfaces first Cisco 3560G switch configurationExample 7-2 Verifying the Vlan setup Said MTU Example 7-3 Create IP addresses Nortel Networks L2/3 GbESM switch configuration Example 7-4 Links Example 7-6 PVIDs set Example 7-7shows what has been configured so far Example 7-7 Verifying the Vlan setup of the Nortel GbESM Re-enable the ports Complete configuration snapshots INT2 INT3 EXT1 EXT2 Page Page Advanced Layer 2 topology sample configurations Basic topology conclusions 0.0 G0/24 Cisco 3560G G0/23 Core Dynamic link aggregation Ieee 802.3ad Lacp Port EXT5 tag ena pvid Port EXT6 tag ena pvid Verify the Lacp trunk status Common Spanning Tree configuration Ieee 802.1D and PvstConfigure the Cisco Core1 and Core2 for tagged Lacp trunks Enter apply to execute the configuration changes Example 7-11 Verifying port status and Vlan assignment Reenable the portsVerify the Spanning Tree status Example 7-12 Verifying the Spanning Tree status 300 Ffff-0011f936b700 8004 Full configuration snapshots Design or topology remarks Def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM2 Page Page Page Configure the Cisco Core1 and Core2 for Rapid-PVST Rapid Spanning Tree Ieee 802.1w Design remarks Full configuration snapshots Def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM2 Page Page Configurations for use of MST Multi-Spanning Tree Ieee 802.1s Key configuration commands to verify Mstp Example 7-17 Mstp Information Display GbESM FWD Example 7-19 Sample Mstp Configuration GbESM Example 7-18 Mstp Information Display CiscoPage Example 7-20 Sample Mstp Configuration Cisco Page Layer 3 topology sample configurations Implications of using Layer Layer 3 sample configuration with static routing and Vrrp Reasons for choosing a Layer 3 design Merits of this configuration Layer 3 sample configuration static routing, Vrrp Summary of IP Addressing used in this sample Configure VLANs and subnets for the uplink ports Example 7-21 Layer 3 VLANs and ports for GbESM switchesPage Example 7-22 Layer 3 VLANs and ports for Core switches Configuration for Core1 address Vrrp configuration Example 7-23 Vrrp Configuration for GbESMs Configuration of Hot-standby for Vrrp Example 7-24 Vrrp Hot-standby configuration Reconnect procedure when configuration is ready Verifying operation of the configuration Name Example 7-26 Verifying Vrrp status INT2 INT3 EXT3 Page Page Page Page Dynamic routing options OSPF/RIP 2summarizes the IP addresses in use. -7also shows these Configure additional VLANs and subnets for the uplink ports Page Example 7-30 Additional VLANs and Subnets Core switches Example 7-31 RIP configuration for the GbESMs Configuring RIPConfiguring Ospf Example 7-32 RIP configuration for the Core switches Example 7-35 Configuration for Core switch Verifying operation of this configurationExample 7-34 Configuration for Core switch Example 7-36 GbESM commands to verify RIP RIP User Configuration Example 7-37 Cisco commands to verify RIP GbESM commands to verify Ospf Example 7-38 GbESM commands to verify OspfPage Ospf Cisco commands to verify Ospf Example 7-39 Cisco commands to verify Ospf Userid L3/vrrp/on /c/l3/vrrp/vr Page Page Page Page Configuration for Extreme switches Example 7-42 Extreme switch configurationPage Page Page Page Page Page Page Serial over LAN feature description and configuration SOL overview General rules to establish an SOL connection Configuring SOL for use with the Nortel GbESM SOL use during Nortel Networks L2/3 GbESM experimentsPage Nortel Networks Layer 2/3 GbE Switch Module troubleshooting Basic rules and unique symptoms Basic rules Nortel Networks L2/3 GbESM troubleshooting methodology General comments on troubleshooting Problem definition Systematic approach Test connectivity Nortel GbESM Alteon OS switch dumpsData collection Details from affected users Action plan implementation Data analysisAction plan creation Observation of results Ping Troubleshooting toolsProblem resolution Traceroute Syslog server Difference toolTftp server Web load generator Protocol analyzer Network monitors or management systems GbE Switch documentsGbE Switch software images Service and support Ordering information Online servicesPlacing a call to IBM Other support sites Listed here are other helpful Web sitesPage Abbreviations and acronyms Pvid Online resources IBM RedbooksOther publications Page How to get IBM Redbooks Help from IBMPage Page Nortel Networks L2/3