Cisco Systems Cisco 4x manual Server Switch Module and HCA Expansion Cards

Page 44

Chapter 1 About the Server Switch Module

Introduction

Figure 1-1 Cisco 4x InfiniBand Switch Module for IBM BladeCenter

154589

Each Server Switch Module includes 16 4x ports to the backplane and 8 4x ports (in the form of 2 4x connectors and 2 12x connectors) on the front panel. The Server Switch Module provides full non-blocking switching for all 24 ports. On the backplane, 14 of the internal 4x ports provide 10 Gbps connections to the HCA expansion cards on server blades. The two remaining internal 4x ports provide connections to the chassis expansion modules. All external 4x connectors provide 10 Gbps connections to the outside IB network and can autonegotiate connection speed.

Server Switch Modules transmit information to and from BladeCenter Management Modules over Ethernet (through an internal Ethernet switch) to facilitate setup and management. After you set up a Server Switch Module and bring it online, the on-board Cisco Subnet Manager brings distributed intelligence to the IB network.

Cisco Server Switch Modules allow you to perform a field upgrade to load the latest firmware on the Server Switch Module. You can perform a firmware upgrade even following a failed upgrade. CLI and GUI interfaces both support upgrades. For details, see the Command Line Interface Reference Guide or the Element Manager User Guide.

Server Switch Module and HCA Expansion Cards

Within the BladeCenter unit, Server Switch Modules manage traffic to and from HCA expansion cards on the BladeCenter hosts. Each HCA expansion card adds two IB ports to a BladeCenter host. Each HCA port connects through the unit backplane to a particular Server Switch Module slot. The first IB port of each HCA card (ib0) connects to the Server Switch Module in I/O slot 7, and the second IB port of each HCA card (ib1) connects to I/O slot 9. For detailed information about the HCA expansion card, see the Cisco 4x InfiniBand HCA Expansion Card for IBM BladeCenter User Guide.

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

1-2	78-17838-01

Image 44

Contents Corporate Headquarters Page N T E N T S India Edition Notice IiiSpecifications Audience OrganizationConventions Boldface fontItem… Related DocumentationMenu1 Menu2 Vii Contacting Technical SupportIBM Support Contact Information Viii Before You CallCisco Systems Support Contact Information Cisco Technical Support & Documentation Website Preface Contacting Technical Support What this Warranty Covers Part 1 General TermsWhat This Warranty Does Not Cover How to Obtain Warranty ServiceWhat IBM Will Do to Correct Problems XiiExchange of a Machine or Part Your Additional ResponsibilitiesLimitation of Liability XiiiPart 2 Country-unique Terms Governing LawJurisdiction ArgentinaBrazil ChileColombia EquadorUruguay VenezuelaCanada United StatesCambodia and Laos CAMBODIA, INDONESIA, and LaosHong Kong S.A.R. of China and Macau S.A.R. of China XviiIndia JapanMalaysia NEW ZealandHow to Obtain Warranty Service Peoples Republic of China PRCPhilippines SingaporeGoverning Law European Union EU XxiFrance and Belgium XxiiAustria EgyptFrance XxiiiGermany HungaryIreland XxivSlovakia South AFRICA, NAMIBIA, BOTSWANA, Lesotho and SwazilandUnited Kingdom Items for Which IBM is Not LiableXxvi Part 3 Warranty InformationWarranty Period Types of Warranty Service XxviiEU Country Telephone List XxviiiXxix Xxx Edition NoticeTrademarks Xxxi Product Recycling and Disposal Battery Return ProgramImportant Notes Xxxii Electronic Emission NoticesFederal Communications Commission FCC Statement Industry Canada Class a emission compliance statement European Union EMC Directive conformance statementTaiwanese Class a warning statement XxxiiiXxxiv Weee Notice XxxvXxxvi Safety XxxviiXxxviii Xxxix Page About the Server Switch Module IntroductionServer Switch Module and HCA Expansion Cards Cisco 4x InfiniBand Switch Module for IBM BladeCenterSingle-Switch Topology Dual-Switch TopologyTopologies Module ManagementYellow OK-Green Decode Server Switch Module Status LEDsLEDs External InfiniBand Ports Port Status LEDsPage Installing and Configuring the Server Switch Installing the Server Switch ModuleConfiguring the Server Switch Module Modules in the other slotsPassword keyword Changing the Default PasswordConfiguring the System Clock Server-three keyword Server-one keywordServer-two keyword Connecting Beyond BladeCenter Connecting InfiniBand CablesSubnet-prefix keyword Priority keywordRemoving a Pull Connector Electrical Requirements Environmental RequirementsSpecifications Environmental Requirements D E IN-1IN-2