Cisco Systems SFS 7008 InfiniBand Connectivity, Flexibility, Hi-Availability, Hardware, Ports

Page 12

12

Example

1.Topspin-270# show card

4.=========================================================================

5.	Card Information

6.=========================================================================

7.	admin	oper	admin	oper	oper
8.	slot type	type	status	status	code

9.-------------------------------------------------------------------------

10.	11*	controllerFabric12x	controllerFabric12x	up	up	normal
11.	12	controllerFabric12x	controllerFabric12x	up	up	standby

The oper code field of the command output identifies the controller card as the active card (normal) or the hot standby card (standby). By default, when you power on a Topspin 270, the card in slot 11 becomes active and the card in slot 12 becomes the standby. The master and standby controllers automatically synchronize state and configuration information.

InfiniBand Connectivity

The Topspin 270 is an enterprise-class managed 960Gb/S, 6U InfiniBand (IB) Switch that is capable of supporting up to 96 4X ports.

In addition, the Topspin 270 is designed to support the 12x InfiniBand ports when they become available.

Flexibility

The architecture of the Topspin 270 offers flexibility in that the switch fabric modules are generic, and will assume the role of fabric controller or fabric node depending on the slot into which they are installed.

This increases the ease of replacing components because only one type of fabric card has to be stocked, and will become a controller or node, depending on what is needed.

Hi-Availability

Hardware

The Topspin 270 features hot-swappable and redundant:

•Power Supply Modules

•Fan Trays

•Line Interface Modules (redundant connection from HCA)

•Fabric Controller Modules (in redundant Core or Node slots)

•Management Interface module

The Topspin 270 features hot-swappable:

•Chassis ID

Ports

No failure on any single InfiniBand port will result in interruptions in service for any of the other ports.

Image 12

Contents Part Number OL-7725-01 Product ID Page Regulatory Notices Vii Managing Individual Components Monitoring the Topspin 270 System 107 FCC Statement Safety Information Electrical CautionsViii Contact Information General CautionsPage System Architecture Hot StandbyInfiniBand Connectivity FlexibilityHi-Availability HardwareDiagram of the Chassis About the Topspin 270 ChassisNon-Blocking Architecture Fabric2Back Chassis View Chassis Slot Numbering 3Chassis Slot Numbering in Front Non-port SideDimensions Power SuppliesConnections LEDsFan Trays Management Interface ModulesFabric Controller Modules Node and Core SlotsMaster/Slave and Standby Roles Node SlotRack Alarm Line Interface Modules LIMChassis ID Module How the Chassis ID is UsedAdministrative Features Prepare the Site Read the Cautionary StatementsPrepare the Physical Environment for Topspin 270 System Rack Mount Installation Mount the Topspin 270 Chassis in a RackRequirements 2Unscrew Extra Rack Ears from the Chassis 3Chassis Set onto Shelf Install Optional HA Components 5Use Appropriate Screws to Attach Rack Ears to RailsConnect Management Devices Attach a Serial Console Cable to a PC or TerminalRecommended Management Configuration Power on the ChassisConnect an Ethernet Cable to the Ethernet Management Port Configure Basic Connectivity 8Power Jack LocationsTopspin-270config#interface mgmt-ethernet Topspin-270#copy running-config startup-configAssigning an Address Statically Assigning an Address DynamicallyAbout Connectors Connect Network DevicesConnecting InfiniBand Devices Manage the SystemOptional Launch the Chassis Manager Prepare Your DeviceLaunch Chassis Manager 10Web Browser Window Optional Install the Element Manager GUI Power Supply Modules About the Power Supply ModulesAbout a Failed Power Supply About the Field Replaceable UnitsRemoving a Power Supply Module Locating the Power Supply ModulePower Cord back Power Supply front Installing a New Power Supply Module 3Pulling the Power Supply Module from the BayFan Tray Modules About the Fan Tray ModulesRemoving a Fan Module About a Failed Fan Tray5Loosening Captive Screws Installing a Fan Module 7Pushing Fan Module into SlotFabric Controllers About the Fabric ControllersRemoving a Fabric Controller 9Loosen Captive Screws Before Removing Installing a Fabric Controller Upgrading the Controller CardLine Interface Management Modules LIM About LIM CardsRemoving a LIM Card 12Removing a Pinch-Type Connector 14Loosen the Captive Screws Installing a LIM Module 17Closing the LIM Module LeversManagement Interface Modules About Management Interface ModulesRemoving a Management Interface Module About a Failed Management Interface ModuleInstalling a Management Interface Module Chassis ID ModulesAbout Chassis ID Modules Removing a Chassis ID Module20Loosen the Captive Screws Installing a Replacement Chassis ID Module Upgrade all Cards in a Chassis Upgrading a Topspin 270 with the CLISelect Maintenance File Management Upgrading a Topspin 270 with Element ManagerSelect Maintenance Boot Config Upgrading an Individual Controller Card Upgrading a Topspin 270 with the Chassis ManagerUpgrading a Controller Card with the CLI Show the standby Controller card Upgrading Individual Node Cards Upgrading a Node Card with the CLI5Copy the .img File to Server Switch Upgrading a Node Card with Element Manager6Watching the File Copy Progress 8Disable and Enable the Node Cards Upgrading Node Cards with the Chassis Manager Page Monitoring the Topspin 270 System Interpreting the Front Panel LEDsSystem-Wide Status LED Locating the System-Wide Status LEDInterpreting the System Status LED Power Supply LEDs Locating the Power Supply LEDsInterpreting the Power Supply LEDs 3Power Supply Identify LEDFan LEDs LocationInterpreting the Fan LEDs Fabric Controller LEDs Interpreting the Fabric Controller LEDsInterpreting the Back Panel LEDs Management Interface Module LEDsInterpreting the Management Interface LEDs 6Management Interface Module LEDsFan Tray Module Status LEDs Chassis ID LEDs Master Management Connection Status LEDLIM Status LEDs InfiniBand Port LEDsInterpreting the LIM Status LEDs Monitoring the System with Chassis Manager Monitor the DeviceInterpreting the InfiniBand Port LEDs Device Rear View and the Device Front View appear 11Chassis Manager 270 Device Front View Monitor the Cards 12Chassis Manager Cards WindowMonitor the InfiniBand Ports 13Chassis Manager Ports WindowMonitor the Power Supplies 14Chassis Manager Port Properties Dialog Box15Chassis Manager Power Supplies Window Monitor the FansMonitor the Temperature 17Chassis Manager Sensors WindowMonitoring the System with Element Manager Interpreting the Summary TabInterpreting the Power Supplies Tab Interpreting the Fans TabInterpreting the Sensors Tab Monitor the Power Supplies Topspin-270show power-supplyMonitor the System With the CLI Monitor the FansMonitor the Sensors Show sensorPage About Diagnostic Tests LED TestsSelf Tests Topspin-270#show diagnostic card Run Card TestsRun a Card Self-Test Example of completed test Run Chassis Tests Topspin-270# more sysloghwiflogTopspin-270config#diag chassis test standard Run a Chassis Standard TestRun Fan Tests Run a Self-Test on a FanTopspin-270#show diag post Enter the diag fan id command Run Power Supply Tests Run a LED Test on the Power SupplyTopspin-270#show diag fru-error Run a Self-Test on a Power Supply Topspin-270#show power-supplyTopspin-270#show diag power-supply Topspin-270#show diag fru-error Displaying Hardware Errors Topspin-270#show diagnostic postTopspin-270#more sysloghwiflog Error Types Topspin-270#show diagnostic fru-error101 102 Specifications and Compliance Certifications Chassis and Management InterfaceElectrical Specifications SafetyEMC/Immunity AcousticsProduct Markings 106 Index