Cisco Systems SFS 7008 manual

Part Number: OL-7725-01

Cisco SFS 7008 InfiniBand Server Switch

Hardware Guide (Topspin 270 Hardware Guide)

Release 2.2.0 Update 1

Product ID: 140265

Contents

Main Page Regulatory Notices........................................ vii 1: Features Overview ................................... 11 2: Installing the Topspin 270 System ........... 21 3: Managing Individual Components............ 35 4: Administrative Tasks ................................ 53 5: Monitoring the Topspin 270 System......... 65 6: Hardware Diagnostic Tests ...................... 89 Page vii Regulatory Notices FCC Statement Safety Information Electrical Cautions viii ix General Cautions Contact Information Page Features Overview System Architecture Hot Standby InfiniBand Connectivity Flexibility Hi-Availability Hardware Ports About the Topspin 270 Chassis Page Chassis Slot Numbering Dimensions Connections LEDs Power Supplies Fan Trays Management Interface Modules Understanding the Core Slot to Mgmt Interface Module Connection Fabric Controller Modules Master/Slave and Standby Roles Node and Core Slots The Node Slot The Core Slot Line Interface Modules (LIM) Chassis ID Module How the Chassis ID is Used About Replacing a Chassis ID Module Rack Alarm Administrative Features Real-Time Clock Latency Non-Volatile Memory Vital Product Data Storage Installing the Topspin 270 System Prepare the Site Read the Cautionary Statements Prepare the Physical Environment for the Topspin 270 System Mount the Topspin 270 Chassis in a Rack Requirements Rack Mount Installation Page Page Page Connect Management Devices Attach a Serial Console Cable to a PC or Ter mi na l Page Configure Basic Connectivity Assigning an Address Statically Assigning an Address Dynamically Connect Network Devices About Connectors Connecting InfiniBand Devices Attaching the IB Cable to the IB Port Connecting to the Host Manage the System (Optional) Launch the Chassis Manager Prepare Your Device Launch Chassis Manager Page (Optional) Install the Element Manager GUI Managing Individual Components About the Field Replaceable Units Power Supply Modules About the Power Supply Modules About a Failed Power Supply Removing a Power Supply Module Page Installing a New Power Supply Module Fan Tray Modules About the Fan Tray Modules About a Failed Fan Tray Locating the Fan Tray Removing a Fan Module Page Installing a Fan Module Fabric Controllers About the Fabric Controllers About a Failed Fabric Controller Locating a Failed Fabric Controller Considerations Before Removing a Fabric Controller Card Page Installing a Fabric Controller Upgrading the Controller Card Line Interface Management Modules (LIM) About LIM Cards Removing a LIM Card Page Page Installing a LIM Module Management Interface Modules About Management Interface Modules About a Failed Management Interface Module Determining Which Management Interface Module has Failed Removing a Management Interface Module Chassis ID Modules About Chassis ID Modules Failed Chassis ID Module Locating the Chassis ID Module Removing a Chassis ID Module Page Installing a Replacement Chassis ID Module Administrative Tasks Upgrade all Cards in a Chassis Upgrading a Topspin 270 with the CLI Upgrading a Topspin 270 with Element Manager Page Upgrading a Topspin 270 with the Chassis Manager Upgrading an Individual Controller Card Upgrading a Controller Card with the CLI Page Upgrading Individual Node Cards Upgrading a Node Card with the CLI Upgrading a Node Card with Element Manager Page Page Page Page Monitoring the Topspin 270 System Interpreting the Front Panel LEDs System-Wide Status LED Locating the System-Wide Status LED Interpreting the System Status LED Power Supply LEDs Locating the Power Supply LEDs Interpreting the Power Supply LEDs Fan LEDs Interpreting the Fan LEDs Fabric Controller LEDs Interpreting the Fabric Controller LEDs Interpreting the Back Panel LEDs Management Interface Module LEDs Interpreting the Management Interface LEDs Page Chassis ID LEDs LIM Status LEDs Interpreting the LIM Status LEDs InfiniBand Port LEDs Interpreting the InfiniBand Port LEDs Monitoring the System with Chassis Manager Monitor the Device Page Page Monitor the Cards Monitor the InfiniBand Ports Monitor the Power Supplies Monitor the Fans Monitor the Temperature Monitoring the System with Element Manager Interpreting the Summary Tab Page Monitor the System With the CLI Monitor the Power Supplies Monitor the Fans Monitor the Sensors Page Hardware Diagnostic Tests About Diagnostic Tests LED Tests Self Tests Run Card Tests Run a Card Self-Test Page Run Chassis Tests Run a Chassis Standard Test Run Fan Tests Run a Self-Test on a Fan Page Run Power Supply Tests Run a LED Test on the Power Supply Run a Self-Test on a Power Supply Page Displaying Hardware Errors Error Types Page Page Specifications and Compliance Certifications Chassis and Management Interface Electrical Specifications EMC/Immunity Safety Acoustics Page Page Index