Cisco Systems SFS 7008 manual Fabric Controller Modules, Node and Core Slots, Node Slot

Page 18

18

Understanding the Core Slot to Mgmt Interface Module Connection

Each Core slot in the chassis (refer to “The Core Slot” on page 18) is connected to 1 port on the Management Interface module. The controller (fabric interface module inserted in the core slot) selects the Management Interface module to which it will connect.

The pairing of Management Interface module to core slot is as follows:

The Management Interface module in slot #15 is connected to the Fabric Controller Module in the Core slot #11.

The Management Interface module in slot #16 is connected to the Fabric Controller Module in the Core slot #12.

For example, removing the Fabric Controller from the Core slot 11 would cause both the Fabric

Controller card and its paired Management Interface module in slot 15 to fail-over. The new primary

Controller would be slot 12 and the primary Management Interface would be slot 16.

Fabric Controller Modules

See Figure 1-2 on page 14 for a diagram of the chassis.

Refer to “Installing a Fabric Controller” on page 44 for Fabric Controller module installation instructions.

The Topspin 270 contains six fabric control modules.

The fabric controller modules perform the following roles within the system:

System Controller

Switch fabric spine

Switch fabric end-nodes

Stores redundant Vital Product Data (VPD) from the Chassis ID module. This allows the chassis to continue functioning (and the VPD information to be recovered) even if a Chassis ID module fails.

Each Fabric Controller module runs the management software and contains non-volatile storage.

The behavior and responsibility of each fabric controller module is determined by the type of slot into which it is inserted. Each fabric controller module can be installed in either a Node slot or a Core slot (refer to “Node and Core Slots” on page 18).

Master/Slave and Standby Roles

When the CPU of a fabric module detects that is in a Core slot, it will arbitrate for system mastership and run system wide control functions in addition to its local management functions.

One fabric controller in the Core slot acts as the Master

One fabric controller in the Core slot acts as the Standby to the Master

Fabric controllers in Node slots act as slaves

Note: Fabric controllers in Node slots do not act in active/standby configuration

Node and Core Slots

The fabric controller modules can occupy either a Node slot or a Core slot in the chassis.

The Node Slot

There are four Node slots in the Topspin 270.

Fabric modules installed in Node slots provide fabric leaf switching, as opposed to controller functionality.

The Core Slot

There are two Core slots in the Topspin 270.

Image 18
Contents Part Number OL-7725-01 Product ID Page Regulatory Notices Vii Managing Individual Components Monitoring the Topspin 270 System 107 FCC Statement Safety Information Electrical CautionsViii Contact Information General CautionsPage System Architecture Hot StandbyHi-Availability InfiniBand ConnectivityFlexibility HardwareNon-Blocking Architecture Diagram of the ChassisAbout the Topspin 270 Chassis Fabric2Back Chassis View Chassis Slot Numbering 3Chassis Slot Numbering in Front Non-port SideConnections DimensionsPower Supplies LEDsFan Trays Management Interface ModulesMaster/Slave and Standby Roles Fabric Controller ModulesNode and Core Slots Node SlotChassis ID Module Rack AlarmLine Interface Modules LIM How the Chassis ID is UsedAdministrative Features Prepare the Site Read the Cautionary StatementsPrepare the Physical Environment for Topspin 270 System Rack Mount Installation Mount the Topspin 270 Chassis in a RackRequirements 2Unscrew Extra Rack Ears from the Chassis 3Chassis Set onto Shelf Install Optional HA Components 5Use Appropriate Screws to Attach Rack Ears to RailsConnect Management Devices Attach a Serial Console Cable to a PC or TerminalRecommended Management Configuration Power on the ChassisConnect an Ethernet Cable to the Ethernet Management Port Configure Basic Connectivity 8Power Jack LocationsAssigning an Address Statically Topspin-270config#interface mgmt-ethernetTopspin-270#copy running-config startup-config Assigning an Address DynamicallyAbout Connectors Connect Network DevicesConnecting InfiniBand Devices Manage the SystemOptional Launch the Chassis Manager Prepare Your DeviceLaunch Chassis Manager 10Web Browser Window Optional Install the Element Manager GUI About a Failed Power Supply Power Supply ModulesAbout the Power Supply Modules About the Field Replaceable UnitsRemoving a Power Supply Module Locating the Power Supply ModulePower Cord back Power Supply front Installing a New Power Supply Module 3Pulling the Power Supply Module from the BayRemoving a Fan Module Fan Tray ModulesAbout the Fan Tray Modules About a Failed Fan Tray5Loosening Captive Screws Installing a Fan Module 7Pushing Fan Module into SlotFabric Controllers About the Fabric ControllersRemoving a Fabric Controller 9Loosen Captive Screws Before Removing Installing a Fabric Controller Upgrading the Controller CardLine Interface Management Modules LIM About LIM CardsRemoving a LIM Card 12Removing a Pinch-Type Connector 14Loosen the Captive Screws Installing a LIM Module 17Closing the LIM Module LeversRemoving a Management Interface Module Management Interface ModulesAbout Management Interface Modules About a Failed Management Interface ModuleAbout Chassis ID Modules Installing a Management Interface ModuleChassis ID Modules Removing a Chassis ID Module20Loosen the Captive Screws Installing a Replacement Chassis ID Module Upgrade all Cards in a Chassis Upgrading a Topspin 270 with the CLISelect Maintenance File Management Upgrading a Topspin 270 with Element ManagerSelect Maintenance Boot Config Upgrading an Individual Controller Card Upgrading a Topspin 270 with the Chassis ManagerUpgrading a Controller Card with the CLI Show the standby Controller card Upgrading Individual Node Cards Upgrading a Node Card with the CLI5Copy the .img File to Server Switch Upgrading a Node Card with Element Manager6Watching the File Copy Progress 8Disable and Enable the Node Cards Upgrading Node Cards with the Chassis Manager Page Monitoring the Topspin 270 System Interpreting the Front Panel LEDsSystem-Wide Status LED Locating the System-Wide Status LEDInterpreting the System Status LED Power Supply LEDs Locating the Power Supply LEDsInterpreting the Power Supply LEDs 3Power Supply Identify LEDFan LEDs LocationInterpreting the Fan LEDs Fabric Controller LEDs Interpreting the Fabric Controller LEDsInterpreting the Back Panel LEDs Management Interface Module LEDsInterpreting the Management Interface LEDs 6Management Interface Module LEDsFan Tray Module Status LEDs Chassis ID LEDs Master Management Connection Status LEDLIM Status LEDs InfiniBand Port LEDsInterpreting the LIM Status LEDs Monitoring the System with Chassis Manager Monitor the DeviceInterpreting the InfiniBand Port LEDs Device Rear View and the Device Front View appear 11Chassis Manager 270 Device Front View Monitor the Cards 12Chassis Manager Cards WindowMonitor the InfiniBand Ports 13Chassis Manager Ports WindowMonitor the Power Supplies 14Chassis Manager Port Properties Dialog Box15Chassis Manager Power Supplies Window Monitor the FansMonitor the Temperature 17Chassis Manager Sensors WindowMonitoring the System with Element Manager Interpreting the Summary TabInterpreting the Power Supplies Tab Interpreting the Fans TabInterpreting the Sensors Tab Monitor the System With the CLI Monitor the Power SuppliesTopspin-270show power-supply Monitor the FansMonitor the Sensors Show sensorPage About Diagnostic Tests LED TestsSelf Tests Topspin-270#show diagnostic card Run Card TestsRun a Card Self-Test Example of completed test Run Chassis Tests Topspin-270# more sysloghwiflogTopspin-270config#diag chassis test standard Run a Chassis Standard TestRun Fan Tests Run a Self-Test on a FanTopspin-270#show diag post Enter the diag fan id command Run Power Supply Tests Run a LED Test on the Power SupplyTopspin-270#show diag fru-error Run a Self-Test on a Power Supply Topspin-270#show power-supplyTopspin-270#show diag power-supply Topspin-270#show diag fru-error Displaying Hardware Errors Topspin-270#show diagnostic postTopspin-270#more sysloghwiflog Error Types Topspin-270#show diagnostic fru-error101 102 Specifications and Compliance Certifications Chassis and Management InterfaceEMC/Immunity Electrical SpecificationsSafety AcousticsProduct Markings 106 Index