Fujitsu T5440 I/O Fabric in 2P Configuration

168 SPARC Enterprise T5440 Server Service Manual • June 2011

I/O Fabric in 2P Configuration

Related Information

■“System Bus Topology” on page167

■“I/O Fabric in 4P Configuration” on page169

CMP Number Devices Controlled

CMP0 Onboard disk drives

Onboard USB ports

Onboard DVD drive

PCIe0

PCIe1

PCIe2

PCIe3

CMP1 Onboard Gbit or 10-Gbit network

PCIe4

PCIe5

PCIe6

PCIe7

Contents

Main Please Recycle Page Page Contents Page Page Page Page Page Page Page Preface For Safe Operation Before You Read This Document Structure and Contents of This Manual Related Documentation (http://primeserver.fujitsu.com/sparcenterprise/manual/) Note update on your product. (http://www.oracle.com/technetwork/documentation/index.html) UNIX Commands Text Conventions * The settings on your browser might differ from these settings. The following prompt notations are used in this manual. Prompt Notations Conventions for Alert Messages Alert Messages in the Text Notes on Safety Important Alert Messages Caution Product Handling Maintenance Caution Remodeling/Rebuilding Caution Alert Label Page Identifying Server Components Infrastructure Boards and Cables Note Page Front Panel Diagram Page Front Panel LEDs Rear Panel Diagram Page Rear Panel LEDs Ethernet Port LEDs Page Managing Faults Understanding Fault Handling Options Server Diagnostics Overview Diagnostic Flowchart Page Page Page Options for Accessing the Service Processor There are three methods of interacting with the service processor: Management Port and the Network Management Port. Users Guide. Note ILOM Overview Note ALOM CMT Compatibility Shell Overview Predictive Self-Healing Overview Oracle VTS Overview POST Fault Management Overview Page Memory Fault Handling Overview Note Connecting to the Service Processor Page Displaying FRU Information With ILOM Display Individual Component Information (ILOM show Command) Use the show command to display information about individual components in the server. Controlling How POST Runs This topic contains the following: POST Parameters Change POST Parameters Run POST in Maximum Mode Note Page Detecting Faults Detecting Faults Using LEDs Page Detecting Faults (ILOM show faulty Command) Detect Faults (ILOM show faulty Command) Note Page Detecting Faults (Oracle Solaris OS Files and Commands) Check the Message Buffer View System Message Log Files Detecting Faults (ILOM Event Log) View ILOM Event Log Note Detecting Faults (Oracle VTS Software) About Oracle VTS Software Verify Installation of Oracle VTS Software Note Start the Oracle VTS Browser Environment Note Tip Oracle VTS Software Packages Useful Oracle VTS Tests Detecting Faults Using POST Note Identifying Faults Detected by PSH Note Detect Faults Identified by the Oracle Solaris PSH Facility (ILOM fmdump Command) Note Page Clearing Faults Note Clear Faults Detected During POST Page Clear Faults Detected by PSH Clear Faults Detected in the External I/O Expansion Unit Note Disabling Faulty Components Disabling Faulty Components Using Automatic System Recovery Note Disable System Components Note Re-Enable System Components Note ILOM-to-ALOM CMT Command Reference Page Page Page The following table shows typical combinations of ALOM CMT variables and associated POST modes. Preparing to Service the System Safety Information Observing Important Safety Precautions Safety Symbols Caution Electrostatic Discharge Safety Measures Handling Electronic Components Caution Antistatic Wrist Strap Note Required Tools Obtain the Chassis Serial Number Obtain the Chassis Serial Number Remotely Powering Off the System Note Power Off (Command Line) Note Power Off (Graceful Shutdown) Power Off (Emergency Shutdown) Caution Disconnect Power Cords From the Server Caution Extending the Server to the Maintenance Position Components Serviced in the Maintenance Position Extend the Server to the Maintenance Position Remove the Server From the Rack Caution Perform Electrostatic Discharge Antistatic Prevention Measures Remove the Top Cover Page Servicing Customer-Replaceable Units Hot-Pluggable and Hot-Swappable Devices Note Servicing Hard Drives About Hard Drives Caution Remove a Hard Drive (Hot-Plug) Note Caution Install a Hard Drive (Hot-Plug) Note Page Remove a Hard Drive Note Install a Hard Drive Hard Drive Device Identifiers Note Hard Drive LEDs Servicing Fan Trays About Fan Trays Caution Remove a Fan Tray (Hot-Swap) Install a Fan Tray (Hot-Swap) Remove a Fan Tray Install a Fan Tray Fan Tray Device Identifiers Fan Tray Fault LED Servicing Power Supplies About Power Supplies Note Remove a Power Supply (Hot-Swap) Caution Note Page Remove a Power Supply Note Install a Power Supply Power Supply Device Identifiers Note Power Supply LED Servicing PCIe Cards Remove a PCIe Card Page Add a PCIe Card PCIe Device Identifiers Note PCIe Slot Configuration Guidelines Note Servicing CMP/Memory Modules CMP/Memory Modules Overview Page Remove a CMP/Memory Module Install a CMP/Memory Module Note Add a CMP/Memory Module Page CMP and Memory Module Device Identifiers Note Supported CMP/Memory Module Configurations Servicing FB-DIMMs Remove FB-DIMMs Caution Install FB-DIMMs Tip Verify FB-DIMM Replacement Page Note Add FB-DIMMs FB-DIMM Configuration Supported FB-DIMM Configurations Memory Bank Configurations Page Note identifiers and the corresponding slots on the CMP/memory modules. FB-DIMM Device Identifiers FB-DIMM Fault Button Locations Note Page Servicing Field-Replaceable Units Note Servicing the Front Bezel Remove the Front Bezel Install the Front Bezel Servicing the DVD-ROM Drive Remove the DVD-ROM Drive Install the DVD-ROM Drive Servicing the Service Processor Remove the Service Processor Page Install the Service Processor Servicing the IDPROM Remove the IDPROM Install the IDPROM Servicing the Battery Remove the Battery Install the Battery Servicing the Power Distribution Board Remove the Power Distribution Board Note Install the Power Distribution Board Note Servicing the Fan Tray Carriage Remove the Fan Tray Carriage Note Install the Fan Tray Carriage Note Servicing the Hard Drive Backplane Remove the Hard Drive Backplane Page Note Servicing the Motherboard Note Remove the Motherboard Page Note Install the Motherboard Note Motherboard Fastener Locations Servicing the Flex Cable Assembly Remove the Flex Cable Assembly Install the Flex Cable Assembly Page Servicing the Front Control Panel Remove the Front Control Panel Page Servicing the Front I/O Board Remove the Front I/O Board Install the Front I/O Board Page Returning the Server to Operation Caution Install the Top Cover Note Install the Server Into the Rack Caution Note Slide the Server Into the Rack Page Connect the Power Cords to the Server Note Power On the Server Note Page Performing Node Reconfiguration I/O Connections to CMP/Memory Modules Recovering From a Failed CMP/Memory Module Options for Recovering From a Failed CMP/Memory Module Note Reconfiguring I/O Device Nodes Options for Reconfiguring I/O Device Nodes Reconfigure the I/O and PCIe Fabric Temporarily Disable All Memory Modules Re-Enable All Memory Modules Reset the LDoms Guest Configuration Page I/O Fabric in 2P Configuration I/O Fabric in 4P Configuration Page Identifying Connector Pinouts Page Page Serial Port Connector Pinouts USB Connector Pinouts Gigabit Ethernet Connector Pinouts Server Components Page Page Page Page Page Index Numerics A B C D E F G H I L M N O P Q R S T U V X