Fujitsu M10-4, M10-4S - page 10

Chapter 13 Maintaining the PCI Express Cards 239

13.1 Configurationof the PCI Express Cards 239

13.2 BeforeMaintaining a PCI Express Card 241

13.2.1 Types of maintenance 241

13.2.2 Maintenanceflow 241

13.2.3 Precautionsfor replacement 242

13.2.4 Precautionsfor installation 242

13.2.5 Precautionsfor removal 242

13.3 CheckingIf PCI Hot Plug (PHP) Can Be Used 243

13.4 Enablingthe Removal of a PCI Express Card 246

13.4.1 Active/Hotmaintenance (with PHP) 246

13.4.2 Active/Hotmaintenance (with DR) 250

13.4.3 Inactive/Hotmaintenance 252

13.4.4 System-stopped maintenance 252

13.5 Removing a PCI Express Card 253

13.5.1 Accessing a PCI Express card cassette 253

13.5.2 Removinga PCI Express card cassette 253

13.5.3 Removing a PCI Express card 255

13.6 Installing a PCI Express Card 258

13.6.1 Installinga PCI Express card 258

13.6.2 Installinga PCI Express card cassette 260

13.6.3 Restoringthe chassis 260

13.7 Restoringthe System 260

13.7.1 Active/Hotmaintenance (with PHP) 261

13.7.2 Active/Hotmaintenance (with DR) 262

13.7.3 Inactive/Hotmaintenance 262

13.7.4 System-stopped maintenance 263

Chapter 14 Maintaining the PSU Backplane Unit 265

14.1 Locationof the PSU Backplane Unit 265

14.2 BeforeMaintaining the PSU Backplane Unit 266

14.2.1 Types of maintenance 267

FujitsuM10-4/Fujitsu M10-4S/SPARC M10-4/SPARC M10-4S Service Manual • December 2013x

Contents

Main Page Contents Page Page Page Page Page Page Page Page Page Page Page Page Page Page Page Page Page Preface Audience Related Documentation Text Conventions Command syntax in the text Notes on Safety Syntax of the Command-Line Interface (CLI) Document Feedback Chapter 1 Before Starting Maintenance Work 1.1 Warning/Caution Indications 1.2 Warning Labels 1.3 Labels/Tags Page Page 1.4 Safety Precautions Safety precautions on electricity Safety precautions on the racks 1.5 Notes Regarding Static Electricity How to use a wrist strap 1.6 Other Precautions 1.7 Emergency Power Off Page Page Page Page Components that can be accessedfrom the rear Internal components Figure2-5 Locations of internal components (SPARC M10-4/M10-4S) Page Page Page 2.2.1 Display function of the operation panel 2.2.2 Control function of the operation panel Page Table2-5 describes the function s of the mode switch. 2.3 Checking the LED Indications 2.3.1 Operation panel LEDs 2.3.2 LEDs on the rear panel (System locator) Page 2.3.3 LEDs on each component Page Page 2.4 Confirming the Types of Cable 2.4.1 Types of cable 2.4.2 Cable connection ports Page Page Page Chapter 3 Troubleshooting 3.1 Suspected Failure Conditions 3.2 Determining the Causes of Individual Failures Figure3-1 Troubleshooting flow 3.3 Identifying a Failure 3.3.1 Checking the LED indications 3.3.2 Checking error messages 3.3.3 Checking the status of a component showhardconf command showstatus command 3.3.4 Checking the status of a PCI expansion unit ioxadm command 3.3.5 Checking log information 3.3.6 Checking the messages output by the predictive self-repairing tool 3.3.7 Identifying the location of the chassis requiring maintenance 3.4 Downloading Error Log Information Page 4.2.1 Confirming the hardware configuration 4.2.2 Confirming the software and firmware configurations Confirming the software configuration Confirming the firmware configuration 4.3 Understanding Types of Maintenance Page Figure4-3 Active/coldmaintenance (for SPARC M10-4S maintenance) Figure4-4 Active/cold maintenance (for dedicated power distribution unit maintenance) Figure4-5 Inactive/hot maintenance (for SPARC M10-4S maintenance) Figure4-6 Inactive/hot maintenance (for crossbar box maintenance) Figure4-7 Inactive/cold maintenance (for SPARC M10-4S maintenance) Figure4-9 System-stopped maintenance (f or crossbar box maintenance) Figure4-10 System-stopped maintenance (for dedicated power distrib ution unit maintenance) Thefollowing describes the types of maintenance for FRUs. Page Page Page Chapter 5 Understanding the Preparations for Enabling Maintenance 5.1 Releasing an FRU from the System with the replacefru Command Page Page 5.2 Releasing a Chassis from the Physical Partition Page Page Page 5.3 Powering Off the Physical Partition Requiring Maintenance Page 5.4 Stopping the Entire System 5.4.1 Stopping the system with the XSCF command 5.4.2 Stopping the system from the operation panel 5.5 Accessing Components 5.5.1 Lowering the cable support 5.5.2 Removing the power cord Page Page Page Chapter 6 Understanding the Preparations for Restoring the System 6.1 Incorporating an FRU into the System with the replacefru Command 4. Confirmthat the status is normal ("Normal") after diagnosis, and then enter "f". 5. Whenthe maintenance menu appears, enter "c" to exit the operation. 6.2 Incorporating a Chassis into a Physical Partition Page 6.3 Powering On the Physical Partition Requiring Maintenance 6.4 Starting the Entire System 6.4.1 Starting the system with an XSCF command 6.4.2 Starting the system from the operation panel 6.5 Restoring the Chassis 6.5.1 Installing the power cord Page Page Page Page Page Page Page Page Page 7.2.2 Maintenance flow 7.2.3 Precautions for replacement 7.2.4 Precautions for installation 7.2.5 Precautions for removal 7.3 Enabling the Removal of a CPU Memory Unit 7.3.1 Active/Cold maintenance 7.3.2 Inactive/Cold maintenance 7.3.3 System-stopped maintenance 7.4 Removing a CPU Memory Unit 7.4.1 Accessing a CPU memory unit Page Page Page 7.4.2 Removing the CPU memory unit lower Page 7.4.3 Removing the CPU memory unit upper Page Page Page Page Page Page 7.4.4 Removing a PCI Express cable Page Page Page Page Page Page Page Page Page Page Page Page Page Page Page Page Page Page 7.5 Installing a CPU Memory Unit 7.5.1 Installing a PCI Express cable Page Page Page Page Page Page Page Page Page Page Page 7.5.2 Installing the CPU memory unit upper Page Page Page Page Page Page Page Page Page 7.5.3 Installing the CPU memory unit lower 7.5.4 Restoring the chassis 7.6 Restoring the System 7.6.1 Active/Cold maintenance 7.6.2 Inactive/Cold maintenance When the system is configured withouta hardware RA ID Page Page 7.6.3 System-stopped maintenance When the system is configured without a hardware RAID Page Page Page Page Page Page Chapter 8 Maintaining the Memory 8.1 Memory Configuration Figure8-1 Memorylocations (CPU memory unit lower) Page Figure8-2 Memorylocations (CPU memory unit upper) 8.2 Memory Configuration Rules Thissection describes the memory mounting rules and the method for checking memoryinformation. 8.2.1 Memory mounting rules Figure8-3 Mountinglocations and units of memory When only the CPU memory unit lower is mounted When both the CPU memory unit lower and the CPU memory unit upper are mounted When expanding a CPU memory unit upper to a chassis in which only a CPU memory unit lower is mounted Installit by observing the mounting configurations shown in either Table 8-3or Table 8-2. 8.2.2 Checking memory information Figure8-4 Viewing memory information 8.3 Before Maintaining Memory Thissection describes the types and flow of maintenance of the memory, as well as some precautions. 8.3.1 Types of maintenance 8.3.2 Maintenance flow 8.3.3 Precautions for replacement 8.3.4 Precautions for installation 8.3.5 Precautions for removal 8.4 Enabling the Removal of Memory 8.4.1 Active/Cold maintenance 8.4.2 Inactive/Cold maintenance 8.4.3 System-stopped maintenance 8.5 Removing Memory 8.5.1 Accessing memory 8.5.2 Removing memory 8.6 Installing Memory 8.6.1 Installing memory 8.6.2 Restoring the chassis 8.7 Restoring the System 8.7.1 Active/Cold maintenance 8.7.2 Inactive/Cold maintenance Page 8.7.3 System-stopped maintenance Chapter 9 Maintaining the Crossbar Units 9.1 Configuration of the Crossbar Units 9.2 Before Maintaining a Crossbar Unit 9.2.1 Types of maintenance 9.2.2 Maintenance flow 9.3 Enabling the Removal of a Crossbar 9.3.1 Active/Cold maintenance 9.3.2 Inactive/Cold maintenance 9.3.3 System-stopped maintenance 9.4 Removing a Crossbar Unit 9.4.1 Accessing a crossbar unit 9.4.2 Removing a crossbar unit Page 9.5 Installing a Crossbar Unit 9.5.1 Installing a crossbar unit 9.5.2 Restoring the chassis 9.6 Restoring the System 9.6.1 Active/Cold maintenance 9.6.2 Inactive/Cold maintenance Page 9.6.3 System-stopped maintenance Page Page 10.2.2 Maintenance flow 10.2.3 P recautions for replacement 10.3 Enabling the Removal of a Power Supply Unit 10.3.1 Active/Hot maintenance 10.3.2 Active/Cold maintenance 10.3.3 Inactive/Hot maintenance 10.3.4 Inactive/Cold maintenance 10.3.5 System-stopped maintenance 10.4 Removing a Power Supply Unit 10.4.1 Accessing a power supply unit 10.4.2 Removing a power supply unit 10.5 Installing a Power Supply Unit 10.5.1 Installing a power supply unit 10.5.2 Restoring the chassis 10.6 Restoring the System 10.6.1 Active/Hot maintenance 10.6.2 Active/Cold maintenance 10.6.3 Inactive/Hot maintenance 10.6.4 Inactive/Cold maintenance 10.6.5 System-stopped maintenance Page Chapter 11 Maintaining the Fan Units 11.1 Configuration of the Fan Units 11.2 Before Maintaining a Fan Unit 11.2.1 T ypes of maintenance 11.2.2 Maintenance flow 11.2.3 P recautions for replacement 11.3 Enabling the Removal of a Fan Unit 11.3.1 Active/Hot maintenance 11.3.2 Active/Cold maintenance 11.3.3 Inactive/Hot maintenance Page 11.3.4 Inactive/Cold maintenance 11.3.5 System-stopped maintenance 11.4 Removing a Fan Unit Page 11.5 Installing a Fan Unit 11.5.1 Installing a fan unit 11.5.2 Restoring the chassis 11.6 Restoring the System 11.6.1 Active/Hot maintenance 11.6.2 Active/Cold maintenance 11.6.3 Inactive/Hot maintenance 11.6.4 Inactive/Cold maintenance 11.6.5 System-stopped maintenance Page Chapter 12 Maintaining the Internal Disks 12.1 Configuration of the Internal Disks 12.1.1 Identification of disk slot Using the format command (Oracle Solaris 11) 2. Executethe format command to confirm the physical disk slot. Using the diskinfo command (Oracle Solaris 11) Page Using the diskinfo command (Oracle Solaris 10) Page 12.2 Before M aintaining an Internal Disk 12.2.1 Types of maintenance 12.2.2 Maintenance flow 12.2.3 Precautions for installation 12.2.4 Precautions for removal 12.3 Enabling the Removal of an Internal Disk 12.3.1 Active/Hot maintenance When the system is configured with a softwareR AID When the system is configured without either a hardware RAID or software RAID 12.3.2 Active/Cold maintenance 12.3.3 Inactive/Hot maintenance 12.3.4 Inactive/Cold maintenance 12.3.5 System-stopped maintenance 12.4 Removing an Internal Disk Page 12.5 Installing an Internal Disk 12.5.1 Installing an internal disk 12.5.2 Restoring the chassis 12.6 Restoring the System 12.6.1 Active/Hot maintenance When the system is configured with asoftware RA ID When the system is configured withouteither a hardware RAID or software RAID 12.6.2 Active/Cold maintenance 12.6.3 Inactive/Hot maintenance 12.6.4 Inactive/Cold maintenance 12.6.5 System-stopped maintenance Page Chapter 13 Maintaining the PCI Express Cards 13.1 Configuration of the PCI Express Cards Figure13-1 Locationof the PCIe card 13.2 Before Maintaining a PCI Express Card 13.2.1 Typesof maintenance 13.2.2 Maintenanceflow 13.2.3 Precautions for replacement 13.2.4 Precautions for installation 13.2.5 Precautions for removal 13.3 Checking If PCI Hot Plug (PHP) Can Be Used Page Page 13.4 Enabling the Removal of a PCI Express Card 13.4.1 Active/Hot maintenance (with PHP) 1. Open the rack door. Page Page Page 13.4.2 Active/Hot maintenance (with DR) Page 13.4.3 Inactive/Hot maintenance 13.4.4 System-stopped maintenance 13.5 Removing a PCI Express Card 13.5.1 Accessing a PCI Express card cassette 13.5.2 Removing a PCI Express card cassette Page Page Page Page 13.6 Installing a PCI Express Card 13.6.1 Installing a PCI Express card Page 13.6.2 Installing a PCI Express card cassette 13.6.3 Restoring the chassis 13.7 Restoring the System 13.7.1 Active/Hot maintenance (with PHP) 13.7.2 Active/Hot maintenance (with DR) 13.7.3 Inactive/Hot maintenance 13.7.4 System-stopped maintenance Page Chapter 14 Maintaining the PSU Backplane Unit 14.1 Location of the PSU Backplane Unit Page 14.2.1 T ypes of maintenance 14.2.2 Maintenance flow 14.3 Enabl ing the Removal of the PSU 14.3.1 Active/Cold maintenance 14.3.2 Inactive/Cold maintenance 14.3.3 System-stopped maintenance 14.4 Removing the PSU Backplane Unit 14.4.1 Accessing the PSU backplane unit Page Page 14.5 Installing the PSU Backplane Unit 14.5.1 Installing the PSU backplane unit 14.5.2 Restoring the chassis 14.6 Restoring the System 14.6.1 Active/Cold maintenance 14.6.2 Inactive/Cold maintenance 14.6.3 System-stopped maintenance Page Page Page Page 15.2.2 Maintenance flow 15.2.3 P recautions for replacement 15.3 Enabl ing the Removal of the Operation 15.3.1 Active/Cold maintenance 15.3.2 Inactive/Cold maintenance 15.3.3 System-stopped maintenance 15.4 Removing the Operation Panel 15.4.1 Accessing the operation panel Page 15.4.2 Removing the operation panel 15.5 Installing the Operation Panel 15.5.1 Installing the operation panel 15.5.2 Restoring the chassis 15.6 Restoring the System 15.6.1 Active/Cold maintenance 15.6.2 Inactive/Cold maintenance 15.6.3 System-stopped maintenance Page Page Page 16.2 Before Maintaining a Crossbar Unit 16.2.1 Types of maintenance 16.2.2 Maintenance flow 16.3 Enabling the Removal of a Crossbar 16.3.1 A ctive/Cold maintenance 16.3.2 Inactive/Cold maintenance 16.3.3 System-stopped maintenance 16.4 Removing a Crossbar Unit Page 16.5 Installing a Crossbar Unit 16.6 Restoring the System 16.6.1 Active/Cold maintenance 16.6.2 Inactive/Cold maintenance 16.6.3 System-stopped maintenance Page Page 17.2 Before Maintaining the XSCF Unit 17.2.1 Types of maintenance 17.2.2 Maintenance flow 17.3 Enabl ing the Removal of the XSCF 17.3.1 Active/Hot maintenance 17.3.2 Inactive/Hot maintenance 17.3.3 System-stopped maintenance 17.4 Removing the XSCF Unit Page 17.5 Installing the XSCF Unit 17.6 Restoring the System 17.6.1 Active/Hot maintenance 17.6.2 Inactive/Hot maintenance 17.6.3 System-stopped maintenance Page 18.2 Before Maintaining a Power Supply 18.2.1 Types of maintenance 18.2.2 Maintenance flow 18.2.3 P recautions for replacement 18.3 Enabling the Removal of a Power Supply Unit 18.3.1 Active/Hot maintenance 18.3.2 Inactive/Hot maintenance 18.3.3 System-stopped maintenance 18.4 Removing a Power Supply Unit 18.5 Installing a Power Supply Unit 18.6 Restoring the System 18.6.1 Active/Hot maintenance 18.6.2 Inactive/Hot maintenance 18.6.3 System-stopped maintenance Page Page 19.2 Before Maintaining a Fan Unit 19.2.1 T ypes of maintenance 19.2.2 Maintenance flow 19.2.3 P recautions for replacement 19.3 Enabling the Removal of a Fan Unit 19.3.1 Active/Hot maintenance 19.3.2 Inactive/Hot maintenance 19.3.3 System-stopped maintenance 19.4 Removing a Fan Unit 19.4.1 Accessing a fan unit 19.4.2 Removing a fan unit 19.5 Installing a Fan Unit 19.5.1 Installing a fan unit 19.5.2 Restoring the chassis 19.6 Restoring the System 19.6.1 Active/Hot maintenance 19.6.2 Inactive/Hot maintenance 19.6.3 System-stopped maintenance Page Page Page 20.2 Before Maintaining the XSCF Interface 20.2.1 Types of maintenance 20.2.2 Maintenance flow 20.3 Enabl ing the Removal of the XSCF Interface Unit 20.4 Removing the XSCF Interface Unit Page 20.5 Installing the XSCF Interface Unit 20.6 Restoring the System Page 21.2 Before Maintaining the Crossbar 21.2.1 Types of maintenance 21.2.2 Maintenance flow 21.3 Enabling the Removal of the Crossbar 21.4 Removing the Crossbar Backplane Page Page Page Page Page Page 21.5 Installing the Crossbar Backplane Unit 21.6 Restoring the System Page Page Page 22.2 Before Maintaining the Fan Backplane 22.2.1 T ypes of maintenance 22.2.2 Maintenance flow 22.3 Enabling the Removal of the Fan Backplane 22.4 Removing the Fan Backplane 22.4.1 Accessing the fan backplane 22.4.2 Removing the fan backplane Page Page Page 22.5 Installing the Fan Backplane 22.5.1 Installing the fan backplane 22.5.2 Restoring the chassis 22.6 Restoring the System Page 23.2 Before Maintaining the Operation 23.2.1 Types of maintenance 23.2.2 Maintenance flow 23.2.3 P recautions for replacement 23.3 Enabl ing the Removal of the Operation 23.4 Removing the Operation Panel 23.4.1 Accessing the operation panel Page Page Page Page Page Page 23.5.2 Restoring the chassis 23.6 Restoring the System Page Figure24-1 Connection ports for crossbar cables (electrical) Figure24-2 Crossbarcables (electrical) 24.2 Before Maintaining a Crossbar Cable (Electrical) 24.2.1 T ypes of maintenance 24.2.2 Maintenance flow 24.2.3 Precautions for replacement 24.3 Enabling the Removal of a Crossbar Cable (Electrical) 24.3.1 Inactive/Cold maintenance 24.3.2 System-stopped maintenance 24.4 Removing a Crossbar Cable (Electrical) 24.5 Installing a Crossbar Cable (Electrical) 24.6 Restoring the System 24.6.1 Inactive/Cold maintenance 24.6.2 System-stopped maintenance Page Page Figure25-1 Connectionports for crossbar cables (optical) (SPARC M10-4S) Figure25-2 Connectionports for crossbar cables (optical) (crossbar box) Page 25.2 Before M aintaining a Crossbar Cable (Optical) 25.2.1 Types of maintenance 25.2.2 Maintenance flow 25.2.3 Precautions for replacement 25.3 Enabling the Removal of a Crossbar Cable (Optical) 25.3.1 Inactive/Cold maintenance 25.3.2 System-stopped maintenance 25.4 Removing a Crossbar Cable (Optical) Page 25.5 Installing a Crossbar Cable (Optical) 25.6 Restoring the System 25.6.1 Inactive/Cold maintenance 25.6.2 System-stopped maintenance Page Page Page Page 26.2 Before Maintaining an XSCF BB 26.2.1 T ypes of maintenance 26.2.2 Maintenance flow 26.3 Enabling the Removal of an XSCF BB 26.3.1 Active/Hot maintenance 26.3.2 Active/Cold maintenance 26.3.3 Inactive/Hot maintenance 26.3.4 Inactive/Cold maintenance 26.3.5 System-stopped maintenance 26.4 Removing an XSCF BB Control Cable Page 26.5 Installing an XSCF BB Control Cable 26.6 Restoring the System 26.6.1 Active/Hot maintenance 26.6.2 Active/Cold maintenance 26.6.3 Inactive/Hot maintenance 26.6.4 Inactive/Cold maintenance 26.6.5 System-stopped maintenance Page Page Page 27.2 Before Maintaining an XSCF DUAL 27.2.1 T ypes of maintenance 27.2.2 Maintenance flow 27.3 Enabling the Removal of an XSCF DUAL Control Cable 27.3.1 Active/Hot maintenance 27.3.2 Active/Cold maintenance 27.3.3 Inactive/Hot maintenance 27.3.4 Inactive/Cold maintenance 27.3.5 System-stopped maintenance 27.4 Removing an XSCF DUAL Control Cable Page 27.5 Installing an XSCF DUAL Control Cable 27.6 Restoring the System 27.6.1 Active/Hot maintenance 27.6.2 Active/Cold maintenance 27.6.3 Inactive/Hot maintenance 27.6.4 Inactive/Cold maintenance 27.6.5 System-stopped maintenance Page Chapter 28 Maintaining the Cable Kit of the Crossbar Box 28.1 Configuration of the Cable Kit 28.1.1 Cables for the connection between the crossbar backplane unit and terminal board Page 28.1.2 Cables for the connection between the terminal board and fan backplane 28.1.3 Locations for the cable kit 28.2 Before Maintaining the Cable Kit 28.2.1 Types of maintenance 28.2.2 Maintenance flow 28.3 Enabling the Removal of the Cable Kit 28.4 Removing the Cable Kit 28.4.1 Removing the cables for the connection between the crossbar backplane unit and terminal board Page Page Page Page Page Page Page Page Page Page Page Page 28.5 Installing the Cable Kit 28.5.2 Installing a cable for the connection between the terminal board and fan backplane Page Page Page Page Page 28.6 Restoring the System Page Page Figure29-1 Locationof the PDU 29.2 Before Maintaining the Dedicated Power Distribution Unit 29.2.1 T ypes of maintenance 29.2.2 Maintenance flow 29.2.3 P recautions for replacement 29.3 Enabling the Removal of the Dedicated Power Distribution Unit 29.3.1 Active/Cold maintenance 29.3.2 System-stopped maintenance 29.4 Removing the Dedicated Power Distribution Unit Page Page Page 29.5 Installing the Dedicated Power Distribution Unit 29.6 Restoring the System 29.6.1 Active/Cold maintenance 29.6.2 System-stopped maintenance Appendix A Component List Page FigureA-2 Locations of compo nents of crossbar box FigureA-3 Locations of components of expanded connection rack Appendix B Component Specifications Components that constitutethe SPA RC M10-4/M10-4S Components that constitutethe crossbar box B.1 CPU Memory Unit B.2 Crossbar Unit B.3 XSCF Unit B.4 Power Supply Unit B.5 Fan Unit B.6 Internal Disk Drive B.7 PCI Express Card B.8 XSCF Interface Unit B.9 Backplanes Page Page B.10 Operation Panel Appendix C Oracle Solaris Troubleshooting Commands C.1 iostat(1M) Command Thefoll owing example shows the iostat(1M) command output. C.2 prtdiag(1M) Command Page Page C.3 prtconf(1M) Command Thefollowing example shows the prtconf(1M) command output. Page Page C.4 netstat(1M) Command Thefoll owing example shows the netstat(1M) command output. C.5 ping(1M) Command Theping (1M) command sends the ICMP ECHO_REQUEST packet to network hosts. Thefollowing example shows the ping(1M) command output. C.6 ps(1) Command Thefollowing example shows the ps(1M) command output. C.7 prstat(1M) Command Thefoll owing example shows the prstat(1M) command output. Appendix D External Interface Specifications D.1 Serial Port D.1.1 Wire connection chart for serial cable FigureD-1 Wire connection chart o f serial cable D.2 USB Port TableD-2 lists the specifications of the USB port of the SPARC M10-4/M10-4S and the crossbar box. D.3 SAS Port D.4 RESET Switch Page Index