Sun BladeTM T6320 Server Module Service Manual
Sun Microsystems, Inc
This distribution may include materials developed by third parties
Contents
2. Sun Blade T6320 Server Module Diagnostics
Preface
1. Sun Blade T6320 Server Module Product Description
iv Sun Blade T6320 Server Module Service Manual June
Contents
3. Replacing Hot-Swappable and Hot-Pluggable Components
4. Replacing Cold-Swappable Components
vi Sun Blade T6320 Server Module Service Manual June
A. Specifications
D. XVR-50 Graphics Accelerator
Index
Index-1
Checking Device Configuration D-5
HD15 Video Output Port D-6
Using UNIX Commands
Preface
Accessing Sun Documentation
Typographic Conventions
Shell Prompts
http//docs.sun.com/app/docs/prod/blade.t6320
module
Preface
Sun Welcomes Your Comments
Third-Party Web Sites
Documentation, Support, and Training
Section 1.2, “Support for RAID Storage Configurations” on page
Section 1.4, “Additional Service Related Information” on page
Sun Blade T6320 Server Module Product Description
1.1 Component Overview
1-2 Sun Blade T6320 Server Module Service Manual June
FIGURE 1-1 Sun Blade T6320 Server Module With Chassis
Rear View
FIGURE 1-2 Front and Rear Panels
Front View
Four connector dongle cable UCP-4
two connectors
Three connector dongle cable UCP-3 RJ-45 serial USB two connectors
1-4 Sun Blade T6320 Server Module Service Manual June
during normal system operation
TABLE 1-1 Sun Blade T6320 Server Module Features Continued
1-6 Sun Blade T6320 Server Module Service Manual June
TABLE 1-2 Interfaces With the chassis
and FIGURE A-2
http//docs.sun.com/app/docs/prod/blade.srvr
FB-DIMMs RAID Expansion Module Service processor
with NVRAM EEPROM with ILOM and ALOM Battery Hard drives
Section 4.4, “Removing and Replacing the Service Processor” on page
1-8 Sun Blade T6320 Server Module Service Manual June
Replacement Instructions
Section 4.3.1, “Removing
the DIMMs” on page
1.1.1 Multicore Processor Information
BL = blade server module NEM1 NEM0
Sun StorageTek RAID Manager Software Users Guide
1.2 Support for RAID Storage Configurations
Uniform Command-Line Interface Users Guide
1.2.1 Sun Blade RAID 5 Expansion Module
1.3 Finding the Serial Number
1.2.2 Sun Blade RAID 0/1 G2 Expansion Module
1-12 Sun Blade T6320 Server Module Service Manual June
FIGURE 1-6 Serial Number and MAC Address Location
MAC address
Serial number
ALOM CMT example
1.4 Additional Service Related Information
1-14 Sun Blade T6320 Server Module Service Manual June
sc showplatform
Slot Number 5 Domain Status
Sun Blade T6320 Server Module Diagnostics
Section 2.2, “Memory Configuration and Fault Handling” on page
Section 2.5, “Using the ILOM Web Interface For Diagnostics” on page
Section 2.3, “Interpreting System LEDs” on page
2.1 Sun Blade T6320 Server Module Diagnostics Overview
Sun Integrated Lights out Manager 2.0 User’s Guide
Chapter 2 Sun Blade T6320 Server Module Diagnostics
FIGURE 2-1 Diagnostic Flowchart
SP/faultmgt
connected and the chassis has power
Section 2.5.3, “Displaying System Faults” on page
System Faults” on
Check the OK LED. The OK LED is located on the front of the Sun Blade
FRU-name deemed faulty and disabled
Section 4.2, “Common Procedures for Parts Replacement” on page
Section 2.7.2, “Clearing PSH Detected Faults” on page
Section 2.7.3, “Clearing the PSH Fault From the ILOM Logs” on page
When Upgrading Memory
2.2 Memory Configuration and Fault Handling
2.2.1 FB-DIMM Configuration Guidelines
2.2.1.1 DIMM Installation Rules
When Replacing Faulty FB-DIMMs
FIGURE 2-3 FB-DIMM Installation Rules
Four DIMMs installed
Eight DIMMs installed
Sixteen DIMMs installed
FIGURE 2-4 DIMM Locate Button and DIMM LEDs
FB-DIMM Configuration and Installation
You can also use TABLE 2-2 to identify the DIMMs you want to remove
TABLE 2-2 FB-DIMM Configuration and Installation Continued
2.2.1.2 Memory Fault Handling
2.2.1.3 Troubleshooting Memory Faults
2.3 Interpreting System LEDs
2.3.1 Front Panel LEDs and Buttons
The LEDs have assigned meanings, described in TABLE
FIGURE 2-5 Front Panel and Hard Drive LEDs
Front View
TABLE 2-3 LED Behavior and Meaning
2-14 Sun Blade T6320 Server Module Service Manual June
TABLE 2-4 LED Behaviors With Assigned Meanings
TABLE 2-5 Front Panel Buttons
Chapter 2 Sun Blade T6320 Server Module Diagnostics
TABLE 2-4 LED Behaviors With Assigned Meanings Continued
http//docs.sun.com/app/docs/prod/blade.6000mod
2.4 Using ILOM for Diagnosis and Repair Verification
2.3.2 Ethernet Port LEDs
ILOM
Service Required LED FRU LEDs FRUID PROMs Event Logs Alerts
2.5 Using the ILOM Web Interface For Diagnostics
fru at location is OK
2.5.1 Changing POST Settings With the ILOM Web Interface
ILOM CLI -show /SP/network
1. Select the Remote Control tab and the Diagnostics tab FIGURE
1. Type the show command to see the current POST settings
2.5.2 Changing POST Settings With the ILOM CLI
2.5.3 Displaying System Faults
2.5.3.1 Viewing Fault Status Using the ILOM Web Interface
FIGURE 2-12 Component Management Page - Fault Status
2.5.3.2 Viewing Fault Status Using the ILOM CLI
FIGURE 2-11 Faulted Component ID Window
show /SP/faultmgmt
2.5.4 Displaying the Environmental Status with the ILOM CLI
3. Double click on the sensor reading that you want to check FIGURE
Chapter 2 Sun Blade T6320 Server Module Diagnostics
2.5.6.1 Using the ILOM Web Interface to Display FRU Information
2.5.6 Displaying FRU Information
1. Select the System Information and Components tabs
2. Click on the component to view the FRU information FIGURE
FIGURE 2-15 Static FRU Information in the ILOM Web Interface
2.5.6.2 Using the CLI to Display FRU Information
Chapter 2 Sun Blade T6320 Server Module Diagnostics
At the - prompt, type the show command
show /SYS/MB
sc showfru SYS/SP container
2.6 Running POST
2.6.1 Controlling How POST Runs
TABLE 2-6 Parameters Used For POST Configuration
FIGURE 2-16 Flowchart of ILOM Variables for POST Configuration
2-32 Sun Blade T6320 Server Module Service Manual June
2.6.2.1 Using the Web Interface to Change POST Parameters
2. Select the Diagnostics Tab
3. Select the POST settings that you require
2.6.2 Changing POST Parameters
5. Select the Remote Power Control Tab
6. Select a power control setting and Select Save FIGURE
FIGURE 2-17 Setting POST Parameters With the ILOM Web Interface
2-34 Sun Blade T6320 Server Module Service Manual June
FIGURE 2-18 Changing Power Settings with the ILOM Web Interface
2.6.2.2 Using the CLI to Change POST Parameters
1. Verify the current post parameters with the show command. Type
2. Type the set command to change the POST parameters
show /HOST/diag
3. Power cycle the server module to run POST
cs MSG = test-error-message
2.6.3 Interpreting POST Messages
1. Interpret the POST messages
2.6.4 Clearing POST Detected Faults
See Section 2.9, “Managing Components With Automatic System Recovery
Commands” on page
show /SP/faultmgmt
2.6.4.1 Clearing Faults With the Web Interface
3. In the Actions menu, select Enable Component
1. Select the tabs System Information and Components tabs FIGURE
2. Select the radio button for the component that you must clear
2.6.4.2 Clearing Faults With the ILOM CLI
POST detected faults
3. Reboot the server module
show /SP/faultmgmt
2.7 Using the Solaris Predictive Self-Healing Feature
2.6.4.3 Clearing Faults Manually with ILOM
2.6.4.4 Clearing Hard Drive Faults
show /SP/faultmgmt
2.7.1 Identifying Faults With the fmadm faulty and fmdump Commands
2.7.1.1 Using the fmadm faulty Command
2.7.1.2 Using the fmdump Command
# fmdump
b. Type the message ID in the SUNW-MSG-ID field, and press Lookup
2.7.2 Clearing PSH Detected Faults
c. Follow the suggested actions to repair the fault
3. Clear the fault from all persistent fault records
2.7.3 Clearing the PSH Fault From the ILOM Logs
1. After replacing a faulty FRU, boot the system
2.8 Collecting Information From Solaris OS Files and Commands
2.8.1 Checking the Message Buffer
1. Log in as superuser
show /SP/faultmgmt
2.9 Managing Components With Automatic System Recovery Commands
2. Type the syslogd command
1. Log in as superuser 2. Type the following command
3. If you want to view all logged messages, type this command
TABLE 2-8 ASR Commands
2-48 Sun Blade T6320 Server Module Service Manual June
2.9.1 Displaying System Components With the show /SYS Command
1. At the - prompt, type the show command
2.10.1 Checking SunVTS Software Installation
2.10 Exercising the System With SunVTS
2.10.2 Exercising the System Using SunVTS Software
2. Enable the remote display. On the display system, type
2.10.3 Steps for Exercising the System With SunVTS Software
SunVTS 6.4 Test Reference Manual for SPARC Platforms
4. Start SunVTS software
2-52 Sun Blade T6320 Server Module Service Manual June
# /opt/SUNWvts/bin/sunvts -display display-system0
FIGURE 2-20 SunVTS BI
6. Optional Customize individual tests
7. Start testing
5. Optional Select the test category you want to run
2.11 Resetting the Password to the Factory Default
2.11.1 To Reset the Root Password to the Factory Default
4. Change the root password
1. Remove the server module from the modular system chassis
Chapter 2 Sun Blade T6320 Server Module Diagnostics
Page
Replacing Hot-Swappable and Hot- Pluggable Components
3.1 Hot-Pluggable Hard Drives
3.2 Hot-Plugging a Hard Drive
Section 3.1, “Hot-Pluggable Hard Drives” on page
3.2.2 Removing a Hard Drive
2. Type the Solaris OS commands required to stop using the hard drive
3.2.1 Rules for Hot-Plugging
4. Push the latch release button FIGURE
5. Grasp the latch and pull the drive out of the drive slot
Amber LED Service Action Required
Green LED
2. Slide the drive into the bay until it is fully seated FIGURE
3.2.3 Replacing a Hard Drive or Installing a New Hard Drive
1. If necessary, remove the hard drive filler panel
3. Close the latch to lock the drive in place
4. Perform administrative tasks to reconfigure the hard drive
3.3 Adding PCI ExpressModules
3-6 Sun Blade T6320 Server Module Service Manual June
4.1 Safety Information
Section 4.1, “Safety Information” on page
Section 4.2, “Common Procedures for Parts Replacement” on page
Section 4.4, “Removing and Replacing the Service Processor” on page
4.1.2.1 Using an Antistatic Wrist Strap
4.1.1 Safety Symbols
4.1.2 Electrostatic Discharge Safety
4.2 Common Procedures for Parts Replacement
4.1.2.2 Using an Antistatic Mat
4.2.1 Required Tools
4.2.2 Shutting Down the System
4.2.3 Using the ILOM Web Interface to Shut Down the Server Module
4. Shut down the Solaris OS using the shutdown 1Mcommand
1. Log in as superuser or equivalent
2. Notify affected users
Chapter 4 Replacing Cold-Swappable Components
4.2.4 Using the ILOM CLI to Shut Down the Server Module
FIGURE 4-1 Powering Off the Server Module with the ILOM Web Interface
2. At the ILOM - prompt, type the set /SYS/PS0
Four connector dongle cable UCP-4
two connectors
Three connector dongle cable UCP-3 RJ-45 serial USB two connectors
DB-9 serial, male TTYA
4. Open the ejector levers FIGURE
4-8 Sun Blade T6320 Server Module Service Manual June
FIGURE 4-4 Stack Five Server Modules or Fewer
6. Set the server module on an antistatic mat
7. Attach an antistatic wrist strap
9. Lift the cover off the chassis
4.3 Removing and Replacing DIMMs
4.3.1 Removing the DIMMs
2. Locate the DIMMs that you want to replace FIGURE
FIGURE 4-6 DIMM Locate Button and DIMM LEDs
Sixteen DIMMs installed
FB-DIMM Configuration
FB-DIMM Configuration
1. Place the replacement DIMMs on an antistatic mat
2. Ensure that the connector ejector tabs are in the open position
4.3.2 Replacing the DIMMs
6. Place DIMMs on an antistatic mat
4.3.2.1 Verifying DIMM Installation
4.4 Removing and Replacing the Service Processor
4.4.1 Removing the Service Processor
4. Place the service processor card on an antistatic mat
4.4.2 Replacing the Service Processor
The PROM is keyed to ensure proper orientation
4.5 Removing and Replacing the Battery on the Service Processor
3. Place the service processor on an antistatic mat
FIGURE 4-11 Removing the Battery From the Service Processor
4.5.1 Replacing the Battery on the Service Processor
1. Remove the replacement battery from the package
http//docs.sun.com/app/docs/prod/blade.6000disk~blade6000dskmod
4.6 Replacing or Installing the Sun Blade RAID 5 Expansion Module
Removing the RAID 5 Expansion Module
4.6.1 Installing the RAID 5 Expansion Module
2. Lift the card free from the connector
3. Lift the REM free from the gray plastic standoff
1. Place the card under the tabs of the gray plastic standoff FIGURE
Verifying the RAID 5 Expansion Module Installation
1. Power-up the computer and storage systems
a. Ensure that all hard disk drives are securely installed
d. Power-on the computer system
In the following example, the HBA is the first device that is listed
4.6.2 Configuring the RAID 5 Expansion Module
5. Return to the root node by using the unselect-dev command
4.6.3 Creating a Bootable Array With the RAID 5 Expansion Module
Uniform Command-Line Interface User’s Guide
4.7 Removing and Replacing the Sun Blade G2 RAID 0/1 Expansion Module
4.6.4 Additional Information
4.7.1 Replacing the RAID 0/1 Expansion Module
4-26 Sun Blade T6320 Server Module Service Manual June
1. Place the card under the tabs of the gray plastic standoff FIGURE
FIGURE 4-14 Removing the RAID Expansion Module
Chapter 4 Replacing Cold-Swappable Components
4.7.2 Verifying the RAID 0/1 Expansion Module Installation
FIGURE 4-15 Replacing the RAID 0/1 Expansion Module
4.8 Finishing Component Replacement
4.8.2 Reinstalling the Server Module in the Chassis
4.8.1 Replacing the Cover
1. Place the cover on the chassis
The server module powers on with 3.3v standby power
The ILOM software boots
FIGURE 4-17 Inserting the Server Module in the Chassis
Chapter 4 Replacing Cold-Swappable Components
4-30 Sun Blade T6320 Server Module Service Manual June
Specifications
A.1 Physical Specifications
Section A.1, “Physical Specifications” on page A-1
Section A.2, “Motherboard Block Diagram” on page A-3
A.1.1 System Environmental Specifications
Operating Temperature and Altitude
Non-Operating Temperature and Altitude
A-2 Sun Blade T6320 Server Module Service Manual June
A.2 Motherboard Block Diagram
Appendix A Specifications A-3
A-4 Sun Blade T6320 Server Module Service Manual June
Creating a Bootable Array With the Sun Blade RAID 5 Expansion Module
“About Creating a Bootable Array on a SPARC System” on page
“Creating a Bootable Array Task Map” on page
“Modifying the Miniroot Directory On the Install Server” on page
1. Install and connect the HBA and disk drives
B.1 About Creating a Bootable Array on a SPARC System
B.2 Creating a Bootable Array Task Map
B.3 Modifying the Miniroot Directory On the Install Server
6. Modify two locations on the network install server
7. Build a logical drive on which to install the Solaris 10 5/08 OS
SUNWaac StorMan SUNWgccruntime
To Modify the Miniroot Directory
To Modify the Product Installation Directory
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. SUNWaac
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. SUNWgccruntime
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. StorMan
B.5 Building a Logical Drive On Which to Install the Solaris OS
To Create a Logical Drive Using a Network Install Server
“To Create a Logical Drive Using a Network Install Server” on page
“To Create a Logical Drive Without a Network Install Server” on page
Labeling the drive Partitioning the drive Preparing a file system
To Create a Logical Drive Without a Network Install Server
4. Insert the path to your CDROM drive
SC network configuration is IP Address Gateway address Netmask
Ethernet Address 00144FE5AD6B
To Delete a Logical Drive on the REM
To Label the Newly Created Logical Drive
To delete a logical drive on the REM, use the DELETE card-number
# init
B.6 Next Steps
# format
B.6.1 Additional Information
Uniform Command-Line Interface User’s Guide
http//docs.sun.com/app/docs/coll/dsk-cntrl
Sun StorageTek RAID Manager Software User’s Guide
Installing the Solaris OS and the RAID 5 Expansion Module Driver
C.1 Preparing to Install the Solaris OS
To Prepare to Install the Solaris OS
“Preparing to Install the Solaris OS” on page
C.2 Installing the RAID 5 Expansion Module Driver With the Solaris OS
To Install the RAID 5 Expansion Module Driver With the Solaris OS
2. Specify that you want to perform a Manual Reboot
3. Use the df command to verify the following
7. Reboot the system
5. Apply the HBA driver package, SUNWaac
6. Apply any patches that are specifically required for the system
# reboot
C.3 Next Steps
C.3.1 Additional Information
Uniform Command-Line Interface User’s Guide
http//docs.sun.com/app/docs/prod/stortek.raid.hba
D.1 Features
Section D.1, “Features” on page D-1
Section D.6, “Default Color Depth” on page D-4
Section D.7, “Checking Device Configuration” on page D-5
host% fbconfig -res \?
D.2 Video Formats
D.4 Man Pages
host% fbconfig -list
D.3 Sun OpenGL for Solaris Software
D.6 Default Color Depth
To access the fbconfig man page, type
To access the XVR-50 graphics accelerator man page, type
8. Set the desired screen resolution. For example, type
2. Log out and then log back in for the change to take effect
D.7 Checking Device Configuration
host% fbconfig -dev pfb0 -propt
host% fbconfig -dev pfb0 -prconf
D.8 HD15 Video Output Port
Index
Page
Page
Page
actions, 2-5 DIMMs
UltraSPARC T1 processor and PSH
video formats, HD15, D-2 video, Sun XVR-50, D-1
voltage and current sensor status, displaying
Index-6 Sun Blade T6320 Server Module Service Manual June
