Sun Microsystems, Inc
Sun BladeTM T6320 Server Module Service Manual
This distribution may include materials developed by third parties
2. Sun Blade T6320 Server Module Diagnostics
Contents
Preface
1. Sun Blade T6320 Server Module Product Description
iv Sun Blade T6320 Server Module Service Manual June
3. Replacing Hot-Swappable and Hot-Pluggable Components
4. Replacing Cold-Swappable Components
Contents
vi Sun Blade T6320 Server Module Service Manual June
D. XVR-50 Graphics Accelerator
A. Specifications
Index-1
Index
Checking Device Configuration D-5
HD15 Video Output Port D-6
Preface
Using UNIX Commands
Typographic Conventions
Accessing Sun Documentation
Shell Prompts
http//docs.sun.com/app/docs/prod/blade.t6320
Preface
module
Third-Party Web Sites
Documentation, Support, and Training
Sun Welcomes Your Comments
Section 1.4, “Additional Service Related Information” on page
Section 1.2, “Support for RAID Storage Configurations” on page
Sun Blade T6320 Server Module Product Description
1.1 Component Overview
FIGURE 1-1 Sun Blade T6320 Server Module With Chassis
1-2 Sun Blade T6320 Server Module Service Manual June
FIGURE 1-2 Front and Rear Panels
Front View
Rear View
two connectors
Four connector dongle cable UCP-4
Three connector dongle cable UCP-3 RJ-45 serial USB two connectors
1-4 Sun Blade T6320 Server Module Service Manual June
during normal system operation
1-6 Sun Blade T6320 Server Module Service Manual June
TABLE 1-1 Sun Blade T6320 Server Module Features Continued
TABLE 1-2 Interfaces With the chassis
and FIGURE A-2
FB-DIMMs RAID Expansion Module Service processor
http//docs.sun.com/app/docs/prod/blade.srvr
with NVRAM EEPROM with ILOM and ALOM Battery Hard drives
Section 4.4, “Removing and Replacing the Service Processor” on page
Replacement Instructions
1-8 Sun Blade T6320 Server Module Service Manual June
Section 4.3.1, “Removing
the DIMMs” on page
BL = blade server module NEM1 NEM0
1.1.1 Multicore Processor Information
1.2 Support for RAID Storage Configurations
Uniform Command-Line Interface Users Guide
Sun StorageTek RAID Manager Software Users Guide
1.3 Finding the Serial Number
1.2.2 Sun Blade RAID 0/1 G2 Expansion Module
1.2.1 Sun Blade RAID 5 Expansion Module
FIGURE 1-6 Serial Number and MAC Address Location
1-12 Sun Blade T6320 Server Module Service Manual June
MAC address
Serial number
ALOM CMT example
1-14 Sun Blade T6320 Server Module Service Manual June
1.4 Additional Service Related Information
sc showplatform
Slot Number 5 Domain Status
Section 2.2, “Memory Configuration and Fault Handling” on page
Sun Blade T6320 Server Module Diagnostics
Section 2.5, “Using the ILOM Web Interface For Diagnostics” on page
Section 2.3, “Interpreting System LEDs” on page
Sun Integrated Lights out Manager 2.0 User’s Guide
2.1 Sun Blade T6320 Server Module Diagnostics Overview
Chapter 2 Sun Blade T6320 Server Module Diagnostics
SP/faultmgt
FIGURE 2-1 Diagnostic Flowchart
Section 2.5.3, “Displaying System Faults” on page
connected and the chassis has power
System Faults” on
Check the OK LED. The OK LED is located on the front of the Sun Blade
Section 4.2, “Common Procedures for Parts Replacement” on page
FRU-name deemed faulty and disabled
Section 2.7.2, “Clearing PSH Detected Faults” on page
Section 2.7.3, “Clearing the PSH Fault From the ILOM Logs” on page
2.2 Memory Configuration and Fault Handling
2.2.1 FB-DIMM Configuration Guidelines
When Upgrading Memory
When Replacing Faulty FB-DIMMs
2.2.1.1 DIMM Installation Rules
Four DIMMs installed
FIGURE 2-3 FB-DIMM Installation Rules
Eight DIMMs installed
Sixteen DIMMs installed
FB-DIMM Configuration and Installation
You can also use TABLE 2-2 to identify the DIMMs you want to remove
FIGURE 2-4 DIMM Locate Button and DIMM LEDs
2.2.1.2 Memory Fault Handling
2.2.1.3 Troubleshooting Memory Faults
TABLE 2-2 FB-DIMM Configuration and Installation Continued
2.3.1 Front Panel LEDs and Buttons
2.3 Interpreting System LEDs
FIGURE 2-5 Front Panel and Hard Drive LEDs
The LEDs have assigned meanings, described in TABLE
Front View
TABLE 2-3 LED Behavior and Meaning
TABLE 2-4 LED Behaviors With Assigned Meanings
Chapter 2 Sun Blade T6320 Server Module Diagnostics
TABLE 2-4 LED Behaviors With Assigned Meanings Continued
TABLE 2-5 Front Panel Buttons
2.4 Using ILOM for Diagnosis and Repair Verification
2.3.2 Ethernet Port LEDs
http//docs.sun.com/app/docs/prod/blade.6000mod
Service Required LED FRU LEDs FRUID PROMs Event Logs Alerts
ILOM
fru at location is OK
2.5 Using the ILOM Web Interface For Diagnostics
ILOM CLI -show /SP/network
2.5.1 Changing POST Settings With the ILOM Web Interface
1. Select the Remote Control tab and the Diagnostics tab FIGURE
2.5.2 Changing POST Settings With the ILOM CLI
2.5.3 Displaying System Faults
1. Type the show command to see the current POST settings
2.5.3.1 Viewing Fault Status Using the ILOM Web Interface
2.5.3.2 Viewing Fault Status Using the ILOM CLI
FIGURE 2-11 Faulted Component ID Window
FIGURE 2-12 Component Management Page - Fault Status
2.5.4 Displaying the Environmental Status with the ILOM CLI
show /SP/faultmgmt
Chapter 2 Sun Blade T6320 Server Module Diagnostics
3. Double click on the sensor reading that you want to check FIGURE
2.5.6 Displaying FRU Information
2.5.6.1 Using the ILOM Web Interface to Display FRU Information
1. Select the System Information and Components tabs
2. Click on the component to view the FRU information FIGURE
2.5.6.2 Using the CLI to Display FRU Information
Chapter 2 Sun Blade T6320 Server Module Diagnostics
FIGURE 2-15 Static FRU Information in the ILOM Web Interface
show /SYS/MB
At the - prompt, type the show command
sc showfru SYS/SP container
2.6.1 Controlling How POST Runs
2.6 Running POST
TABLE 2-6 Parameters Used For POST Configuration
2-32 Sun Blade T6320 Server Module Service Manual June
FIGURE 2-16 Flowchart of ILOM Variables for POST Configuration
2. Select the Diagnostics Tab
2.6.2.1 Using the Web Interface to Change POST Parameters
3. Select the POST settings that you require
2.6.2 Changing POST Parameters
6. Select a power control setting and Select Save FIGURE
5. Select the Remote Power Control Tab
FIGURE 2-17 Setting POST Parameters With the ILOM Web Interface
2-34 Sun Blade T6320 Server Module Service Manual June
FIGURE 2-18 Changing Power Settings with the ILOM Web Interface
1. Verify the current post parameters with the show command. Type
2.6.2.2 Using the CLI to Change POST Parameters
2. Type the set command to change the POST parameters
show /HOST/diag
cs MSG = test-error-message
3. Power cycle the server module to run POST
2.6.3 Interpreting POST Messages
1. Interpret the POST messages
See Section 2.9, “Managing Components With Automatic System Recovery
2.6.4 Clearing POST Detected Faults
Commands” on page
show /SP/faultmgmt
3. In the Actions menu, select Enable Component
2.6.4.1 Clearing Faults With the Web Interface
1. Select the tabs System Information and Components tabs FIGURE
2. Select the radio button for the component that you must clear
POST detected faults
2.6.4.2 Clearing Faults With the ILOM CLI
3. Reboot the server module
show /SP/faultmgmt
2.6.4.3 Clearing Faults Manually with ILOM
2.7 Using the Solaris Predictive Self-Healing Feature
2.6.4.4 Clearing Hard Drive Faults
show /SP/faultmgmt
2.7.1.1 Using the fmadm faulty Command
2.7.1 Identifying Faults With the fmadm faulty and fmdump Commands
# fmdump
2.7.1.2 Using the fmdump Command
2.7.2 Clearing PSH Detected Faults
c. Follow the suggested actions to repair the fault
b. Type the message ID in the SUNW-MSG-ID field, and press Lookup
2.7.3 Clearing the PSH Fault From the ILOM Logs
1. After replacing a faulty FRU, boot the system
3. Clear the fault from all persistent fault records
2.8.1 Checking the Message Buffer
2.8 Collecting Information From Solaris OS Files and Commands
1. Log in as superuser
show /SP/faultmgmt
2. Type the syslogd command
2.9 Managing Components With Automatic System Recovery Commands
1. Log in as superuser 2. Type the following command
3. If you want to view all logged messages, type this command
2-48 Sun Blade T6320 Server Module Service Manual June
TABLE 2-8 ASR Commands
1. At the - prompt, type the show command
2.9.1 Displaying System Components With the show /SYS Command
2.10 Exercising the System With SunVTS
2.10.1 Checking SunVTS Software Installation
2. Enable the remote display. On the display system, type
2.10.2 Exercising the System Using SunVTS Software
2.10.3 Steps for Exercising the System With SunVTS Software
SunVTS 6.4 Test Reference Manual for SPARC Platforms
2-52 Sun Blade T6320 Server Module Service Manual June
4. Start SunVTS software
# /opt/SUNWvts/bin/sunvts -display display-system0
FIGURE 2-20 SunVTS BI
7. Start testing
5. Optional Select the test category you want to run
6. Optional Customize individual tests
2.11.1 To Reset the Root Password to the Factory Default
2.11 Resetting the Password to the Factory Default
4. Change the root password
1. Remove the server module from the modular system chassis
Chapter 2 Sun Blade T6320 Server Module Diagnostics
Page
3.1 Hot-Pluggable Hard Drives
Replacing Hot-Swappable and Hot- Pluggable Components
3.2 Hot-Plugging a Hard Drive
Section 3.1, “Hot-Pluggable Hard Drives” on page
2. Type the Solaris OS commands required to stop using the hard drive
3.2.1 Rules for Hot-Plugging
3.2.2 Removing a Hard Drive
5. Grasp the latch and pull the drive out of the drive slot
4. Push the latch release button FIGURE
Amber LED Service Action Required
Green LED
3.2.3 Replacing a Hard Drive or Installing a New Hard Drive
1. If necessary, remove the hard drive filler panel
2. Slide the drive into the bay until it is fully seated FIGURE
4. Perform administrative tasks to reconfigure the hard drive
3.3 Adding PCI ExpressModules
3. Close the latch to lock the drive in place
3-6 Sun Blade T6320 Server Module Service Manual June
Section 4.1, “Safety Information” on page
4.1 Safety Information
Section 4.2, “Common Procedures for Parts Replacement” on page
Section 4.4, “Removing and Replacing the Service Processor” on page
4.1.1 Safety Symbols
4.1.2 Electrostatic Discharge Safety
4.1.2.1 Using an Antistatic Wrist Strap
4.1.2.2 Using an Antistatic Mat
4.2 Common Procedures for Parts Replacement
4.2.1 Required Tools
4.2.2 Shutting Down the System
4. Shut down the Solaris OS using the shutdown 1Mcommand
4.2.3 Using the ILOM Web Interface to Shut Down the Server Module
1. Log in as superuser or equivalent
2. Notify affected users
4.2.4 Using the ILOM CLI to Shut Down the Server Module
FIGURE 4-1 Powering Off the Server Module with the ILOM Web Interface
Chapter 4 Replacing Cold-Swappable Components
2. At the ILOM - prompt, type the set /SYS/PS0
two connectors
Four connector dongle cable UCP-4
Three connector dongle cable UCP-3 RJ-45 serial USB two connectors
DB-9 serial, male TTYA
4-8 Sun Blade T6320 Server Module Service Manual June
4. Open the ejector levers FIGURE
6. Set the server module on an antistatic mat
7. Attach an antistatic wrist strap
FIGURE 4-4 Stack Five Server Modules or Fewer
4.3 Removing and Replacing DIMMs
4.3.1 Removing the DIMMs
9. Lift the cover off the chassis
FIGURE 4-6 DIMM Locate Button and DIMM LEDs
2. Locate the DIMMs that you want to replace FIGURE
FB-DIMM Configuration
Sixteen DIMMs installed
FB-DIMM Configuration
2. Ensure that the connector ejector tabs are in the open position
1. Place the replacement DIMMs on an antistatic mat
4.3.2 Replacing the DIMMs
6. Place DIMMs on an antistatic mat
4.4 Removing and Replacing the Service Processor
4.4.1 Removing the Service Processor
4.3.2.1 Verifying DIMM Installation
4. Place the service processor card on an antistatic mat
The PROM is keyed to ensure proper orientation
4.4.2 Replacing the Service Processor
3. Place the service processor on an antistatic mat
4.5 Removing and Replacing the Battery on the Service Processor
4.5.1 Replacing the Battery on the Service Processor
1. Remove the replacement battery from the package
FIGURE 4-11 Removing the Battery From the Service Processor
4.6 Replacing or Installing the Sun Blade RAID 5 Expansion Module
Removing the RAID 5 Expansion Module
http//docs.sun.com/app/docs/prod/blade.6000disk~blade6000dskmod
2. Lift the card free from the connector
4.6.1 Installing the RAID 5 Expansion Module
3. Lift the REM free from the gray plastic standoff
1. Place the card under the tabs of the gray plastic standoff FIGURE
1. Power-up the computer and storage systems
Verifying the RAID 5 Expansion Module Installation
a. Ensure that all hard disk drives are securely installed
d. Power-on the computer system
In the following example, the HBA is the first device that is listed
5. Return to the root node by using the unselect-dev command
4.6.2 Configuring the RAID 5 Expansion Module
Uniform Command-Line Interface User’s Guide
4.6.3 Creating a Bootable Array With the RAID 5 Expansion Module
4.7 Removing and Replacing the Sun Blade G2 RAID 0/1 Expansion Module
4.6.4 Additional Information
4-26 Sun Blade T6320 Server Module Service Manual June
4.7.1 Replacing the RAID 0/1 Expansion Module
1. Place the card under the tabs of the gray plastic standoff FIGURE
FIGURE 4-14 Removing the RAID Expansion Module
4.7.2 Verifying the RAID 0/1 Expansion Module Installation
FIGURE 4-15 Replacing the RAID 0/1 Expansion Module
Chapter 4 Replacing Cold-Swappable Components
4.8.2 Reinstalling the Server Module in the Chassis
4.8 Finishing Component Replacement
4.8.1 Replacing the Cover
1. Place the cover on the chassis
The ILOM software boots
The server module powers on with 3.3v standby power
FIGURE 4-17 Inserting the Server Module in the Chassis
Chapter 4 Replacing Cold-Swappable Components
4-30 Sun Blade T6320 Server Module Service Manual June
A.1 Physical Specifications
Specifications
Section A.1, “Physical Specifications” on page A-1
Section A.2, “Motherboard Block Diagram” on page A-3
Operating Temperature and Altitude
A.1.1 System Environmental Specifications
Non-Operating Temperature and Altitude
A-2 Sun Blade T6320 Server Module Service Manual June
Appendix A Specifications A-3
A.2 Motherboard Block Diagram
A-4 Sun Blade T6320 Server Module Service Manual June
“About Creating a Bootable Array on a SPARC System” on page
Creating a Bootable Array With the Sun Blade RAID 5 Expansion Module
“Creating a Bootable Array Task Map” on page
“Modifying the Miniroot Directory On the Install Server” on page
B.1 About Creating a Bootable Array on a SPARC System
B.2 Creating a Bootable Array Task Map
1. Install and connect the HBA and disk drives
6. Modify two locations on the network install server
B.3 Modifying the Miniroot Directory On the Install Server
7. Build a logical drive on which to install the Solaris 10 5/08 OS
SUNWaac StorMan SUNWgccruntime
To Modify the Miniroot Directory
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. SUNWaac
To Modify the Product Installation Directory
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. SUNWgccruntime
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. StorMan
To Create a Logical Drive Using a Network Install Server
B.5 Building a Logical Drive On Which to Install the Solaris OS
“To Create a Logical Drive Using a Network Install Server” on page
“To Create a Logical Drive Without a Network Install Server” on page
Labeling the drive Partitioning the drive Preparing a file system
4. Insert the path to your CDROM drive
To Create a Logical Drive Without a Network Install Server
SC network configuration is IP Address Gateway address Netmask
Ethernet Address 00144FE5AD6B
To Delete a Logical Drive on the REM
To delete a logical drive on the REM, use the DELETE card-number
To Label the Newly Created Logical Drive
B.6 Next Steps
# format
# init
Uniform Command-Line Interface User’s Guide
B.6.1 Additional Information
http//docs.sun.com/app/docs/coll/dsk-cntrl
Sun StorageTek RAID Manager Software User’s Guide
C.1 Preparing to Install the Solaris OS
Installing the Solaris OS and the RAID 5 Expansion Module Driver
To Prepare to Install the Solaris OS
“Preparing to Install the Solaris OS” on page
To Install the RAID 5 Expansion Module Driver With the Solaris OS
C.2 Installing the RAID 5 Expansion Module Driver With the Solaris OS
2. Specify that you want to perform a Manual Reboot
3. Use the df command to verify the following
5. Apply the HBA driver package, SUNWaac
7. Reboot the system
6. Apply any patches that are specifically required for the system
# reboot
C.3.1 Additional Information
C.3 Next Steps
Uniform Command-Line Interface User’s Guide
http//docs.sun.com/app/docs/prod/stortek.raid.hba
Section D.1, “Features” on page D-1
D.1 Features
Section D.6, “Default Color Depth” on page D-4
Section D.7, “Checking Device Configuration” on page D-5
D.2 Video Formats
host% fbconfig -res \?
host% fbconfig -list
D.3 Sun OpenGL for Solaris Software
D.4 Man Pages
To access the fbconfig man page, type
D.6 Default Color Depth
To access the XVR-50 graphics accelerator man page, type
8. Set the desired screen resolution. For example, type
D.7 Checking Device Configuration
host% fbconfig -dev pfb0 -propt
2. Log out and then log back in for the change to take effect
D.8 HD15 Video Output Port
host% fbconfig -dev pfb0 -prconf
Index
Page
Page
Page
UltraSPARC T1 processor and PSH
actions, 2-5 DIMMs
video formats, HD15, D-2 video, Sun XVR-50, D-1
voltage and current sensor status, displaying
Index-6 Sun Blade T6320 Server Module Service Manual June
