Sun Microsystems, Inc
Sun BladeTM T6320 Server Module Service Manual
This distribution may include materials developed by third parties
1. Sun Blade T6320 Server Module Product Description
Contents
2. Sun Blade T6320 Server Module Diagnostics
Preface
iv Sun Blade T6320 Server Module Service Manual June
Contents
3. Replacing Hot-Swappable and Hot-Pluggable Components
4. Replacing Cold-Swappable Components
vi Sun Blade T6320 Server Module Service Manual June
D. XVR-50 Graphics Accelerator
A. Specifications
HD15 Video Output Port D-6
Index
Index-1
Checking Device Configuration D-5
Preface
Using UNIX Commands
http//docs.sun.com/app/docs/prod/blade.t6320
Accessing Sun Documentation
Typographic Conventions
Shell Prompts
Preface
module
Sun Welcomes Your Comments
Third-Party Web Sites
Documentation, Support, and Training
1.1 Component Overview
Section 1.2, “Support for RAID Storage Configurations” on page
Section 1.4, “Additional Service Related Information” on page
Sun Blade T6320 Server Module Product Description
FIGURE 1-1 Sun Blade T6320 Server Module With Chassis
1-2 Sun Blade T6320 Server Module Service Manual June
Rear View
FIGURE 1-2 Front and Rear Panels
Front View
1-4 Sun Blade T6320 Server Module Service Manual June
Four connector dongle cable UCP-4
two connectors
Three connector dongle cable UCP-3 RJ-45 serial USB two connectors
during normal system operation
and FIGURE A-2
TABLE 1-1 Sun Blade T6320 Server Module Features Continued
1-6 Sun Blade T6320 Server Module Service Manual June
TABLE 1-2 Interfaces With the chassis
Section 4.4, “Removing and Replacing the Service Processor” on page
http//docs.sun.com/app/docs/prod/blade.srvr
FB-DIMMs RAID Expansion Module Service processor
with NVRAM EEPROM with ILOM and ALOM Battery Hard drives
the DIMMs” on page
1-8 Sun Blade T6320 Server Module Service Manual June
Replacement Instructions
Section 4.3.1, “Removing
BL = blade server module NEM1 NEM0
1.1.1 Multicore Processor Information
Sun StorageTek RAID Manager Software Users Guide
1.2 Support for RAID Storage Configurations
Uniform Command-Line Interface Users Guide
1.2.1 Sun Blade RAID 5 Expansion Module
1.3 Finding the Serial Number
1.2.2 Sun Blade RAID 0/1 G2 Expansion Module
Serial number
1-12 Sun Blade T6320 Server Module Service Manual June
FIGURE 1-6 Serial Number and MAC Address Location
MAC address
ALOM CMT example
Slot Number 5 Domain Status
1.4 Additional Service Related Information
1-14 Sun Blade T6320 Server Module Service Manual June
sc showplatform
Section 2.3, “Interpreting System LEDs” on page
Sun Blade T6320 Server Module Diagnostics
Section 2.2, “Memory Configuration and Fault Handling” on page
Section 2.5, “Using the ILOM Web Interface For Diagnostics” on page
Sun Integrated Lights out Manager 2.0 User’s Guide
2.1 Sun Blade T6320 Server Module Diagnostics Overview
Chapter 2 Sun Blade T6320 Server Module Diagnostics
SP/faultmgt
FIGURE 2-1 Diagnostic Flowchart
Check the OK LED. The OK LED is located on the front of the Sun Blade
connected and the chassis has power
Section 2.5.3, “Displaying System Faults” on page
System Faults” on
Section 2.7.3, “Clearing the PSH Fault From the ILOM Logs” on page
FRU-name deemed faulty and disabled
Section 4.2, “Common Procedures for Parts Replacement” on page
Section 2.7.2, “Clearing PSH Detected Faults” on page
When Upgrading Memory
2.2 Memory Configuration and Fault Handling
2.2.1 FB-DIMM Configuration Guidelines
When Replacing Faulty FB-DIMMs
2.2.1.1 DIMM Installation Rules
Sixteen DIMMs installed
FIGURE 2-3 FB-DIMM Installation Rules
Four DIMMs installed
Eight DIMMs installed
FIGURE 2-4 DIMM Locate Button and DIMM LEDs
FB-DIMM Configuration and Installation
You can also use TABLE 2-2 to identify the DIMMs you want to remove
TABLE 2-2 FB-DIMM Configuration and Installation Continued
2.2.1.2 Memory Fault Handling
2.2.1.3 Troubleshooting Memory Faults
2.3.1 Front Panel LEDs and Buttons
2.3 Interpreting System LEDs
TABLE 2-3 LED Behavior and Meaning
The LEDs have assigned meanings, described in TABLE
FIGURE 2-5 Front Panel and Hard Drive LEDs
Front View
TABLE 2-4 LED Behaviors With Assigned Meanings
2-14 Sun Blade T6320 Server Module Service Manual June
TABLE 2-5 Front Panel Buttons
Chapter 2 Sun Blade T6320 Server Module Diagnostics
TABLE 2-4 LED Behaviors With Assigned Meanings Continued
http//docs.sun.com/app/docs/prod/blade.6000mod
2.4 Using ILOM for Diagnosis and Repair Verification
2.3.2 Ethernet Port LEDs
Service Required LED FRU LEDs FRUID PROMs Event Logs Alerts
ILOM
fru at location is OK
2.5 Using the ILOM Web Interface For Diagnostics
ILOM CLI -show /SP/network
2.5.1 Changing POST Settings With the ILOM Web Interface
1. Select the Remote Control tab and the Diagnostics tab FIGURE
1. Type the show command to see the current POST settings
2.5.2 Changing POST Settings With the ILOM CLI
2.5.3 Displaying System Faults
2.5.3.1 Viewing Fault Status Using the ILOM Web Interface
FIGURE 2-12 Component Management Page - Fault Status
2.5.3.2 Viewing Fault Status Using the ILOM CLI
FIGURE 2-11 Faulted Component ID Window
2.5.4 Displaying the Environmental Status with the ILOM CLI
show /SP/faultmgmt
Chapter 2 Sun Blade T6320 Server Module Diagnostics
3. Double click on the sensor reading that you want to check FIGURE
2. Click on the component to view the FRU information FIGURE
2.5.6.1 Using the ILOM Web Interface to Display FRU Information
2.5.6 Displaying FRU Information
1. Select the System Information and Components tabs
FIGURE 2-15 Static FRU Information in the ILOM Web Interface
2.5.6.2 Using the CLI to Display FRU Information
Chapter 2 Sun Blade T6320 Server Module Diagnostics
show /SYS/MB
At the - prompt, type the show command
sc showfru SYS/SP container
2.6.1 Controlling How POST Runs
2.6 Running POST
TABLE 2-6 Parameters Used For POST Configuration
2-32 Sun Blade T6320 Server Module Service Manual June
FIGURE 2-16 Flowchart of ILOM Variables for POST Configuration
2.6.2 Changing POST Parameters
2.6.2.1 Using the Web Interface to Change POST Parameters
2. Select the Diagnostics Tab
3. Select the POST settings that you require
2-34 Sun Blade T6320 Server Module Service Manual June
5. Select the Remote Power Control Tab
6. Select a power control setting and Select Save FIGURE
FIGURE 2-17 Setting POST Parameters With the ILOM Web Interface
FIGURE 2-18 Changing Power Settings with the ILOM Web Interface
show /HOST/diag
2.6.2.2 Using the CLI to Change POST Parameters
1. Verify the current post parameters with the show command. Type
2. Type the set command to change the POST parameters
1. Interpret the POST messages
3. Power cycle the server module to run POST
cs MSG = test-error-message
2.6.3 Interpreting POST Messages
show /SP/faultmgmt
2.6.4 Clearing POST Detected Faults
See Section 2.9, “Managing Components With Automatic System Recovery
Commands” on page
2. Select the radio button for the component that you must clear
2.6.4.1 Clearing Faults With the Web Interface
3. In the Actions menu, select Enable Component
1. Select the tabs System Information and Components tabs FIGURE
show /SP/faultmgmt
2.6.4.2 Clearing Faults With the ILOM CLI
POST detected faults
3. Reboot the server module
show /SP/faultmgmt
2.7 Using the Solaris Predictive Self-Healing Feature
2.6.4.3 Clearing Faults Manually with ILOM
2.6.4.4 Clearing Hard Drive Faults
2.7.1.1 Using the fmadm faulty Command
2.7.1 Identifying Faults With the fmadm faulty and fmdump Commands
# fmdump
2.7.1.2 Using the fmdump Command
b. Type the message ID in the SUNW-MSG-ID field, and press Lookup
2.7.2 Clearing PSH Detected Faults
c. Follow the suggested actions to repair the fault
3. Clear the fault from all persistent fault records
2.7.3 Clearing the PSH Fault From the ILOM Logs
1. After replacing a faulty FRU, boot the system
show /SP/faultmgmt
2.8 Collecting Information From Solaris OS Files and Commands
2.8.1 Checking the Message Buffer
1. Log in as superuser
3. If you want to view all logged messages, type this command
2.9 Managing Components With Automatic System Recovery Commands
2. Type the syslogd command
1. Log in as superuser 2. Type the following command
2-48 Sun Blade T6320 Server Module Service Manual June
TABLE 2-8 ASR Commands
1. At the - prompt, type the show command
2.9.1 Displaying System Components With the show /SYS Command
2.10 Exercising the System With SunVTS
2.10.1 Checking SunVTS Software Installation
SunVTS 6.4 Test Reference Manual for SPARC Platforms
2.10.2 Exercising the System Using SunVTS Software
2. Enable the remote display. On the display system, type
2.10.3 Steps for Exercising the System With SunVTS Software
FIGURE 2-20 SunVTS BI
4. Start SunVTS software
2-52 Sun Blade T6320 Server Module Service Manual June
# /opt/SUNWvts/bin/sunvts -display display-system0
6. Optional Customize individual tests
7. Start testing
5. Optional Select the test category you want to run
1. Remove the server module from the modular system chassis
2.11 Resetting the Password to the Factory Default
2.11.1 To Reset the Root Password to the Factory Default
4. Change the root password
Chapter 2 Sun Blade T6320 Server Module Diagnostics
Page
Section 3.1, “Hot-Pluggable Hard Drives” on page
Replacing Hot-Swappable and Hot- Pluggable Components
3.1 Hot-Pluggable Hard Drives
3.2 Hot-Plugging a Hard Drive
3.2.2 Removing a Hard Drive
2. Type the Solaris OS commands required to stop using the hard drive
3.2.1 Rules for Hot-Plugging
Green LED
4. Push the latch release button FIGURE
5. Grasp the latch and pull the drive out of the drive slot
Amber LED Service Action Required
2. Slide the drive into the bay until it is fully seated FIGURE
3.2.3 Replacing a Hard Drive or Installing a New Hard Drive
1. If necessary, remove the hard drive filler panel
3. Close the latch to lock the drive in place
4. Perform administrative tasks to reconfigure the hard drive
3.3 Adding PCI ExpressModules
3-6 Sun Blade T6320 Server Module Service Manual June
Section 4.4, “Removing and Replacing the Service Processor” on page
4.1 Safety Information
Section 4.1, “Safety Information” on page
Section 4.2, “Common Procedures for Parts Replacement” on page
4.1.2.1 Using an Antistatic Wrist Strap
4.1.1 Safety Symbols
4.1.2 Electrostatic Discharge Safety
4.2.2 Shutting Down the System
4.2 Common Procedures for Parts Replacement
4.1.2.2 Using an Antistatic Mat
4.2.1 Required Tools
2. Notify affected users
4.2.3 Using the ILOM Web Interface to Shut Down the Server Module
4. Shut down the Solaris OS using the shutdown 1Mcommand
1. Log in as superuser or equivalent
Chapter 4 Replacing Cold-Swappable Components
4.2.4 Using the ILOM CLI to Shut Down the Server Module
FIGURE 4-1 Powering Off the Server Module with the ILOM Web Interface
2. At the ILOM - prompt, type the set /SYS/PS0
DB-9 serial, male TTYA
Four connector dongle cable UCP-4
two connectors
Three connector dongle cable UCP-3 RJ-45 serial USB two connectors
4-8 Sun Blade T6320 Server Module Service Manual June
4. Open the ejector levers FIGURE
FIGURE 4-4 Stack Five Server Modules or Fewer
6. Set the server module on an antistatic mat
7. Attach an antistatic wrist strap
9. Lift the cover off the chassis
4.3 Removing and Replacing DIMMs
4.3.1 Removing the DIMMs
FIGURE 4-6 DIMM Locate Button and DIMM LEDs
2. Locate the DIMMs that you want to replace FIGURE
FB-DIMM Configuration
Sixteen DIMMs installed
FB-DIMM Configuration
6. Place DIMMs on an antistatic mat
1. Place the replacement DIMMs on an antistatic mat
2. Ensure that the connector ejector tabs are in the open position
4.3.2 Replacing the DIMMs
4.3.2.1 Verifying DIMM Installation
4.4 Removing and Replacing the Service Processor
4.4.1 Removing the Service Processor
4. Place the service processor card on an antistatic mat
The PROM is keyed to ensure proper orientation
4.4.2 Replacing the Service Processor
3. Place the service processor on an antistatic mat
4.5 Removing and Replacing the Battery on the Service Processor
FIGURE 4-11 Removing the Battery From the Service Processor
4.5.1 Replacing the Battery on the Service Processor
1. Remove the replacement battery from the package
http//docs.sun.com/app/docs/prod/blade.6000disk~blade6000dskmod
4.6 Replacing or Installing the Sun Blade RAID 5 Expansion Module
Removing the RAID 5 Expansion Module
1. Place the card under the tabs of the gray plastic standoff FIGURE
4.6.1 Installing the RAID 5 Expansion Module
2. Lift the card free from the connector
3. Lift the REM free from the gray plastic standoff
d. Power-on the computer system
Verifying the RAID 5 Expansion Module Installation
1. Power-up the computer and storage systems
a. Ensure that all hard disk drives are securely installed
In the following example, the HBA is the first device that is listed
5. Return to the root node by using the unselect-dev command
4.6.2 Configuring the RAID 5 Expansion Module
4.6.4 Additional Information
4.6.3 Creating a Bootable Array With the RAID 5 Expansion Module
Uniform Command-Line Interface User’s Guide
4.7 Removing and Replacing the Sun Blade G2 RAID 0/1 Expansion Module
FIGURE 4-14 Removing the RAID Expansion Module
4.7.1 Replacing the RAID 0/1 Expansion Module
4-26 Sun Blade T6320 Server Module Service Manual June
1. Place the card under the tabs of the gray plastic standoff FIGURE
Chapter 4 Replacing Cold-Swappable Components
4.7.2 Verifying the RAID 0/1 Expansion Module Installation
FIGURE 4-15 Replacing the RAID 0/1 Expansion Module
1. Place the cover on the chassis
4.8 Finishing Component Replacement
4.8.2 Reinstalling the Server Module in the Chassis
4.8.1 Replacing the Cover
Chapter 4 Replacing Cold-Swappable Components
The server module powers on with 3.3v standby power
The ILOM software boots
FIGURE 4-17 Inserting the Server Module in the Chassis
4-30 Sun Blade T6320 Server Module Service Manual June
Section A.2, “Motherboard Block Diagram” on page A-3
Specifications
A.1 Physical Specifications
Section A.1, “Physical Specifications” on page A-1
A-2 Sun Blade T6320 Server Module Service Manual June
A.1.1 System Environmental Specifications
Operating Temperature and Altitude
Non-Operating Temperature and Altitude
Appendix A Specifications A-3
A.2 Motherboard Block Diagram
A-4 Sun Blade T6320 Server Module Service Manual June
“Modifying the Miniroot Directory On the Install Server” on page
Creating a Bootable Array With the Sun Blade RAID 5 Expansion Module
“About Creating a Bootable Array on a SPARC System” on page
“Creating a Bootable Array Task Map” on page
1. Install and connect the HBA and disk drives
B.1 About Creating a Bootable Array on a SPARC System
B.2 Creating a Bootable Array Task Map
SUNWaac StorMan SUNWgccruntime
B.3 Modifying the Miniroot Directory On the Install Server
6. Modify two locations on the network install server
7. Build a logical drive on which to install the Solaris 10 5/08 OS
To Modify the Miniroot Directory
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. StorMan
To Modify the Product Installation Directory
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. SUNWaac
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. SUNWgccruntime
“To Create a Logical Drive Without a Network Install Server” on page
B.5 Building a Logical Drive On Which to Install the Solaris OS
To Create a Logical Drive Using a Network Install Server
“To Create a Logical Drive Using a Network Install Server” on page
Labeling the drive Partitioning the drive Preparing a file system
Ethernet Address 00144FE5AD6B
To Create a Logical Drive Without a Network Install Server
4. Insert the path to your CDROM drive
SC network configuration is IP Address Gateway address Netmask
To Delete a Logical Drive on the REM
To delete a logical drive on the REM, use the DELETE card-number
To Label the Newly Created Logical Drive
# init
B.6 Next Steps
# format
Sun StorageTek RAID Manager Software User’s Guide
B.6.1 Additional Information
Uniform Command-Line Interface User’s Guide
http//docs.sun.com/app/docs/coll/dsk-cntrl
“Preparing to Install the Solaris OS” on page
Installing the Solaris OS and the RAID 5 Expansion Module Driver
C.1 Preparing to Install the Solaris OS
To Prepare to Install the Solaris OS
3. Use the df command to verify the following
C.2 Installing the RAID 5 Expansion Module Driver With the Solaris OS
To Install the RAID 5 Expansion Module Driver With the Solaris OS
2. Specify that you want to perform a Manual Reboot
# reboot
7. Reboot the system
5. Apply the HBA driver package, SUNWaac
6. Apply any patches that are specifically required for the system
http//docs.sun.com/app/docs/prod/stortek.raid.hba
C.3 Next Steps
C.3.1 Additional Information
Uniform Command-Line Interface User’s Guide
Section D.7, “Checking Device Configuration” on page D-5
D.1 Features
Section D.1, “Features” on page D-1
Section D.6, “Default Color Depth” on page D-4
D.2 Video Formats
host% fbconfig -res \?
D.4 Man Pages
host% fbconfig -list
D.3 Sun OpenGL for Solaris Software
8. Set the desired screen resolution. For example, type
D.6 Default Color Depth
To access the fbconfig man page, type
To access the XVR-50 graphics accelerator man page, type
2. Log out and then log back in for the change to take effect
D.7 Checking Device Configuration
host% fbconfig -dev pfb0 -propt
D.8 HD15 Video Output Port
host% fbconfig -dev pfb0 -prconf
Index
Page
Page
Page
voltage and current sensor status, displaying
actions, 2-5 DIMMs
UltraSPARC T1 processor and PSH
video formats, HD15, D-2 video, Sun XVR-50, D-1
Index-6 Sun Blade T6320 Server Module Service Manual June
