Sun BladeTM T6320 Server Module Service Manual
Sun Microsystems, Inc
This distribution may include materials developed by third parties
Preface
Contents
2. Sun Blade T6320 Server Module Diagnostics
1. Sun Blade T6320 Server Module Product Description
iv Sun Blade T6320 Server Module Service Manual June
Contents
3. Replacing Hot-Swappable and Hot-Pluggable Components
4. Replacing Cold-Swappable Components
vi Sun Blade T6320 Server Module Service Manual June
A. Specifications
D. XVR-50 Graphics Accelerator
Checking Device Configuration D-5
Index
Index-1
HD15 Video Output Port D-6
Using UNIX Commands
Preface
Shell Prompts
Accessing Sun Documentation
Typographic Conventions
http//docs.sun.com/app/docs/prod/blade.t6320
module
Preface
Sun Welcomes Your Comments
Third-Party Web Sites
Documentation, Support, and Training
Sun Blade T6320 Server Module Product Description
Section 1.2, “Support for RAID Storage Configurations” on page
Section 1.4, “Additional Service Related Information” on page
1.1 Component Overview
1-2 Sun Blade T6320 Server Module Service Manual June
FIGURE 1-1 Sun Blade T6320 Server Module With Chassis
Rear View
FIGURE 1-2 Front and Rear Panels
Front View
Three connector dongle cable UCP-3 RJ-45 serial USB two connectors
Four connector dongle cable UCP-4
two connectors
1-4 Sun Blade T6320 Server Module Service Manual June
during normal system operation
TABLE 1-2 Interfaces With the chassis
TABLE 1-1 Sun Blade T6320 Server Module Features Continued
1-6 Sun Blade T6320 Server Module Service Manual June
and FIGURE A-2
with NVRAM EEPROM with ILOM and ALOM Battery Hard drives
http//docs.sun.com/app/docs/prod/blade.srvr
FB-DIMMs RAID Expansion Module Service processor
Section 4.4, “Removing and Replacing the Service Processor” on page
Section 4.3.1, “Removing
1-8 Sun Blade T6320 Server Module Service Manual June
Replacement Instructions
the DIMMs” on page
1.1.1 Multicore Processor Information
BL = blade server module NEM1 NEM0
Sun StorageTek RAID Manager Software Users Guide
1.2 Support for RAID Storage Configurations
Uniform Command-Line Interface Users Guide
1.2.1 Sun Blade RAID 5 Expansion Module
1.3 Finding the Serial Number
1.2.2 Sun Blade RAID 0/1 G2 Expansion Module
MAC address
1-12 Sun Blade T6320 Server Module Service Manual June
FIGURE 1-6 Serial Number and MAC Address Location
Serial number
ALOM CMT example
sc showplatform
1.4 Additional Service Related Information
1-14 Sun Blade T6320 Server Module Service Manual June
Slot Number 5 Domain Status
Section 2.5, “Using the ILOM Web Interface For Diagnostics” on page
Sun Blade T6320 Server Module Diagnostics
Section 2.2, “Memory Configuration and Fault Handling” on page
Section 2.3, “Interpreting System LEDs” on page
2.1 Sun Blade T6320 Server Module Diagnostics Overview
Sun Integrated Lights out Manager 2.0 User’s Guide
Chapter 2 Sun Blade T6320 Server Module Diagnostics
FIGURE 2-1 Diagnostic Flowchart
SP/faultmgt
System Faults” on
connected and the chassis has power
Section 2.5.3, “Displaying System Faults” on page
Check the OK LED. The OK LED is located on the front of the Sun Blade
Section 2.7.2, “Clearing PSH Detected Faults” on page
FRU-name deemed faulty and disabled
Section 4.2, “Common Procedures for Parts Replacement” on page
Section 2.7.3, “Clearing the PSH Fault From the ILOM Logs” on page
When Upgrading Memory
2.2 Memory Configuration and Fault Handling
2.2.1 FB-DIMM Configuration Guidelines
2.2.1.1 DIMM Installation Rules
When Replacing Faulty FB-DIMMs
Eight DIMMs installed
FIGURE 2-3 FB-DIMM Installation Rules
Four DIMMs installed
Sixteen DIMMs installed
FIGURE 2-4 DIMM Locate Button and DIMM LEDs
FB-DIMM Configuration and Installation
You can also use TABLE 2-2 to identify the DIMMs you want to remove
TABLE 2-2 FB-DIMM Configuration and Installation Continued
2.2.1.2 Memory Fault Handling
2.2.1.3 Troubleshooting Memory Faults
2.3 Interpreting System LEDs
2.3.1 Front Panel LEDs and Buttons
Front View
The LEDs have assigned meanings, described in TABLE
FIGURE 2-5 Front Panel and Hard Drive LEDs
TABLE 2-3 LED Behavior and Meaning
2-14 Sun Blade T6320 Server Module Service Manual June
TABLE 2-4 LED Behaviors With Assigned Meanings
TABLE 2-5 Front Panel Buttons
Chapter 2 Sun Blade T6320 Server Module Diagnostics
TABLE 2-4 LED Behaviors With Assigned Meanings Continued
http//docs.sun.com/app/docs/prod/blade.6000mod
2.4 Using ILOM for Diagnosis and Repair Verification
2.3.2 Ethernet Port LEDs
ILOM
Service Required LED FRU LEDs FRUID PROMs Event Logs Alerts
2.5 Using the ILOM Web Interface For Diagnostics
fru at location is OK
2.5.1 Changing POST Settings With the ILOM Web Interface
ILOM CLI -show /SP/network
1. Select the Remote Control tab and the Diagnostics tab FIGURE
1. Type the show command to see the current POST settings
2.5.2 Changing POST Settings With the ILOM CLI
2.5.3 Displaying System Faults
2.5.3.1 Viewing Fault Status Using the ILOM Web Interface
FIGURE 2-12 Component Management Page - Fault Status
2.5.3.2 Viewing Fault Status Using the ILOM CLI
FIGURE 2-11 Faulted Component ID Window
show /SP/faultmgmt
2.5.4 Displaying the Environmental Status with the ILOM CLI
3. Double click on the sensor reading that you want to check FIGURE
Chapter 2 Sun Blade T6320 Server Module Diagnostics
1. Select the System Information and Components tabs
2.5.6.1 Using the ILOM Web Interface to Display FRU Information
2.5.6 Displaying FRU Information
2. Click on the component to view the FRU information FIGURE
FIGURE 2-15 Static FRU Information in the ILOM Web Interface
2.5.6.2 Using the CLI to Display FRU Information
Chapter 2 Sun Blade T6320 Server Module Diagnostics
At the - prompt, type the show command
show /SYS/MB
sc showfru SYS/SP container
2.6 Running POST
2.6.1 Controlling How POST Runs
TABLE 2-6 Parameters Used For POST Configuration
FIGURE 2-16 Flowchart of ILOM Variables for POST Configuration
2-32 Sun Blade T6320 Server Module Service Manual June
3. Select the POST settings that you require
2.6.2.1 Using the Web Interface to Change POST Parameters
2. Select the Diagnostics Tab
2.6.2 Changing POST Parameters
FIGURE 2-17 Setting POST Parameters With the ILOM Web Interface
5. Select the Remote Power Control Tab
6. Select a power control setting and Select Save FIGURE
2-34 Sun Blade T6320 Server Module Service Manual June
FIGURE 2-18 Changing Power Settings with the ILOM Web Interface
2. Type the set command to change the POST parameters
2.6.2.2 Using the CLI to Change POST Parameters
1. Verify the current post parameters with the show command. Type
show /HOST/diag
2.6.3 Interpreting POST Messages
3. Power cycle the server module to run POST
cs MSG = test-error-message
1. Interpret the POST messages
Commands” on page
2.6.4 Clearing POST Detected Faults
See Section 2.9, “Managing Components With Automatic System Recovery
show /SP/faultmgmt
1. Select the tabs System Information and Components tabs FIGURE
2.6.4.1 Clearing Faults With the Web Interface
3. In the Actions menu, select Enable Component
2. Select the radio button for the component that you must clear
3. Reboot the server module
2.6.4.2 Clearing Faults With the ILOM CLI
POST detected faults
show /SP/faultmgmt
2.6.4.4 Clearing Hard Drive Faults
2.7 Using the Solaris Predictive Self-Healing Feature
2.6.4.3 Clearing Faults Manually with ILOM
show /SP/faultmgmt
2.7.1 Identifying Faults With the fmadm faulty and fmdump Commands
2.7.1.1 Using the fmadm faulty Command
2.7.1.2 Using the fmdump Command
# fmdump
b. Type the message ID in the SUNW-MSG-ID field, and press Lookup
2.7.2 Clearing PSH Detected Faults
c. Follow the suggested actions to repair the fault
3. Clear the fault from all persistent fault records
2.7.3 Clearing the PSH Fault From the ILOM Logs
1. After replacing a faulty FRU, boot the system
1. Log in as superuser
2.8 Collecting Information From Solaris OS Files and Commands
2.8.1 Checking the Message Buffer
show /SP/faultmgmt
1. Log in as superuser 2. Type the following command
2.9 Managing Components With Automatic System Recovery Commands
2. Type the syslogd command
3. If you want to view all logged messages, type this command
TABLE 2-8 ASR Commands
2-48 Sun Blade T6320 Server Module Service Manual June
2.9.1 Displaying System Components With the show /SYS Command
1. At the - prompt, type the show command
2.10.1 Checking SunVTS Software Installation
2.10 Exercising the System With SunVTS
2.10.3 Steps for Exercising the System With SunVTS Software
2.10.2 Exercising the System Using SunVTS Software
2. Enable the remote display. On the display system, type
SunVTS 6.4 Test Reference Manual for SPARC Platforms
# /opt/SUNWvts/bin/sunvts -display display-system0
4. Start SunVTS software
2-52 Sun Blade T6320 Server Module Service Manual June
FIGURE 2-20 SunVTS BI
6. Optional Customize individual tests
7. Start testing
5. Optional Select the test category you want to run
4. Change the root password
2.11 Resetting the Password to the Factory Default
2.11.1 To Reset the Root Password to the Factory Default
1. Remove the server module from the modular system chassis
Chapter 2 Sun Blade T6320 Server Module Diagnostics
Page
3.2 Hot-Plugging a Hard Drive
Replacing Hot-Swappable and Hot- Pluggable Components
3.1 Hot-Pluggable Hard Drives
Section 3.1, “Hot-Pluggable Hard Drives” on page
3.2.2 Removing a Hard Drive
2. Type the Solaris OS commands required to stop using the hard drive
3.2.1 Rules for Hot-Plugging
Amber LED Service Action Required
4. Push the latch release button FIGURE
5. Grasp the latch and pull the drive out of the drive slot
Green LED
2. Slide the drive into the bay until it is fully seated FIGURE
3.2.3 Replacing a Hard Drive or Installing a New Hard Drive
1. If necessary, remove the hard drive filler panel
3. Close the latch to lock the drive in place
4. Perform administrative tasks to reconfigure the hard drive
3.3 Adding PCI ExpressModules
3-6 Sun Blade T6320 Server Module Service Manual June
Section 4.2, “Common Procedures for Parts Replacement” on page
4.1 Safety Information
Section 4.1, “Safety Information” on page
Section 4.4, “Removing and Replacing the Service Processor” on page
4.1.2.1 Using an Antistatic Wrist Strap
4.1.1 Safety Symbols
4.1.2 Electrostatic Discharge Safety
4.2.1 Required Tools
4.2 Common Procedures for Parts Replacement
4.1.2.2 Using an Antistatic Mat
4.2.2 Shutting Down the System
1. Log in as superuser or equivalent
4.2.3 Using the ILOM Web Interface to Shut Down the Server Module
4. Shut down the Solaris OS using the shutdown 1Mcommand
2. Notify affected users
Chapter 4 Replacing Cold-Swappable Components
4.2.4 Using the ILOM CLI to Shut Down the Server Module
FIGURE 4-1 Powering Off the Server Module with the ILOM Web Interface
2. At the ILOM - prompt, type the set /SYS/PS0
Three connector dongle cable UCP-3 RJ-45 serial USB two connectors
Four connector dongle cable UCP-4
two connectors
DB-9 serial, male TTYA
4. Open the ejector levers FIGURE
4-8 Sun Blade T6320 Server Module Service Manual June
FIGURE 4-4 Stack Five Server Modules or Fewer
6. Set the server module on an antistatic mat
7. Attach an antistatic wrist strap
9. Lift the cover off the chassis
4.3 Removing and Replacing DIMMs
4.3.1 Removing the DIMMs
2. Locate the DIMMs that you want to replace FIGURE
FIGURE 4-6 DIMM Locate Button and DIMM LEDs
Sixteen DIMMs installed
FB-DIMM Configuration
FB-DIMM Configuration
4.3.2 Replacing the DIMMs
1. Place the replacement DIMMs on an antistatic mat
2. Ensure that the connector ejector tabs are in the open position
6. Place DIMMs on an antistatic mat
4.3.2.1 Verifying DIMM Installation
4.4 Removing and Replacing the Service Processor
4.4.1 Removing the Service Processor
4. Place the service processor card on an antistatic mat
4.4.2 Replacing the Service Processor
The PROM is keyed to ensure proper orientation
4.5 Removing and Replacing the Battery on the Service Processor
3. Place the service processor on an antistatic mat
FIGURE 4-11 Removing the Battery From the Service Processor
4.5.1 Replacing the Battery on the Service Processor
1. Remove the replacement battery from the package
http//docs.sun.com/app/docs/prod/blade.6000disk~blade6000dskmod
4.6 Replacing or Installing the Sun Blade RAID 5 Expansion Module
Removing the RAID 5 Expansion Module
3. Lift the REM free from the gray plastic standoff
4.6.1 Installing the RAID 5 Expansion Module
2. Lift the card free from the connector
1. Place the card under the tabs of the gray plastic standoff FIGURE
a. Ensure that all hard disk drives are securely installed
Verifying the RAID 5 Expansion Module Installation
1. Power-up the computer and storage systems
d. Power-on the computer system
In the following example, the HBA is the first device that is listed
4.6.2 Configuring the RAID 5 Expansion Module
5. Return to the root node by using the unselect-dev command
4.7 Removing and Replacing the Sun Blade G2 RAID 0/1 Expansion Module
4.6.3 Creating a Bootable Array With the RAID 5 Expansion Module
Uniform Command-Line Interface User’s Guide
4.6.4 Additional Information
1. Place the card under the tabs of the gray plastic standoff FIGURE
4.7.1 Replacing the RAID 0/1 Expansion Module
4-26 Sun Blade T6320 Server Module Service Manual June
FIGURE 4-14 Removing the RAID Expansion Module
Chapter 4 Replacing Cold-Swappable Components
4.7.2 Verifying the RAID 0/1 Expansion Module Installation
FIGURE 4-15 Replacing the RAID 0/1 Expansion Module
4.8.1 Replacing the Cover
4.8 Finishing Component Replacement
4.8.2 Reinstalling the Server Module in the Chassis
1. Place the cover on the chassis
FIGURE 4-17 Inserting the Server Module in the Chassis
The server module powers on with 3.3v standby power
The ILOM software boots
Chapter 4 Replacing Cold-Swappable Components
4-30 Sun Blade T6320 Server Module Service Manual June
Section A.1, “Physical Specifications” on page A-1
Specifications
A.1 Physical Specifications
Section A.2, “Motherboard Block Diagram” on page A-3
Non-Operating Temperature and Altitude
A.1.1 System Environmental Specifications
Operating Temperature and Altitude
A-2 Sun Blade T6320 Server Module Service Manual June
A.2 Motherboard Block Diagram
Appendix A Specifications A-3
A-4 Sun Blade T6320 Server Module Service Manual June
“Creating a Bootable Array Task Map” on page
Creating a Bootable Array With the Sun Blade RAID 5 Expansion Module
“About Creating a Bootable Array on a SPARC System” on page
“Modifying the Miniroot Directory On the Install Server” on page
1. Install and connect the HBA and disk drives
B.1 About Creating a Bootable Array on a SPARC System
B.2 Creating a Bootable Array Task Map
7. Build a logical drive on which to install the Solaris 10 5/08 OS
B.3 Modifying the Miniroot Directory On the Install Server
6. Modify two locations on the network install server
SUNWaac StorMan SUNWgccruntime
To Modify the Miniroot Directory
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. SUNWgccruntime
To Modify the Product Installation Directory
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. SUNWaac
# pkgadd -R installdirpath/Solaris10/Tools/Boot -d. StorMan
“To Create a Logical Drive Using a Network Install Server” on page
B.5 Building a Logical Drive On Which to Install the Solaris OS
To Create a Logical Drive Using a Network Install Server
“To Create a Logical Drive Without a Network Install Server” on page
Labeling the drive Partitioning the drive Preparing a file system
SC network configuration is IP Address Gateway address Netmask
To Create a Logical Drive Without a Network Install Server
4. Insert the path to your CDROM drive
Ethernet Address 00144FE5AD6B
To Delete a Logical Drive on the REM
To Label the Newly Created Logical Drive
To delete a logical drive on the REM, use the DELETE card-number
# init
B.6 Next Steps
# format
http//docs.sun.com/app/docs/coll/dsk-cntrl
B.6.1 Additional Information
Uniform Command-Line Interface User’s Guide
Sun StorageTek RAID Manager Software User’s Guide
To Prepare to Install the Solaris OS
Installing the Solaris OS and the RAID 5 Expansion Module Driver
C.1 Preparing to Install the Solaris OS
“Preparing to Install the Solaris OS” on page
2. Specify that you want to perform a Manual Reboot
C.2 Installing the RAID 5 Expansion Module Driver With the Solaris OS
To Install the RAID 5 Expansion Module Driver With the Solaris OS
3. Use the df command to verify the following
6. Apply any patches that are specifically required for the system
7. Reboot the system
5. Apply the HBA driver package, SUNWaac
# reboot
Uniform Command-Line Interface User’s Guide
C.3 Next Steps
C.3.1 Additional Information
http//docs.sun.com/app/docs/prod/stortek.raid.hba
Section D.6, “Default Color Depth” on page D-4
D.1 Features
Section D.1, “Features” on page D-1
Section D.7, “Checking Device Configuration” on page D-5
host% fbconfig -res \?
D.2 Video Formats
D.4 Man Pages
host% fbconfig -list
D.3 Sun OpenGL for Solaris Software
To access the XVR-50 graphics accelerator man page, type
D.6 Default Color Depth
To access the fbconfig man page, type
8. Set the desired screen resolution. For example, type
2. Log out and then log back in for the change to take effect
D.7 Checking Device Configuration
host% fbconfig -dev pfb0 -propt
host% fbconfig -dev pfb0 -prconf
D.8 HD15 Video Output Port
Index
Page
Page
Page
video formats, HD15, D-2 video, Sun XVR-50, D-1
actions, 2-5 DIMMs
UltraSPARC T1 processor and PSH
voltage and current sensor status, displaying
Index-6 Sun Blade T6320 Server Module Service Manual June
