Sun Microsystems, Inc
Sun Netra CP3260 Blade Server User’s Guide
April 2009, Revision
Please Recycle
2. Hardware Installation
Contents
Preface 1. Introduction
4. Firmware and Blade Server Management
3. Software Installation
iv Netra CP3260 Blade Server User’s Guide April
4.3.3.4 Using watch-net and watch-net-all Commands to
probe-scsi and probe-scsi-all Commands
5. Hardware Functional Descriptions
vi Netra CP3260 Blade Server User’s Guide April
B. Sun OEM IPMI Commands B-1
Get Version Command
Get RTM Status Command
A. Physical Characteristics
Index-1
Send Sensor State Command B-5
Solaris OS Graceful Shutdown Commands B-4
Index
Figures
Zone 3 Power Connector
Power Distribution Connector Zone 1 P10 A-7
Zone 2 Connectors A-9
Zone 3 Signal Connectors
CPU Temperature Alarms
Tables
Ethernet Port Connector Pin Assignments
TABLE B-1
Get Version Command Data Bytes B-2
Get RTM Status Command Data Bytes
Send Sensor State Command Data Bytes
How This Document Is Organized
Preface
Shell Prompts
Using UNIX Commands
Related Documentation
Typographic Conventions
Advanced Rear Transition Module
Documentation, Support, and Training
Third-Party Web Sites
Sun Netra CP32x0 SAS Storage
Sun Netra CP3260 Blade Server User’s Guide, part number
Sun Welcomes Your Comments
xviii Sun Netra CP3260 Blade Server User’s Guide April
Introduction
Section 1.1, “Overview” on page Section 1.2, “Features” on page
Section 1.3, “System Configurations” on page
Section 1.7, “Technical Support and Warranty” on page
1.2 Features
Chapter 1 Introduction
FeatureDescription
1-4 Netra CP3260 Blade Server User’s Guide April
FIGURE 1-1 Netra CP3260 Blade Server Front Panel
Chapter 1 Introduction
FIGURE 1-2 Netra CP3260 Blade Server Top View
1-6 Netra CP3260 Blade Server User’s Guide April
⑤ ④ ③ ② ① ⑦
3 Zone 3 RTM signal connectors 4 Zone 3 ARTM power connector
1 Top latch 2 Out of Service LED yellow
8 Hot-Swap switch and bottom latch
1 Zone 1 power connector 2 Zone 2 signal connectors
1-8 Netra CP3260 Blade Server User’s Guide April
1.3 System Configurations
Chapter 1 Introduction
FIGURE 1-3 Netra CP3260 Blade Server in an ATCA Shelf Enclosure
1-10 Netra CP3260 Blade Server User’s Guide April
⑤ ⑥ ⑦
kless client that boots through network from a remote server
Ethernet
3 Serial connection 4 Console terminal 5 Ethernet connection RJ-45
1.4 Advanced Rear Transition Modules
1 Remote server 2 Sun Netra CP32X0 Advanced RTM installed from rear
6 Sun Netra CP3260 blade server installed from front
FIGURE 1-4 Netra CP3260 Blade Server, Midplane, and Netra CP32x0 ARTM
①② ③
1-12 Netra CP3260 Blade Server User’s Guide April
1 Sun Netra CP3260 blade server 2 Sun Netra CP32X0 ARTM
TABLE 1-2 I/O Configurations
3 ATCA chassis midplane
1.6 System Requirements and Options
1.5 Hot-Swap Support
1.6.1 Hardware Requirements and Options
1.6.2 Software Requirements
1.7 Technical Support and Warranty
http//docs.sun.com/app/docs/prod/netra.brds
1.7.1 Part Number, Serial Number, and Revision Number Identification
Chapter 1 Introduction
FIGURE 1-5 Netra CP3260 Blade Server Barcode Labeling
1-18 Netra CP3260 Blade Server User’s Guide April
Section 2.3, “Preparing for the Installation” on page
Hardware Installation
2.1 Equipment and Operator Safety
Section 2.1, “Equipment and Operator Safety” on page
Use an antistatic wrist strap when
page
2.3 Preparing for the Installation
2.3.1 Checking Power, Thermal, Environmental, and Space Requirements
2.2 Materials and Tools Required
2.4 Installation Procedure Summary
2.5.1 Adding or Replacing FB-DIMM Memory Modules
2.5 Configuring On-Board Hardware
2-6 Netra CP3260 Blade Server User’s Guide April
FIGURE 2-1 FB-DIMM Memory Locations
Chapter 2 Hardware Installation
2-8 Netra CP3260 Blade Server User’s Guide April
FB0B
2.5.1.1 To Remove FB-DIMM Memory Modules
FIGURE 2-2 Removing an FB-DIMM Memory Module
2.5.1.2 To Install FB-DIMM Memory Modules
1. Locate the FB-DIMM connectors on the Netra CP3260 blade server
2.5.2 Adding or Replacing Compact Flash Card
1 Compact Flash connector
2.5.3 Adding or Replacing TOD Clock Battery
2-14 Netra CP3260 Blade Server User’s Guide April
1. Remove the FB-DIMM closest to the front panel
2-16 Netra CP3260 Blade Server User’s Guide April
FIGURE 2-5 TOD Battery Location
Chapter 2 Hardware Installation
2-18 Netra CP3260 Blade Server User’s Guide April
2.6 Installing an Advanced Rear Transition Module Optional
1 Netra CP3260 blade server 2 Netra CP32X0 ARTM
② ① ③
FIGURE 2-6 Installing a Netra CP32X0 ARTM
Chapter 2 Hardware Installation
2.7 Installing the Netra CP3260 Blade Server
Chapter 2 Hardware Installation
FIGURE 2-7 Installing Blade Server Into Chassis Slot
FIGURE 2-8 Netra CP3260 Blade Server Latches and Locking Screws
2.8 Connecting External I/O Cables
2-22 Netra CP3260 Blade Server User’s Guide April
Information on connecting each of these cables follows
2.9 Hot-Swapping the Netra CP3260 Blade Server
FIGURE 2-9 Hot-Swap Latch and Hot-Swap LED
Chapter 2 Hardware Installation
2-26 Netra CP3260 Blade Server User’s Guide April
Section 3.5, “Configuring for 1-GbE or 10-GbE Switches” on page
Software Installation
Section 3.3, “Installing as a Diskless Clients” on page
Section 3.4, “Firmware Updates” on page
CODE EXAMPLE 3-1 Zone 2 Connectivity Both nxge Ports
3.2 Configuring Payload OS NIU Driver for Multiplexing to Zones 2 and
CODE EXAMPLE 3-2 Zone 3 Connectivity Both nxge Ports
Chapter 3 Software Installation
3.3.1 Creating a Boot Server for Diskless Clients
3.3 Installing as a Diskless Clients
http//docs.sun.com/app/docs/prod/solaris
4. Download and install additional patches
rootpassword = rootpassword imagedirectory = /export/install
3.3.2 Adding a Diskless Client
locale = enUS
swapsize =
ipaddress =
ethernetaddress = 802022b3aa
hostname = clienthost
3.3.3 Determining Local Network IP Addresses and Host Names
timezone = US/Pacific locale = enUS nameservice = NIS
6. Boot the diskless client
3.5 Configuring for 1-GbE or 10-GbE Switches
3.4 Firmware Updates
http//docs.sun.com/app/docs/prod/netra.brds
3.6 Downloading and Installing SunVTS Software
3.7 Formatting the Optional Compact Flash Card
Section 4.5, “Automatic System Recovery” on page
Section 4.2, “Power-On Self-Test Diagnostics” on page
Section 4.3, “OpenBoot Firmware” on page
Section 4.4, “Error Handling Summary” on page
http//docs.sun.com/app/docs/prod/n900.srvr#hic
4.1 System Firmware
4.2.1 POST Test Coverage
4.2 Power-On Self-Test Diagnostics
4.2.2 POST Diagnostic and Error Message Format
4.3 OpenBoot Firmware
TABLE 4-1 Ways of Accessing the ok Prompt
4.3.1 Getting to the ok Prompt
4.3.3 OpenBoot Commands
4.3.2 Auto-Boot Options
probe-scsi and probe-scsi-all probe-ide show-devs
0 ok probe-scsi-all
4.3.3.1 probe-scsi and probe-scsi-all Commands
4.3.3.3 show-devs Command
4.3.3.2 probe-ide Command
cpu@37 cpu@36 cpu@35 cpu@34 cpu@33 cpu@32 cpu@31 cpu@30 cpu@2f cpu@2e
cpu@8 cpu@7 cpu@6 cpu@5 cpu@4 cpu@3 cpu@2 cpu@1
‘.’ is a Good Packet. ‘X’ is a Bad Packet. Type any key to stop
0 ok watch-net
1000 Mbps full duplex Link up Looking for Ethernet Packets
‘.’ is a Good Packet. ‘X’ is a Bad Packet Type any key to stop
If false
4.3.4 OpenBoot Configuration Variables
diag-switch? is false
is false
key=value
string. network-boot-arguments can
use-nvramrc? is true
protocol
0 ok printenv
4.3.4.1 Viewing and Setting OpenBoot Configuration Variables
security-mode is not none never
Halt the server to display the ok prompt
4.4 Error Handling Summary
4.5 Automatic System Recovery
4.5.1.1 To Enable Automatic System Recovery
4.5.1 Enabling and Disabling Automatic System Recovery
4.5.1.2 To Disable Automatic System Recovery
TABLE 4-3 Network Device Aliases
4.6 Network Device Aliases
4.7 Retrieving Device Information
connected ok configured bridge/fhs
Condition
console serial, 6f00000154 rtc obp-device, 6f00000161
pci pciex, 6f0000050e pci pciex, 6f00000533
network network, 6f00000804 network network, 6f00000814
L2BANK7 other, 6f00000cda BR0 other, 6f00000ce0 CH0 other, 6f00000ce6
CH0 other, 6f00000e4e D0 module, 6f00000e54 R0 unknown, 6f00000e5f
IMMU other, 6f00000f86 DMMU other, 6f00000f8c CORE5 other, 6f00000f92
P24 other, 6f000010a0 P25 other, 6f000010a6 P26 other, 6f000010ac
4.8 Multiplexing to Zones 2 and
Be aware of the following possible issues when multiplexing zones
Section 5.2, “Hardware Modules” on page
Hardware Functional Descriptions
5.1 Hardware Architecture
Section 5.1, “Hardware Architecture” on page
Flash
5.1.1 UltraSPARC T2 Processor and Memory
POWER PC MPC885 66MHz
5-2 Netra CP3260 Blade Server User’s Guide April
5.1.4 Additional I/O
5.1.5 Power PC
5.1.2 I/O
5.1.3 Base and Fabric Interfaces
5.1.6 ARTM Support
5.2 Hardware Modules
5.2.1 UltraSPARC T2 Processor
Chapter 5 Hardware Functional Descriptions
FIGURE 5-2 UltraSPARC T2 Multicore Processor Block Diagram
5-6 Netra CP3260 Blade Server User’s Guide April
SPARC
5.2.1.1 Electronic Fuse
UltraSPARC T2
SPARC
5.2.1.5 I/O Interface
5.2.1.2 Cores
5.2.1.3 L2 Cache
5.2.1.4 Memory Controller
5.2.2.2 Memory Speed
5.2.2 Memory Subsystem
5.2.3 I/O Subsystem
5.2.2.1 Memory Capacity
5.2.3.3 Fabric Interface
5.2.3.1 PCI Express Switch
ARTM Power and Management
5.2.3.2 Base Interface
5.2.4.2 Ethernet Management Port
5.2.4 Other ARTM Interfaces
5.2.5 Front Panel I/O
5.2.4.1 Serial Ports
5.2.7.1 Field-Programmable Gate Array
5.2.7 Service Processor MPC885
5.2.6 Compact Flash Socket
5.2.5.3 Dual USB Ports
5.2.8 Intelligent Platform Management Controller
5.2.8.4 ATCA Hot-Swap Latch
5.2.8.1 Intelligent Platform Management Bus
5.2.8.2 Interface to the PPC
5.2.8.3 IPMB-L Interface
Voltage Monitoring
5.2.8.6 Power Control
5.2.8.5 LEDs
5.2.8.7 System Monitor ADM1026 and Thresholds
TABLE 5-2 CPU Temperature Alarms
Temperature Monitoring
TABLE 5-1 Voltage Sensor Thresholds
5.2.8.8 FRUID PROMs
5.2.9 I/O Subsystem Resets
5.2.11 TOD Clock Battery
5.2.10 ATCA Power Module −48V to
A.2 Layout
Physical Characteristics
Section A.4, “Connectors and Pinout” on page A-3
A.1 Form Factor
FIGURE A-1 Netra CP3260 Blade Server Layout
② ③ ⑥ ⑤
A-2 Netra CP3260 Blade Server User’s Guide April
A.3 Front Panel
A.4 Connectors and Pinout
A.3.1 Visual Indicators
A.4.1 Front Panel Connectors
Link LED green
A.4.1.1 Ethernet Port
A.4.1.2 Dual USB Port
Activity LED yellow
A.4.1.3
For USB connector signals, see TABLE A-2
Serial Port
A.4.3 Midplane Power Connector Zone
A.4.2 Compact Flash Connector
I0I0I
FIGURE A-5 shows the pin assignments
TABLE A-4 lists the power connector pin assignments
FIGURE A-5 Power Distribution Connector Zone 1 P10
TABLE A-4 Power Distribution Connector Pin Assignments
A.4.4 Data Transport Connector Zone
TABLE A-6 gives the Zone 2 J20 connector pin assignments
TABLE A-5 gives the Zone 2 J23 connector pin assignments
Appendix A Physical Characteristics
A.4.5 Sun Netra ARTM Connectors Zone
TABLE A-8 Zone 3 J32 Connector Pin Assignments
TABLE A-7 gives the Zone 3 J31 connector signals and pin assignments
TABLE A-8 gives the Zone 3 J32 connector signals and pin assignments
TABLE A-7 Zone 3 J31 Connector Pin Assignments
n Pow Con
TABLE A-9 gives the Zone 3 J33 connector signals and pin assignments
TABLE A-10 Zone 3 Power Connector Pin Assignments
A.4.6 TOD Clock Battery Holder
A-14 Netra CP3260 Blade Server User’s Guide April
FIGURE A-9 TOD Battery Location
1 TOD battery location
2 TOD clock battery location with FB-DIMM removed
Section B.3, “Solaris OS Graceful Shutdown Commands” on page B-4
Sun OEM IPMI Commands
Section B.1, “Get Version Command” on page B-2
Section B.2, “Get RTM Status Command” on page B-3
Get Version
B.1 Get Version Command
Example Terminal Mode
B.2 Get RTM Status Command
Example Terminal Mode
B.3 Solaris OS Graceful Shutdown Commands
Netra CT 900 Software Developer’s Guide 819-1178 for IPMI commands
B.4 Send Sensor State Command
B-6 Netra CP3260 Blade Server User’s Guide April
TABLE B-3 Send Sensor State Command Data Bytes Continued
TABLE B-3 Send Sensor State Command Data Bytes Continued
B-8 Netra CP3260 Blade Server User’s Guide April
Index
Page