April 2009, Revision
Sun Netra CP3260 Blade Server User’s Guide
Sun Microsystems, Inc
Please Recycle
Preface 1. Introduction
Contents
2. Hardware Installation
iv Netra CP3260 Blade Server User’s Guide April
3. Software Installation
4. Firmware and Blade Server Management
5. Hardware Functional Descriptions
probe-scsi and probe-scsi-all Commands
4.3.3.4 Using watch-net and watch-net-all Commands to
vi Netra CP3260 Blade Server User’s Guide April
Get Version Command
Get RTM Status Command
A. Physical Characteristics
B. Sun OEM IPMI Commands B-1
Send Sensor State Command B-5
Solaris OS Graceful Shutdown Commands B-4
Index
Index-1
Figures
Power Distribution Connector Zone 1 P10 A-7
Zone 2 Connectors A-9
Zone 3 Signal Connectors
Zone 3 Power Connector
Ethernet Port Connector Pin Assignments
Tables
CPU Temperature Alarms
Get Version Command Data Bytes B-2
Get RTM Status Command Data Bytes
Send Sensor State Command Data Bytes
TABLE B-1
Preface
How This Document Is Organized
Using UNIX Commands
Shell Prompts
Typographic Conventions
Related Documentation
Documentation, Support, and Training
Third-Party Web Sites
Sun Netra CP32x0 SAS Storage
Advanced Rear Transition Module
Sun Welcomes Your Comments
Sun Netra CP3260 Blade Server User’s Guide, part number
xviii Sun Netra CP3260 Blade Server User’s Guide April
Section 1.1, “Overview” on page Section 1.2, “Features” on page
Section 1.3, “System Configurations” on page
Section 1.7, “Technical Support and Warranty” on page
Introduction
1.2 Features
FeatureDescription
Chapter 1 Introduction
FIGURE 1-1 Netra CP3260 Blade Server Front Panel
1-4 Netra CP3260 Blade Server User’s Guide April
FIGURE 1-2 Netra CP3260 Blade Server Top View
Chapter 1 Introduction
⑤ ④ ③ ② ① ⑦
1-6 Netra CP3260 Blade Server User’s Guide April
1 Top latch 2 Out of Service LED yellow
8 Hot-Swap switch and bottom latch
1 Zone 1 power connector 2 Zone 2 signal connectors
3 Zone 3 RTM signal connectors 4 Zone 3 ARTM power connector
1.3 System Configurations
1-8 Netra CP3260 Blade Server User’s Guide April
FIGURE 1-3 Netra CP3260 Blade Server in an ATCA Shelf Enclosure
Chapter 1 Introduction
⑤ ⑥ ⑦
kless client that boots through network from a remote server
Ethernet
1-10 Netra CP3260 Blade Server User’s Guide April
1.4 Advanced Rear Transition Modules
1 Remote server 2 Sun Netra CP32X0 Advanced RTM installed from rear
6 Sun Netra CP3260 blade server installed from front
3 Serial connection 4 Console terminal 5 Ethernet connection RJ-45
1-12 Netra CP3260 Blade Server User’s Guide April
①② ③
FIGURE 1-4 Netra CP3260 Blade Server, Midplane, and Netra CP32x0 ARTM
3 ATCA chassis midplane
TABLE 1-2 I/O Configurations
1 Sun Netra CP3260 blade server 2 Sun Netra CP32X0 ARTM
1.6.1 Hardware Requirements and Options
1.5 Hot-Swap Support
1.6 System Requirements and Options
http//docs.sun.com/app/docs/prod/netra.brds
1.7 Technical Support and Warranty
1.6.2 Software Requirements
1.7.1 Part Number, Serial Number, and Revision Number Identification
FIGURE 1-5 Netra CP3260 Blade Server Barcode Labeling
Chapter 1 Introduction
1-18 Netra CP3260 Blade Server User’s Guide April
Hardware Installation
2.1 Equipment and Operator Safety
Section 2.1, “Equipment and Operator Safety” on page
Section 2.3, “Preparing for the Installation” on page
Use an antistatic wrist strap when
2.3 Preparing for the Installation
2.3.1 Checking Power, Thermal, Environmental, and Space Requirements
2.2 Materials and Tools Required
page
2.4 Installation Procedure Summary
2.5 Configuring On-Board Hardware
2.5.1 Adding or Replacing FB-DIMM Memory Modules
FIGURE 2-1 FB-DIMM Memory Locations
2-6 Netra CP3260 Blade Server User’s Guide April
Chapter 2 Hardware Installation
2-8 Netra CP3260 Blade Server User’s Guide April
FB0B
2.5.1.1 To Remove FB-DIMM Memory Modules
2.5.1.2 To Install FB-DIMM Memory Modules
FIGURE 2-2 Removing an FB-DIMM Memory Module
1. Locate the FB-DIMM connectors on the Netra CP3260 blade server
2.5.2 Adding or Replacing Compact Flash Card
2-14 Netra CP3260 Blade Server User’s Guide April
2.5.3 Adding or Replacing TOD Clock Battery
1 Compact Flash connector
1. Remove the FB-DIMM closest to the front panel
FIGURE 2-5 TOD Battery Location
2-16 Netra CP3260 Blade Server User’s Guide April
Chapter 2 Hardware Installation
2.6 Installing an Advanced Rear Transition Module Optional
2-18 Netra CP3260 Blade Server User’s Guide April
② ① ③
FIGURE 2-6 Installing a Netra CP32X0 ARTM
Chapter 2 Hardware Installation
1 Netra CP3260 blade server 2 Netra CP32X0 ARTM
2.7 Installing the Netra CP3260 Blade Server
FIGURE 2-7 Installing Blade Server Into Chassis Slot
Chapter 2 Hardware Installation
2-22 Netra CP3260 Blade Server User’s Guide April
2.8 Connecting External I/O Cables
FIGURE 2-8 Netra CP3260 Blade Server Latches and Locking Screws
Information on connecting each of these cables follows
2.9 Hot-Swapping the Netra CP3260 Blade Server
Chapter 2 Hardware Installation
FIGURE 2-9 Hot-Swap Latch and Hot-Swap LED
2-26 Netra CP3260 Blade Server User’s Guide April
Software Installation
Section 3.3, “Installing as a Diskless Clients” on page
Section 3.4, “Firmware Updates” on page
Section 3.5, “Configuring for 1-GbE or 10-GbE Switches” on page
CODE EXAMPLE 3-2 Zone 3 Connectivity Both nxge Ports
3.2 Configuring Payload OS NIU Driver for Multiplexing to Zones 2 and
CODE EXAMPLE 3-1 Zone 2 Connectivity Both nxge Ports
Chapter 3 Software Installation
http//docs.sun.com/app/docs/prod/solaris
3.3 Installing as a Diskless Clients
3.3.1 Creating a Boot Server for Diskless Clients
rootpassword = rootpassword imagedirectory = /export/install
3.3.2 Adding a Diskless Client
locale = enUS
4. Download and install additional patches
ipaddress =
ethernetaddress = 802022b3aa
hostname = clienthost
swapsize =
6. Boot the diskless client
timezone = US/Pacific locale = enUS nameservice = NIS
3.3.3 Determining Local Network IP Addresses and Host Names
http//docs.sun.com/app/docs/prod/netra.brds
3.4 Firmware Updates
3.5 Configuring for 1-GbE or 10-GbE Switches
3.6 Downloading and Installing SunVTS Software
3.7 Formatting the Optional Compact Flash Card
Section 4.2, “Power-On Self-Test Diagnostics” on page
Section 4.3, “OpenBoot Firmware” on page
Section 4.4, “Error Handling Summary” on page
Section 4.5, “Automatic System Recovery” on page
4.1 System Firmware
http//docs.sun.com/app/docs/prod/n900.srvr#hic
4.2 Power-On Self-Test Diagnostics
4.2.1 POST Test Coverage
4.3 OpenBoot Firmware
4.2.2 POST Diagnostic and Error Message Format
4.3.1 Getting to the ok Prompt
TABLE 4-1 Ways of Accessing the ok Prompt
probe-scsi and probe-scsi-all probe-ide show-devs
4.3.2 Auto-Boot Options
4.3.3 OpenBoot Commands
4.3.3.1 probe-scsi and probe-scsi-all Commands
0 ok probe-scsi-all
4.3.3.2 probe-ide Command
4.3.3.3 show-devs Command
cpu@37 cpu@36 cpu@35 cpu@34 cpu@33 cpu@32 cpu@31 cpu@30 cpu@2f cpu@2e
cpu@8 cpu@7 cpu@6 cpu@5 cpu@4 cpu@3 cpu@2 cpu@1
0 ok watch-net
1000 Mbps full duplex Link up Looking for Ethernet Packets
‘.’ is a Good Packet. ‘X’ is a Bad Packet Type any key to stop
‘.’ is a Good Packet. ‘X’ is a Bad Packet. Type any key to stop
4.3.4 OpenBoot Configuration Variables
diag-switch? is false
is false
If false
string. network-boot-arguments can
use-nvramrc? is true
protocol
key=value
4.3.4.1 Viewing and Setting OpenBoot Configuration Variables
security-mode is not none never
Halt the server to display the ok prompt
0 ok printenv
4.4 Error Handling Summary
4.5 Automatic System Recovery
4.5.1.2 To Disable Automatic System Recovery
4.5.1 Enabling and Disabling Automatic System Recovery
4.5.1.1 To Enable Automatic System Recovery
4.6 Network Device Aliases
TABLE 4-3 Network Device Aliases
Condition
connected ok configured bridge/fhs
4.7 Retrieving Device Information
console serial, 6f00000154 rtc obp-device, 6f00000161
pci pciex, 6f0000050e pci pciex, 6f00000533
network network, 6f00000804 network network, 6f00000814
L2BANK7 other, 6f00000cda BR0 other, 6f00000ce0 CH0 other, 6f00000ce6
CH0 other, 6f00000e4e D0 module, 6f00000e54 R0 unknown, 6f00000e5f
IMMU other, 6f00000f86 DMMU other, 6f00000f8c CORE5 other, 6f00000f92
P24 other, 6f000010a0 P25 other, 6f000010a6 P26 other, 6f000010ac
4.8 Multiplexing to Zones 2 and
Be aware of the following possible issues when multiplexing zones
Hardware Functional Descriptions
5.1 Hardware Architecture
Section 5.1, “Hardware Architecture” on page
Section 5.2, “Hardware Modules” on page
5.1.1 UltraSPARC T2 Processor and Memory
POWER PC MPC885 66MHz
5-2 Netra CP3260 Blade Server User’s Guide April
Flash
5.1.5 Power PC
5.1.2 I/O
5.1.3 Base and Fabric Interfaces
5.1.4 Additional I/O
5.2.1 UltraSPARC T2 Processor
5.2 Hardware Modules
5.1.6 ARTM Support
FIGURE 5-2 UltraSPARC T2 Multicore Processor Block Diagram
Chapter 5 Hardware Functional Descriptions
5-6 Netra CP3260 Blade Server User’s Guide April
5.2.1.1 Electronic Fuse
UltraSPARC T2
SPARC
SPARC
5.2.1.2 Cores
5.2.1.3 L2 Cache
5.2.1.4 Memory Controller
5.2.1.5 I/O Interface
5.2.2 Memory Subsystem
5.2.3 I/O Subsystem
5.2.2.1 Memory Capacity
5.2.2.2 Memory Speed
5.2.3.1 PCI Express Switch
ARTM Power and Management
5.2.3.2 Base Interface
5.2.3.3 Fabric Interface
5.2.4 Other ARTM Interfaces
5.2.5 Front Panel I/O
5.2.4.1 Serial Ports
5.2.4.2 Ethernet Management Port
5.2.7 Service Processor MPC885
5.2.6 Compact Flash Socket
5.2.5.3 Dual USB Ports
5.2.7.1 Field-Programmable Gate Array
5.2.8 Intelligent Platform Management Controller
5.2.8.1 Intelligent Platform Management Bus
5.2.8.2 Interface to the PPC
5.2.8.3 IPMB-L Interface
5.2.8.4 ATCA Hot-Swap Latch
5.2.8.6 Power Control
5.2.8.5 LEDs
5.2.8.7 System Monitor ADM1026 and Thresholds
Voltage Monitoring
TABLE 5-1 Voltage Sensor Thresholds
Temperature Monitoring
TABLE 5-2 CPU Temperature Alarms
5.2.9 I/O Subsystem Resets
5.2.8.8 FRUID PROMs
5.2.10 ATCA Power Module −48V to
5.2.11 TOD Clock Battery
Physical Characteristics
Section A.4, “Connectors and Pinout” on page A-3
A.1 Form Factor
A.2 Layout
A-2 Netra CP3260 Blade Server User’s Guide April
② ③ ⑥ ⑤
FIGURE A-1 Netra CP3260 Blade Server Layout
A.4 Connectors and Pinout
A.3.1 Visual Indicators
A.4.1 Front Panel Connectors
A.3 Front Panel
A.4.1.1 Ethernet Port
A.4.1.2 Dual USB Port
Activity LED yellow
Link LED green
Serial Port
For USB connector signals, see TABLE A-2
A.4.1.3
I0I0I
A.4.2 Compact Flash Connector
A.4.3 Midplane Power Connector Zone
TABLE A-4 lists the power connector pin assignments
FIGURE A-5 Power Distribution Connector Zone 1 P10
TABLE A-4 Power Distribution Connector Pin Assignments
FIGURE A-5 shows the pin assignments
A.4.4 Data Transport Connector Zone
Appendix A Physical Characteristics
TABLE A-5 gives the Zone 2 J23 connector pin assignments
TABLE A-6 gives the Zone 2 J20 connector pin assignments
A.4.5 Sun Netra ARTM Connectors Zone
TABLE A-7 gives the Zone 3 J31 connector signals and pin assignments
TABLE A-8 gives the Zone 3 J32 connector signals and pin assignments
TABLE A-7 Zone 3 J31 Connector Pin Assignments
TABLE A-8 Zone 3 J32 Connector Pin Assignments
TABLE A-9 gives the Zone 3 J33 connector signals and pin assignments
n Pow Con
A.4.6 TOD Clock Battery Holder
TABLE A-10 Zone 3 Power Connector Pin Assignments
FIGURE A-9 TOD Battery Location
1 TOD battery location
2 TOD clock battery location with FB-DIMM removed
A-14 Netra CP3260 Blade Server User’s Guide April
Sun OEM IPMI Commands
Section B.1, “Get Version Command” on page B-2
Section B.2, “Get RTM Status Command” on page B-3
Section B.3, “Solaris OS Graceful Shutdown Commands” on page B-4
B.1 Get Version Command
Get Version
B.2 Get RTM Status Command
Example Terminal Mode
B.3 Solaris OS Graceful Shutdown Commands
Example Terminal Mode
B.4 Send Sensor State Command
Netra CT 900 Software Developer’s Guide 819-1178 for IPMI commands
TABLE B-3 Send Sensor State Command Data Bytes Continued
B-6 Netra CP3260 Blade Server User’s Guide April
TABLE B-3 Send Sensor State Command Data Bytes Continued
B-8 Netra CP3260 Blade Server User’s Guide April
Index
Page
