Sun Netra CP3260 Blade Server User’s Guide
Sun Microsystems, Inc
April 2009, Revision
Please Recycle
Contents
2. Hardware Installation
Preface 1. Introduction
3. Software Installation
4. Firmware and Blade Server Management
iv Netra CP3260 Blade Server User’s Guide April
probe-scsi and probe-scsi-all Commands
4.3.3.4 Using watch-net and watch-net-all Commands to
5. Hardware Functional Descriptions
vi Netra CP3260 Blade Server User’s Guide April
Get Version Command
Get RTM Status Command
A. Physical Characteristics
B. Sun OEM IPMI Commands B-1
Send Sensor State Command B-5
Solaris OS Graceful Shutdown Commands B-4
Index
Index-1
Figures
Power Distribution Connector Zone 1 P10 A-7
Zone 2 Connectors A-9
Zone 3 Signal Connectors
Zone 3 Power Connector
Tables
CPU Temperature Alarms
Ethernet Port Connector Pin Assignments
Get Version Command Data Bytes B-2
Get RTM Status Command Data Bytes
Send Sensor State Command Data Bytes
TABLE B-1
Preface
How This Document Is Organized
Using UNIX Commands
Shell Prompts
Typographic Conventions
Related Documentation
Documentation, Support, and Training
Third-Party Web Sites
Sun Netra CP32x0 SAS Storage
Advanced Rear Transition Module
Sun Welcomes Your Comments
Sun Netra CP3260 Blade Server User’s Guide, part number
xviii Sun Netra CP3260 Blade Server User’s Guide April
Section 1.1, “Overview” on page Section 1.2, “Features” on page
Section 1.3, “System Configurations” on page
Section 1.7, “Technical Support and Warranty” on page
Introduction
1.2 Features
FeatureDescription
Chapter 1 Introduction
FIGURE 1-1 Netra CP3260 Blade Server Front Panel
1-4 Netra CP3260 Blade Server User’s Guide April
FIGURE 1-2 Netra CP3260 Blade Server Top View
Chapter 1 Introduction
⑤ ④ ③ ② ① ⑦
1-6 Netra CP3260 Blade Server User’s Guide April
1 Top latch 2 Out of Service LED yellow
8 Hot-Swap switch and bottom latch
1 Zone 1 power connector 2 Zone 2 signal connectors
3 Zone 3 RTM signal connectors 4 Zone 3 ARTM power connector
1.3 System Configurations
1-8 Netra CP3260 Blade Server User’s Guide April
FIGURE 1-3 Netra CP3260 Blade Server in an ATCA Shelf Enclosure
Chapter 1 Introduction
⑤ ⑥ ⑦
kless client that boots through network from a remote server
Ethernet
1-10 Netra CP3260 Blade Server User’s Guide April
1.4 Advanced Rear Transition Modules
1 Remote server 2 Sun Netra CP32X0 Advanced RTM installed from rear
6 Sun Netra CP3260 blade server installed from front
3 Serial connection 4 Console terminal 5 Ethernet connection RJ-45
①② ③
FIGURE 1-4 Netra CP3260 Blade Server, Midplane, and Netra CP32x0 ARTM
1-12 Netra CP3260 Blade Server User’s Guide April
TABLE 1-2 I/O Configurations
1 Sun Netra CP3260 blade server 2 Sun Netra CP32X0 ARTM
3 ATCA chassis midplane
1.5 Hot-Swap Support
1.6 System Requirements and Options
1.6.1 Hardware Requirements and Options
1.7 Technical Support and Warranty
1.6.2 Software Requirements
http//docs.sun.com/app/docs/prod/netra.brds
1.7.1 Part Number, Serial Number, and Revision Number Identification
FIGURE 1-5 Netra CP3260 Blade Server Barcode Labeling
Chapter 1 Introduction
1-18 Netra CP3260 Blade Server User’s Guide April
Hardware Installation
2.1 Equipment and Operator Safety
Section 2.1, “Equipment and Operator Safety” on page
Section 2.3, “Preparing for the Installation” on page
Use an antistatic wrist strap when
2.3 Preparing for the Installation
2.3.1 Checking Power, Thermal, Environmental, and Space Requirements
2.2 Materials and Tools Required
page
2.4 Installation Procedure Summary
2.5 Configuring On-Board Hardware
2.5.1 Adding or Replacing FB-DIMM Memory Modules
FIGURE 2-1 FB-DIMM Memory Locations
2-6 Netra CP3260 Blade Server User’s Guide April
Chapter 2 Hardware Installation
2-8 Netra CP3260 Blade Server User’s Guide April
FB0B
2.5.1.1 To Remove FB-DIMM Memory Modules
2.5.1.2 To Install FB-DIMM Memory Modules
FIGURE 2-2 Removing an FB-DIMM Memory Module
1. Locate the FB-DIMM connectors on the Netra CP3260 blade server
2.5.2 Adding or Replacing Compact Flash Card
2.5.3 Adding or Replacing TOD Clock Battery
1 Compact Flash connector
2-14 Netra CP3260 Blade Server User’s Guide April
1. Remove the FB-DIMM closest to the front panel
FIGURE 2-5 TOD Battery Location
2-16 Netra CP3260 Blade Server User’s Guide April
Chapter 2 Hardware Installation
2.6 Installing an Advanced Rear Transition Module Optional
2-18 Netra CP3260 Blade Server User’s Guide April
② ① ③
FIGURE 2-6 Installing a Netra CP32X0 ARTM
Chapter 2 Hardware Installation
1 Netra CP3260 blade server 2 Netra CP32X0 ARTM
2.7 Installing the Netra CP3260 Blade Server
FIGURE 2-7 Installing Blade Server Into Chassis Slot
Chapter 2 Hardware Installation
2.8 Connecting External I/O Cables
FIGURE 2-8 Netra CP3260 Blade Server Latches and Locking Screws
2-22 Netra CP3260 Blade Server User’s Guide April
Information on connecting each of these cables follows
2.9 Hot-Swapping the Netra CP3260 Blade Server
Chapter 2 Hardware Installation
FIGURE 2-9 Hot-Swap Latch and Hot-Swap LED
2-26 Netra CP3260 Blade Server User’s Guide April
Software Installation
Section 3.3, “Installing as a Diskless Clients” on page
Section 3.4, “Firmware Updates” on page
Section 3.5, “Configuring for 1-GbE or 10-GbE Switches” on page
3.2 Configuring Payload OS NIU Driver for Multiplexing to Zones 2 and
CODE EXAMPLE 3-1 Zone 2 Connectivity Both nxge Ports
CODE EXAMPLE 3-2 Zone 3 Connectivity Both nxge Ports
Chapter 3 Software Installation
3.3 Installing as a Diskless Clients
3.3.1 Creating a Boot Server for Diskless Clients
http//docs.sun.com/app/docs/prod/solaris
rootpassword = rootpassword imagedirectory = /export/install
3.3.2 Adding a Diskless Client
locale = enUS
4. Download and install additional patches
ipaddress =
ethernetaddress = 802022b3aa
hostname = clienthost
swapsize =
timezone = US/Pacific locale = enUS nameservice = NIS
3.3.3 Determining Local Network IP Addresses and Host Names
6. Boot the diskless client
3.4 Firmware Updates
3.5 Configuring for 1-GbE or 10-GbE Switches
http//docs.sun.com/app/docs/prod/netra.brds
3.6 Downloading and Installing SunVTS Software
3.7 Formatting the Optional Compact Flash Card
Section 4.2, “Power-On Self-Test Diagnostics” on page
Section 4.3, “OpenBoot Firmware” on page
Section 4.4, “Error Handling Summary” on page
Section 4.5, “Automatic System Recovery” on page
4.1 System Firmware
http//docs.sun.com/app/docs/prod/n900.srvr#hic
4.2 Power-On Self-Test Diagnostics
4.2.1 POST Test Coverage
4.3 OpenBoot Firmware
4.2.2 POST Diagnostic and Error Message Format
4.3.1 Getting to the ok Prompt
TABLE 4-1 Ways of Accessing the ok Prompt
4.3.2 Auto-Boot Options
4.3.3 OpenBoot Commands
probe-scsi and probe-scsi-all probe-ide show-devs
4.3.3.1 probe-scsi and probe-scsi-all Commands
0 ok probe-scsi-all
4.3.3.2 probe-ide Command
4.3.3.3 show-devs Command
cpu@37 cpu@36 cpu@35 cpu@34 cpu@33 cpu@32 cpu@31 cpu@30 cpu@2f cpu@2e
cpu@8 cpu@7 cpu@6 cpu@5 cpu@4 cpu@3 cpu@2 cpu@1
0 ok watch-net
1000 Mbps full duplex Link up Looking for Ethernet Packets
‘.’ is a Good Packet. ‘X’ is a Bad Packet Type any key to stop
‘.’ is a Good Packet. ‘X’ is a Bad Packet. Type any key to stop
4.3.4 OpenBoot Configuration Variables
diag-switch? is false
is false
If false
string. network-boot-arguments can
use-nvramrc? is true
protocol
key=value
4.3.4.1 Viewing and Setting OpenBoot Configuration Variables
security-mode is not none never
Halt the server to display the ok prompt
0 ok printenv
4.4 Error Handling Summary
4.5 Automatic System Recovery
4.5.1 Enabling and Disabling Automatic System Recovery
4.5.1.1 To Enable Automatic System Recovery
4.5.1.2 To Disable Automatic System Recovery
4.6 Network Device Aliases
TABLE 4-3 Network Device Aliases
connected ok configured bridge/fhs
4.7 Retrieving Device Information
Condition
console serial, 6f00000154 rtc obp-device, 6f00000161
pci pciex, 6f0000050e pci pciex, 6f00000533
network network, 6f00000804 network network, 6f00000814
L2BANK7 other, 6f00000cda BR0 other, 6f00000ce0 CH0 other, 6f00000ce6
CH0 other, 6f00000e4e D0 module, 6f00000e54 R0 unknown, 6f00000e5f
IMMU other, 6f00000f86 DMMU other, 6f00000f8c CORE5 other, 6f00000f92
P24 other, 6f000010a0 P25 other, 6f000010a6 P26 other, 6f000010ac
4.8 Multiplexing to Zones 2 and
Be aware of the following possible issues when multiplexing zones
Hardware Functional Descriptions
5.1 Hardware Architecture
Section 5.1, “Hardware Architecture” on page
Section 5.2, “Hardware Modules” on page
5.1.1 UltraSPARC T2 Processor and Memory
POWER PC MPC885 66MHz
5-2 Netra CP3260 Blade Server User’s Guide April
Flash
5.1.5 Power PC
5.1.2 I/O
5.1.3 Base and Fabric Interfaces
5.1.4 Additional I/O
5.2 Hardware Modules
5.1.6 ARTM Support
5.2.1 UltraSPARC T2 Processor
FIGURE 5-2 UltraSPARC T2 Multicore Processor Block Diagram
Chapter 5 Hardware Functional Descriptions
5-6 Netra CP3260 Blade Server User’s Guide April
5.2.1.1 Electronic Fuse
UltraSPARC T2
SPARC
SPARC
5.2.1.2 Cores
5.2.1.3 L2 Cache
5.2.1.4 Memory Controller
5.2.1.5 I/O Interface
5.2.2 Memory Subsystem
5.2.3 I/O Subsystem
5.2.2.1 Memory Capacity
5.2.2.2 Memory Speed
5.2.3.1 PCI Express Switch
ARTM Power and Management
5.2.3.2 Base Interface
5.2.3.3 Fabric Interface
5.2.4 Other ARTM Interfaces
5.2.5 Front Panel I/O
5.2.4.1 Serial Ports
5.2.4.2 Ethernet Management Port
5.2.7 Service Processor MPC885
5.2.6 Compact Flash Socket
5.2.5.3 Dual USB Ports
5.2.7.1 Field-Programmable Gate Array
5.2.8 Intelligent Platform Management Controller
5.2.8.1 Intelligent Platform Management Bus
5.2.8.2 Interface to the PPC
5.2.8.3 IPMB-L Interface
5.2.8.4 ATCA Hot-Swap Latch
5.2.8.6 Power Control
5.2.8.5 LEDs
5.2.8.7 System Monitor ADM1026 and Thresholds
Voltage Monitoring
Temperature Monitoring
TABLE 5-2 CPU Temperature Alarms
TABLE 5-1 Voltage Sensor Thresholds
5.2.9 I/O Subsystem Resets
5.2.8.8 FRUID PROMs
5.2.10 ATCA Power Module −48V to
5.2.11 TOD Clock Battery
Physical Characteristics
Section A.4, “Connectors and Pinout” on page A-3
A.1 Form Factor
A.2 Layout
② ③ ⑥ ⑤
FIGURE A-1 Netra CP3260 Blade Server Layout
A-2 Netra CP3260 Blade Server User’s Guide April
A.4 Connectors and Pinout
A.3.1 Visual Indicators
A.4.1 Front Panel Connectors
A.3 Front Panel
A.4.1.1 Ethernet Port
A.4.1.2 Dual USB Port
Activity LED yellow
Link LED green
For USB connector signals, see TABLE A-2
A.4.1.3
Serial Port
A.4.2 Compact Flash Connector
A.4.3 Midplane Power Connector Zone
I0I0I
TABLE A-4 lists the power connector pin assignments
FIGURE A-5 Power Distribution Connector Zone 1 P10
TABLE A-4 Power Distribution Connector Pin Assignments
FIGURE A-5 shows the pin assignments
A.4.4 Data Transport Connector Zone
TABLE A-5 gives the Zone 2 J23 connector pin assignments
TABLE A-6 gives the Zone 2 J20 connector pin assignments
Appendix A Physical Characteristics
A.4.5 Sun Netra ARTM Connectors Zone
TABLE A-7 gives the Zone 3 J31 connector signals and pin assignments
TABLE A-8 gives the Zone 3 J32 connector signals and pin assignments
TABLE A-7 Zone 3 J31 Connector Pin Assignments
TABLE A-8 Zone 3 J32 Connector Pin Assignments
TABLE A-9 gives the Zone 3 J33 connector signals and pin assignments
n Pow Con
A.4.6 TOD Clock Battery Holder
TABLE A-10 Zone 3 Power Connector Pin Assignments
FIGURE A-9 TOD Battery Location
1 TOD battery location
2 TOD clock battery location with FB-DIMM removed
A-14 Netra CP3260 Blade Server User’s Guide April
Sun OEM IPMI Commands
Section B.1, “Get Version Command” on page B-2
Section B.2, “Get RTM Status Command” on page B-3
Section B.3, “Solaris OS Graceful Shutdown Commands” on page B-4
B.1 Get Version Command
Get Version
B.2 Get RTM Status Command
Example Terminal Mode
B.3 Solaris OS Graceful Shutdown Commands
Example Terminal Mode
B.4 Send Sensor State Command
Netra CT 900 Software Developer’s Guide 819-1178 for IPMI commands
TABLE B-3 Send Sensor State Command Data Bytes Continued
B-6 Netra CP3260 Blade Server User’s Guide April
TABLE B-3 Send Sensor State Command Data Bytes Continued
B-8 Netra CP3260 Blade Server User’s Guide April
Index
Page
