Manuals / Sun Microsystems / Computer Equipment / Server

Sun Microsystems CP3260 manual UltraSPARC T2 Processor and Memory, POWER PC MPC885 66MHz, Flash

Models: CP3260

1 144

Download 144 pages 25.13 Kb

Page 102

UltraSPARC

FIGURE 5-1Netra CP3260 Blade Server Block Diagram

I2C	FBDIMM

8 FBDIMM SLOTS

D190 (Vcore)

	-3
FBDIMM BRANCH0
	UltraSPARC
		T2
	Processor
XAUI
0	1
	X8 PCI	I2C
	EXPRESS	I2C
	EXPRESS

						HOST(OBP)		FLASH
		FPGA		FLASH						TPM
		FPGA		FLASH						TPM

SSI				SSI
SSI	SSI			N2 JTAG
JTAG				N2 JTAG
JTAG								FPGA

DOC

MD4832

PPC

FLASH

SP SDRAM

256 MB

PPC

Parallel Bus

H8

Parallel Bus

POWER PC

MPC885 66MHz

Payload(RS232)	Serial RS232	PPC
		I2C

	PPC Ethernet
	RMII – Port 2
	PPC Ethernet	PHY
	RMII

		10/100
		10/100
			BASE-T

DC Blocking	0	X8
caps.	PORT	X8

Console

MUX

I2C (Netconsole)

MUX MUX

PORT 1

X4

Dual

GBE

XFMR XFMR

PPC

Ethernet

RMII

BCM5397

Switch

(5 port+RGMII/GMII)

PCI-E

SWITCH 0

X4	X4	X8
PORT 9	PORT 2	PORT 8

Dual

GBE

PORT 10

Payload

X4

0 Ohm

PCIe-PCI

FRONT/REAR

I2C

Devices

Bridge

SERIAL

CONSOLE

TI

RS232

5 port

TUSB6250

I2C

USB

-IDE

USB Hub

USB 2,3

Serial

Selector

CF

Flash

I2C

Devices

Parallel Bus I/F

Serial Payload

Serial Netconsole

Dual

I2C

GBE

SYS_I2C

I2C (Netconsole)

I2C

H8

I2C

RTM

I2C

IPMC_I2C

I2C Devices

SMM15

FLASH_SEL

OBP/HV

SP NVRAM

SUNFRUID

SCC_MAC

FBDIMM SPD[0..7]

ADM1026

IPMI FRUID

		XAUI_RTM								XFMR
		XAUI_RTM				2,3
						2,3
			XFMR		XFMR		USB



	0	1	0	1
	0	1	0	1
	Fabric		Base

			10/100/1000
	Midplane Zone 2		10/100/1000
	Midplane Zone 2		MGMNT
			FRONT PANEL
			ETHERNET

RTM

Debug

Serial

XAUI

Front board header

FRONT/REAR

SERIAL CONSOLE

ETHERNET (Mgmnt)

ETHERNET

ETHERNET

PCIEXP-

XAUI

SERIAL Console

IPMB

RJ45

Midplane Zone 1

Zone 3 RTM

Serial

NOTES:

1)Functions in orange are for Power PC

2)Functions in yellow are replacing Southbridge

SEL EEPROM DC-DC

Telco Daughter Card

5.1.1UltraSPARC T2 Processor and Memory

The UltraSPARC T2 processor has eight SPARC physical processor cores. Each SPARC physical processor core has full hardware support for eight strands, two integer execution pipelines, one floating-point execution pipeline, and one memory pipeline. The eight SPARC cores are connected through a crossbar to an on-chip unified 4-Mbyte, 16 way associative L2 cache.

5-2Netra CP3260 Blade Server User’s Guide • April 2009

Image 102

Sun Microsystems UltraSPARC T2 Processor and Memory, Netra CP3260 Blade Server User’s Guide April, Flash, Midplane Zone

Contents

Sun Netra CP3260 Blade Server User’s Guide Sun Microsystems, IncApril 2009, Revision Please Recycle Contents 2. Hardware InstallationPreface 1. Introduction 3. Software Installation 4. Firmware and Blade Server Managementiv Netra CP3260 Blade Server User’s Guide April probe-scsi and probe-scsi-all Commands 4.3.3.4 Using watch-net and watch-net-all Commands to5. Hardware Functional Descriptions vi Netra CP3260 Blade Server User’s Guide April A. Physical Characteristics Get Version CommandGet RTM Status Command B. Sun OEM IPMI Commands B-1Index Send Sensor State Command B-5Solaris OS Graceful Shutdown Commands B-4 Index-1Figures Zone 3 Signal Connectors Power Distribution Connector Zone 1 P10 A-7Zone 2 Connectors A-9 Zone 3 Power ConnectorTables CPU Temperature AlarmsEthernet Port Connector Pin Assignments Send Sensor State Command Data Bytes Get Version Command Data Bytes B-2Get RTM Status Command Data Bytes TABLE B-1Preface How This Document Is OrganizedUsing UNIX Commands Shell PromptsTypographic Conventions Related DocumentationSun Netra CP32x0 SAS Storage Documentation, Support, and TrainingThird-Party Web Sites Advanced Rear Transition ModuleSun Welcomes Your Comments Sun Netra CP3260 Blade Server User’s Guide, part numberxviii Sun Netra CP3260 Blade Server User’s Guide April Section 1.7, “Technical Support and Warranty” on page Section 1.1, “Overview” on page Section 1.2, “Features” on pageSection 1.3, “System Configurations” on page Introduction1.2 Features FeatureDescription Chapter 1 IntroductionFIGURE 1-1 Netra CP3260 Blade Server Front Panel 1-4 Netra CP3260 Blade Server User’s Guide AprilFIGURE 1-2 Netra CP3260 Blade Server Top View Chapter 1 Introduction⑤ ④ ③ ② ① ⑦ 1-6 Netra CP3260 Blade Server User’s Guide April1 Zone 1 power connector 2 Zone 2 signal connectors 1 Top latch 2 Out of Service LED yellow8 Hot-Swap switch and bottom latch 3 Zone 3 RTM signal connectors 4 Zone 3 ARTM power connector1.3 System Configurations 1-8 Netra CP3260 Blade Server User’s Guide AprilFIGURE 1-3 Netra CP3260 Blade Server in an ATCA Shelf Enclosure Chapter 1 IntroductionEthernet ⑤ ⑥ ⑦kless client that boots through network from a remote server 1-10 Netra CP3260 Blade Server User’s Guide April6 Sun Netra CP3260 blade server installed from front 1.4 Advanced Rear Transition Modules1 Remote server 2 Sun Netra CP32X0 Advanced RTM installed from rear 3 Serial connection 4 Console terminal 5 Ethernet connection RJ-45①② ③ FIGURE 1-4 Netra CP3260 Blade Server, Midplane, and Netra CP32x0 ARTM1-12 Netra CP3260 Blade Server User’s Guide April TABLE 1-2 I/O Configurations 1 Sun Netra CP3260 blade server 2 Sun Netra CP32X0 ARTM3 ATCA chassis midplane 1.5 Hot-Swap Support 1.6 System Requirements and Options1.6.1 Hardware Requirements and Options 1.7 Technical Support and Warranty 1.6.2 Software Requirementshttp//docs.sun.com/app/docs/prod/netra.brds 1.7.1 Part Number, Serial Number, and Revision Number Identification FIGURE 1-5 Netra CP3260 Blade Server Barcode Labeling Chapter 1 Introduction1-18 Netra CP3260 Blade Server User’s Guide April Section 2.1, “Equipment and Operator Safety” on page Hardware Installation2.1 Equipment and Operator Safety Section 2.3, “Preparing for the Installation” on pageUse an antistatic wrist strap when 2.2 Materials and Tools Required 2.3 Preparing for the Installation2.3.1 Checking Power, Thermal, Environmental, and Space Requirements page2.4 Installation Procedure Summary 2.5 Configuring On-Board Hardware 2.5.1 Adding or Replacing FB-DIMM Memory ModulesFIGURE 2-1 FB-DIMM Memory Locations 2-6 Netra CP3260 Blade Server User’s Guide AprilChapter 2 Hardware Installation 2-8 Netra CP3260 Blade Server User’s Guide April FB0B 2.5.1.1 To Remove FB-DIMM Memory Modules 2.5.1.2 To Install FB-DIMM Memory Modules FIGURE 2-2 Removing an FB-DIMM Memory Module1. Locate the FB-DIMM connectors on the Netra CP3260 blade server 2.5.2 Adding or Replacing Compact Flash Card 2.5.3 Adding or Replacing TOD Clock Battery 1 Compact Flash connector2-14 Netra CP3260 Blade Server User’s Guide April 1. Remove the FB-DIMM closest to the front panel FIGURE 2-5 TOD Battery Location 2-16 Netra CP3260 Blade Server User’s Guide AprilChapter 2 Hardware Installation 2.6 Installing an Advanced Rear Transition Module Optional 2-18 Netra CP3260 Blade Server User’s Guide AprilChapter 2 Hardware Installation ② ① ③FIGURE 2-6 Installing a Netra CP32X0 ARTM 1 Netra CP3260 blade server 2 Netra CP32X0 ARTM2.7 Installing the Netra CP3260 Blade Server FIGURE 2-7 Installing Blade Server Into Chassis Slot Chapter 2 Hardware Installation2.8 Connecting External I/O Cables FIGURE 2-8 Netra CP3260 Blade Server Latches and Locking Screws2-22 Netra CP3260 Blade Server User’s Guide April Information on connecting each of these cables follows 2.9 Hot-Swapping the Netra CP3260 Blade Server Chapter 2 Hardware Installation FIGURE 2-9 Hot-Swap Latch and Hot-Swap LED2-26 Netra CP3260 Blade Server User’s Guide April Section 3.4, “Firmware Updates” on page Software InstallationSection 3.3, “Installing as a Diskless Clients” on page Section 3.5, “Configuring for 1-GbE or 10-GbE Switches” on page3.2 Configuring Payload OS NIU Driver for Multiplexing to Zones 2 and CODE EXAMPLE 3-1 Zone 2 Connectivity Both nxge PortsCODE EXAMPLE 3-2 Zone 3 Connectivity Both nxge Ports Chapter 3 Software Installation 3.3 Installing as a Diskless Clients 3.3.1 Creating a Boot Server for Diskless Clientshttp//docs.sun.com/app/docs/prod/solaris locale = enUS rootpassword = rootpassword imagedirectory = /export/install3.3.2 Adding a Diskless Client 4. Download and install additional patcheshostname = clienthost ipaddress =ethernetaddress = 802022b3aa swapsize =timezone = US/Pacific locale = enUS nameservice = NIS 3.3.3 Determining Local Network IP Addresses and Host Names6. Boot the diskless client 3.4 Firmware Updates 3.5 Configuring for 1-GbE or 10-GbE Switcheshttp//docs.sun.com/app/docs/prod/netra.brds 3.6 Downloading and Installing SunVTS Software 3.7 Formatting the Optional Compact Flash Card Section 4.4, “Error Handling Summary” on page Section 4.2, “Power-On Self-Test Diagnostics” on pageSection 4.3, “OpenBoot Firmware” on page Section 4.5, “Automatic System Recovery” on page4.1 System Firmware http//docs.sun.com/app/docs/prod/n900.srvr#hic4.2 Power-On Self-Test Diagnostics 4.2.1 POST Test Coverage4.3 OpenBoot Firmware 4.2.2 POST Diagnostic and Error Message Format4.3.1 Getting to the ok Prompt TABLE 4-1 Ways of Accessing the ok Prompt4.3.2 Auto-Boot Options 4.3.3 OpenBoot Commandsprobe-scsi and probe-scsi-all probe-ide show-devs 4.3.3.1 probe-scsi and probe-scsi-all Commands 0 ok probe-scsi-all4.3.3.2 probe-ide Command 4.3.3.3 show-devs Commandcpu@37 cpu@36 cpu@35 cpu@34 cpu@33 cpu@32 cpu@31 cpu@30 cpu@2f cpu@2e cpu@8 cpu@7 cpu@6 cpu@5 cpu@4 cpu@3 cpu@2 cpu@1 ‘.’ is a Good Packet. ‘X’ is a Bad Packet Type any key to stop 0 ok watch-net1000 Mbps full duplex Link up Looking for Ethernet Packets ‘.’ is a Good Packet. ‘X’ is a Bad Packet. Type any key to stopis false 4.3.4 OpenBoot Configuration Variablesdiag-switch? is false If falseprotocol string. network-boot-arguments canuse-nvramrc? is true key=valueHalt the server to display the ok prompt 4.3.4.1 Viewing and Setting OpenBoot Configuration Variablessecurity-mode is not none never 0 ok printenv4.4 Error Handling Summary 4.5 Automatic System Recovery 4.5.1 Enabling and Disabling Automatic System Recovery 4.5.1.1 To Enable Automatic System Recovery4.5.1.2 To Disable Automatic System Recovery 4.6 Network Device Aliases TABLE 4-3 Network Device Aliasesconnected ok configured bridge/fhs 4.7 Retrieving Device InformationCondition console serial, 6f00000154 rtc obp-device, 6f00000161 pci pciex, 6f0000050e pci pciex, 6f00000533 network network, 6f00000804 network network, 6f00000814 L2BANK7 other, 6f00000cda BR0 other, 6f00000ce0 CH0 other, 6f00000ce6 CH0 other, 6f00000e4e D0 module, 6f00000e54 R0 unknown, 6f00000e5f IMMU other, 6f00000f86 DMMU other, 6f00000f8c CORE5 other, 6f00000f92 P24 other, 6f000010a0 P25 other, 6f000010a6 P26 other, 6f000010ac 4.8 Multiplexing to Zones 2 and Be aware of the following possible issues when multiplexing zones Section 5.1, “Hardware Architecture” on page Hardware Functional Descriptions5.1 Hardware Architecture Section 5.2, “Hardware Modules” on page5-2 Netra CP3260 Blade Server User’s Guide April 5.1.1 UltraSPARC T2 Processor and MemoryPOWER PC MPC885 66MHz Flash5.1.3 Base and Fabric Interfaces 5.1.5 Power PC5.1.2 I/O 5.1.4 Additional I/O5.2 Hardware Modules 5.1.6 ARTM Support5.2.1 UltraSPARC T2 Processor FIGURE 5-2 UltraSPARC T2 Multicore Processor Block Diagram Chapter 5 Hardware Functional Descriptions5-6 Netra CP3260 Blade Server User’s Guide April SPARC 5.2.1.1 Electronic FuseUltraSPARC T2 SPARC5.2.1.4 Memory Controller 5.2.1.2 Cores5.2.1.3 L2 Cache 5.2.1.5 I/O Interface5.2.2.1 Memory Capacity 5.2.2 Memory Subsystem5.2.3 I/O Subsystem 5.2.2.2 Memory Speed5.2.3.2 Base Interface 5.2.3.1 PCI Express SwitchARTM Power and Management 5.2.3.3 Fabric Interface5.2.4.1 Serial Ports 5.2.4 Other ARTM Interfaces5.2.5 Front Panel I/O 5.2.4.2 Ethernet Management Port5.2.5.3 Dual USB Ports 5.2.7 Service Processor MPC8855.2.6 Compact Flash Socket 5.2.7.1 Field-Programmable Gate Array5.2.8 Intelligent Platform Management Controller 5.2.8.3 IPMB-L Interface 5.2.8.1 Intelligent Platform Management Bus5.2.8.2 Interface to the PPC 5.2.8.4 ATCA Hot-Swap Latch5.2.8.7 System Monitor ADM1026 and Thresholds 5.2.8.6 Power Control5.2.8.5 LEDs Voltage MonitoringTemperature Monitoring TABLE 5-2 CPU Temperature AlarmsTABLE 5-1 Voltage Sensor Thresholds 5.2.9 I/O Subsystem Resets 5.2.8.8 FRUID PROMs5.2.10 ATCA Power Module −48V to 5.2.11 TOD Clock BatteryA.1 Form Factor Physical CharacteristicsSection A.4, “Connectors and Pinout” on page A-3 A.2 Layout② ③ ⑥ ⑤ FIGURE A-1 Netra CP3260 Blade Server LayoutA-2 Netra CP3260 Blade Server User’s Guide April A.4.1 Front Panel Connectors A.4 Connectors and PinoutA.3.1 Visual Indicators A.3 Front PanelActivity LED yellow A.4.1.1 Ethernet PortA.4.1.2 Dual USB Port Link LED greenFor USB connector signals, see TABLE A-2 A.4.1.3Serial Port A.4.2 Compact Flash Connector A.4.3 Midplane Power Connector ZoneI0I0I TABLE A-4 Power Distribution Connector Pin Assignments TABLE A-4 lists the power connector pin assignmentsFIGURE A-5 Power Distribution Connector Zone 1 P10 FIGURE A-5 shows the pin assignmentsA.4.4 Data Transport Connector Zone TABLE A-5 gives the Zone 2 J23 connector pin assignments TABLE A-6 gives the Zone 2 J20 connector pin assignmentsAppendix A Physical Characteristics A.4.5 Sun Netra ARTM Connectors Zone TABLE A-7 Zone 3 J31 Connector Pin Assignments TABLE A-7 gives the Zone 3 J31 connector signals and pin assignmentsTABLE A-8 gives the Zone 3 J32 connector signals and pin assignments TABLE A-8 Zone 3 J32 Connector Pin AssignmentsTABLE A-9 gives the Zone 3 J33 connector signals and pin assignments n Pow ConA.4.6 TOD Clock Battery Holder TABLE A-10 Zone 3 Power Connector Pin Assignments2 TOD clock battery location with FB-DIMM removed FIGURE A-9 TOD Battery Location1 TOD battery location A-14 Netra CP3260 Blade Server User’s Guide AprilSection B.2, “Get RTM Status Command” on page B-3 Sun OEM IPMI CommandsSection B.1, “Get Version Command” on page B-2 Section B.3, “Solaris OS Graceful Shutdown Commands” on page B-4B.1 Get Version Command Get VersionB.2 Get RTM Status Command Example Terminal ModeB.3 Solaris OS Graceful Shutdown Commands Example Terminal ModeB.4 Send Sensor State Command Netra CT 900 Software Developer’s Guide 819-1178 for IPMI commandsTABLE B-3 Send Sensor State Command Data Bytes Continued B-6 Netra CP3260 Blade Server User’s Guide AprilTABLE B-3 Send Sensor State Command Data Bytes Continued B-8 Netra CP3260 Blade Server User’s Guide April Index Page