Manuals / Sun Microsystems / Computer Equipment / Switch

Sun Microsystems CP3240 manual 5 Expansion Fabric Switch Subsystem

Models: CP3240

1 131

Download 131 pages 18.57 Kb

Page 64

2.4.4Expansion Fabric Switch Subsystem

2.4.4Expansion Fabric Switch Subsystem

FIGURE 2-5Expansion Fabric Switch Subsystem

PICMG 3.0 AdvancedTCA provides an agnostic mesh on the backplane called the Expansion Fabric. This interface is the data plane in the shelf. The Expansion Fabric is called “Fabric” in this guide. This fabric can be several different technologies defined by AdvancedTCA sub-specifications. The Sun Netra CP3240 switch is designed to comply with PICMG 3.1 Ethernet/Fibre Channel for AdvancedTCA Systems, options 1 and option 9. That means the Sun Netra CP3240 switch provides a single 1/10Gigabyte port to each node board.

The Fabric uses 10GBase-BX4 Ethernet to provide connectivity between boards though the backplane. The Fabric can scale down to 1Gigabyte and work with 1000Base-BX boards. The Fabric subsystem is based around two main components: the Broadcom BCM56800 and the Freescale MPC8247.

2-24Sun Netra CP3240 Switch Installation Guide • September 2009

Image 64

Sun Microsystems CP3240 manual 5 Expansion Fabric Switch Subsystem

Contents

Sun Microsystems, Inc Sun Netra CP3240 Switch Installation GuideSeptember 2009, Revision A Please Recycle Please Recycle Page Contents Preface 1. Getting Startedvi Sun Netra CP3240 Switch Installation Guide September 2. Overview3. Configuring Jumper Settings Contents4. Configuring Switch Software viii Sun Netra CP3240 Switch Installation Guide September4.6 Boot Sequence B. Connectors A. Environment Specificationsx Sun Netra CP3240 Switch Installation Guide September C. Datasheet Reference D. Agency CertificationsIndex Index-1xii Sun Netra CP3240 Switch Installation Guide September Figures xiv Sun Netra CP3240 Switch Installation Guide September Switch Configuration Jumper Settings Tables2-27 TABLE A-1 10/100Base-TX RJ-45 Connector J13-2nd TABLE B-10TABLE B-11 TABLE B-12xviii Sun Netra CP3240 Switch Installation Guide September Preface Before You Read This DocumentHow This Document Is Organized xx Sun Netra CP3240 Switch Installation Guide SeptemberTypographic Conventions http//docs.sun.com/app/docs/prod/cp3240.switch?l=en#hic Related Documentationhttp//docs.sun.com/app/docs/prod/n900.srvr#hic Third-Party Web Sites Sun Welcomes Your Commentsxxiv Sun Netra CP3240 Switch Installation Guide September Getting Started 1.1 System Requirements 1.1.1 Connectivity1.1.2 Electrical and Environmental 1.1.1.1 Hub ConnectivityChapter 1 Getting Started 1.3 Handling Switches 1.2 Unpacking1.4 Connectors 1.5 Jumper Options1.6 Switch and RTM Faceplates FIGURE 1-1 Switch and RTM FaceplatesSwitch Faceplate Copper RTM1.7 RTM Airflows 1.6.1 Base 10/100/1000 Uplink Ports RJ-451.6.2 10/100 Management Port RJ-45 1.6.3 Serial Management Port RJ-45FIGURE 1-2 Netra CP3240H-RTM-CU Airflow Pa 1.7.2 RTM Pressure Drop Versus Airflows Impedence CurvesFIGURE 1-3 Netra CP3240H-RTM-CU Airflow InchesH20 Netra CP3240H-RTM-OP Airflow InchesH20 Netra CP3240H-RTM-OP Airflow PaChapter 1 Getting Started 1.8 Removing and Installing Switches 1.8.1 Removing a Switch Set1.8.1.1 Removing a Switch From the Front of the Server FIGURE 1-6 Front Cable Management Bracket in Lower Position3. Disconnect all cables connected to the switch 1.8.1.2 Removing a Rear Transition Module for a Switch 1.8.2.1 Installing the Rear Transition Module for a Switch 1.8.2 Installing a Switch Set1.8.2.2 Installing a Switch 1.9 Switch LEDs 1.9.1 ATCA Board Status LEDs1.9.2 Hot-Swap LED Overview Section 2.1, “Features” on pageSection 2.2, “Switch Components” on page Section 2.4, “Functional Diagrams and Port Maps” on page2.1 Features 2.1.1 General2.1.2 Base Interface 2.1.3 Fabric Gigabit Interface 2-4 Sun Netra CP3240 Switch Installation Guide September2.1.4 AMC Sites Site 1 AMC.0 Mid-size, AMC.2 Type E1Site 2 AMC.0 Mid-size, AMC.2 Type 5 and E1 Site 3 AMC.0 Mid-size, AMC.2 Type E12.2 Switch Components 2.2.1 Broadcom StrataXGS 3 BCM56503 Ethernet Switch2.2.2 Broadcom StrataXGS 3 BCM56800 Ethernet Switch 2.2.3 Broadcom BCM5464R and BCM5461S 10/100/1000Base-T Ethernet PHY2.2.4 Freescale PowerQUICC II MPC8247 Communications Processor 2.2.5 Pigeon Point BMR-H8S-AMCc AdvancedTCA IPMI Subsystem2.3.1 FASTPATH Switching 2.3 Protocols, RFCs, and MIBs Support2.3.1.1 Additional Layer 2 Functionality 2.3.1.2 System Facilities2.3.1.3 Switching MIBs 2.3.1.4 Routing MIBs2.3.2 FASTPATH Routing 2.3.3.2 Access Control Lists ACLs 2.3.3 FASTPATH Quality of Service2.3.3.1 DiffServ 2.3.3.4 Quality of Service MIBs 2.3.3.3 Class of Service CoS2.3.4 FASTPATH Multicast 2.3.5 FASTPATH IPv6 Routing 2.3.4.1 Multicast MIBs2.3.6 FASTPATH Management 2.3.5.1 IPv6 Routing MIBs2.3.6.1 SSL 3.0 and TLS 2.3.6.3 Additional Management Features2.3.6.2 SSH 1.5 and 2.4.1 Switch 2.4 Functional Diagrams and Port MapsFIGURE 2-1 Switch Functional Block Diagram TABLE 2-1 Switch External Ports 2.4.2 Rear Transition Modules RTMsTABLE 2-2 Zone 3 RTM Ports 2.4.2.1 Copper RTM FIGURE 2-2 Copper RTM Functional Block DiagramTABLE 2-3 Copper RTM External Ports 2-20 Sun Netra CP3240 Switch Installation Guide SeptemberTABLE 2-4 Copper RTM Port Restrictions 2.4.2.2 Fiber Optic RTM FIGURE 2-3 Fiber Optic RTM Functional Block DiagramTABLE 2-5 Fiber Optic External RTM Ports 2-22 Sun Netra CP3240 Switch Installation Guide SeptemberTABLE 2-6 Fiber Optic RTM Port Restrictions 2.4.3 Base Fabric Switch Subsystem FIGURE 2-4 Base Fabric Switch Subsystem2.4.4 Expansion Fabric Switch Subsystem FIGURE 2-5 Expansion Fabric Switch Subsystem2.4.5 AdvancedMC Sites 2.4.5.1 AMC Port Maps FIGURE 2-6 AMC Port Map DiagramTABLE 2-7 AMC Ethernet Port Availability 2-28 Sun Netra CP3240 Switch Installation Guide September Page 2.4.5.2 AMC Module Support by Site 2.4.5.3 AMC Port Restrictions for RTMsTABLE 2-11 AMC Modules by Site TABLE 2-12 AMC Port Restrictions for Copper RTMsSection 3.1, “Jumper Settings” on page Configuring Jumper SettingsSection 3.2, “Jumper Locations” on page 3.1 Jumper Settings 3.1.1 P4 Cross-Connect Control3.1.3 P63-4 Base Zero Reset Configuration Word 3.1.2 P61-2 Fabric Zero Reset Configuration Word3.1.4 P81-2 Base Write Protect 3.1.5 P83-4 Fabric Write Protect 3.1.7 P101-2 IPMC Reset3.1.6 P9 IPMC Firmware Program 3.1.10 P113-4 IPMC Board Reset 3.1.9 P111-2 Forced-Board Enable3.1.8 P103-4 IPMC FWE 3.1.11 P121-2 and P12 3-4 EMI Ground to Logic Ground 3.1.12 P13 Serial DirectionFIGURE 3-1 shows the locations of the jumper settings 3.2 Jumper LocationsFIGURE 3-1 Switch Jumper Locations 3-8 Sun Netra CP3240 Switch Installation Guide September Configuring Switch Software 4.1 IPMI Firmware Sensors 4.1.1 State SensorsThe following tables lists the logic that drives these sensors Chapter 4 Configuring Switch SoftwareTABLE 4-3 IPMI Sensor Logic 4.1.2 Threshold Sensors IPMI Thresold Sensors4.2 uBoot 4.2.1 uBoot Console4.2.2 E-Keying Control in uBoot 4.3 Linux 4.2.3 Serial-Baud Rate Control in uBoot4.3.1 e-Keying 4.3.2 e-Keying Bypass 4.4 Serial Select4.3.3 ATCA LEDs 4.5 Serial Location 4.5.1 Changing Serial Location from UBoot4.5.2 Changing Serial Location from FASTPATH 4.6 Boot Sequence The following is an example of a boot sequence4.6.1 Boot Utility Menu 4.6.1.1 Load Code Update Package using TFTP/FTP 4.6.1.2 Erase Current Configuration4.6.1.4 Select Boot Method 4.6.1.3 Erase Permanent Storage4.7 Primary and Backup Flash 4.8.1 Booting the Non-Active Image4.6.1.5 Start Diagnostic Application 4.8 Dual Firmware Images4.8.2 Updating the Non-Active Image 4.9 Network Boot4.8.3 Fabric 1G/10G Auto-negotiation 9. Press number 1 to boot the system CODE EXAMPLE 4-5 Example Console Output4-16 Sun Netra CP3240 Switch Installation Guide September CODE EXAMPLE 4-5 Example Console Output ContinuedUser 4.10.1 Management Options 4.10 FASTPATH4.10.1.1 CLI 4.10.2 Basic CLI Commands TABLE 4-6 Basic CLI Commands4.10.3.1 CLI Defaults 4.10.3 Logins and Prompts4.10.3.2 Web Interface Defaults 4.10.4 Secure Remote Access 4.10.3.3 SNMP Defaults4.10.4.1 SSH and SSL/TLS Keys 4.10.4.2 Enabling SSH and SSL4.10.5 Default Settings 4.10.6 Port OrderingTABLE 4-7 Port Order List Continued 4.11.2 Firmware Upgrades 4.11 Firmware Updates4.11.1 Firmware List 4.12 Fiber Optic RTM Configuration 4.12.3 10G Configuration for RTM Optical Port4.12.1 Module Support 4.12.2 Backplane Ports Versus RTM Optical Portsconfigure 4.12.4 1G Configuration for RTM Optical Portauto-negotiate exit exit Environment Specifications A.1.1 Absolute Maximum Ratings A.1 Electrical and EnvironmentalA.1.2 Normal Operating Ranges A.2Reliability A.3.1 Board Dimensions and WeightA.3 Mechanical FIGURE A-1 PCB Dimensions A-4 Sun Netra CP3240 Switch Installation Guide SeptemberConnectors B.1 Connector Assignments TABLE B-1 Connector AssignmentsB.2 Connector Locations Topside FIGURE B-1 Connector Locations TopsideTABLE B-2 ATCA Zone 1 Connector J9 Pins FIGURE B-2 ATCA Zone 1 Connector J9ATCA Zone 2 P20 ZD Connector J5 ATCA Zone 2 P21 ZD Connector J4TABLE B-4 ATCA Zone 2 P21 ZD Connector J4 TABLE B-3 ATCA Zone 2 P20 ZD Connector J5ATCA Zone 2 P21 ZD Connector J4 B-6 Sun Netra CP3240 Switch Installation Guide SeptemberATCA Zone 2 P22 ZD Connector J3 ATCA Zone 2 P23 ZD Connector J2TABLE B-6 ATCA Zone 2 P23 ZD Connector J2 B-8 Sun Netra CP3240 Switch Installation Guide SeptemberATCA Zone 2 P24 ZD Connector J1 B.8 Serial RJ-45 Connector J13 TopTABLE B-7 ATCA Zone 2 P24 ZD Connector J1 This connector is the Cisco/Intel pinoutB.9 Serial Cable B.10 10/100/1000Base-T RJ-45 Connector J13 3rd, J13 Bottom B.11 10/100Base-TX RJ-45 Connector J13 2ndTABLE B-10 10/100/1000Base-T RJ-45 Connector J13-3rd and Bottom TABLE B-11 10/100Base-TX RJ-45 Connector J13-2ndATCA Zone 3 RTM Connector Top J8 ATCA Zone 3 RTM Connector J7B.12 B.13ATCA Zone 3 RTM Connector J6 B.14Bottom TABLE B-14 ATCA Zone 3 RTM Connector J6-BottomDatasheet Reference IEEE 802.3-2002 CDMA/CD Ethernet and Other IEEE 802.3/802.1 DocumentsPICMG 3.0 AdvancedTCA PICMG 3.1 AdvancedTCA Ethernet and Fibre ChannelBroadcom Datasheets MPC8272 PowerQUICC II Family Reference ManualIETF RFCs This and other Freescale documents about the MPC8247 are available atD.1 CE Certification Agency CertificationsD.2 NEBS/ETSI D.3 Safety D.4.1 EN 50081-1 Emissions D.4 Emissions Test RegulationsD.4.2 EN 55024 Immunity D.5 Regulatory Information D.5.1 D.4.1FCC USAD.5.2 Industry Canada Canada D-6 Sun Netra CP3240 Switch Installation Guide September Index handling cards, cautions I installing switchesswitches, rear transition cards LEDs switches R removing switches switches, rear transition cardsIndex-2 Sun Netra CP3240 Switch Installation Guide September