Manuals / Sun Microsystems / Computer Equipment / Network Card

Sun Microsystems PCI manual InfiniBand Software Overview

Models: PCI

1 50

Download 50 pages 32.77 Kb

Page 37

Image 37

C H A P T E R 4

InfiniBand Software Overview

This chapter includes the following topics:

■“InfiniBand Software” on page 15

■“Related Software Documentation” on page 18

InfiniBand Software

The InfiniBand software is included in the Solaris 10 Operating System. FIGURE 4-1shows a block diagram of the InfiniBand software stack which includes the following modules:

■Solaris 10 SPARC® Platform Edition or Solaris 10 X86 Platform Operating Systems

■User Direct Access Programming Library (uDAPL)

■IP over InfiniBand Driver (IPoIB)

■InfiniBand Transport Framework (IBTF)

■InfiniBand Management Framework (IBMF)

■Tavor HCA Driver

Page 37

Image 37

Sun Microsystems PCI manual InfiniBand Software Overview

Contents

User’s Guide Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation andSun Microsystems, Inc Page 1. Product Overview 1 Product Features 1 Hardware Description ContentsRegulatory Compliance Statements Declaration of Conformity3. Configuring IP Over InfiniBand 2. Adapter InstallationB. Diagnostic Software and Troubleshooting 4. InfiniBand Software OverviewIndex cfgadm snoop netstat kstatContents Other Useful UtilitiesPage Typical Adapter-to-Switch Configuration InfiniBand Software Stack FiguresSun Dual Port 4x IB Host Channel Adapter PCI-X Card 2 LED Layout Sun 4x-to-12x InfiniBand Cable Pin AssignmentsPage IB-HCA LEDs Hardware, Software, and Cable Requirements TablesSunVTS Documentation TABLE B-1Page FCC Class A Notice Regulatory Compliance StatementsFCC Class B Notice ICES-003 Class A Notice - Avis NMB-003, Classe ABSMI Class A Notice ICES-003 Class B Notice - Avis NMB-003, Classe BGOST-R Certiﬁcation Mark CCC Class A NoticeRegulatory Compliance Statements Page European Union Declaration of ConformityPage How This Book Is Organized PrefaceShell Prompts Using UNIX Commandshttp//docs.sun.com Sun InfiniBand Switch Nine-Port Release Notes System Administration Guide Network ServicesPCI-X Addendum to the PCI Local Bus Specification, Revision Typographic ConventionsThird-Party Web Sites Documentation, Support, and TrainingContacting Sun Technical Support DocumentationSun Welcomes Your Comments Page Product Overview Product FeaturesHardware Description Standard faceplate LED Displays I/O InterfacesInfiniBand Interface PCI-X InterfaceLogical link Amber LED Physical link Green LEDFIGURE 1-2 LED Layout TABLE 1-2 Hardware, Software, and Cable Requirements Hardware, Software, and Cable RequirementsPage Installing the Adapter Adapter InstallationIB-HCA Bus and Slot Selection 7. Replace the cover on the unit 9. Turn power back on to the system and allow the server to rebootFIGURE 2-1 Typical Adapter-to-Switch Configuration Verifying the InstallationPage IPoIB Configuration Configuring IP Over InfiniBandConfiguring IPoIB 1. Confirm that the IB-HCA ports are up. To do this, type the command3. Verify InfiniBand devices 2. Create the InfiniBand devices using the following command4. Plumb each of the IB devices Managing IB Devices for IPoIB 5. Verify that the devices are plumbed. To do this, type the command6. Check that data can be send over the InfiniBand link Page InfiniBand Software InfiniBand Software OverviewIP over InfiniBand Driver User Direct Access Programming LibrarySolaris 10 OS uDAPL IPoIBInfiniBand Management Framework InfiniBand Transport FrameworkTavor HCA Driver Sun Cluster 3.x Hardware Administration Manual for Solaris OS System Administration Guide Devices and Files SystemRelated Software Documentation ManualsFIGURE A-1 shows the InfiniBand cable connectors and pin assignments InfiniBand Cable Pin AssignmentsA P P E N D I X A FIGURE A-1 Sun 4x-to-12x InfiniBand Cable Pin Assignments SunVTS Diagnostic Testing Diagnostic Software and TroubleshootingUsing the SunVTS ibhcatest Using the ibhcatest Troubleshooting Tasks2. Unplumb the interface from the system, using the ifconfig command Other Useful Utilities Check the system log or console for Tavor driver error messagescfgadm netstat snoopkstat # snoop -d ibd1Page Index versions Tavor driver, 17 troubleshooting IB-HCA, 25 tasks, 25 utilitiesuDAPL, 15, 16 utilities cfgadm, 26 kstat, 27 netstat, 27 snoop