Sun Microsystems, Inc
Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and
User’s Guide
Page
Declaration of Conformity
Contents
1. Product Overview 1 Product Features 1 Hardware Description
Regulatory Compliance Statements
4. InfiniBand Software Overview
2. Adapter Installation
3. Configuring IP Over InfiniBand
B. Diagnostic Software and Troubleshooting
Other Useful Utilities
cfgadm snoop netstat kstat
Index
Contents
Page
Sun 4x-to-12x InfiniBand Cable Pin Assignments
Figures
Typical Adapter-to-Switch Configuration InfiniBand Software Stack
Sun Dual Port 4x IB Host Channel Adapter PCI-X Card 2 LED Layout
Page
TABLE B-1
Tables
IB-HCA LEDs Hardware, Software, and Cable Requirements
SunVTS Documentation
Page
ICES-003 Class A Notice - Avis NMB-003, Classe A
Regulatory Compliance Statements
FCC Class A Notice
FCC Class B Notice
BSMI Class A Notice
ICES-003 Class B Notice - Avis NMB-003, Classe B
Regulatory Compliance Statements
CCC Class A Notice
GOST-R Certification Mark
Page
European Union
Declaration of Conformity
Page
How This Book Is Organized
Preface
http//docs.sun.com
Using UNIX Commands
Shell Prompts
Typographic Conventions
System Administration Guide Network Services
Sun InfiniBand Switch Nine-Port Release Notes
PCI-X Addendum to the PCI Local Bus Specification, Revision
Documentation
Documentation, Support, and Training
Third-Party Web Sites
Contacting Sun Technical Support
Sun Welcomes Your Comments
Page
Hardware Description
Product Features
Product Overview
Standard faceplate
PCI-X Interface
I/O Interfaces
LED Displays
InfiniBand Interface
FIGURE 1-2 LED Layout
Physical link Green LED
Logical link Amber LED
TABLE 1-2 Hardware, Software, and Cable Requirements
Hardware, Software, and Cable Requirements
Page
IB-HCA Bus and Slot Selection
Adapter Installation
Installing the Adapter
7. Replace the cover on the unit
9. Turn power back on to the system and allow the server to reboot
FIGURE 2-1 Typical Adapter-to-Switch Configuration
Verifying the Installation
Page
1. Confirm that the IB-HCA ports are up. To do this, type the command
Configuring IP Over InfiniBand
IPoIB Configuration
Configuring IPoIB
4. Plumb each of the IB devices
2. Create the InfiniBand devices using the following command
3. Verify InfiniBand devices
6. Check that data can be send over the InfiniBand link
5. Verify that the devices are plumbed. To do this, type the command
Managing IB Devices for IPoIB
Page
InfiniBand Software
InfiniBand Software Overview
uDAPL IPoIB
User Direct Access Programming Library
IP over InfiniBand Driver
Solaris 10 OS
Tavor HCA Driver
InfiniBand Transport Framework
InfiniBand Management Framework
Manuals
System Administration Guide Devices and Files System
Sun Cluster 3.x Hardware Administration Manual for Solaris OS
Related Software Documentation
A P P E N D I X A
InfiniBand Cable Pin Assignments
FIGURE A-1 shows the InfiniBand cable connectors and pin assignments
FIGURE A-1 Sun 4x-to-12x InfiniBand Cable Pin Assignments
SunVTS Diagnostic Testing
Diagnostic Software and Troubleshooting
Using the SunVTS ibhcatest
2. Unplumb the interface from the system, using the ifconfig command
Troubleshooting Tasks
Using the ibhcatest
cfgadm
Check the system log or console for Tavor driver error messages
Other Useful Utilities
# snoop -d ibd1
snoop
netstat
kstat
Page
Index
uDAPL, 15, 16 utilities cfgadm, 26 kstat, 27 netstat, 27 snoop
Tavor driver, 17 troubleshooting IB-HCA, 25 tasks, 25 utilities
versions