Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and
User’s Guide
Sun Microsystems, Inc
Page
1. Product Overview 1 Product Features 1 Hardware Description
Contents
Regulatory Compliance Statements
Declaration of Conformity
3. Configuring IP Over InfiniBand
2. Adapter Installation
B. Diagnostic Software and Troubleshooting
4. InfiniBand Software Overview
Index
cfgadm snoop netstat kstat
Contents
Other Useful Utilities
Page
Typical Adapter-to-Switch Configuration InfiniBand Software Stack
Figures
Sun Dual Port 4x IB Host Channel Adapter PCI-X Card 2 LED Layout
Sun 4x-to-12x InfiniBand Cable Pin Assignments
Page
IB-HCA LEDs Hardware, Software, and Cable Requirements
Tables
SunVTS Documentation
TABLE B-1
Page
FCC Class A Notice
Regulatory Compliance Statements
FCC Class B Notice
ICES-003 Class A Notice - Avis NMB-003, Classe A
BSMI Class A Notice
ICES-003 Class B Notice - Avis NMB-003, Classe B
CCC Class A Notice
GOST-R Certification Mark
Regulatory Compliance Statements
Page
European Union
Declaration of Conformity
Page
How This Book Is Organized
Preface
Using UNIX Commands
Shell Prompts
http//docs.sun.com
Sun InfiniBand Switch Nine-Port Release Notes
System Administration Guide Network Services
PCI-X Addendum to the PCI Local Bus Specification, Revision
Typographic Conventions
Third-Party Web Sites
Documentation, Support, and Training
Contacting Sun Technical Support
Documentation
Sun Welcomes Your Comments
Page
Product Features
Product Overview
Hardware Description
Standard faceplate
LED Displays
I/O Interfaces
InfiniBand Interface
PCI-X Interface
Physical link Green LED
Logical link Amber LED
FIGURE 1-2 LED Layout
TABLE 1-2 Hardware, Software, and Cable Requirements
Hardware, Software, and Cable Requirements
Page
Adapter Installation
Installing the Adapter
IB-HCA Bus and Slot Selection
7. Replace the cover on the unit
9. Turn power back on to the system and allow the server to reboot
FIGURE 2-1 Typical Adapter-to-Switch Configuration
Verifying the Installation
Page
IPoIB Configuration
Configuring IP Over InfiniBand
Configuring IPoIB
1. Confirm that the IB-HCA ports are up. To do this, type the command
2. Create the InfiniBand devices using the following command
3. Verify InfiniBand devices
4. Plumb each of the IB devices
5. Verify that the devices are plumbed. To do this, type the command
Managing IB Devices for IPoIB
6. Check that data can be send over the InfiniBand link
Page
InfiniBand Software
InfiniBand Software Overview
IP over InfiniBand Driver
User Direct Access Programming Library
Solaris 10 OS
uDAPL IPoIB
InfiniBand Transport Framework
InfiniBand Management Framework
Tavor HCA Driver
Sun Cluster 3.x Hardware Administration Manual for Solaris OS
System Administration Guide Devices and Files System
Related Software Documentation
Manuals
InfiniBand Cable Pin Assignments
FIGURE A-1 shows the InfiniBand cable connectors and pin assignments
A P P E N D I X A
FIGURE A-1 Sun 4x-to-12x InfiniBand Cable Pin Assignments
SunVTS Diagnostic Testing
Diagnostic Software and Troubleshooting
Using the SunVTS ibhcatest
Troubleshooting Tasks
Using the ibhcatest
2. Unplumb the interface from the system, using the ifconfig command
Check the system log or console for Tavor driver error messages
Other Useful Utilities
cfgadm
netstat
snoop
kstat
# snoop -d ibd1
Page
Index
Tavor driver, 17 troubleshooting IB-HCA, 25 tasks, 25 utilities
versions
uDAPL, 15, 16 utilities cfgadm, 26 kstat, 27 netstat, 27 snoop