User’s Guide
Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and
Sun Microsystems, Inc
Page
Contents
1. Product Overview 1 Product Features 1 Hardware Description
Regulatory Compliance Statements
Declaration of Conformity
2. Adapter Installation
3. Configuring IP Over InfiniBand
B. Diagnostic Software and Troubleshooting
4. InfiniBand Software Overview
cfgadm snoop netstat kstat
Index
Contents
Other Useful Utilities
Page
Figures
Typical Adapter-to-Switch Configuration InfiniBand Software Stack
Sun Dual Port 4x IB Host Channel Adapter PCI-X Card 2 LED Layout
Sun 4x-to-12x InfiniBand Cable Pin Assignments
Page
Tables
IB-HCA LEDs Hardware, Software, and Cable Requirements
SunVTS Documentation
TABLE B-1
Page
Regulatory Compliance Statements
FCC Class A Notice
FCC Class B Notice
ICES-003 Class A Notice - Avis NMB-003, Classe A
ICES-003 Class B Notice - Avis NMB-003, Classe B
BSMI Class A Notice
GOST-R Certification Mark
CCC Class A Notice
Regulatory Compliance Statements
Page
Declaration of Conformity
European Union
Page
Preface
How This Book Is Organized
Shell Prompts
Using UNIX Commands
http//docs.sun.com
System Administration Guide Network Services
Sun InfiniBand Switch Nine-Port Release Notes
PCI-X Addendum to the PCI Local Bus Specification, Revision
Typographic Conventions
Documentation, Support, and Training
Third-Party Web Sites
Contacting Sun Technical Support
Documentation
Sun Welcomes Your Comments
Page
Product Overview
Product Features
Hardware Description
Standard faceplate
I/O Interfaces
LED Displays
InfiniBand Interface
PCI-X Interface
Logical link Amber LED
Physical link Green LED
FIGURE 1-2 LED Layout
Hardware, Software, and Cable Requirements
TABLE 1-2 Hardware, Software, and Cable Requirements
Page
Installing the Adapter
Adapter Installation
IB-HCA Bus and Slot Selection
9. Turn power back on to the system and allow the server to reboot
7. Replace the cover on the unit
Verifying the Installation
FIGURE 2-1 Typical Adapter-to-Switch Configuration
Page
Configuring IP Over InfiniBand
IPoIB Configuration
Configuring IPoIB
1. Confirm that the IB-HCA ports are up. To do this, type the command
3. Verify InfiniBand devices
2. Create the InfiniBand devices using the following command
4. Plumb each of the IB devices
Managing IB Devices for IPoIB
5. Verify that the devices are plumbed. To do this, type the command
6. Check that data can be send over the InfiniBand link
Page
InfiniBand Software Overview
InfiniBand Software
User Direct Access Programming Library
IP over InfiniBand Driver
Solaris 10 OS
uDAPL IPoIB
InfiniBand Management Framework
InfiniBand Transport Framework
Tavor HCA Driver
System Administration Guide Devices and Files System
Sun Cluster 3.x Hardware Administration Manual for Solaris OS
Related Software Documentation
Manuals
FIGURE A-1 shows the InfiniBand cable connectors and pin assignments
InfiniBand Cable Pin Assignments
A P P E N D I X A
FIGURE A-1 Sun 4x-to-12x InfiniBand Cable Pin Assignments
Diagnostic Software and Troubleshooting
SunVTS Diagnostic Testing
Using the SunVTS ibhcatest
Using the ibhcatest
Troubleshooting Tasks
2. Unplumb the interface from the system, using the ifconfig command
Other Useful Utilities
Check the system log or console for Tavor driver error messages
cfgadm
snoop
netstat
kstat
# snoop -d ibd1
Page
Index
versions
Tavor driver, 17 troubleshooting IB-HCA, 25 tasks, 25 utilities
uDAPL, 15, 16 utilities cfgadm, 26 kstat, 27 netstat, 27 snoop
