Q-Logic
IB0056101-00 G
manual
Troubleshooting
Install
Missing Kernel RPM Errors
LED Link and Data Indicators
Configuring the Bios
Hardware Issues
Cluster Setup
Command Meaning
Adapter Settings
New Features
Page 24
3
–
Step-by-Step
Installation Checklist Software Installation
Notes
S
3-4
IB0056101-00
G
Page 23
Page 25
Image 24
Page 23
Page 25
Contents
QLogic HCA and InfiniPath→ Software Install Guide
QLogic HCA and InfiniPath→ Software Install Guide Version
Document Revision History
Table of Contents
Software Installation
Installation Troubleshooting
Configuration Files RPM Descriptions
List of Figures
Page
Who Should Read this Guide
How this Guide is Organized
Overview
Interoperability
Conventions Used in this Guide
Typographical Conventions
Convention Meaning
Documentation
Contact Information
Support Headquarters
Introduction Contact Information IB0056101-00 G
What’s New in this Release
QLogic Adapter Model Numbers
Description
New Features
QLogic Model Description
Supported Distributions and Kernels
InfiniPath/OpenFabrics Supported Distributions Kernels
Distribution InfiniPath/OpenFabrics Supported
Compiler Support
Software Components
Distribution InfiniPath/OpenFabrics Supported Kernels
Ofed SRP
Feature Overview Software Components
Step-by-Step Installation Checklist
Hardware Installation
Software Installation
Installing Software Using Rocks on
Step-by-Step Installation Checklist Software Installation
Page
Hardware Installation Requirements
Hardware
Adapter Models and Related Platforms
QLogic Platform Plugs Into
Form Factors
Cabling and Switches
QLogic InfiniBand Cables
Product Number Description
Configuring the Bios
Optical Fibre Option
Safety with Electricity
Verify the Package Contents
List of the Package Contents
Unpacking Information
Hardware Installation Unpacking Information
QLogic QLE7280 with IBA7220 Asic
Unpacking the QLogic Adapter
Asic
Dual Adapter Installation
Installation Steps
PCIe Slot in a Typical Motherboard
QLogic PCIe HCA Assembly with Riser Card
Hardware Installation for QHT7140 with HTX Riser
Assembled PCIe HCA with Riser
HTX Slot
QLogic QHT7140 Adapter with Riser Card
Assembled QHT7140 with Riser
Hardware Installation for the QHT7140 Without an HTX Riser
Switch Configuration and Monitoring
Cabling the Adapter to the InfiniBand Switch
Completing the Installation
Cluster Setup
Types of Nodes in a Cluster Environment
Setting Up Your Environment
Supported Linux Distributions
InfiniPath/OpenFabrics Supported Distributions and Kernels
Choosing the Appropriate Download Files
Available Packages
Package Description Comments
Unpacking the InfiniPath tar File
Check for Missing Files or RPMs
Libibverbs-2.2-xxx.11.yyy.x8664.rpm
Installing the InfiniPath and OpenFabrics RPMs
Distribution Used On
Rhel4
Sles10
Choosing the RPMs to Install
Rpms to Install
If you want to Then install
Using rpm to Install InfiniPath and OpenFabrics
Preparing
Installed Layout
Starting the InfiniPath Service
Configuring the InfiniPath Drivers
InfiniPath and OpenFabrics Driver Overview
Configuring the ibipath Driver
Configuring the ipathether Network Interface
Ipathether Configuration on Red Hat
Etc/sysconfig/network-scripts/ifcfg-eth2
# QLogic Interconnect Ethernet DEVICE=eth2 BOOTPROTO=static
Ipathether Configuration on Sles
00117504e011
Etc/sysconfig/hardware/hwcfg-eth-id-$MAC
Etc/sysconfig/network/ifcfg-eth2
Etc/udev/rules.d/30-netpersistentnames.rules
MODULE=ipathether STARTMODE=auto
OpenFabrics Drivers and Services Configuration and Startup
Configuring the IPoIB Network Interface
Output from this command will be similar to this
Configuring and Administering the Vnic Interface
Etc/sysconfig/infinipath. Change this line to
00066a0130000001
Service 1 1000066a00000101 InfiniNIC.InfiniConSys.Data01
Etc/infiniband/qlgcvnic.cfg
NAME=eioc1 IOCGUID=0x66A0137FFFFE7
# HEARTBEAT=100
This example uses DGID, Iocguid and Iocstring
# /etc/init.d/infinipath start # /etc/init.d/qlgcvnic start
# /etc/init.d/qlgcvnic stop
OpenSM
# ibqlgcvnicinfo
Etc/init.d/opensmd
Using Ofed SRP
21000001ff040bf6
# ibsrpdm -c
# mkdir /mnt/targetname # mount /dev/sde1 /mnt/targetname
Other Configuration Changing the MTU Size
Starting and Stopping the InfiniPath Software
MPI over uDAPL
To check the configuration state, use the command
Rebuilding or Reinstalling Drivers After a Kernel Upgrade
Further Information on Configuring and Loading Drivers
LED Link and Data Indicators
LED Link and Data Indicators
LED States Indication
Adapter Settings
Off
Customer Acceptance Utility
Hostname1 Hostname2
Command Meaning
Ipathcheckout Options
Additional Installation Instructions
Uninstalling InfiniPath and OpenFabrics RPMs
Uninstalling Ofed 1.3 Software
Removing Software Packages
Installing Lustre
Installing QLogic MPI in an Alternate Location
Installing on an Unsupported Distribution
/etc/redhat-release file or the /etc/SuSE-release file
Managing and Installing Software Using Rocks
Usr/src/infinipath/drivers/build-guards.sh
Installing Rocks and InfiniPath RPMs
Use the following contents
Software Installation Additional Installation Instructions
Home/install/contrib/4.2.1/x8664/RPMS
Further Information on Rocks and kickstart
Page
Hardware Issues
Bios Settings
Node Spontaneously Reboots
Some HTX Motherboards May Need Two or More CPUs in Use
Edit Bios Settings to Fix Mtrr Issues
Mtrr Mapping and Write Combining
Mtrr Mapping Discrete
Software Installation Issues
Issue with Supermicro H8DCE-HTe and QHT7040
Use the ipathmtrr Script to Fix Mtrr Issues
Version Number Conflict with opensm-*on RHEL5 Systems
OpenFabrics Dependencies
OpenFabrics Library Dependencies
Rpm no packages given for erase
Missing Kernel RPM Errors
Mpirun Installation Requires 32-bit Support
Resolving Conflicts
Libgcc-3.4.3-9.EL4.i386.rpm
Lockable Memory Error on Initial Installation of InfiniPath
Ifup on ipathether on Sles 10 Reports unknown device
Glibc-2.3.4-2.i686.rpm or glibc-2.3.4-2.i386.rpm
Eth3 device QLogic Corp Unknown device 0010 rev
Page
Table B-1. Configuration Files
Configuration File Name Description
Sample and Template Files Description
InfiniPath and OpenFabrics RPMs
Different Nodes May Use Different RPMs
RPM Version Numbers and Identifiers
Infinipath-2.2-33597.832rhel4qlc.x8664.rpm
RPM Organization
Documentation and InfiniPath RPMs
Table C-1. InfiniPath Documentation/RPMs
RPM Name Front End Compute Development
Table C-2. InfiniPath/RPMs
Table C-3. InfiniPath-Devel/RPMs
Contains ipathcheckout Ipathbug-helpera
OpenFabrics RPMs
Table C-4. InfiniPath-MPI/RPMs
Table C-5. OpenFabrics Documentation/RPMs
RPM Name Comments
Dapl-utils-2.2-xxx.207.yyy.x8664.rpm
Ib-bonding-2.2-xxx.090.yyy.x8664.rpm
Ibsim-2.2-xxx.04.yyy.x8664.rpm
Ibutils-2.2-xxx.12.yyy.x8664.rpm
Libibverbs-2.2-xxx.111.yyy.x8664.rpm
Libibverbs-utils-2.2-xxx.111.yyy.x8664.rpm
Libipathverbs-2.2-xxx.11.yyy.x8664.rpm
Librdmacm-2.2-xxx.106.yyy.x8664.rpm
Table C-7. OpenFabrics-Devel/RPMs
Table C-8. OpenSM/RPMs
Table C-9. Other HCAs/RPMs
Table C-10. Other HCAs-Devel/RPMs
Table C-11. OtherMPIs/RPMs
RPM Name Front Comput
End
RPM Name Front Comput Developme End
Openmpiintel-2.2-xxx.125.yyy.x8
Openmpipathscale-2.2-xxx.125.yy
Openmpipgi-2.2-xxx.125.yyy.x86
Qlogic-mpi-regis
RPM Descriptions OpenFabrics RPMs IB0056101-00 G
Index
Help
Openssh Openssh-server 5-3 Optical media converters
No packages given for erase warning message A-4
Verbose
Page
Page
Camberley Surrey, GU16 7ER UK +44 0 1276 804
Related pages
Troubleshooting for Tekkeon MP1280
Technical specifications for Dakota Digital ION-16
Error Messages for Dell PD055
ELECTriCaL DiaGramS for Lincoln Electric SVM161-A
Select how to answer incoming calls on your phone for Nextel comm I465
Installation for McIntosh XRT28
G9953 Cutterhead Parts List for Grizzly G9860
Country/Area codes list for Parental Lock for JVC TH-M42
How do I adjust the brakes on my Cub Cadet 7264?
Adjusting Brakes
Top
Page
Image
Contents