Q-Logic
IB0056101-00 G
manual
Troubleshooting
Install
Missing Kernel RPM Errors
LED Link and Data Indicators
Configuring the Bios
Hardware Issues
Cluster Setup
Command Meaning
Adapter Settings
New Features
Page 8
QLogic HCA and InfiniPath
→
Software Install Guide Version 2.2
Notes
S
Page viii
IB0056101-00
G
Page 7
Page 9
Image 8
Page 7
Page 9
Contents
QLogic HCA and InfiniPath→ Software Install Guide
QLogic HCA and InfiniPath→ Software Install Guide Version
Document Revision History
Table of Contents
Software Installation
Installation Troubleshooting
Configuration Files RPM Descriptions
List of Figures
Page
Who Should Read this Guide
How this Guide is Organized
Overview
Interoperability
Conventions Used in this Guide
Typographical Conventions
Convention Meaning
Documentation
Contact Information
Support Headquarters
Introduction Contact Information IB0056101-00 G
Description
What’s New in this Release
QLogic Adapter Model Numbers
New Features
QLogic Model Description
Distribution InfiniPath/OpenFabrics Supported
Supported Distributions and Kernels
InfiniPath/OpenFabrics Supported Distributions Kernels
Distribution InfiniPath/OpenFabrics Supported Kernels
Compiler Support
Software Components
Ofed SRP
Feature Overview Software Components
Step-by-Step Installation Checklist
Hardware Installation
Software Installation
Installing Software Using Rocks on
Step-by-Step Installation Checklist Software Installation
Page
Hardware Installation Requirements
Hardware
Adapter Models and Related Platforms
QLogic Platform Plugs Into
Form Factors
Product Number Description
Cabling and Switches
QLogic InfiniBand Cables
Configuring the Bios
Optical Fibre Option
Safety with Electricity
Verify the Package Contents
List of the Package Contents
Unpacking Information
Hardware Installation Unpacking Information
QLogic QLE7280 with IBA7220 Asic
Unpacking the QLogic Adapter
Asic
Dual Adapter Installation
Installation Steps
PCIe Slot in a Typical Motherboard
QLogic PCIe HCA Assembly with Riser Card
Hardware Installation for QHT7140 with HTX Riser
Assembled PCIe HCA with Riser
HTX Slot
QLogic QHT7140 Adapter with Riser Card
Assembled QHT7140 with Riser
Hardware Installation for the QHT7140 Without an HTX Riser
Switch Configuration and Monitoring
Cabling the Adapter to the InfiniBand Switch
Completing the Installation
Cluster Setup
Types of Nodes in a Cluster Environment
InfiniPath/OpenFabrics Supported Distributions and Kernels
Setting Up Your Environment
Supported Linux Distributions
Package Description Comments
Choosing the Appropriate Download Files
Available Packages
Unpacking the InfiniPath tar File
Check for Missing Files or RPMs
Libibverbs-2.2-xxx.11.yyy.x8664.rpm
Installing the InfiniPath and OpenFabrics RPMs
Distribution Used On
Rhel4
Sles10
If you want to Then install
Choosing the RPMs to Install
Rpms to Install
Using rpm to Install InfiniPath and OpenFabrics
Preparing
Installed Layout
Starting the InfiniPath Service
Configuring the InfiniPath Drivers
InfiniPath and OpenFabrics Driver Overview
Ipathether Configuration on Red Hat
Configuring the ibipath Driver
Configuring the ipathether Network Interface
Etc/sysconfig/network-scripts/ifcfg-eth2
# QLogic Interconnect Ethernet DEVICE=eth2 BOOTPROTO=static
Ipathether Configuration on Sles
00117504e011
Etc/sysconfig/hardware/hwcfg-eth-id-$MAC
Etc/sysconfig/network/ifcfg-eth2
Etc/udev/rules.d/30-netpersistentnames.rules
MODULE=ipathether STARTMODE=auto
OpenFabrics Drivers and Services Configuration and Startup
Configuring the IPoIB Network Interface
Output from this command will be similar to this
00066a0130000001
Configuring and Administering the Vnic Interface
Etc/sysconfig/infinipath. Change this line to
Service 1 1000066a00000101 InfiniNIC.InfiniConSys.Data01
Etc/infiniband/qlgcvnic.cfg
NAME=eioc1 IOCGUID=0x66A0137FFFFE7
# HEARTBEAT=100
This example uses DGID, Iocguid and Iocstring
# /etc/init.d/infinipath start # /etc/init.d/qlgcvnic start
# /etc/init.d/qlgcvnic stop
Etc/init.d/opensmd
OpenSM
# ibqlgcvnicinfo
Using Ofed SRP
21000001ff040bf6
# ibsrpdm -c
# mkdir /mnt/targetname # mount /dev/sde1 /mnt/targetname
MPI over uDAPL
Other Configuration Changing the MTU Size
Starting and Stopping the InfiniPath Software
To check the configuration state, use the command
Rebuilding or Reinstalling Drivers After a Kernel Upgrade
Further Information on Configuring and Loading Drivers
LED Link and Data Indicators
LED Link and Data Indicators
LED States Indication
Adapter Settings
Off
Customer Acceptance Utility
Hostname1 Hostname2
Command Meaning
Ipathcheckout Options
Additional Installation Instructions
Uninstalling InfiniPath and OpenFabrics RPMs
Uninstalling Ofed 1.3 Software
Removing Software Packages
Installing Lustre
Installing QLogic MPI in an Alternate Location
Installing on an Unsupported Distribution
/etc/redhat-release file or the /etc/SuSE-release file
Managing and Installing Software Using Rocks
Usr/src/infinipath/drivers/build-guards.sh
Installing Rocks and InfiniPath RPMs
Use the following contents
Software Installation Additional Installation Instructions
Home/install/contrib/4.2.1/x8664/RPMS
Further Information on Rocks and kickstart
Page
Hardware Issues
Bios Settings
Node Spontaneously Reboots
Some HTX Motherboards May Need Two or More CPUs in Use
Mtrr Mapping Discrete
Edit Bios Settings to Fix Mtrr Issues
Mtrr Mapping and Write Combining
Use the ipathmtrr Script to Fix Mtrr Issues
Software Installation Issues
Issue with Supermicro H8DCE-HTe and QHT7040
Version Number Conflict with opensm-*on RHEL5 Systems
OpenFabrics Dependencies
OpenFabrics Library Dependencies
Rpm no packages given for erase
Missing Kernel RPM Errors
Libgcc-3.4.3-9.EL4.i386.rpm
Mpirun Installation Requires 32-bit Support
Resolving Conflicts
Lockable Memory Error on Initial Installation of InfiniPath
Ifup on ipathether on Sles 10 Reports unknown device
Glibc-2.3.4-2.i686.rpm or glibc-2.3.4-2.i386.rpm
Eth3 device QLogic Corp Unknown device 0010 rev
Page
Table B-1. Configuration Files
Configuration File Name Description
Sample and Template Files Description
InfiniPath and OpenFabrics RPMs
Different Nodes May Use Different RPMs
RPM Version Numbers and Identifiers
Infinipath-2.2-33597.832rhel4qlc.x8664.rpm
RPM Organization
Documentation and InfiniPath RPMs
Table C-1. InfiniPath Documentation/RPMs
RPM Name Front End Compute Development
Contains ipathcheckout Ipathbug-helpera
Table C-2. InfiniPath/RPMs
Table C-3. InfiniPath-Devel/RPMs
OpenFabrics RPMs
Table C-4. InfiniPath-MPI/RPMs
Table C-5. OpenFabrics Documentation/RPMs
RPM Name Comments
Dapl-utils-2.2-xxx.207.yyy.x8664.rpm
Ib-bonding-2.2-xxx.090.yyy.x8664.rpm
Ibsim-2.2-xxx.04.yyy.x8664.rpm
Ibutils-2.2-xxx.12.yyy.x8664.rpm
Libibverbs-2.2-xxx.111.yyy.x8664.rpm
Libibverbs-utils-2.2-xxx.111.yyy.x8664.rpm
Libipathverbs-2.2-xxx.11.yyy.x8664.rpm
Librdmacm-2.2-xxx.106.yyy.x8664.rpm
Table C-7. OpenFabrics-Devel/RPMs
Table C-8. OpenSM/RPMs
Table C-9. Other HCAs/RPMs
Table C-10. Other HCAs-Devel/RPMs
Table C-11. OtherMPIs/RPMs
RPM Name Front Comput
End
RPM Name Front Comput Developme End
Openmpiintel-2.2-xxx.125.yyy.x8
Openmpipathscale-2.2-xxx.125.yy
Openmpipgi-2.2-xxx.125.yyy.x86
Qlogic-mpi-regis
RPM Descriptions OpenFabrics RPMs IB0056101-00 G
Index
Help
Openssh Openssh-server 5-3 Optical media converters
No packages given for erase warning message A-4
Verbose
Page
Page
Camberley Surrey, GU16 7ER UK +44 0 1276 804
Related pages
Troubleshooting Procedures for Toshiba ProT1!0
Specifications for Haier XPBM15-0501
Error Error Message Possible Cause Possible Solution Code for Kodak 2J0686
Wiring Diagram for Desa VFP30R
How To Enable the Auto Power Off Mode for Ricoh RDC-5000
Installing the Batteries for Symphonic COLOR TV/DVD
Electrical Parts List for Samsung GH17LS
Appendix B Country code list for parental lock for JVC XV-M556TN
What are the steps for adding and replacing parts in Dell T3400?
(#)
Top
Page
Image
Contents