Manuals
/
Q-Logic
/
Computer Equipment
/
Computer Drive
Q-Logic
IB0056101-00 G manual QLogic HCA and InfiniPath→ Software Install Guide Version, Page
Models:
IB0056101-00 G
1
8
114
114
Download
114 pages
8.55 Kb
5
6
7
8
9
10
11
12
<
>
Troubleshooting
Specifications
Install
Configuration Files
Hardware Issues
Cluster Setup
To restart the QLogic VNIC driver, run the following command
5. QLogic PCIe HCA Assembly with Riser Card
Missing Kernel RPM Errors
Optimize your adapter for the best performance. See “Adapter Settings” on page 5-30. Also see the Performance and Management Tips section in the QLogic HCA and InfiniPath Software User Guide
Page 8
Image 8
QLogic HCA and InfiniPath
→
Software Install Guide Version 2.2
Notes
S
Page viii
IB0056101-00
G
Page 7
Page 9
Page 8
Image 8
Page 7
Page 9
Contents
QLogic HCA and InfiniPath→ Software Install Guide
Version
Sections Affected
Document Revision History
Changes
Feature Overview
Step-by-Step Installation Checklist
Hardware Installation
Introduction
Software Installation
Installation Troubleshooting
Configuration Files
RPM Descriptions
InfiniPath and OpenFabrics RPMs
Different Nodes May Use Different RPMs
List of Figures
List of Tables
Page
Page
IB0056101-00 G
QLogic HCA and InfiniPath→ Software Install Guide Version
Page
How this Guide is Organized
1 Introduction
Who Should Read this Guide
Overview
Interoperability
Conventions Used in this Guide
Table 1-1. Typographical Conventions
Convention
„ The QLogic HCA and InfiniPath Software Install Guide
Documentation
Table 1-1. Typographical Conventions Continued
„ The QLogic HCA and InfiniPath Software User Guide
Contact Information
Support Headquarters
support.qlogic.com
North American Region
1 - Introduction Contact Information
IB0056101-00 G
2 Feature Overview
What’s New in this Release
Table 2-1. QLogic Adapter Model Numbers
Description
New Features
Table 2-1. QLogic Adapter Model Numbers Continued
QLogic Model
Description
Supported Distributions and Kernels
Table 2-2. InfiniPath/OpenFabrics Supported Distributions and Kernels
Distribution
InfiniPath/OpenFabrics Supported
Compiler Support
Software Components
Table 2-2. InfiniPath/OpenFabrics Supported Distributions
and Kernels Continued
Included components are „ InfiniPath driver
Page
3 Step-by-Step Installation Checklist
Hardware Installation
Software Installation
Installing Software Using Rocks” on page
10. Optimize your adapter for the best performance. See “Adapter Settings” on page 5-30. Also see the Performance and Management Tips section in the QLogic HCA and InfiniPath Software User Guide
3 - Step-by-Step Installation Checklist Software Installation
IB0056101-00 G
4 Hardware Installation
Hardware Installation Requirements
Hardware
Table 4-1. Adapter Models and Related Platforms
Form Factors
Table 4-1. Adapter Models and Related Platforms Continued
QLogic
Platform
Cabling and Switches
Table 4-2. QLogic InfiniBand Cables
Product Number
Description
Optical Fibre Option
Configuring the BIOS
For more details, see “BIOS Settings” on page A-1
Safety with Electricity
Verify the Package Contents
List of the Package Contents
Unpacking Information
Page
Figure 4-1. QLogic QLE7280 with IBA7220 ASIC
Figure 4-2. QLogic QLE7140 Card with Riser, Top View
Unpacking the QLogic Adapter
View
Dual Adapter Installation
Installation Steps
Follow the instructions in “Installation Steps” on page
Hardware Installation
Figure 4-4. PCIe Slot in a Typical Motherboard
Figure 4-5. QLogic PCIe HCA Assembly with Riser Card
Hardware Installation for QHT7140 with HTX Riser
Figure 4-6. Assembled PCIe HCA with Riser
Figure 4-7. HTX Slot
Figure 4-8. QLogic QHT7140 Adapter with Riser Card
Figure 4-9. Assembled QHT7140 with Riser
Hardware Installation for the QHT7140 Without an HTX Riser
Figure 4-10. QHT7140 Without Riser Installed in a 3U Chassis
Switch Configuration and Monitoring
Cabling the Adapter to the InfiniBand Switch
Completing the Installation
Types of Nodes in a Cluster Environment
5 Software Installation
Cluster Setup
Setting Up Your Environment
Supported Linux Distributions
Table 5-1. InfiniPath/OpenFabrics Supported Distributions and Kernels
Distribution
Downloading and Unpacking the InfiniPath and OpenFabrics Software
Choosing the Appropriate Download Files
Table 5-2. Available Packages
Package
Unpacking the InfiniPath tar File
Table 5-2. Available Packages Continued
Package
Description
Check for Missing Files or RPMs
Installing the InfiniPath and OpenFabrics RPMs
Table 5-3. InfiniPath and OpenFabrics RPMs to Use for Each Node in a
Cluster
Used On
Choosing the RPMs to Install
Table 5-4. RPMS to Install
Then install
If you want to
Using rpm to Install InfiniPath and OpenFabrics
Installed Layout
Starting the InfiniPath Service
Figure 5-1. Relationship Between InfiniPath and OpenFabrics Software
Configuring the InfiniPath Drivers
InfiniPath and OpenFabrics Driver Overview
ipathether Configuration on Red Hat
Configuring the ibipath Driver
Configuring the ipathether Network Interface
3. Create or edit the following file as root
# sed ’s/\......\..../\1/’ \ sys/bus/pci/drivers/ibipath/00/guid
ipathether Configuration on SLES
# lsmod grep -q ipathether modprobe ipathether
The Globally Unique IDentifer GUID can also be returned by running
OpenFabrics Drivers and Services Configuration and Startup
Configuring the IPoIB Network Interface
Configuring and Administering the VNIC Interface
# /etc/init.d/infinipath restart
2. Create the VNIC interfaces using the configuration file
The following is an example of VIO hardware failover
This example uses DGID, IOCGUID and IOCSTRING
To restart the QLogic VNIC driver, run the following command
OpenSM
Using OFED SRP
# ibsrpdm -c
# echo
MPI over uDAPL
Other Configuration Changing the MTU Size
Starting and Stopping the InfiniPath Software
To check the configuration state, use the command
Rebuilding or Reinstalling Drivers After a Kernel Upgrade
Rebuilding or Reinstalling Drivers if a Different Kernel is Installed
Further Information on Configuring and Loading Drivers
LED Link and Data Indicators
Table 5-5. LED Link and Data Indicators
Adapter Settings
Table 5-5. LED Link and Data Indicators Continued
LED States
Indication
Customer Acceptance Utility
Meaning
Command
Table 5-6. ipathcheckout Options
Additional Installation Instructions
Uninstalling InfiniPath and OpenFabrics RPMs
Uninstalling OFED 1.3 Software
Removing Software Packages
Installing Lustre
Installing QLogic MPI in an Alternate Location
Installing on an Unsupported Distribution
Managing and Installing Software Using Rocks
Installing Rocks and InfiniPath RPMs
Use the following contents
skip lam -- package-lam-gnu/package post set
home/install/contrib/4.2.1/x8664/RPMS
Further Information on Rocks and kickstart
IB0056101-00 G
5 - Software Installation Additional Installation Instructions
5-42
A Installation Troubleshooting
Hardware Issues
BIOS Settings
Node Spontaneously Reboots
Edit BIOS Settings to Fix MTRR Issues
MTRR Mapping and Write Combining
Use the ipathmtrr Script to Fix MTRR Issues
Software Installation Issues
Issue with Supermicro H8DCE-HTe and QHT7040
OpenFabrics Library Dependencies
Version Number Conflict with opensm-* on RHEL5 Systems
OpenFabrics Dependencies
Missing Kernel RPM Errors
mpirun Installation Requires 32-bit Support
Resolving Conflicts
# rpm -Uvh Documentation/*rpm InfiniPath/*rpm
InfiniPath-Devel/*rpm InfiniPath-MPI/*rpm OpenFabrics/*rpm
Software User Guide
Lockable Memory Error on Initial Installation of InfiniPath
ifup on ipathether on SLES 10 Reports unknown device
IB0056101-00 G
A - Installation Troubleshooting
Version Number Conflict with opensm-* on RHEL5 Systems
B Configuration Files
Table B-1. Configuration Files
Configuration File Name
Description
Table B-1. Configuration Files Continued
Sample and Template Files
Configuration File Name
Description
C RPM Descriptions
InfiniPath and OpenFabrics RPMs
Different Nodes May Use Different RPMs
RPM Version Numbers and Identifiers
RPM Organization
Documentation and InfiniPath RPMs
Table C-1. InfiniPath Documentation/RPMs
RPM Name
Table C-2. InfiniPath/RPMs
Table C-3. InfiniPath-Devel/RPMs
RPM Name
Front End
OpenFabrics RPMs
Table C-4. InfiniPath-MPI/RPMs
Table C-5. OpenFabrics Documentation/RPMs
Table C-6. OpenFabrics/RPMs
Comments
Table C-6. OpenFabrics/RPMs Continued
RPM Name
described in the InfiniBand Architecture Specification. This library
Table C-6. OpenFabrics/RPMs Continued
RPM Name
Comments
Table C-7. OpenFabrics-Devel/RPMs
Table C-6. OpenFabrics/RPMs Continued
RPM Name
Comments
Table C-7. OpenFabrics-Devel/RPMs Continued
Table C-8. OpenSM/RPMs
Table C-9. Other HCAs/RPMs
RPM Name
Table C-9. Other HCAs/RPMs Continued
Table C-10. Other HCAs-Devel/RPMs
Table C-11. OtherMPIs/RPMs
Front
Table C-11. OtherMPIs/RPMs Continued
Developme
RPM Name
Front
Table C-11. OtherMPIs/RPMs Continued
RPM Name
Front
Comput
IB0056101-00 G
C - RPM Descriptions OpenFabrics RPMs
C-12
Index
Page
Page
Page
verbose
vverbose 5-32 -vvv vvverbose
workdir=DIR
VNIC, configuration 5-18 -vv
IB0056101-00 G
QLogic HCA and InfiniPath→ Software Install Guide Version
Index-6
Page
Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway
