Manuals
/
Q-Logic
/
Computer Equipment
/
Computer Drive
Q-Logic
IB0056101-00 G manual QLogic HCA and InfiniPath→ Software Install Guide Version, Index-6
Models:
IB0056101-00 G
1
112
114
114
Download
114 pages
8.55 Kb
107
108
109
110
111
112
113
114
<
>
Troubleshooting
Specs
Install
Configuration Files
Hardware Issues
Cluster Setup
To restart the QLogic VNIC driver, run the following command
5. QLogic PCIe HCA Assembly with Riser Card
Missing Kernel RPM Errors
Optimize your adapter for the best performance. See “Adapter Settings” on page 5-30. Also see the Performance and Management Tips section in the QLogic HCA and InfiniPath Software User Guide
Page 112
Image 112
QLogic HCA and InfiniPath
→
Software Install Guide Version 2.2
Notes
S
Index-6
IB0056101-00
G
Page 111
Page 113
Page 112
Image 112
Page 111
Page 113
Contents
QLogic HCA and InfiniPath→ Software Install Guide
Version
Changes
Document Revision History
Sections Affected
Feature Overview
Step-by-Step Installation Checklist
Hardware Installation
Introduction
Software Installation
Installation Troubleshooting
Configuration Files
RPM Descriptions
InfiniPath and OpenFabrics RPMs
Different Nodes May Use Different RPMs
List of Figures
List of Tables
Page
Page
Page
QLogic HCA and InfiniPath→ Software Install Guide Version
IB0056101-00 G
Who Should Read this Guide
1 Introduction
How this Guide is Organized
Overview
Interoperability
Conventions Used in this Guide
Table 1-1. Typographical Conventions
Convention
„ The QLogic HCA and InfiniPath Software Install Guide
Documentation
Table 1-1. Typographical Conventions Continued
„ The QLogic HCA and InfiniPath Software User Guide
Contact Information
Support Headquarters
support.qlogic.com
North American Region
1 - Introduction Contact Information
IB0056101-00 G
2 Feature Overview
What’s New in this Release
Table 2-1. QLogic Adapter Model Numbers
Description
New Features
Table 2-1. QLogic Adapter Model Numbers Continued
QLogic Model
Description
Supported Distributions and Kernels
Table 2-2. InfiniPath/OpenFabrics Supported Distributions and Kernels
Distribution
InfiniPath/OpenFabrics Supported
Compiler Support
Software Components
Table 2-2. InfiniPath/OpenFabrics Supported Distributions
and Kernels Continued
Included components are „ InfiniPath driver
Page
3 Step-by-Step Installation Checklist
Hardware Installation
Software Installation
Installing Software Using Rocks” on page
10. Optimize your adapter for the best performance. See “Adapter Settings” on page 5-30. Also see the Performance and Management Tips section in the QLogic HCA and InfiniPath Software User Guide
3 - Step-by-Step Installation Checklist Software Installation
IB0056101-00 G
4 Hardware Installation
Hardware Installation Requirements
Hardware
Table 4-1. Adapter Models and Related Platforms
Form Factors
Table 4-1. Adapter Models and Related Platforms Continued
QLogic
Platform
Cabling and Switches
Table 4-2. QLogic InfiniBand Cables
Product Number
Description
For more details, see “BIOS Settings” on page A-1
Configuring the BIOS
Optical Fibre Option
Safety with Electricity
Verify the Package Contents
List of the Package Contents
Unpacking Information
Page
Figure 4-1. QLogic QLE7280 with IBA7220 ASIC
Figure 4-2. QLogic QLE7140 Card with Riser, Top View
Unpacking the QLogic Adapter
View
Dual Adapter Installation
Installation Steps
Follow the instructions in “Installation Steps” on page
Hardware Installation
Figure 4-4. PCIe Slot in a Typical Motherboard
Figure 4-5. QLogic PCIe HCA Assembly with Riser Card
Hardware Installation for QHT7140 with HTX Riser
Figure 4-6. Assembled PCIe HCA with Riser
Figure 4-7. HTX Slot
Figure 4-8. QLogic QHT7140 Adapter with Riser Card
Figure 4-9. Assembled QHT7140 with Riser
Hardware Installation for the QHT7140 Without an HTX Riser
Cabling the Adapter to the InfiniBand Switch
Switch Configuration and Monitoring
Figure 4-10. QHT7140 Without Riser Installed in a 3U Chassis
Completing the Installation
Cluster Setup
5 Software Installation
Types of Nodes in a Cluster Environment
Setting Up Your Environment
Supported Linux Distributions
Table 5-1. InfiniPath/OpenFabrics Supported Distributions and Kernels
Distribution
Downloading and Unpacking the InfiniPath and OpenFabrics Software
Choosing the Appropriate Download Files
Table 5-2. Available Packages
Package
Unpacking the InfiniPath tar File
Table 5-2. Available Packages Continued
Package
Description
Check for Missing Files or RPMs
Installing the InfiniPath and OpenFabrics RPMs
Table 5-3. InfiniPath and OpenFabrics RPMs to Use for Each Node in a
Cluster
Used On
Choosing the RPMs to Install
Table 5-4. RPMS to Install
Then install
If you want to
Using rpm to Install InfiniPath and OpenFabrics
Installed Layout
Starting the InfiniPath Service
InfiniPath and OpenFabrics Driver Overview
Configuring the InfiniPath Drivers
Figure 5-1. Relationship Between InfiniPath and OpenFabrics Software
Configuring the ipathether Network Interface
Configuring the ibipath Driver
ipathether Configuration on Red Hat
3. Create or edit the following file as root
# lsmod grep -q ipathether modprobe ipathether
ipathether Configuration on SLES
# sed ’s/\......\..../\1/’ \ sys/bus/pci/drivers/ibipath/00/guid
The Globally Unique IDentifer GUID can also be returned by running
OpenFabrics Drivers and Services Configuration and Startup
Configuring the IPoIB Network Interface
Configuring and Administering the VNIC Interface
# /etc/init.d/infinipath restart
2. Create the VNIC interfaces using the configuration file
The following is an example of VIO hardware failover
This example uses DGID, IOCGUID and IOCSTRING
To restart the QLogic VNIC driver, run the following command
OpenSM
Using OFED SRP
# ibsrpdm -c
# echo
Starting and Stopping the InfiniPath Software
Other Configuration Changing the MTU Size
MPI over uDAPL
To check the configuration state, use the command
Rebuilding or Reinstalling Drivers After a Kernel Upgrade
Rebuilding or Reinstalling Drivers if a Different Kernel is Installed
Further Information on Configuring and Loading Drivers
LED Link and Data Indicators
Table 5-5. LED Link and Data Indicators
Adapter Settings
Table 5-5. LED Link and Data Indicators Continued
LED States
Indication
Customer Acceptance Utility
Table 5-6. ipathcheckout Options
Command
Meaning
Additional Installation Instructions
Uninstalling InfiniPath and OpenFabrics RPMs
Uninstalling OFED 1.3 Software
Removing Software Packages
Installing Lustre
Installing QLogic MPI in an Alternate Location
Installing on an Unsupported Distribution
Managing and Installing Software Using Rocks
Installing Rocks and InfiniPath RPMs
Use the following contents
skip lam -- package-lam-gnu/package post set
home/install/contrib/4.2.1/x8664/RPMS
Further Information on Rocks and kickstart
5-42
5 - Software Installation Additional Installation Instructions
IB0056101-00 G
A Installation Troubleshooting
Hardware Issues
BIOS Settings
Node Spontaneously Reboots
Edit BIOS Settings to Fix MTRR Issues
MTRR Mapping and Write Combining
Issue with Supermicro H8DCE-HTe and QHT7040
Software Installation Issues
Use the ipathmtrr Script to Fix MTRR Issues
OpenFabrics Dependencies
Version Number Conflict with opensm-* on RHEL5 Systems
OpenFabrics Library Dependencies
Missing Kernel RPM Errors
mpirun Installation Requires 32-bit Support
Resolving Conflicts
# rpm -Uvh Documentation/*rpm InfiniPath/*rpm
InfiniPath-Devel/*rpm InfiniPath-MPI/*rpm OpenFabrics/*rpm
ifup on ipathether on SLES 10 Reports unknown device
Lockable Memory Error on Initial Installation of InfiniPath
Software User Guide
Version Number Conflict with opensm-* on RHEL5 Systems
A - Installation Troubleshooting
IB0056101-00 G
B Configuration Files
Table B-1. Configuration Files
Configuration File Name
Description
Table B-1. Configuration Files Continued
Sample and Template Files
Configuration File Name
Description
C RPM Descriptions
InfiniPath and OpenFabrics RPMs
Different Nodes May Use Different RPMs
RPM Version Numbers and Identifiers
RPM Organization
Documentation and InfiniPath RPMs
Table C-1. InfiniPath Documentation/RPMs
RPM Name
Table C-2. InfiniPath/RPMs
Table C-3. InfiniPath-Devel/RPMs
RPM Name
Front End
OpenFabrics RPMs
Table C-4. InfiniPath-MPI/RPMs
Table C-5. OpenFabrics Documentation/RPMs
Table C-6. OpenFabrics/RPMs
RPM Name
Table C-6. OpenFabrics/RPMs Continued
Comments
described in the InfiniBand Architecture Specification. This library
Table C-6. OpenFabrics/RPMs Continued
RPM Name
Comments
Table C-7. OpenFabrics-Devel/RPMs
Table C-6. OpenFabrics/RPMs Continued
RPM Name
Comments
Table C-7. OpenFabrics-Devel/RPMs Continued
Table C-8. OpenSM/RPMs
Table C-9. Other HCAs/RPMs
RPM Name
Table C-9. Other HCAs/RPMs Continued
Table C-10. Other HCAs-Devel/RPMs
Table C-11. OtherMPIs/RPMs
Front
Table C-11. OtherMPIs/RPMs Continued
Developme
RPM Name
Front
Table C-11. OtherMPIs/RPMs Continued
RPM Name
Front
Comput
C-12
C - RPM Descriptions OpenFabrics RPMs
IB0056101-00 G
Index
Page
Page
Page
verbose
vverbose 5-32 -vvv vvverbose
workdir=DIR
VNIC, configuration 5-18 -vv
Index-6
QLogic HCA and InfiniPath→ Software Install Guide Version
IB0056101-00 G
Page
Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway
