Manuals
/
Q-Logic
/
Computer Equipment
/
Computer Drive
Q-Logic
IB0056101-00 G manual QLogic HCA and InfiniPath→ Software Install Guide, Version
Models:
IB0056101-00 G
1
1
114
114
Download
114 pages
8.55 Kb
1
2
3
4
5
6
7
8
<
>
Troubleshooting
Specs
Install
Configuration Files
Hardware Issues
Cluster Setup
To restart the QLogic VNIC driver, run the following command
5. QLogic PCIe HCA Assembly with Riser Card
Missing Kernel RPM Errors
Optimize your adapter for the best performance. See “Adapter Settings” on page 5-30. Also see the Performance and Management Tips section in the QLogic HCA and InfiniPath Software User Guide
Page 1
Image 1
QLogic HCA and InfiniPath
→
Software
Install Guide
Version 2.2
IB0056101-00
G
Page 2
Page 1
Image 1
Page 2
Contents
Version
QLogic HCA and InfiniPath→ Software Install Guide
Changes
Document Revision History
Sections Affected
Step-by-Step Installation Checklist
Feature Overview
Hardware Installation
Introduction
Software Installation
Installation Troubleshooting
RPM Descriptions
Configuration Files
InfiniPath and OpenFabrics RPMs
Different Nodes May Use Different RPMs
List of Tables
List of Figures
Page
Page
Page
QLogic HCA and InfiniPath→ Software Install Guide Version
IB0056101-00 G
Who Should Read this Guide
1 Introduction
How this Guide is Organized
Overview
Conventions Used in this Guide
Interoperability
Table 1-1. Typographical Conventions
Convention
Documentation
„ The QLogic HCA and InfiniPath Software Install Guide
Table 1-1. Typographical Conventions Continued
„ The QLogic HCA and InfiniPath Software User Guide
Support Headquarters
Contact Information
support.qlogic.com
North American Region
IB0056101-00 G
1 - Introduction Contact Information
What’s New in this Release
2 Feature Overview
Table 2-1. QLogic Adapter Model Numbers
Description
Table 2-1. QLogic Adapter Model Numbers Continued
New Features
QLogic Model
Description
Table 2-2. InfiniPath/OpenFabrics Supported Distributions and Kernels
Supported Distributions and Kernels
Distribution
InfiniPath/OpenFabrics Supported
Software Components
Compiler Support
Table 2-2. InfiniPath/OpenFabrics Supported Distributions
and Kernels Continued
Included components are „ InfiniPath driver
Page
Hardware Installation
3 Step-by-Step Installation Checklist
Installing Software Using Rocks” on page
Software Installation
10. Optimize your adapter for the best performance. See “Adapter Settings” on page 5-30. Also see the Performance and Management Tips section in the QLogic HCA and InfiniPath Software User Guide
IB0056101-00 G
3 - Step-by-Step Installation Checklist Software Installation
Hardware Installation Requirements
4 Hardware Installation
Hardware
Table 4-1. Adapter Models and Related Platforms
Table 4-1. Adapter Models and Related Platforms Continued
Form Factors
QLogic
Platform
Table 4-2. QLogic InfiniBand Cables
Cabling and Switches
Product Number
Description
For more details, see “BIOS Settings” on page A-1
Configuring the BIOS
Optical Fibre Option
Verify the Package Contents
Safety with Electricity
List of the Package Contents
Unpacking Information
Page
Figure 4-2. QLogic QLE7140 Card with Riser, Top View
Figure 4-1. QLogic QLE7280 with IBA7220 ASIC
View
Unpacking the QLogic Adapter
Installation Steps
Dual Adapter Installation
Follow the instructions in “Installation Steps” on page
Hardware Installation
Figure 4-4. PCIe Slot in a Typical Motherboard
Figure 4-5. QLogic PCIe HCA Assembly with Riser Card
Figure 4-6. Assembled PCIe HCA with Riser
Hardware Installation for QHT7140 with HTX Riser
Figure 4-7. HTX Slot
Figure 4-8. QLogic QHT7140 Adapter with Riser Card
Figure 4-9. Assembled QHT7140 with Riser
Hardware Installation for the QHT7140 Without an HTX Riser
Cabling the Adapter to the InfiniBand Switch
Switch Configuration and Monitoring
Figure 4-10. QHT7140 Without Riser Installed in a 3U Chassis
Completing the Installation
Cluster Setup
5 Software Installation
Types of Nodes in a Cluster Environment
Supported Linux Distributions
Setting Up Your Environment
Table 5-1. InfiniPath/OpenFabrics Supported Distributions and Kernels
Distribution
Choosing the Appropriate Download Files
Downloading and Unpacking the InfiniPath and OpenFabrics Software
Table 5-2. Available Packages
Package
Table 5-2. Available Packages Continued
Unpacking the InfiniPath tar File
Package
Description
Check for Missing Files or RPMs
Table 5-3. InfiniPath and OpenFabrics RPMs to Use for Each Node in a
Installing the InfiniPath and OpenFabrics RPMs
Cluster
Used On
Table 5-4. RPMS to Install
Choosing the RPMs to Install
Then install
If you want to
Using rpm to Install InfiniPath and OpenFabrics
Installed Layout
Starting the InfiniPath Service
InfiniPath and OpenFabrics Driver Overview
Configuring the InfiniPath Drivers
Figure 5-1. Relationship Between InfiniPath and OpenFabrics Software
Configuring the ipathether Network Interface
Configuring the ibipath Driver
ipathether Configuration on Red Hat
3. Create or edit the following file as root
# lsmod grep -q ipathether modprobe ipathether
ipathether Configuration on SLES
# sed ’s/\......\..../\1/’ \ sys/bus/pci/drivers/ibipath/00/guid
The Globally Unique IDentifer GUID can also be returned by running
OpenFabrics Drivers and Services Configuration and Startup
Configuring the IPoIB Network Interface
# /etc/init.d/infinipath restart
Configuring and Administering the VNIC Interface
2. Create the VNIC interfaces using the configuration file
The following is an example of VIO hardware failover
This example uses DGID, IOCGUID and IOCSTRING
To restart the QLogic VNIC driver, run the following command
OpenSM
Using OFED SRP
# echo
# ibsrpdm -c
Starting and Stopping the InfiniPath Software
Other Configuration Changing the MTU Size
MPI over uDAPL
To check the configuration state, use the command
Rebuilding or Reinstalling Drivers After a Kernel Upgrade
Further Information on Configuring and Loading Drivers
Rebuilding or Reinstalling Drivers if a Different Kernel is Installed
LED Link and Data Indicators
Table 5-5. LED Link and Data Indicators
Table 5-5. LED Link and Data Indicators Continued
Adapter Settings
LED States
Indication
Customer Acceptance Utility
Table 5-6. ipathcheckout Options
Command
Meaning
Uninstalling InfiniPath and OpenFabrics RPMs
Additional Installation Instructions
Uninstalling OFED 1.3 Software
Removing Software Packages
Installing QLogic MPI in an Alternate Location
Installing Lustre
Installing on an Unsupported Distribution
Managing and Installing Software Using Rocks
Installing Rocks and InfiniPath RPMs
Use the following contents
skip lam -- package-lam-gnu/package post set
home/install/contrib/4.2.1/x8664/RPMS
Further Information on Rocks and kickstart
5-42
5 - Software Installation Additional Installation Instructions
IB0056101-00 G
Hardware Issues
A Installation Troubleshooting
BIOS Settings
Node Spontaneously Reboots
MTRR Mapping and Write Combining
Edit BIOS Settings to Fix MTRR Issues
Issue with Supermicro H8DCE-HTe and QHT7040
Software Installation Issues
Use the ipathmtrr Script to Fix MTRR Issues
OpenFabrics Dependencies
Version Number Conflict with opensm-* on RHEL5 Systems
OpenFabrics Library Dependencies
Missing Kernel RPM Errors
Resolving Conflicts
mpirun Installation Requires 32-bit Support
# rpm -Uvh Documentation/*rpm InfiniPath/*rpm
InfiniPath-Devel/*rpm InfiniPath-MPI/*rpm OpenFabrics/*rpm
ifup on ipathether on SLES 10 Reports unknown device
Lockable Memory Error on Initial Installation of InfiniPath
Software User Guide
Version Number Conflict with opensm-* on RHEL5 Systems
A - Installation Troubleshooting
IB0056101-00 G
Table B-1. Configuration Files
B Configuration Files
Configuration File Name
Description
Sample and Template Files
Table B-1. Configuration Files Continued
Configuration File Name
Description
InfiniPath and OpenFabrics RPMs
C RPM Descriptions
Different Nodes May Use Different RPMs
RPM Version Numbers and Identifiers
Documentation and InfiniPath RPMs
RPM Organization
Table C-1. InfiniPath Documentation/RPMs
RPM Name
Table C-3. InfiniPath-Devel/RPMs
Table C-2. InfiniPath/RPMs
RPM Name
Front End
Table C-4. InfiniPath-MPI/RPMs
OpenFabrics RPMs
Table C-5. OpenFabrics Documentation/RPMs
Table C-6. OpenFabrics/RPMs
RPM Name
Table C-6. OpenFabrics/RPMs Continued
Comments
Table C-6. OpenFabrics/RPMs Continued
described in the InfiniBand Architecture Specification. This library
RPM Name
Comments
Table C-6. OpenFabrics/RPMs Continued
Table C-7. OpenFabrics-Devel/RPMs
RPM Name
Comments
Table C-8. OpenSM/RPMs
Table C-7. OpenFabrics-Devel/RPMs Continued
Table C-9. Other HCAs/RPMs
RPM Name
Table C-10. Other HCAs-Devel/RPMs
Table C-9. Other HCAs/RPMs Continued
Table C-11. OtherMPIs/RPMs
Front
Developme
Table C-11. OtherMPIs/RPMs Continued
RPM Name
Front
RPM Name
Table C-11. OtherMPIs/RPMs Continued
Front
Comput
C-12
C - RPM Descriptions OpenFabrics RPMs
IB0056101-00 G
Index
Page
Page
Page
vverbose 5-32 -vvv vvverbose
verbose
workdir=DIR
VNIC, configuration 5-18 -vv
Index-6
QLogic HCA and InfiniPath→ Software Install Guide Version
IB0056101-00 G
Page
Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway
