Manuals
/
Q-Logic
/
Computer Equipment
/
Computer Drive
Q-Logic
IB0056101-00 G manual
Models:
IB0056101-00 G
1
113
114
114
Download
114 pages
8.55 Kb
107
108
109
110
111
112
113
114
<
>
Troubleshooting
Specifications
Install
Configuration Files
Hardware Issues
Cluster Setup
To restart the QLogic VNIC driver, run the following command
5. QLogic PCIe HCA Assembly with Riser Card
Missing Kernel RPM Errors
Optimize your adapter for the best performance. See “Adapter Settings” on page 5-30. Also see the Performance and Management Tips section in the QLogic HCA and InfiniPath Software User Guide
Page 113
Image 113
Page 112
Page 114
Page 113
Image 113
Page 112
Page 114
Contents
Version
QLogic HCA and InfiniPath→ Software Install Guide
Sections Affected
Document Revision History
Changes
Step-by-Step Installation Checklist
Feature Overview
Hardware Installation
Introduction
Software Installation
Installation Troubleshooting
RPM Descriptions
Configuration Files
InfiniPath and OpenFabrics RPMs
Different Nodes May Use Different RPMs
List of Tables
List of Figures
Page
Page
IB0056101-00 G
QLogic HCA and InfiniPath→ Software Install Guide Version
Page
How this Guide is Organized
1 Introduction
Who Should Read this Guide
Overview
Conventions Used in this Guide
Interoperability
Table 1-1. Typographical Conventions
Convention
Documentation
„ The QLogic HCA and InfiniPath Software Install Guide
Table 1-1. Typographical Conventions Continued
„ The QLogic HCA and InfiniPath Software User Guide
Support Headquarters
Contact Information
support.qlogic.com
North American Region
IB0056101-00 G
1 - Introduction Contact Information
What’s New in this Release
2 Feature Overview
Table 2-1. QLogic Adapter Model Numbers
Description
Table 2-1. QLogic Adapter Model Numbers Continued
New Features
QLogic Model
Description
Table 2-2. InfiniPath/OpenFabrics Supported Distributions and Kernels
Supported Distributions and Kernels
Distribution
InfiniPath/OpenFabrics Supported
Software Components
Compiler Support
Table 2-2. InfiniPath/OpenFabrics Supported Distributions
and Kernels Continued
Included components are „ InfiniPath driver
Page
Hardware Installation
3 Step-by-Step Installation Checklist
Installing Software Using Rocks” on page
Software Installation
10. Optimize your adapter for the best performance. See “Adapter Settings” on page 5-30. Also see the Performance and Management Tips section in the QLogic HCA and InfiniPath Software User Guide
IB0056101-00 G
3 - Step-by-Step Installation Checklist Software Installation
Hardware Installation Requirements
4 Hardware Installation
Hardware
Table 4-1. Adapter Models and Related Platforms
Table 4-1. Adapter Models and Related Platforms Continued
Form Factors
QLogic
Platform
Table 4-2. QLogic InfiniBand Cables
Cabling and Switches
Product Number
Description
Optical Fibre Option
Configuring the BIOS
For more details, see “BIOS Settings” on page A-1
Verify the Package Contents
Safety with Electricity
List of the Package Contents
Unpacking Information
Page
Figure 4-2. QLogic QLE7140 Card with Riser, Top View
Figure 4-1. QLogic QLE7280 with IBA7220 ASIC
View
Unpacking the QLogic Adapter
Installation Steps
Dual Adapter Installation
Follow the instructions in “Installation Steps” on page
Hardware Installation
Figure 4-4. PCIe Slot in a Typical Motherboard
Figure 4-5. QLogic PCIe HCA Assembly with Riser Card
Figure 4-6. Assembled PCIe HCA with Riser
Hardware Installation for QHT7140 with HTX Riser
Figure 4-7. HTX Slot
Figure 4-8. QLogic QHT7140 Adapter with Riser Card
Figure 4-9. Assembled QHT7140 with Riser
Hardware Installation for the QHT7140 Without an HTX Riser
Figure 4-10. QHT7140 Without Riser Installed in a 3U Chassis
Switch Configuration and Monitoring
Cabling the Adapter to the InfiniBand Switch
Completing the Installation
Types of Nodes in a Cluster Environment
5 Software Installation
Cluster Setup
Supported Linux Distributions
Setting Up Your Environment
Table 5-1. InfiniPath/OpenFabrics Supported Distributions and Kernels
Distribution
Choosing the Appropriate Download Files
Downloading and Unpacking the InfiniPath and OpenFabrics Software
Table 5-2. Available Packages
Package
Table 5-2. Available Packages Continued
Unpacking the InfiniPath tar File
Package
Description
Check for Missing Files or RPMs
Table 5-3. InfiniPath and OpenFabrics RPMs to Use for Each Node in a
Installing the InfiniPath and OpenFabrics RPMs
Cluster
Used On
Table 5-4. RPMS to Install
Choosing the RPMs to Install
Then install
If you want to
Using rpm to Install InfiniPath and OpenFabrics
Installed Layout
Starting the InfiniPath Service
Figure 5-1. Relationship Between InfiniPath and OpenFabrics Software
Configuring the InfiniPath Drivers
InfiniPath and OpenFabrics Driver Overview
ipathether Configuration on Red Hat
Configuring the ibipath Driver
Configuring the ipathether Network Interface
3. Create or edit the following file as root
# sed ’s/\......\..../\1/’ \ sys/bus/pci/drivers/ibipath/00/guid
ipathether Configuration on SLES
# lsmod grep -q ipathether modprobe ipathether
The Globally Unique IDentifer GUID can also be returned by running
OpenFabrics Drivers and Services Configuration and Startup
Configuring the IPoIB Network Interface
# /etc/init.d/infinipath restart
Configuring and Administering the VNIC Interface
2. Create the VNIC interfaces using the configuration file
The following is an example of VIO hardware failover
This example uses DGID, IOCGUID and IOCSTRING
To restart the QLogic VNIC driver, run the following command
OpenSM
Using OFED SRP
# echo
# ibsrpdm -c
MPI over uDAPL
Other Configuration Changing the MTU Size
Starting and Stopping the InfiniPath Software
To check the configuration state, use the command
Rebuilding or Reinstalling Drivers After a Kernel Upgrade
Further Information on Configuring and Loading Drivers
Rebuilding or Reinstalling Drivers if a Different Kernel is Installed
LED Link and Data Indicators
Table 5-5. LED Link and Data Indicators
Table 5-5. LED Link and Data Indicators Continued
Adapter Settings
LED States
Indication
Customer Acceptance Utility
Meaning
Command
Table 5-6. ipathcheckout Options
Uninstalling InfiniPath and OpenFabrics RPMs
Additional Installation Instructions
Uninstalling OFED 1.3 Software
Removing Software Packages
Installing QLogic MPI in an Alternate Location
Installing Lustre
Installing on an Unsupported Distribution
Managing and Installing Software Using Rocks
Installing Rocks and InfiniPath RPMs
Use the following contents
skip lam -- package-lam-gnu/package post set
home/install/contrib/4.2.1/x8664/RPMS
Further Information on Rocks and kickstart
IB0056101-00 G
5 - Software Installation Additional Installation Instructions
5-42
Hardware Issues
A Installation Troubleshooting
BIOS Settings
Node Spontaneously Reboots
MTRR Mapping and Write Combining
Edit BIOS Settings to Fix MTRR Issues
Use the ipathmtrr Script to Fix MTRR Issues
Software Installation Issues
Issue with Supermicro H8DCE-HTe and QHT7040
OpenFabrics Library Dependencies
Version Number Conflict with opensm-* on RHEL5 Systems
OpenFabrics Dependencies
Missing Kernel RPM Errors
Resolving Conflicts
mpirun Installation Requires 32-bit Support
# rpm -Uvh Documentation/*rpm InfiniPath/*rpm
InfiniPath-Devel/*rpm InfiniPath-MPI/*rpm OpenFabrics/*rpm
Software User Guide
Lockable Memory Error on Initial Installation of InfiniPath
ifup on ipathether on SLES 10 Reports unknown device
IB0056101-00 G
A - Installation Troubleshooting
Version Number Conflict with opensm-* on RHEL5 Systems
Table B-1. Configuration Files
B Configuration Files
Configuration File Name
Description
Sample and Template Files
Table B-1. Configuration Files Continued
Configuration File Name
Description
InfiniPath and OpenFabrics RPMs
C RPM Descriptions
Different Nodes May Use Different RPMs
RPM Version Numbers and Identifiers
Documentation and InfiniPath RPMs
RPM Organization
Table C-1. InfiniPath Documentation/RPMs
RPM Name
Table C-3. InfiniPath-Devel/RPMs
Table C-2. InfiniPath/RPMs
RPM Name
Front End
Table C-4. InfiniPath-MPI/RPMs
OpenFabrics RPMs
Table C-5. OpenFabrics Documentation/RPMs
Table C-6. OpenFabrics/RPMs
Comments
Table C-6. OpenFabrics/RPMs Continued
RPM Name
Table C-6. OpenFabrics/RPMs Continued
described in the InfiniBand Architecture Specification. This library
RPM Name
Comments
Table C-6. OpenFabrics/RPMs Continued
Table C-7. OpenFabrics-Devel/RPMs
RPM Name
Comments
Table C-8. OpenSM/RPMs
Table C-7. OpenFabrics-Devel/RPMs Continued
Table C-9. Other HCAs/RPMs
RPM Name
Table C-10. Other HCAs-Devel/RPMs
Table C-9. Other HCAs/RPMs Continued
Table C-11. OtherMPIs/RPMs
Front
Developme
Table C-11. OtherMPIs/RPMs Continued
RPM Name
Front
RPM Name
Table C-11. OtherMPIs/RPMs Continued
Front
Comput
IB0056101-00 G
C - RPM Descriptions OpenFabrics RPMs
C-12
Index
Page
Page
Page
vverbose 5-32 -vvv vvverbose
verbose
workdir=DIR
VNIC, configuration 5-18 -vv
IB0056101-00 G
QLogic HCA and InfiniPath→ Software Install Guide Version
Index-6
Page
Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway
