Q-Logic IB0056101-00 G specs

QLogic HCA and InfiniPath→ Software Install Guide Version 2.2

Notes

S

Page viii

IB0056101-00 G

Image 8

Q-Logic IB0056101-00 G manual

Contents

QLogic HCA and InfiniPath→ Software Install Guide QLogic HCA and InfiniPath→ Software Install Guide Version Document Revision History Table of Contents Software Installation Installation Troubleshooting Configuration Files RPM Descriptions List of Figures Page Who Should Read this Guide How this Guide is Organized Overview Interoperability Conventions Used in this GuideTypographical Conventions Convention Meaning Documentation Contact Information Support Headquarters Introduction Contact Information IB0056101-00 G Description What’s New in this ReleaseQLogic Adapter Model Numbers New Features QLogic Model Description Distribution InfiniPath/OpenFabrics Supported Supported Distributions and KernelsInfiniPath/OpenFabrics Supported Distributions Kernels Distribution InfiniPath/OpenFabrics Supported Kernels Compiler SupportSoftware Components „ Ofed SRP Feature Overview Software Components Step-by-Step Installation Checklist Hardware Installation Software Installation Installing Software Using Rocks on Step-by-Step Installation Checklist Software Installation Page Hardware Installation Requirements HardwareAdapter Models and Related Platforms QLogic Platform Plugs Into Form Factors Product Number Description Cabling and SwitchesQLogic InfiniBand Cables Configuring the Bios Optical Fibre Option Safety with Electricity Verify the Package ContentsList of the Package Contents Unpacking Information Hardware Installation Unpacking Information QLogic QLE7280 with IBA7220 Asic Unpacking the QLogic Adapter Asic Dual Adapter Installation Installation Steps PCIe Slot in a Typical Motherboard QLogic PCIe HCA Assembly with Riser Card Hardware Installation for QHT7140 with HTX Riser Assembled PCIe HCA with Riser HTX Slot QLogic QHT7140 Adapter with Riser Card Assembled QHT7140 with Riser Hardware Installation for the QHT7140 Without an HTX Riser Switch Configuration and Monitoring Cabling the Adapter to the InfiniBand Switch Completing the Installation Cluster Setup Types of Nodes in a Cluster Environment InfiniPath/OpenFabrics Supported Distributions and Kernels Setting Up Your EnvironmentSupported Linux Distributions Package Description Comments Choosing the Appropriate Download FilesAvailable Packages Unpacking the InfiniPath tar File Check for Missing Files or RPMs Libibverbs-2.2-xxx.11.yyy.x8664.rpm Installing the InfiniPath and OpenFabrics RPMs Distribution Used OnRhel4 Sles10 If you want to Then install Choosing the RPMs to InstallRpms to Install Using rpm to Install InfiniPath and OpenFabrics Preparing Installed Layout Starting the InfiniPath Service Configuring the InfiniPath Drivers InfiniPath and OpenFabrics Driver Overview Ipathether Configuration on Red Hat Configuring the ibipath DriverConfiguring the ipathether Network Interface Etc/sysconfig/network-scripts/ifcfg-eth2 # QLogic Interconnect Ethernet DEVICE=eth2 BOOTPROTO=static Ipathether Configuration on Sles 00117504e011 Etc/sysconfig/hardware/hwcfg-eth-id-$MAC Etc/sysconfig/network/ifcfg-eth2Etc/udev/rules.d/30-netpersistentnames.rules MODULE=ipathether STARTMODE=auto OpenFabrics Drivers and Services Configuration and Startup Configuring the IPoIB Network Interface Output from this command will be similar to this 00066a0130000001 Configuring and Administering the Vnic InterfaceEtc/sysconfig/infinipath. Change this line to Service 1 1000066a00000101 InfiniNIC.InfiniConSys.Data01 Etc/infiniband/qlgcvnic.cfg NAME=eioc1 IOCGUID=0x66A0137FFFFE7 # HEARTBEAT=100 This example uses DGID, Iocguid and Iocstring # /etc/init.d/infinipath start # /etc/init.d/qlgcvnic start # /etc/init.d/qlgcvnic stop Etc/init.d/opensmd OpenSM# ibqlgcvnicinfo Using Ofed SRP 21000001ff040bf6 # ibsrpdm -c # mkdir /mnt/targetname # mount /dev/sde1 /mnt/targetname MPI over uDAPL Other Configuration Changing the MTU SizeStarting and Stopping the InfiniPath Software To check the configuration state, use the command Rebuilding or Reinstalling Drivers After a Kernel Upgrade Further Information on Configuring and Loading Drivers LED Link and Data IndicatorsLED Link and Data Indicators LED States Indication Adapter Settings Off Customer Acceptance Utility Hostname1 Hostname2 Command Meaning Ipathcheckout Options Additional Installation Instructions Uninstalling InfiniPath and OpenFabrics RPMsUninstalling Ofed 1.3 Software Removing Software Packages Installing Lustre Installing QLogic MPI in an Alternate Location Installing on an Unsupported Distribution /etc/redhat-release file or the /etc/SuSE-release file Managing and Installing Software Using Rocks Usr/src/infinipath/drivers/build-guards.sh Installing Rocks and InfiniPath RPMs Use the following contents Software Installation Additional Installation Instructions Home/install/contrib/4.2.1/x8664/RPMS Further Information on Rocks and kickstart Page Hardware Issues Bios SettingsNode Spontaneously Reboots Some HTX Motherboards May Need Two or More CPUs in Use Mtrr Mapping Discrete Edit Bios Settings to Fix Mtrr IssuesMtrr Mapping and Write Combining Use the ipathmtrr Script to Fix Mtrr Issues Software Installation IssuesIssue with Supermicro H8DCE-HTe and QHT7040 Version Number Conflict with opensm-*on RHEL5 Systems OpenFabrics DependenciesOpenFabrics Library Dependencies Rpm no packages given for erase Missing Kernel RPM Errors Libgcc-3.4.3-9.EL4.i386.rpm Mpirun Installation Requires 32-bit SupportResolving Conflicts Lockable Memory Error on Initial Installation of InfiniPath Ifup on ipathether on Sles 10 Reports unknown deviceGlibc-2.3.4-2.i686.rpm or glibc-2.3.4-2.i386.rpm Eth3 device QLogic Corp Unknown device 0010 revPage Table B-1. Configuration Files Configuration File Name Description Sample and Template Files Description InfiniPath and OpenFabrics RPMs Different Nodes May Use Different RPMsRPM Version Numbers and Identifiers Infinipath-2.2-33597.832rhel4qlc.x8664.rpm RPM Organization Documentation and InfiniPath RPMsTable C-1. InfiniPath Documentation/RPMs RPM Name Front End Compute Development Contains ipathcheckout Ipathbug-helpera Table C-2. InfiniPath/RPMsTable C-3. InfiniPath-Devel/RPMs OpenFabrics RPMs Table C-4. InfiniPath-MPI/RPMsTable C-5. OpenFabrics Documentation/RPMs RPM Name Comments Dapl-utils-2.2-xxx.207.yyy.x8664.rpm Ib-bonding-2.2-xxx.090.yyy.x8664.rpmIbsim-2.2-xxx.04.yyy.x8664.rpm Ibutils-2.2-xxx.12.yyy.x8664.rpm Libibverbs-2.2-xxx.111.yyy.x8664.rpm Libibverbs-utils-2.2-xxx.111.yyy.x8664.rpmLibipathverbs-2.2-xxx.11.yyy.x8664.rpm Librdmacm-2.2-xxx.106.yyy.x8664.rpm Table C-7. OpenFabrics-Devel/RPMs Table C-8. OpenSM/RPMs Table C-9. Other HCAs/RPMs Table C-10. Other HCAs-Devel/RPMs Table C-11. OtherMPIs/RPMsRPM Name Front Comput End RPM Name Front Comput Developme End Openmpiintel-2.2-xxx.125.yyy.x8 Openmpipathscale-2.2-xxx.125.yyOpenmpipgi-2.2-xxx.125.yyy.x86 Qlogic-mpi-regis RPM Descriptions OpenFabrics RPMs IB0056101-00 G Index Help Openssh Openssh-server 5-3 Optical media converters No packages given for erase warning message A-4 Verbose Page Page Camberley Surrey, GU16 7ER UK +44 0 1276 804