QLogic QLE7280 with IBA7220 Asic | Q-Logic IB0056101-00 G instruction

A

4 – Hardware Installation Unpacking Information

PCI Express

Edge Connectors

InfiniBand

Connector

Face Plate

IBA7220 ASIC

Figure 4-1. QLogic QLE7280 with IBA7220 ASIC

PCI Express Riser Card. Not supplied; shown for reference.

PCI Express

Edge Connectors

IBA6120 ASIC

InfiniBand

Connector

Face Plate

Figure 4-2. QLogic QLE7140 Card with Riser, Top View

IB0056101-00 G

4-7

Image 31

Q-Logic IB0056101-00 G manual QLogic QLE7280 with IBA7220 Asic

Contents

QLogic HCA and InfiniPath→ Software Install Guide Document Revision History QLogic HCA and InfiniPath→ Software Install Guide Version Table of Contents Software Installation Installation Troubleshooting Configuration Files RPM Descriptions List of Figures Page How this Guide is Organized Who Should Read this Guide Overview Convention Meaning InteroperabilityConventions Used in this Guide Typographical Conventions Documentation Support Headquarters Contact Information Introduction Contact Information IB0056101-00 G QLogic Adapter Model Numbers What’s New in this ReleaseDescription QLogic Model Description New Features InfiniPath/OpenFabrics Supported Distributions Kernels Supported Distributions and KernelsDistribution InfiniPath/OpenFabrics Supported Software Components Compiler SupportDistribution InfiniPath/OpenFabrics Supported Kernels „ Ofed SRP Feature Overview Software Components Hardware Installation Step-by-Step Installation Checklist Installing Software Using Rocks on Software Installation Step-by-Step Installation Checklist Software Installation Page QLogic Platform Plugs Into Hardware Installation RequirementsHardware Adapter Models and Related Platforms Form Factors QLogic InfiniBand Cables Cabling and SwitchesProduct Number Description Optical Fibre Option Configuring the Bios Unpacking Information Safety with ElectricityVerify the Package Contents List of the Package Contents Hardware Installation Unpacking Information QLogic QLE7280 with IBA7220 Asic Asic Unpacking the QLogic Adapter Installation Steps Dual Adapter Installation PCIe Slot in a Typical Motherboard QLogic PCIe HCA Assembly with Riser Card Assembled PCIe HCA with Riser Hardware Installation for QHT7140 with HTX Riser HTX Slot QLogic QHT7140 Adapter with Riser Card Assembled QHT7140 with Riser Hardware Installation for the QHT7140 Without an HTX Riser Cabling the Adapter to the InfiniBand Switch Switch Configuration and Monitoring Completing the Installation Types of Nodes in a Cluster Environment Cluster Setup Supported Linux Distributions Setting Up Your EnvironmentInfiniPath/OpenFabrics Supported Distributions and Kernels Available Packages Choosing the Appropriate Download FilesPackage Description Comments Unpacking the InfiniPath tar File Libibverbs-2.2-xxx.11.yyy.x8664.rpm Check for Missing Files or RPMs Sles10 Installing the InfiniPath and OpenFabrics RPMsDistribution Used On Rhel4 Rpms to Install Choosing the RPMs to InstallIf you want to Then install Preparing Using rpm to Install InfiniPath and OpenFabrics Installed Layout Starting the InfiniPath Service InfiniPath and OpenFabrics Driver Overview Configuring the InfiniPath Drivers Configuring the ipathether Network Interface Configuring the ibipath DriverIpathether Configuration on Red Hat # QLogic Interconnect Ethernet DEVICE=eth2 BOOTPROTO=static Etc/sysconfig/network-scripts/ifcfg-eth2 00117504e011 Ipathether Configuration on Sles MODULE=ipathether STARTMODE=auto Etc/sysconfig/hardware/hwcfg-eth-id-$MACEtc/sysconfig/network/ifcfg-eth2 Etc/udev/rules.d/30-netpersistentnames.rules OpenFabrics Drivers and Services Configuration and Startup Output from this command will be similar to this Configuring the IPoIB Network Interface Etc/sysconfig/infinipath. Change this line to Configuring and Administering the Vnic Interface00066a0130000001 Etc/infiniband/qlgcvnic.cfg Service 1 1000066a00000101 InfiniNIC.InfiniConSys.Data01 # HEARTBEAT=100 NAME=eioc1 IOCGUID=0x66A0137FFFFE7 This example uses DGID, Iocguid and Iocstring # /etc/init.d/qlgcvnic stop # /etc/init.d/infinipath start # /etc/init.d/qlgcvnic start # ibqlgcvnicinfo OpenSMEtc/init.d/opensmd 21000001ff040bf6 Using Ofed SRP # mkdir /mnt/targetname # mount /dev/sde1 /mnt/targetname # ibsrpdm -c Starting and Stopping the InfiniPath Software Other Configuration Changing the MTU SizeMPI over uDAPL To check the configuration state, use the command Rebuilding or Reinstalling Drivers After a Kernel Upgrade LED States Indication Further Information on Configuring and Loading DriversLED Link and Data Indicators LED Link and Data Indicators Off Adapter Settings Hostname1 Hostname2 Customer Acceptance Utility Ipathcheckout Options Command Meaning Removing Software Packages Additional Installation InstructionsUninstalling InfiniPath and OpenFabrics RPMs Uninstalling Ofed 1.3 Software Installing QLogic MPI in an Alternate Location Installing Lustre /etc/redhat-release file or the /etc/SuSE-release file Installing on an Unsupported Distribution Usr/src/infinipath/drivers/build-guards.sh Managing and Installing Software Using Rocks Installing Rocks and InfiniPath RPMs Use the following contents Software Installation Additional Installation Instructions Home/install/contrib/4.2.1/x8664/RPMS Further Information on Rocks and kickstart Page Some HTX Motherboards May Need Two or More CPUs in Use Hardware IssuesBios Settings Node Spontaneously Reboots Mtrr Mapping and Write Combining Edit Bios Settings to Fix Mtrr IssuesMtrr Mapping Discrete Issue with Supermicro H8DCE-HTe and QHT7040 Software Installation IssuesUse the ipathmtrr Script to Fix Mtrr Issues Rpm no packages given for erase Version Number Conflict with opensm-*on RHEL5 SystemsOpenFabrics Dependencies OpenFabrics Library Dependencies Missing Kernel RPM Errors Resolving Conflicts Mpirun Installation Requires 32-bit SupportLibgcc-3.4.3-9.EL4.i386.rpm Eth3 device QLogic Corp Unknown device 0010 rev Lockable Memory Error on Initial Installation of InfiniPathIfup on ipathether on Sles 10 Reports unknown device Glibc-2.3.4-2.i686.rpm or glibc-2.3.4-2.i386.rpmPage Configuration File Name Description Table B-1. Configuration Files Sample and Template Files Description Infinipath-2.2-33597.832rhel4qlc.x8664.rpm InfiniPath and OpenFabrics RPMsDifferent Nodes May Use Different RPMs RPM Version Numbers and Identifiers RPM Name Front End Compute Development RPM OrganizationDocumentation and InfiniPath RPMs Table C-1. InfiniPath Documentation/RPMs Table C-3. InfiniPath-Devel/RPMs Table C-2. InfiniPath/RPMsContains ipathcheckout Ipathbug-helpera RPM Name Comments OpenFabrics RPMsTable C-4. InfiniPath-MPI/RPMs Table C-5. OpenFabrics Documentation/RPMs Ibutils-2.2-xxx.12.yyy.x8664.rpm Dapl-utils-2.2-xxx.207.yyy.x8664.rpmIb-bonding-2.2-xxx.090.yyy.x8664.rpm Ibsim-2.2-xxx.04.yyy.x8664.rpm Librdmacm-2.2-xxx.106.yyy.x8664.rpm Libibverbs-2.2-xxx.111.yyy.x8664.rpmLibibverbs-utils-2.2-xxx.111.yyy.x8664.rpm Libipathverbs-2.2-xxx.11.yyy.x8664.rpm Table C-7. OpenFabrics-Devel/RPMs Table C-9. Other HCAs/RPMs Table C-8. OpenSM/RPMs End Table C-10. Other HCAs-Devel/RPMsTable C-11. OtherMPIs/RPMs RPM Name Front Comput RPM Name Front Comput Developme End Qlogic-mpi-regis Openmpiintel-2.2-xxx.125.yyy.x8Openmpipathscale-2.2-xxx.125.yy Openmpipgi-2.2-xxx.125.yyy.x86 RPM Descriptions OpenFabrics RPMs IB0056101-00 G Index Help Openssh Openssh-server 5-3 Optical media converters No packages given for erase warning message A-4 Verbose Page Page Camberley Surrey, GU16 7ER UK +44 0 1276 804