Q-Logic IB0056101-00 G manual Installing on an Unsupported Distribution

Page 77

A

5 – Software Installation Additional Installation Instructions

For example, install all RPMs that relate to QLogic MPI in /usr/mpi/qlogic. Leave all remaining InfiniPath libraries and tools in their default installation location (/usr). This approach leaves InfiniPath libraries (such as libpsm_infinipath.so and libinfinipath.so) in standard system directories so that other MPIs can easily find them in their expected location. Also, this scenario leaves InfiniPath-specific utilities such as ipath_checkout and ipath_control in standard system search paths.

For this example, unpack the InfiniPath tarball as shown in “Unpacking the InfiniPath tar File” on page 5-4. Then move all RPMs that will be prefixed to a new directory called InfiniPath-MPI-prefixed. This includes all QLogic MPI development headers, libraries, runtime and documentation RPMs, as well as mpi-selectorregistration scripts. For example:

% mkdir InfiniPath-MPI-prefixed

% mv InfiniPath-MPI/mpi-{frontend,benchmark,libs}* InfiniPath-Devel/mpi-devel* \ OtherMPIs/qlogic-mpi-register* \ Documentation/mpi-doc* InfiniPath-MPI-prefixed/

Next, install all non-prefixed RPMs as explained in “Using rpm to Install InfiniPath and OpenFabrics” on page 5-8:

% rpm -Uvh InfiniPath/*.rpm InfiniPath-Devel/*.rpm \ OpenFabrics/*.rpm OpenFabrics-Devel/*.rpm

Finally, install the prefixed InfiniPath-MPI RPMs in /usr/mpi/qlogic:

% rpm -Uvh --prefix /usr/mpi/qlogic InfiniPath-MPI-prefixed/*.rpm

The desired prefix should be made available in the $MPICH_ROOT environment variable, either by global shell configuration files or through third-party environment management utilities such as mpi-selectoror the Environment Modules.

See the Using QLogic MPI section in the QLogic HCA and InfiniPath Software User Guide for more information on setting $MPICH_ROOT and using the mpi-selectorutility.

Installing on an Unsupported Distribution

If you are running a kernel that does not match a supported kernel/distribution pair, you may need to provide an override during the install of the infinipath-kernelRPM. This override may be needed if you have a completely unsupported distribution, or if you have upgraded the kernel without upgrading the rest of the distribution. The InfiniPath install determines the distribution from either

the /etc/redhat-release file or the /etc/SuSE-release file.

IB0056101-00 G

5-35

Image 77
Contents QLogic HCA and InfiniPath→ Software Install Guide Document Revision History QLogic HCA and InfiniPath→ Software Install Guide VersionTable of Contents Software Installation Installation Troubleshooting Configuration Files RPM Descriptions List of Figures Page How this Guide is Organized Who Should Read this GuideOverview Conventions Used in this Guide InteroperabilityTypographical Conventions Convention MeaningDocumentation Support Headquarters Contact InformationIntroduction Contact Information IB0056101-00 G Description What’s New in this ReleaseQLogic Adapter Model Numbers QLogic Model Description New FeaturesDistribution InfiniPath/OpenFabrics Supported Supported Distributions and KernelsInfiniPath/OpenFabrics Supported Distributions Kernels Distribution InfiniPath/OpenFabrics Supported Kernels Compiler SupportSoftware Components „ Ofed SRP Feature Overview Software Components Hardware Installation Step-by-Step Installation ChecklistInstalling Software Using Rocks on Software InstallationStep-by-Step Installation Checklist Software Installation Page Hardware Hardware Installation RequirementsAdapter Models and Related Platforms QLogic Platform Plugs IntoForm Factors Product Number Description Cabling and SwitchesQLogic InfiniBand Cables Optical Fibre Option Configuring the BiosVerify the Package Contents Safety with ElectricityList of the Package Contents Unpacking InformationHardware Installation Unpacking Information QLogic QLE7280 with IBA7220 Asic Asic Unpacking the QLogic AdapterInstallation Steps Dual Adapter InstallationPCIe Slot in a Typical Motherboard QLogic PCIe HCA Assembly with Riser Card Assembled PCIe HCA with Riser Hardware Installation for QHT7140 with HTX RiserHTX Slot QLogic QHT7140 Adapter with Riser Card Assembled QHT7140 with Riser Hardware Installation for the QHT7140 Without an HTX Riser Cabling the Adapter to the InfiniBand Switch Switch Configuration and MonitoringCompleting the Installation Types of Nodes in a Cluster Environment Cluster SetupInfiniPath/OpenFabrics Supported Distributions and Kernels Setting Up Your EnvironmentSupported Linux Distributions Package Description Comments Choosing the Appropriate Download FilesAvailable Packages Unpacking the InfiniPath tar File Libibverbs-2.2-xxx.11.yyy.x8664.rpm Check for Missing Files or RPMsDistribution Used On Installing the InfiniPath and OpenFabrics RPMsRhel4 Sles10If you want to Then install Choosing the RPMs to InstallRpms to Install Preparing Using rpm to Install InfiniPath and OpenFabricsInstalled Layout Starting the InfiniPath Service InfiniPath and OpenFabrics Driver Overview Configuring the InfiniPath DriversIpathether Configuration on Red Hat Configuring the ibipath DriverConfiguring the ipathether Network Interface # QLogic Interconnect Ethernet DEVICE=eth2 BOOTPROTO=static Etc/sysconfig/network-scripts/ifcfg-eth200117504e011 Ipathether Configuration on SlesEtc/sysconfig/network/ifcfg-eth2 Etc/sysconfig/hardware/hwcfg-eth-id-$MACEtc/udev/rules.d/30-netpersistentnames.rules MODULE=ipathether STARTMODE=autoOpenFabrics Drivers and Services Configuration and Startup Output from this command will be similar to this Configuring the IPoIB Network Interface00066a0130000001 Configuring and Administering the Vnic InterfaceEtc/sysconfig/infinipath. Change this line to Etc/infiniband/qlgcvnic.cfg Service 1 1000066a00000101 InfiniNIC.InfiniConSys.Data01# HEARTBEAT=100 NAME=eioc1 IOCGUID=0x66A0137FFFFE7This example uses DGID, Iocguid and Iocstring # /etc/init.d/qlgcvnic stop # /etc/init.d/infinipath start # /etc/init.d/qlgcvnic startEtc/init.d/opensmd OpenSM# ibqlgcvnicinfo 21000001ff040bf6 Using Ofed SRP# mkdir /mnt/targetname # mount /dev/sde1 /mnt/targetname # ibsrpdm -cMPI over uDAPL Other Configuration Changing the MTU SizeStarting and Stopping the InfiniPath Software To check the configuration state, use the command Rebuilding or Reinstalling Drivers After a Kernel Upgrade LED Link and Data Indicators Further Information on Configuring and Loading DriversLED Link and Data Indicators LED States IndicationOff Adapter SettingsHostname1 Hostname2 Customer Acceptance UtilityIpathcheckout Options Command MeaningUninstalling InfiniPath and OpenFabrics RPMs Additional Installation InstructionsUninstalling Ofed 1.3 Software Removing Software PackagesInstalling QLogic MPI in an Alternate Location Installing Lustre/etc/redhat-release file or the /etc/SuSE-release file Installing on an Unsupported DistributionUsr/src/infinipath/drivers/build-guards.sh Managing and Installing Software Using RocksInstalling Rocks and InfiniPath RPMs Use the following contents Software Installation Additional Installation Instructions Home/install/contrib/4.2.1/x8664/RPMS Further Information on Rocks and kickstart Page Bios Settings Hardware IssuesNode Spontaneously Reboots Some HTX Motherboards May Need Two or More CPUs in UseMtrr Mapping Discrete Edit Bios Settings to Fix Mtrr IssuesMtrr Mapping and Write Combining Use the ipathmtrr Script to Fix Mtrr Issues Software Installation IssuesIssue with Supermicro H8DCE-HTe and QHT7040 OpenFabrics Dependencies Version Number Conflict with opensm-*on RHEL5 SystemsOpenFabrics Library Dependencies Rpm no packages given for eraseMissing Kernel RPM Errors Libgcc-3.4.3-9.EL4.i386.rpm Mpirun Installation Requires 32-bit SupportResolving Conflicts Ifup on ipathether on Sles 10 Reports unknown device Lockable Memory Error on Initial Installation of InfiniPathGlibc-2.3.4-2.i686.rpm or glibc-2.3.4-2.i386.rpm Eth3 device QLogic Corp Unknown device 0010 revPage Configuration File Name Description Table B-1. Configuration FilesSample and Template Files Description Different Nodes May Use Different RPMs InfiniPath and OpenFabrics RPMsRPM Version Numbers and Identifiers Infinipath-2.2-33597.832rhel4qlc.x8664.rpmDocumentation and InfiniPath RPMs RPM OrganizationTable C-1. InfiniPath Documentation/RPMs RPM Name Front End Compute DevelopmentContains ipathcheckout Ipathbug-helpera Table C-2. InfiniPath/RPMsTable C-3. InfiniPath-Devel/RPMs Table C-4. InfiniPath-MPI/RPMs OpenFabrics RPMsTable C-5. OpenFabrics Documentation/RPMs RPM Name CommentsIb-bonding-2.2-xxx.090.yyy.x8664.rpm Dapl-utils-2.2-xxx.207.yyy.x8664.rpmIbsim-2.2-xxx.04.yyy.x8664.rpm Ibutils-2.2-xxx.12.yyy.x8664.rpmLibibverbs-utils-2.2-xxx.111.yyy.x8664.rpm Libibverbs-2.2-xxx.111.yyy.x8664.rpmLibipathverbs-2.2-xxx.11.yyy.x8664.rpm Librdmacm-2.2-xxx.106.yyy.x8664.rpmTable C-7. OpenFabrics-Devel/RPMs Table C-9. Other HCAs/RPMs Table C-8. OpenSM/RPMsTable C-11. OtherMPIs/RPMs Table C-10. Other HCAs-Devel/RPMsRPM Name Front Comput EndRPM Name Front Comput Developme End Openmpipathscale-2.2-xxx.125.yy Openmpiintel-2.2-xxx.125.yyy.x8Openmpipgi-2.2-xxx.125.yyy.x86 Qlogic-mpi-regisRPM Descriptions OpenFabrics RPMs IB0056101-00 G Index Help Openssh Openssh-server 5-3 Optical media converters No packages given for erase warning message A-4 Verbose Page Page Camberley Surrey, GU16 7ER UK +44 0 1276 804