Q-Logic IB0056101-00 G manual NAME=eioc1 IOCGUID=0x66A0137FFFFE7, # HEARTBEAT=100

Page 62

5 – Software Installation

OpenFabrics Drivers and Services Configuration and Startup

S

a.Format 1: Defining an IOC using the IOCGUID. Use the following format to allow the host to connect to a specific VIO hardware card, regardless of which chassis and/or slot the VIO hardware card resides:

{CREATE;

NAME="eioc1";

IOCGUID=0x66A0137FFFFE7;}

The following is an example of VIO hardware failover:

{CREATE; NAME="eioc1"; PRIMARY={IOCGUID=0x66a01de000003; INSTANCE=1; PORT=1; } SECONDARY={IOCGUID=0x66a02de000003; INSTANCE=1; PORT=1;}

NOTE:

Do not create EIOC names with similar character strings (e.g., eioc3 and eioc30). There is a limitation with certain Linux operating systems that cannot recognize the subtle differences. The result is that the user will be unable to ping across the network.

b.Format 2: Defining an IOC using the IOCSTRING. Defining the IOC using the IOCSTRING allows VIO hardware to be hot-swapped in and out of a specific slot. The host attempts to connect to the specified IOC (1, 2, or 3) on the VIO hardware that currently resides in the specified slot of the specified chassis. Use the following format to allow the host to connect to a VIO hardware that resides in a specific slot of a specific chassis:

{CREATE;

NAME="eioc1";

IOCSTRING="Chassis 0x00066A0005000001, Slot 1, IOC 1";

#RX_CSUM=TRUE;

#HEARTBEAT=100; }

NOTE:

The IOCSTRING field is a literal, case-sensitive string. Its syntax must be exactly in the format shown in the previous example, including the placement of commas. to reduce the likelihood to syntax error, use the command ib_qlgc_vnic_query -es. Note that the chassis serial number must match the chassis Ox (Hex) value. The slot serial number is specific to the line card as well.

5-20

IB0056101-00 G

Image 62
Contents QLogic HCA and InfiniPath→ Software Install Guide QLogic HCA and InfiniPath→ Software Install Guide Version Document Revision HistoryTable of Contents Software Installation Installation Troubleshooting Configuration Files RPM Descriptions List of Figures Page Who Should Read this Guide How this Guide is OrganizedOverview Typographical Conventions InteroperabilityConventions Used in this Guide Convention MeaningDocumentation Contact Information Support HeadquartersIntroduction Contact Information IB0056101-00 G Description What’s New in this ReleaseQLogic Adapter Model Numbers New Features QLogic Model DescriptionDistribution InfiniPath/OpenFabrics Supported Supported Distributions and KernelsInfiniPath/OpenFabrics Supported Distributions Kernels Distribution InfiniPath/OpenFabrics Supported Kernels Compiler SupportSoftware Components „ Ofed SRP Feature Overview Software Components Step-by-Step Installation Checklist Hardware InstallationSoftware Installation Installing Software Using Rocks onStep-by-Step Installation Checklist Software Installation Page Adapter Models and Related Platforms Hardware Installation RequirementsHardware QLogic Platform Plugs IntoForm Factors Product Number Description Cabling and SwitchesQLogic InfiniBand Cables Configuring the Bios Optical Fibre OptionList of the Package Contents Safety with ElectricityVerify the Package Contents Unpacking InformationHardware Installation Unpacking Information QLogic QLE7280 with IBA7220 Asic Unpacking the QLogic Adapter AsicDual Adapter Installation Installation StepsPCIe Slot in a Typical Motherboard QLogic PCIe HCA Assembly with Riser Card Hardware Installation for QHT7140 with HTX Riser Assembled PCIe HCA with RiserHTX Slot QLogic QHT7140 Adapter with Riser Card Assembled QHT7140 with Riser Hardware Installation for the QHT7140 Without an HTX Riser Switch Configuration and Monitoring Cabling the Adapter to the InfiniBand SwitchCompleting the Installation Cluster Setup Types of Nodes in a Cluster EnvironmentInfiniPath/OpenFabrics Supported Distributions and Kernels Setting Up Your EnvironmentSupported Linux Distributions Package Description Comments Choosing the Appropriate Download FilesAvailable Packages Unpacking the InfiniPath tar File Check for Missing Files or RPMs Libibverbs-2.2-xxx.11.yyy.x8664.rpmRhel4 Installing the InfiniPath and OpenFabrics RPMsDistribution Used On Sles10If you want to Then install Choosing the RPMs to InstallRpms to Install Using rpm to Install InfiniPath and OpenFabrics PreparingInstalled Layout Starting the InfiniPath Service Configuring the InfiniPath Drivers InfiniPath and OpenFabrics Driver OverviewIpathether Configuration on Red Hat Configuring the ibipath DriverConfiguring the ipathether Network Interface Etc/sysconfig/network-scripts/ifcfg-eth2 # QLogic Interconnect Ethernet DEVICE=eth2 BOOTPROTO=staticIpathether Configuration on Sles 00117504e011Etc/udev/rules.d/30-netpersistentnames.rules Etc/sysconfig/hardware/hwcfg-eth-id-$MACEtc/sysconfig/network/ifcfg-eth2 MODULE=ipathether STARTMODE=autoOpenFabrics Drivers and Services Configuration and Startup Configuring the IPoIB Network Interface Output from this command will be similar to this00066a0130000001 Configuring and Administering the Vnic InterfaceEtc/sysconfig/infinipath. Change this line to Service 1 1000066a00000101 InfiniNIC.InfiniConSys.Data01 Etc/infiniband/qlgcvnic.cfgNAME=eioc1 IOCGUID=0x66A0137FFFFE7 # HEARTBEAT=100This example uses DGID, Iocguid and Iocstring # /etc/init.d/infinipath start # /etc/init.d/qlgcvnic start # /etc/init.d/qlgcvnic stopEtc/init.d/opensmd OpenSM# ibqlgcvnicinfo Using Ofed SRP 21000001ff040bf6# ibsrpdm -c # mkdir /mnt/targetname # mount /dev/sde1 /mnt/targetnameMPI over uDAPL Other Configuration Changing the MTU SizeStarting and Stopping the InfiniPath Software To check the configuration state, use the command Rebuilding or Reinstalling Drivers After a Kernel Upgrade LED Link and Data Indicators Further Information on Configuring and Loading DriversLED Link and Data Indicators LED States IndicationAdapter Settings OffCustomer Acceptance Utility Hostname1 Hostname2Command Meaning Ipathcheckout OptionsUninstalling Ofed 1.3 Software Additional Installation InstructionsUninstalling InfiniPath and OpenFabrics RPMs Removing Software PackagesInstalling Lustre Installing QLogic MPI in an Alternate LocationInstalling on an Unsupported Distribution /etc/redhat-release file or the /etc/SuSE-release fileManaging and Installing Software Using Rocks Usr/src/infinipath/drivers/build-guards.shInstalling Rocks and InfiniPath RPMs Use the following contents Software Installation Additional Installation Instructions Home/install/contrib/4.2.1/x8664/RPMS Further Information on Rocks and kickstart Page Node Spontaneously Reboots Hardware IssuesBios Settings Some HTX Motherboards May Need Two or More CPUs in UseMtrr Mapping Discrete Edit Bios Settings to Fix Mtrr IssuesMtrr Mapping and Write Combining Use the ipathmtrr Script to Fix Mtrr Issues Software Installation IssuesIssue with Supermicro H8DCE-HTe and QHT7040 OpenFabrics Library Dependencies Version Number Conflict with opensm-*on RHEL5 SystemsOpenFabrics Dependencies Rpm no packages given for eraseMissing Kernel RPM Errors Libgcc-3.4.3-9.EL4.i386.rpm Mpirun Installation Requires 32-bit SupportResolving Conflicts Glibc-2.3.4-2.i686.rpm or glibc-2.3.4-2.i386.rpm Lockable Memory Error on Initial Installation of InfiniPathIfup on ipathether on Sles 10 Reports unknown device Eth3 device QLogic Corp Unknown device 0010 revPage Table B-1. Configuration Files Configuration File Name DescriptionSample and Template Files Description RPM Version Numbers and Identifiers InfiniPath and OpenFabrics RPMsDifferent Nodes May Use Different RPMs Infinipath-2.2-33597.832rhel4qlc.x8664.rpmTable C-1. InfiniPath Documentation/RPMs RPM OrganizationDocumentation and InfiniPath RPMs RPM Name Front End Compute DevelopmentContains ipathcheckout Ipathbug-helpera Table C-2. InfiniPath/RPMsTable C-3. InfiniPath-Devel/RPMs Table C-5. OpenFabrics Documentation/RPMs OpenFabrics RPMsTable C-4. InfiniPath-MPI/RPMs RPM Name CommentsIbsim-2.2-xxx.04.yyy.x8664.rpm Dapl-utils-2.2-xxx.207.yyy.x8664.rpmIb-bonding-2.2-xxx.090.yyy.x8664.rpm Ibutils-2.2-xxx.12.yyy.x8664.rpmLibipathverbs-2.2-xxx.11.yyy.x8664.rpm Libibverbs-2.2-xxx.111.yyy.x8664.rpmLibibverbs-utils-2.2-xxx.111.yyy.x8664.rpm Librdmacm-2.2-xxx.106.yyy.x8664.rpmTable C-7. OpenFabrics-Devel/RPMs Table C-8. OpenSM/RPMs Table C-9. Other HCAs/RPMsRPM Name Front Comput Table C-10. Other HCAs-Devel/RPMsTable C-11. OtherMPIs/RPMs EndRPM Name Front Comput Developme End Openmpipgi-2.2-xxx.125.yyy.x86 Openmpiintel-2.2-xxx.125.yyy.x8Openmpipathscale-2.2-xxx.125.yy Qlogic-mpi-regisRPM Descriptions OpenFabrics RPMs IB0056101-00 G Index Help Openssh Openssh-server 5-3 Optical media converters No packages given for erase warning message A-4 Verbose Page Page Camberley Surrey, GU16 7ER UK +44 0 1276 804