Q-Logic IB0056101-00 G manual Configuring and Administering the Vnic Interface, 00066a0130000001

Page 60

5 – Software Installation

OpenFabrics Drivers and Services Configuration and Startup

S

NOTE:

„The configuration must be repeated each time the system is rebooted.

„IPoIB-CM (Connected Mode) is enabled by default. If you want to change this to datagram mode, edit the file

/etc/sysconfig/infinipath. Change this line to:

IPOIB_MODE="datagram"

Restart infinipath (as root) by typing:

#/etc/init.d/infinipath restart

The default IPOIB_MODE setting is "CM" for Connected Mode.

Configuring and Administering the VNIC Interface

The VirtualNIC (VNIC) Upper Layer Protocol (ULP) works in conjunction with firmware running on Virtual Input/Output (VIO) hardware such as the SilverStorm Ethernet Virtual I/O Controller (EVIC™) or the InfiniBand/Ethernet Bridge Module for IBM® BladeCenter®, providing virtual Ethernet connectivity.

The VNIC interface must be configured before it can be used. To do so, perform the following steps:

1.Discover EVIC/VEx Input/Output Controllers (IOCs) present on the fabric using ib_qlgc_vnic_query. For writing the configuration file, you need information about the EVIC/VEx IOCs present on the fabric, for example, their IOCGUID, IOCSTRING, etc. Use the ib_qlgc_vnic_query tool to get this information.

When ib_qlgc_vnic_query is executed without any options, it displays detailed information about all the EVIC/VEx IOCs present on the fabric. For example:

#ib_qlgc_vnic_query IO Unit Info:

port LID:

 

0003

port GID:

 

fe8000000000000000066a0258000001

change ID:

 

0009

max controllers:

0x03

controller[

1]

 

GUID:

00066a0130000001

vendor ID:

00066a

 

device ID:

000030

 

IO class :

2000

 

ID:

Chassis 0x00066A00010003F2, Slot 1, IOC 1

service entries:

2

service[ 0]: 1000066a00000001 InfiniNIC.InfiniConSys.Control:01

5-18

IB0056101-00 G

Image 60
Contents QLogic HCA and InfiniPath→ Software Install Guide QLogic HCA and InfiniPath→ Software Install Guide Version Document Revision HistoryTable of Contents Software Installation Installation Troubleshooting Configuration Files RPM Descriptions List of Figures Page Who Should Read this Guide How this Guide is OrganizedOverview Interoperability Conventions Used in this GuideTypographical Conventions Convention MeaningDocumentation Contact Information Support HeadquartersIntroduction Contact Information IB0056101-00 G What’s New in this Release QLogic Adapter Model NumbersDescription New Features QLogic Model DescriptionSupported Distributions and Kernels InfiniPath/OpenFabrics Supported Distributions KernelsDistribution InfiniPath/OpenFabrics Supported Compiler Support Software ComponentsDistribution InfiniPath/OpenFabrics Supported Kernels „ Ofed SRP Feature Overview Software Components Step-by-Step Installation Checklist Hardware InstallationSoftware Installation Installing Software Using Rocks onStep-by-Step Installation Checklist Software Installation Page Hardware Installation Requirements HardwareAdapter Models and Related Platforms QLogic Platform Plugs IntoForm Factors Cabling and Switches QLogic InfiniBand CablesProduct Number Description Configuring the Bios Optical Fibre OptionSafety with Electricity Verify the Package ContentsList of the Package Contents Unpacking InformationHardware Installation Unpacking Information QLogic QLE7280 with IBA7220 Asic Unpacking the QLogic Adapter AsicDual Adapter Installation Installation StepsPCIe Slot in a Typical Motherboard QLogic PCIe HCA Assembly with Riser Card Hardware Installation for QHT7140 with HTX Riser Assembled PCIe HCA with RiserHTX Slot QLogic QHT7140 Adapter with Riser Card Assembled QHT7140 with Riser Hardware Installation for the QHT7140 Without an HTX Riser Switch Configuration and Monitoring Cabling the Adapter to the InfiniBand SwitchCompleting the Installation Cluster Setup Types of Nodes in a Cluster EnvironmentSetting Up Your Environment Supported Linux DistributionsInfiniPath/OpenFabrics Supported Distributions and Kernels Choosing the Appropriate Download Files Available PackagesPackage Description Comments Unpacking the InfiniPath tar File Check for Missing Files or RPMs Libibverbs-2.2-xxx.11.yyy.x8664.rpmInstalling the InfiniPath and OpenFabrics RPMs Distribution Used OnRhel4 Sles10Choosing the RPMs to Install Rpms to InstallIf you want to Then install Using rpm to Install InfiniPath and OpenFabrics PreparingInstalled Layout Starting the InfiniPath Service Configuring the InfiniPath Drivers InfiniPath and OpenFabrics Driver OverviewConfiguring the ibipath Driver Configuring the ipathether Network InterfaceIpathether Configuration on Red Hat Etc/sysconfig/network-scripts/ifcfg-eth2 # QLogic Interconnect Ethernet DEVICE=eth2 BOOTPROTO=staticIpathether Configuration on Sles 00117504e011Etc/sysconfig/hardware/hwcfg-eth-id-$MAC Etc/sysconfig/network/ifcfg-eth2Etc/udev/rules.d/30-netpersistentnames.rules MODULE=ipathether STARTMODE=autoOpenFabrics Drivers and Services Configuration and Startup Configuring the IPoIB Network Interface Output from this command will be similar to thisConfiguring and Administering the Vnic Interface Etc/sysconfig/infinipath. Change this line to00066a0130000001 Service 1 1000066a00000101 InfiniNIC.InfiniConSys.Data01 Etc/infiniband/qlgcvnic.cfgNAME=eioc1 IOCGUID=0x66A0137FFFFE7 # HEARTBEAT=100This example uses DGID, Iocguid and Iocstring # /etc/init.d/infinipath start # /etc/init.d/qlgcvnic start # /etc/init.d/qlgcvnic stopOpenSM # ibqlgcvnicinfoEtc/init.d/opensmd Using Ofed SRP 21000001ff040bf6# ibsrpdm -c # mkdir /mnt/targetname # mount /dev/sde1 /mnt/targetnameOther Configuration Changing the MTU Size Starting and Stopping the InfiniPath SoftwareMPI over uDAPL To check the configuration state, use the command Rebuilding or Reinstalling Drivers After a Kernel Upgrade Further Information on Configuring and Loading Drivers LED Link and Data IndicatorsLED Link and Data Indicators LED States IndicationAdapter Settings OffCustomer Acceptance Utility Hostname1 Hostname2Command Meaning Ipathcheckout OptionsAdditional Installation Instructions Uninstalling InfiniPath and OpenFabrics RPMsUninstalling Ofed 1.3 Software Removing Software PackagesInstalling Lustre Installing QLogic MPI in an Alternate LocationInstalling on an Unsupported Distribution /etc/redhat-release file or the /etc/SuSE-release fileManaging and Installing Software Using Rocks Usr/src/infinipath/drivers/build-guards.shInstalling Rocks and InfiniPath RPMs Use the following contents Software Installation Additional Installation Instructions Home/install/contrib/4.2.1/x8664/RPMS Further Information on Rocks and kickstart Page Hardware Issues Bios SettingsNode Spontaneously Reboots Some HTX Motherboards May Need Two or More CPUs in UseEdit Bios Settings to Fix Mtrr Issues Mtrr Mapping and Write CombiningMtrr Mapping Discrete Software Installation Issues Issue with Supermicro H8DCE-HTe and QHT7040Use the ipathmtrr Script to Fix Mtrr Issues Version Number Conflict with opensm-*on RHEL5 Systems OpenFabrics DependenciesOpenFabrics Library Dependencies Rpm no packages given for eraseMissing Kernel RPM Errors Mpirun Installation Requires 32-bit Support Resolving ConflictsLibgcc-3.4.3-9.EL4.i386.rpm Lockable Memory Error on Initial Installation of InfiniPath Ifup on ipathether on Sles 10 Reports unknown deviceGlibc-2.3.4-2.i686.rpm or glibc-2.3.4-2.i386.rpm Eth3 device QLogic Corp Unknown device 0010 revPage Table B-1. Configuration Files Configuration File Name DescriptionSample and Template Files Description InfiniPath and OpenFabrics RPMs Different Nodes May Use Different RPMsRPM Version Numbers and Identifiers Infinipath-2.2-33597.832rhel4qlc.x8664.rpmRPM Organization Documentation and InfiniPath RPMsTable C-1. InfiniPath Documentation/RPMs RPM Name Front End Compute DevelopmentTable C-2. InfiniPath/RPMs Table C-3. InfiniPath-Devel/RPMsContains ipathcheckout Ipathbug-helpera OpenFabrics RPMs Table C-4. InfiniPath-MPI/RPMsTable C-5. OpenFabrics Documentation/RPMs RPM Name CommentsDapl-utils-2.2-xxx.207.yyy.x8664.rpm Ib-bonding-2.2-xxx.090.yyy.x8664.rpmIbsim-2.2-xxx.04.yyy.x8664.rpm Ibutils-2.2-xxx.12.yyy.x8664.rpmLibibverbs-2.2-xxx.111.yyy.x8664.rpm Libibverbs-utils-2.2-xxx.111.yyy.x8664.rpmLibipathverbs-2.2-xxx.11.yyy.x8664.rpm Librdmacm-2.2-xxx.106.yyy.x8664.rpmTable C-7. OpenFabrics-Devel/RPMs Table C-8. OpenSM/RPMs Table C-9. Other HCAs/RPMsTable C-10. Other HCAs-Devel/RPMs Table C-11. OtherMPIs/RPMsRPM Name Front Comput EndRPM Name Front Comput Developme End Openmpiintel-2.2-xxx.125.yyy.x8 Openmpipathscale-2.2-xxx.125.yyOpenmpipgi-2.2-xxx.125.yyy.x86 Qlogic-mpi-regisRPM Descriptions OpenFabrics RPMs IB0056101-00 G Index Help Openssh Openssh-server 5-3 Optical media converters No packages given for erase warning message A-4 Verbose Page Page Camberley Surrey, GU16 7ER UK +44 0 1276 804