Manuals / Q-Logic / Computer Equipment / Computer Drive

Q-Logic IB0056101-00 G manual 1. QLogic QLE7280 with IBA7220 ASIC

Models: IB0056101-00 G

1 114

Download 114 pages 8.55 Kb

Page 31

Image 31

Figure 4-1. QLogic QLE7280 with IBA7220 ASIC

4 – Hardware Installation Unpacking Information

PCI Express

Edge Connectors

InfiniBand

Connector

Face Plate

IBA7220 ASIC

Figure 4-1. QLogic QLE7280 with IBA7220 ASIC

PCI Express Riser Card. Not supplied; shown for reference.

PCI Express

Edge Connectors

IBA6120 ASIC

InfiniBand

Connector

Face Plate

Figure 4-2. QLogic QLE7140 Card with Riser, Top View

IB0056101-00 G

4-7

Page 31

Image 31

Q-Logic IB0056101-00 G manual 1. QLogic QLE7280 with IBA7220 ASIC, 2. QLogic QLE7140 Card with Riser, Top View

Contents

Version QLogic HCA and InfiniPath→ Software Install GuideChanges Document Revision HistorySections Affected Introduction Feature OverviewStep-by-Step Installation Checklist Hardware InstallationSoftware Installation Installation Troubleshooting Different Nodes May Use Different RPMs Configuration FilesRPM Descriptions InfiniPath and OpenFabrics RPMsPage List of FiguresList of Tables PagePage QLogic HCA and InfiniPath→ Software Install Guide VersionIB0056101-00 G Who Should Read this Guide 1 IntroductionHow this Guide is Organized Overview Convention InteroperabilityConventions Used in this Guide Table 1-1. Typographical Conventions„ The QLogic HCA and InfiniPath Software User Guide „ The QLogic HCA and InfiniPath Software Install GuideDocumentation Table 1-1. Typographical Conventions ContinuedNorth American Region Contact InformationSupport Headquarters support.qlogic.comIB0056101-00 G 1 - Introduction Contact InformationDescription 2 Feature OverviewWhat’s New in this Release Table 2-1. QLogic Adapter Model NumbersDescription New FeaturesTable 2-1. QLogic Adapter Model Numbers Continued QLogic ModelInfiniPath/OpenFabrics Supported Supported Distributions and KernelsTable 2-2. InfiniPath/OpenFabrics Supported Distributions and Kernels Distributionand Kernels Continued Compiler SupportSoftware Components Table 2-2. InfiniPath/OpenFabrics Supported DistributionsIncluded components are „ InfiniPath driver Page Hardware Installation 3 Step-by-Step Installation ChecklistInstalling Software Using Rocks” on page Software Installation10. Optimize your adapter for the best performance. See “Adapter Settings” on page 5-30. Also see the Performance and Management Tips section in the QLogic HCA and InfiniPath Software User Guide IB0056101-00 G 3 - Step-by-Step Installation Checklist Software InstallationTable 4-1. Adapter Models and Related Platforms 4 Hardware InstallationHardware Installation Requirements HardwarePlatform Form FactorsTable 4-1. Adapter Models and Related Platforms Continued QLogicDescription Cabling and SwitchesTable 4-2. QLogic InfiniBand Cables Product NumberFor more details, see “BIOS Settings” on page A-1 Configuring the BIOSOptical Fibre Option Unpacking Information Safety with ElectricityVerify the Package Contents List of the Package ContentsPage Figure 4-2. QLogic QLE7140 Card with Riser, Top View Figure 4-1. QLogic QLE7280 with IBA7220 ASICView Unpacking the QLogic AdapterHardware Installation Dual Adapter InstallationInstallation Steps Follow the instructions in “Installation Steps” on pageFigure 4-4. PCIe Slot in a Typical Motherboard Figure 4-5. QLogic PCIe HCA Assembly with Riser Card Figure 4-6. Assembled PCIe HCA with Riser Hardware Installation for QHT7140 with HTX RiserFigure 4-7. HTX Slot Figure 4-8. QLogic QHT7140 Adapter with Riser Card Figure 4-9. Assembled QHT7140 with Riser Hardware Installation for the QHT7140 Without an HTX Riser Cabling the Adapter to the InfiniBand Switch Switch Configuration and MonitoringFigure 4-10. QHT7140 Without Riser Installed in a 3U Chassis Completing the Installation Cluster Setup 5 Software InstallationTypes of Nodes in a Cluster Environment Distribution Setting Up Your EnvironmentSupported Linux Distributions Table 5-1. InfiniPath/OpenFabrics Supported Distributions and KernelsPackage Downloading and Unpacking the InfiniPath and OpenFabrics SoftwareChoosing the Appropriate Download Files Table 5-2. Available PackagesDescription Unpacking the InfiniPath tar FileTable 5-2. Available Packages Continued PackageCheck for Missing Files or RPMs Used On Installing the InfiniPath and OpenFabrics RPMsTable 5-3. InfiniPath and OpenFabrics RPMs to Use for Each Node in a ClusterIf you want to Choosing the RPMs to InstallTable 5-4. RPMS to Install Then installUsing rpm to Install InfiniPath and OpenFabrics Installed Layout Starting the InfiniPath Service InfiniPath and OpenFabrics Driver Overview Configuring the InfiniPath DriversFigure 5-1. Relationship Between InfiniPath and OpenFabrics Software Configuring the ipathether Network Interface Configuring the ibipath Driveripathether Configuration on Red Hat 3. Create or edit the following file as root # lsmod grep -q ipathether modprobe ipathether ipathether Configuration on SLES# sed ’s/\......\..../\1/’ \ sys/bus/pci/drivers/ibipath/00/guid The Globally Unique IDentifer GUID can also be returned by running OpenFabrics Drivers and Services Configuration and Startup Configuring the IPoIB Network Interface # /etc/init.d/infinipath restart Configuring and Administering the VNIC Interface2. Create the VNIC interfaces using the configuration file The following is an example of VIO hardware failover This example uses DGID, IOCGUID and IOCSTRING To restart the QLogic VNIC driver, run the following command OpenSM Using OFED SRP # echo # ibsrpdm -cStarting and Stopping the InfiniPath Software Other Configuration Changing the MTU SizeMPI over uDAPL To check the configuration state, use the command Rebuilding or Reinstalling Drivers After a Kernel Upgrade Table 5-5. LED Link and Data Indicators Rebuilding or Reinstalling Drivers if a Different Kernel is InstalledFurther Information on Configuring and Loading Drivers LED Link and Data IndicatorsIndication Adapter SettingsTable 5-5. LED Link and Data Indicators Continued LED StatesCustomer Acceptance Utility Table 5-6. ipathcheckout Options CommandMeaning Removing Software Packages Additional Installation InstructionsUninstalling InfiniPath and OpenFabrics RPMs Uninstalling OFED 1.3 SoftwareInstalling QLogic MPI in an Alternate Location Installing LustreInstalling on an Unsupported Distribution Managing and Installing Software Using Rocks Installing Rocks and InfiniPath RPMs Use the following contents skip lam -- package-lam-gnu/package post set home/install/contrib/4.2.1/x8664/RPMS Further Information on Rocks and kickstart 5-42 5 - Software Installation Additional Installation InstructionsIB0056101-00 G Node Spontaneously Reboots A Installation TroubleshootingHardware Issues BIOS SettingsMTRR Mapping and Write Combining Edit BIOS Settings to Fix MTRR IssuesIssue with Supermicro H8DCE-HTe and QHT7040 Software Installation IssuesUse the ipathmtrr Script to Fix MTRR Issues OpenFabrics Dependencies Version Number Conflict with opensm-* on RHEL5 SystemsOpenFabrics Library Dependencies Missing Kernel RPM Errors InfiniPath-Devel/*rpm InfiniPath-MPI/*rpm OpenFabrics/*rpm mpirun Installation Requires 32-bit SupportResolving Conflicts # rpm -Uvh Documentation/*rpm InfiniPath/*rpmifup on ipathether on SLES 10 Reports unknown device Lockable Memory Error on Initial Installation of InfiniPathSoftware User Guide Version Number Conflict with opensm-* on RHEL5 Systems A - Installation TroubleshootingIB0056101-00 G Description B Configuration FilesTable B-1. Configuration Files Configuration File NameDescription Table B-1. Configuration Files ContinuedSample and Template Files Configuration File NameRPM Version Numbers and Identifiers C RPM DescriptionsInfiniPath and OpenFabrics RPMs Different Nodes May Use Different RPMsRPM Name RPM OrganizationDocumentation and InfiniPath RPMs Table C-1. InfiniPath Documentation/RPMsFront End Table C-2. InfiniPath/RPMsTable C-3. InfiniPath-Devel/RPMs RPM NameTable C-6. OpenFabrics/RPMs OpenFabrics RPMsTable C-4. InfiniPath-MPI/RPMs Table C-5. OpenFabrics Documentation/RPMsRPM Name Table C-6. OpenFabrics/RPMs ContinuedComments Comments described in the InfiniBand Architecture Specification. This libraryTable C-6. OpenFabrics/RPMs Continued RPM NameComments Table C-7. OpenFabrics-Devel/RPMsTable C-6. OpenFabrics/RPMs Continued RPM NameRPM Name Table C-7. OpenFabrics-Devel/RPMs ContinuedTable C-8. OpenSM/RPMs Table C-9. Other HCAs/RPMsFront Table C-9. Other HCAs/RPMs ContinuedTable C-10. Other HCAs-Devel/RPMs Table C-11. OtherMPIs/RPMsFront Table C-11. OtherMPIs/RPMs ContinuedDevelopme RPM NameComput Table C-11. OtherMPIs/RPMs ContinuedRPM Name FrontC-12 C - RPM Descriptions OpenFabrics RPMsIB0056101-00 G Index Page Page Page VNIC, configuration 5-18 -vv verbosevverbose 5-32 -vvv vvverbose workdir=DIRIndex-6 QLogic HCA and InfiniPath→ Software Install Guide VersionIB0056101-00 G Page Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway