Manuals / Q-Logic / Computer Equipment / Computer Drive

Q-Logic IB0056101-00 G manual A - Installation Troubleshooting

Models: IB0056101-00 G

1 114

Download 114 pages 8.55 Kb

Page 92

Manual background

A – Installation Troubleshooting

Version Number Conflict with opensm-*on RHEL5 Systems

Notes

S

A-8	IB0056101-00 G

Image 92

Q-Logic IB0056101-00 G manual A - Installation Troubleshooting, Version Number Conflict with opensm-* on RHEL5 Systems

Contents

QLogic HCA and InfiniPath→ Software Install Guide VersionSections Affected Document Revision HistoryChanges Feature Overview Step-by-Step Installation ChecklistHardware Installation IntroductionSoftware Installation Installation Troubleshooting Configuration Files RPM DescriptionsInfiniPath and OpenFabrics RPMs Different Nodes May Use Different RPMsList of Figures List of TablesPage PageIB0056101-00 G QLogic HCA and InfiniPath→ Software Install Guide VersionPage How this Guide is Organized 1 IntroductionWho Should Read this Guide Overview Interoperability Conventions Used in this GuideTable 1-1. Typographical Conventions Convention„ The QLogic HCA and InfiniPath Software Install Guide DocumentationTable 1-1. Typographical Conventions Continued „ The QLogic HCA and InfiniPath Software User GuideContact Information Support Headquarterssupport.qlogic.com North American Region1 - Introduction Contact Information IB0056101-00 G2 Feature Overview What’s New in this ReleaseTable 2-1. QLogic Adapter Model Numbers DescriptionNew Features Table 2-1. QLogic Adapter Model Numbers ContinuedQLogic Model DescriptionSupported Distributions and Kernels Table 2-2. InfiniPath/OpenFabrics Supported Distributions and KernelsDistribution InfiniPath/OpenFabrics SupportedCompiler Support Software ComponentsTable 2-2. InfiniPath/OpenFabrics Supported Distributions and Kernels ContinuedIncluded components are „ InfiniPath driver Page 3 Step-by-Step Installation Checklist Hardware InstallationSoftware Installation Installing Software Using Rocks” on page10. Optimize your adapter for the best performance. See “Adapter Settings” on page 5-30. Also see the Performance and Management Tips section in the QLogic HCA and InfiniPath Software User Guide 3 - Step-by-Step Installation Checklist Software Installation IB0056101-00 G4 Hardware Installation Hardware Installation RequirementsHardware Table 4-1. Adapter Models and Related PlatformsForm Factors Table 4-1. Adapter Models and Related Platforms ContinuedQLogic PlatformCabling and Switches Table 4-2. QLogic InfiniBand CablesProduct Number DescriptionOptical Fibre Option Configuring the BIOSFor more details, see “BIOS Settings” on page A-1 Safety with Electricity Verify the Package ContentsList of the Package Contents Unpacking InformationPage Figure 4-1. QLogic QLE7280 with IBA7220 ASIC Figure 4-2. QLogic QLE7140 Card with Riser, Top ViewUnpacking the QLogic Adapter ViewDual Adapter Installation Installation StepsFollow the instructions in “Installation Steps” on page Hardware InstallationFigure 4-4. PCIe Slot in a Typical Motherboard Figure 4-5. QLogic PCIe HCA Assembly with Riser Card Hardware Installation for QHT7140 with HTX Riser Figure 4-6. Assembled PCIe HCA with RiserFigure 4-7. HTX Slot Figure 4-8. QLogic QHT7140 Adapter with Riser Card Figure 4-9. Assembled QHT7140 with Riser Hardware Installation for the QHT7140 Without an HTX Riser Figure 4-10. QHT7140 Without Riser Installed in a 3U Chassis Switch Configuration and MonitoringCabling the Adapter to the InfiniBand Switch Completing the Installation Types of Nodes in a Cluster Environment 5 Software InstallationCluster Setup Setting Up Your Environment Supported Linux DistributionsTable 5-1. InfiniPath/OpenFabrics Supported Distributions and Kernels DistributionDownloading and Unpacking the InfiniPath and OpenFabrics Software Choosing the Appropriate Download FilesTable 5-2. Available Packages PackageUnpacking the InfiniPath tar File Table 5-2. Available Packages ContinuedPackage DescriptionCheck for Missing Files or RPMs Installing the InfiniPath and OpenFabrics RPMs Table 5-3. InfiniPath and OpenFabrics RPMs to Use for Each Node in aCluster Used OnChoosing the RPMs to Install Table 5-4. RPMS to InstallThen install If you want toUsing rpm to Install InfiniPath and OpenFabrics Installed Layout Starting the InfiniPath Service Figure 5-1. Relationship Between InfiniPath and OpenFabrics Software Configuring the InfiniPath DriversInfiniPath and OpenFabrics Driver Overview ipathether Configuration on Red Hat Configuring the ibipath DriverConfiguring the ipathether Network Interface 3. Create or edit the following file as root # sed ’s/\......\..../\1/’ \ sys/bus/pci/drivers/ibipath/00/guid ipathether Configuration on SLES# lsmod grep -q ipathether modprobe ipathether The Globally Unique IDentifer GUID can also be returned by running OpenFabrics Drivers and Services Configuration and Startup Configuring the IPoIB Network Interface Configuring and Administering the VNIC Interface # /etc/init.d/infinipath restart2. Create the VNIC interfaces using the configuration file The following is an example of VIO hardware failover This example uses DGID, IOCGUID and IOCSTRING To restart the QLogic VNIC driver, run the following command OpenSM Using OFED SRP # ibsrpdm -c # echoMPI over uDAPL Other Configuration Changing the MTU SizeStarting and Stopping the InfiniPath Software To check the configuration state, use the command Rebuilding or Reinstalling Drivers After a Kernel Upgrade Rebuilding or Reinstalling Drivers if a Different Kernel is Installed Further Information on Configuring and Loading DriversLED Link and Data Indicators Table 5-5. LED Link and Data IndicatorsAdapter Settings Table 5-5. LED Link and Data Indicators ContinuedLED States IndicationCustomer Acceptance Utility Meaning CommandTable 5-6. ipathcheckout Options Additional Installation Instructions Uninstalling InfiniPath and OpenFabrics RPMsUninstalling OFED 1.3 Software Removing Software PackagesInstalling Lustre Installing QLogic MPI in an Alternate LocationInstalling on an Unsupported Distribution Managing and Installing Software Using Rocks Installing Rocks and InfiniPath RPMs Use the following contents skip lam -- package-lam-gnu/package post set home/install/contrib/4.2.1/x8664/RPMS Further Information on Rocks and kickstart IB0056101-00 G 5 - Software Installation Additional Installation Instructions5-42 A Installation Troubleshooting Hardware IssuesBIOS Settings Node Spontaneously RebootsEdit BIOS Settings to Fix MTRR Issues MTRR Mapping and Write CombiningUse the ipathmtrr Script to Fix MTRR Issues Software Installation IssuesIssue with Supermicro H8DCE-HTe and QHT7040 OpenFabrics Library Dependencies Version Number Conflict with opensm-* on RHEL5 SystemsOpenFabrics Dependencies Missing Kernel RPM Errors mpirun Installation Requires 32-bit Support Resolving Conflicts# rpm -Uvh Documentation/*rpm InfiniPath/*rpm InfiniPath-Devel/*rpm InfiniPath-MPI/*rpm OpenFabrics/*rpmSoftware User Guide Lockable Memory Error on Initial Installation of InfiniPathifup on ipathether on SLES 10 Reports unknown device IB0056101-00 G A - Installation TroubleshootingVersion Number Conflict with opensm-* on RHEL5 Systems B Configuration Files Table B-1. Configuration FilesConfiguration File Name DescriptionTable B-1. Configuration Files Continued Sample and Template FilesConfiguration File Name DescriptionC RPM Descriptions InfiniPath and OpenFabrics RPMsDifferent Nodes May Use Different RPMs RPM Version Numbers and IdentifiersRPM Organization Documentation and InfiniPath RPMsTable C-1. InfiniPath Documentation/RPMs RPM NameTable C-2. InfiniPath/RPMs Table C-3. InfiniPath-Devel/RPMsRPM Name Front EndOpenFabrics RPMs Table C-4. InfiniPath-MPI/RPMsTable C-5. OpenFabrics Documentation/RPMs Table C-6. OpenFabrics/RPMsComments Table C-6. OpenFabrics/RPMs ContinuedRPM Name described in the InfiniBand Architecture Specification. This library Table C-6. OpenFabrics/RPMs ContinuedRPM Name CommentsTable C-7. OpenFabrics-Devel/RPMs Table C-6. OpenFabrics/RPMs ContinuedRPM Name CommentsTable C-7. OpenFabrics-Devel/RPMs Continued Table C-8. OpenSM/RPMsTable C-9. Other HCAs/RPMs RPM NameTable C-9. Other HCAs/RPMs Continued Table C-10. Other HCAs-Devel/RPMsTable C-11. OtherMPIs/RPMs FrontTable C-11. OtherMPIs/RPMs Continued DevelopmeRPM Name FrontTable C-11. OtherMPIs/RPMs Continued RPM NameFront ComputIB0056101-00 G C - RPM Descriptions OpenFabrics RPMsC-12 Index Page Page Page verbose vverbose 5-32 -vvv vvverboseworkdir=DIR VNIC, configuration 5-18 -vvIB0056101-00 G QLogic HCA and InfiniPath→ Software Install Guide VersionIndex-6 Page Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway