Manuals / HP / Computer Equipment / Software

HP UX 11i v2 Networking Software manual User-Space Rdma Library, Kernel Rdma Subsystem

Models: UX 11i v2 Networking Software

1 236

Page 21

User-Space RDMA Library

The User-Space RDMA Library exposes the IT-API interface and provides user-space access to the RDMA hardware. Support for HP Fabric only is provided.

HCA

The HP Fabric Host Channel Adapter (HCA) for InfiniBand™ is the RDMA-capable network interface card.

Kernel RDMA Subsystem

The Kernel RDMA Subsystem provides access to an extended IT-API for kernel applications such as IPoIB. Support for HP Fabric only is provided.

Interaction with HyperFabric Driver

The HP Fabric Clustering System driver will not co-exist with HyperFabric driver versions prior to B.11.23.01. The HyperFabric driver versions must be upgraded to version B.11.23.01 before installing the HP Fabric Clustering System driver. Failure to upgrade the HyperFabric driver to version B.11.23.01 will result in a system panic if HP Fabric Clustering System or HyperFabric commands are issued.

About the HP Fabric Clustering System Software Suite 21

Page 21

Image 21

HP UX 11i v2 Networking Software manual User-Space Rdma Library, Kernel Rdma Subsystem, Interaction with HyperFabric Driver

Contents

HP Fabric Clustering System HP-UX Administrators Guide Copyright 2004-2008 Hewlett-Packard Development Company, L.P Table of Contents Interfaces ConfigurationSwitch Administration and Management 109 131 129154 152155 156217 223227 Page List of Figures HyperTerminal LoginPage Description of Access Levels Default User Names, Passwords and PrivilegesList of Tables Show ib Keyword DescriptionsShow trace Command Syntax Descriptions Show logging Command Syntax DescriptionShow user Command Syntax Descriptions IP CommandsIntended Audience About This DocumentNew and Changed Documentation in This Edition Publishing HistoryTypographical Conventions What’s in This DocumentRelated Documents Related Documents HP Encourages Your CommentsPage Introduction to Technology Understanding the Fabric Clustering SystemUnderstanding InfiniBand About the HP Fabric Clustering System Software Suite Kernel Rdma Subsystem User-Space Rdma LibraryInteraction with HyperFabric Driver About the HP Fabric Clustering System Software SuitePage Hardware Components Hardware OverviewHost Channel Adapters HP offers the following new Host Channel Adapters HCAHardware Overview AB286C Host Channel Adapter Connector View AB286C Host Channel Adapter Side View AB286A Host Channel Adapter Connector View AB286A Host Channel Adapter Side View Figureigure Hardware Components Other Product Elements SwitchHardware Overview Preliminary Considerations Installation PlanningApplications Preliminary ConsiderationsInstallation Planning Site Set-upApplication Availability Installing HP Fabric Clustering System HP Fabric Clustering System Installation PrerequisitesEnter your product name Click the double arrow Install HP Fabric Clustering System Adapters Installing the AH304A Host Channel AdapterInstalling HP Fabric Clustering System Installing the 410533-B21 Host Channel Adapter Installing the AD313A Host Channel AdapterSecure the card and reassemble the system Inserting the AD313A Host Channel Adapter Installing the AB286C Host Channel AdapterInserting the AB286C Host Channel Adapter On-Line Addition and Replacement Operations OLInstall HP Fabric Clustering System Software Where devicename is the name assigned to the CD-ROM driveThis opens the Software Selection window T-25 Torx screwdrivers Second person for the installation Install HP Fabric Clustering System SwitchesRack Mount Preparation IB subsystem IB Rdma IPoIB IB device driver ibtFixed and Sliding Rails Installing the SwitchAttach Rail to Switch Remove Support Bracket if installed Remove Shipping SleeveSecurely attach all rails to the rack Attach Cable Guides & Cables Cable Routing and Bend LimitsAttach Cable Guides & Cables Attach Cables Cable Installation Minimum Bend RadiusConnect Cables to Switch Switch SetupSwitch or Adapter Attach to other HP Fabric devicesEnter configure to enter the global-configuration mode Setting up the SwitchSet the default gateway address. This address is an example Enable the management portSyntax and Example nwmgr -S ipoib Internet Protocol over InfiniBand IPoIBPage Configuration Supported FeaturesConfiguration Parameters Supported Configurations Non-Supported FeaturesSample Configurations using the AB286A/C or AD313A HCA Configurations up to 24 End NodesSample Configurations using the AB286A/C or AD313A HCA Configurations with More Than 24 End Nodes128 Node 50% non-Blocking Configuration Following is a listing of the major topics in this chapter Administration and ManagementHP-UX Host Administration and Management Using ItutilAdministration and Management Itutil Administrative Commands Summary of Itutil Command OptionsItutil Command Options Following syntax must be used with itutil command optionsItutil Management Commands Syntax itutil Syntax Example itutil Output Example Syntax Example itutil -i ib0 Output Example Syntax Example itutil -s-i ib0 Output Example Syntax Example itutil -t IB Output ExampleAdministration and Management Displaying Connectivity Information Using Itutil Syntax Example itutil -r Output ExampleSyntax Example itutil -c Output Example Example itutil -T Viewing the Itutil Manpage Using NetTLSyntax nettl -llog class -esubsystem Ifconfig Command IPoIB Administration and ManagementIB Tracing IPoIB TracingDisable the IPoIB Interface To disable the IPoIB interface Lanadmin CommandsDisplaying IPoIB Interface Link-Level Information Level information for a given ipoibppaSyntax Example lanadmin -a Output Example Syntax Example lanadmin -s Output ExampleSyntax Example lanadmin -g Output Example Syntax lanadmin -x-hipoibppa Syntax Example lanadmin -x -h Serviceguard and IPoIB Lanscan CommandIntroduction Using Serviceguard and IPoverIB Configuring IPoIB Interfaces for Serviceguard ClustersSwitch Administration and Management Switch Administration and ManagementCLI Overview Using the CLIStarting a CLI Session Privilege LevelEntering CLI Modes Administrator RolesExiting CLI Modes Using Command CompletionQuick Help Command AbbreviationCommand-Line Editing Exiting the CLI Session Command before returning to user-execute modeSpecifying the Card/Port Key Stroke ShortcutsRanges Card/Port pairsIndicates ports 2 through 4 on card ListsConfiguring the System Hostname Advanced Switch SetupTesting Network Connectivity Enter the global-configuration modeManaging the Switch Setting User Levels and PasswordsLogging Onto the System Logging On Through the CLIManaging Through the CLI Management MethodsConfiguration, Image, and Log File Overview Configuration, Image, and Log FilesImage Upgrade Procedure Summary Understanding the Upgrade ProcessUpgrading Image Files Set-Up the Hardware ConnectionCheck the Image Version Enter the privileged-execute modeCopy/Download the Image Install a New Image Optional View the images by using the dir image commandShow the new system -image Specify a New Boot ImageReboot the System Troubleshooting an Image UpgradeDeleting System Images and Image Files Viewing Configuration Files Listing Configuration, Image, and Log FilesFile Management Viewing Log FilesSaving for System Reboot Saving Configuration FilesSaving the Backup Configuration Specifying the Configuration to Use at System RebootSaving and Copying Files Arguments to the copy command are described belowExample Show the new system imageDownloading Files to the System Deleting Configuration, Image, and Log FilesColon Tslog. The .cfg extension is optionalDetermine the configuration files in memory Deleting Configuration FilesDeleting Log Files Display the log files that are in memoryDetermine the currently installed system-images Verify that you had successfully removed the log fileDeleting Image Files Managing Log Files HP Fabric Switch devices use the following log formatUnderstanding the Log Format Uploading Log FilesSwitching User Identity Administering the SystemNotifying Users Broadcasting Messages to UsersSending Messages to Individual Users Default User Names, Passwords and Privileges Understanding Usernames and PasswordsSetting or Changing a Password Creating User AccountsAdding New Users Displaying User InformationDeleting a User Account User Account Configuration Commands User Account Administrative CommandsCommunity Strings Using DNS Services Setting Administrative RolesFollowing table displays the different access-levels Setting the System Clock Rebooting the System Setting the NTP Servers to Maintain the System ClockSetting Time Through the CLI Save your configurationReboot the System Through the CLI 108 Monitoring and Troubleshooting Diagnosing ProblemsDiagnosing Problems HP Fabric Switch System Status HP Fabric Switch Cluster Connection LEDsIB Port Status LED Indicators LED Color, Behavior, and MeaningRear System Status LED Indicator Front System Status LED IndicatorPower supply/ Fan Status LED Indicator Power Supply TroubleshootingEthernet Management Port LEDs Ethernet Port Status LED IndicatorsHP Fabric HCA Connection LEDs Bottom Top Green- over Green Off FlickeringHCA Connection LED Colors and Meanings Logical Solid Indicates aBeen Top Established None HCA is not Determining if the Switch is Faulty Determining Whether the HCA or Cable is FaultyMonitoring and Troubleshooting the HP-UX Host HP-UX Host Troubleshooting ProcedureNext Steps Syntax example itutil Output example Monitoring and Troubleshooting the HP-UX HostMonitoring and Troubleshooting Syntax example itutil -c fe802c9018a08a11 ib0 Description Port failure Sample nettl Log MessagesNettl Sample Log Output Monitoring and Troubleshooting IPoIBSample IB Logs Following are examples of nettl log outputPDU in Trace Sample IPoIB LogsLinkloop Command Known ProblemsNetTL Health Monitoring Monitoring and Troubleshooting the SwitchIP Filter Product CLI can also be used to monitor the systemAbout Logging and Tracing About HP Fabric EventsAbout Tracing Troubleshooting the HP Fabric Network PingFlow Enabling Tracing Setting Trace LevelsDisabling Tracing Verify Link SpeedReplacing Individual Components Replacing a Power Supply ModulePhysical and Environmental Specifications SpecificationsHCA Physical Specifications AB286C HCA Environmental Specifications AB286C130 Using the Documentation Switch Command Line InterfaceDefaults Show CommandsRelated Commands ExamplesDefaults There are no defaults for this command Show arp ethernetShow arp IB Examples To display the authentication method Show authenticationShow backplane Examples To display the InfiniBand ARP tableShow boot-config Defaults This command has no defaultsTable B-3 show boot-config Command Field Descriptions This command has the following arguments Show cardShow card Syntax Description Image data for internal configuration Defaults show card defaults to show card allOper status CardTable B-7 show card-inventory Command Field Descriptions Table B-6 Show card-inventory Command Syntax DescriptionsShow card-inventory SynopsisShow config Related Commands clockShow clock Table B-8 show fan Command Field Descriptions Related Commands copyShow fan Syntax show fanShow host Show ib sm configurationShow ib Table B-9 show ib Keyword DescriptionsTable B-11 Show ib Command Field Descriptions Table B-10 Show ib Command Syntax DescriptionsUser-execute and privileged-execute modes InfiniBand read-only userTable B-12 show ib sm multicast Command Syntax Descriptions Show ib sm multicastShow ib sm neighbor Table B-13 show ib sm neighbor Command Field Descriptions Arguments associated with this command are described belowShow ib sm node subnet-prefix Class-version Node guid Use with the all keywordType An unknown typeShow ib sm partition Table B-16 Show ib sm port Command Syntax Descriptions Table B-17 show ib sm port Command Field DescriptionsShow ib sm port No state change Value may be1x or 12xTransmitted by this port. There is no default value Received by this port. There is no default valuePackets received by this port. There is no default value Packets transmitted by this port. There is no default valueErrors and the buffers are not immediately reclaimed Local-phy-errorTable B-18 Show ib sm service Command Syntax Descriptions Show ib sm serviceShow ib sm switch Table B-19 show ib sm switch Command Syntax DescriptionsTable B-20 show ib sm switch Command Field Descriptions Life-time-value Partition enforcement is not supported by the switchPort-state-change Lid-per-portShow ib-agent channel-adapter Show ib-agent summary Table B-22 Show ib-agent summary Command Field DescriptionsUsage Guidelines form Slot System chassis slot in which the device resides TypeFollowing example displays a summary of all the SMA nodes Show ib-agent switchAgent Lid Decimal-base LID of this portShow ib-agent switch linear-frd-info Display the attributes of a single switchSwguid Show ib-agent switch all node-info Show ib-agent switch all mcast-info lidSwguid Guid of a specific InfiniBand switch Type, GUIDs, and capabilitiesDefaults This command has no defaults Show ib-agent switch all pkey-info Show ib-agent switch port-infoUsage Guidelines None Examples Node-guid Bit Guid of this node In-ib-port Show ib-agent switch sl-vl-mapOut-ib-port SL0 to VL mappingShow ib-agent switch switch-info Show interface ib Table B-30 Show interface ib Command Syntax DescriptionsSyntax is described in the table below Table B-31 Show interface ib Output DescriptionsLink-trap Usage Guidelines None Show interface ib smShow interface ib sm statistics Show interface mgmt-ib Show interface mgmt-ethernetShow ip Show interface mgmt-serialTable B-33 show ip Command Syntax Descriptions Show locationShow logging Show ntp Table B-34 show logging Command Syntax DescriptionSyntax show ntp EndRelated Commands ntp Show power-supplyShow running-status Usage Guidelines ExamplesShow sensor Show snmp Show system-servicesTable B-36 show trace Command Syntax Descriptions Show terminalShow trace Show user Table B-37 Show user Command Syntax DescriptionsUsername Specify the name of a specific user Shows all users in the user databaseShow version IP Commands Table B-38 IP CommandsArp ib Clear ib arp-cache Default ip ip-over-ib-mtuTable B-39 Auto-negotiate Syntax Description Enter the IP address of the target hostDefaults The default domain name is an empty string Defaults The default ip-over-ib-mtu isIp domain-name Ip ip-over-ib-mtuTable B-42 Command Syntax Description Defaults The default ip-over-ib-mtu unit isDefaults The default is an empty string Ip name-server-oneTable B-44 Command Syntax Description Table B-43 Command Syntax DescriptionIp name-server-two Ip routeTable B-45 InfiniBand Commands InfiniBand CommandsIb sm subnet-prefix Arp ibTable B-46 ib sm subnet-prefix Syntax Description Following example removes a specified subnet manager Table B-47 Acceptable PKey ValuesFollowing example creates a Partition, and adds Sweep-interval is 10 secondsResponse-timeout is 2,000 microseconds Ib-agent switchIb-agent channel-adapter Syntax is described in the following tableTable B-50 interface ib Command Syntax Description Config-if-ib submodeInterface ib Link-trapDefaults The default is no link-trap Commands syntax is described in the table belowDefaults The default interface name is card#/port# NameCommands stoats is described in the table below Administrative CommandsTable B-53 Shutdown Command Syntax Description Table B-54 Administrative CommandsLogging Configures active log Ftp-server enable Use to enable or disable ftp-servicesConfigures a radius-server. See radius-server Reboots the chassis. See reloadTable B-56 boot-config Keywords Boot-configAction Table B-55 action KeywordsTable B-57 boot-config Arguments Table B-58 Broadcast Command ArgumentsBroadcast Table B-59 clock Command Argument Descriptions ConfigureCard ClockTable B-61 Copy Command Argument Descriptions Syntax Table B-60 copy Command Syntax DescriptionsSystem upon boot-up CopyTable B-62 Delete Command Argument Descriptions Arguments related to the delete command are described belowDelete Syntax delete fsfileTable B-63 Dir Command Argument Descriptions Related Commands cardTo display installed system-images and image files DirEnable DisableSyntax disable Syntax enableFtp-server enable ExecExit Privileged-execute modes GatewayRelated Commands None Defaults The default gateway IP address isHelp HistorySynopsis The hostname command assigns a name to the system InstallTable B-69 hostname Command Argument Description HostnameTable B-70 install Command Argument Descriptions Table B-71 interface Command KeywordsInterface Example Interface mgmt-ethernetInterface mgmt-ib Related Commands ipSyntax ipip mask No ipip maskTable B-72 Location Syntax Descriptions LocationSynopsis The logout command ends the current CLI session LoginLogging LogoutRelated Commands dir Related Commands exitMore NtpRadius-server PingSyntax ping dest Table B-73 Radius-server Syntax DescriptionsReload Synopsis The reload command reboots the chassisSyntax reload Enabling/Disabling the Ethernet Management PortNo snmp-server Snmp-serverTable B-75 snmp-server Command Argument Descriptions Table B-74 Snmp-server Command Keyword DescriptionsCommand Modes Privilege Level Usage Guidelines Defaults Telnet access is enabled by defaultDefaults The default time-out interval is 15 minutes Defaults The default is 24 lines per screenTerminal length Terminal time-outType Syntax type type Table B-76 type Command ArgumentUsername Table B-77 Default User Accounts WhoSyntax who Defaults This command has no defaultsWrite 216 Attaching through Windows HyperTerminal How to Use Windows HyperTerminalHyperTerminal Prerequisite Loading HyperTerminalHow to Use Windows HyperTerminal Configuring the HyperTerminal ConnectionFigure C-3 Connect To Dialog Box Figure C-4 COM Port Properties Dialog Box Verifying the HyperTerminal ConnectionFigure C-5 HyperTerminal Login 222 223 GlossaryGlossary Ietf225 Snmp226 Ib-rw, 104 setting levels, 104 unrestricted-rw Index227 Index CLI229 See also HCAs hostname 231 Index See also ports Snmp Changing, 104 user access levels changing About, 104 adding, 101 creating, 100 user information235 Index