HP UX 11i v2 Networking Software guide

10.You must save the configuration persistently by using the copy command.

HP-IB(config mgmt-ethernet)# exit HP-IB# copy running-config startup-config

Internet Protocol over InfiniBand (IPoIB)

In order to use the Internet Protocol over InfiniBand™ (IPoIB) the same patches need to be installed on each server used for IPoIB in the HP Fabric Clustering System. For current patch requirement, see the latest HP Fabric Clustering System for InfiniBand Support Matrix on http://www.docs.hp.com.

NOTE: The nwmgr utility is a unified command, introduced in HP-UX 11i v3, intended to replace the existing lanadmin, lanscan, and linkloop commands, which are being deprecated, but are still available on HP-UX 11i v3. See nwmgr(1M) for details.

The ifconfig command provides information about the IPoIB interface, enables or disables an IPoIB interface, configuring the link to the HP Fabric Clustering System.

Checking the IPoIB Interface Status To check the current status of the IPoIB interface.

Syntax and example: ifconfig lan9000

Output Example:

lan9000: flags=842<BROADCAST,RUNNING,MULTICAST>

inet 192.32.32.255 netmask ffffff00 broadcast 192.32.32.255

Listing All IPoIB Interfaces (HP-UX 11i v3 only) To list all IPoIB interfaces.

Syntax and Example: nwmgr -S ipoib

Listing All IPoIB Interfaces (HP-UX 11i v2 and 11i v3 ) To list all IPoIB interfaces.

Syntax and Example: lanadmin -x [if_info] link_info all_if_info ] <ipoib_ppa>

Display Details of an IPoIB Interface (HP-UX 11i v3 only) To display details of a particular interface.

Syntax and Example: nwmgr[-v]-c lan9000

Enable the IPoIB Interface To enable the IPoIB interface.

Syntax: ifconfig <ipoib_interface> [address] [netmask] up

Example: ifconfig lan9000 192.32.32.255 up

There is no direct output from this command.

To confirm that the interface is UP, run the ifconfig lan9000 command again. Output Example:

lan9000: flags=843<UP,BROADCAST,RUNNING,MULTICAST>

inet 192.32.32.255 netmask ffffff00 broadcast 192.32.32.255

Managing the IPoIB Interface See the “IPoIB Administration and Management” (page 67) for additional information on the IPoIB interface.

Internet Protocol over InfiniBand (IPoIB)

49

Image 49

HP UX 11i v2 Networking Software manual Internet Protocol over InfiniBand IPoIB, Syntax and Example nwmgr -S ipoib

Contents

HP Fabric Clustering System HP-UX Administrators Guide Copyright 2004-2008 Hewlett-Packard Development Company, L.P Table of Contents Interfaces Configuration Switch Administration and Management 109 131 129 154 152155 156 223 217227 Page List of Figures HyperTerminal LoginPage Description of Access Levels Default User Names, Passwords and PrivilegesList of Tables Show ib Keyword Descriptions Show trace Command Syntax Descriptions Show logging Command Syntax DescriptionShow user Command Syntax Descriptions IP Commands Intended Audience About This DocumentNew and Changed Documentation in This Edition Publishing History Typographical Conventions What’s in This Document Related Documents Related Documents HP Encourages Your CommentsPage Understanding the Fabric Clustering System Introduction to TechnologyUnderstanding InfiniBand About the HP Fabric Clustering System Software Suite Kernel Rdma Subsystem User-Space Rdma LibraryInteraction with HyperFabric Driver About the HP Fabric Clustering System Software SuitePage Hardware Components Hardware OverviewHost Channel Adapters HP offers the following new Host Channel Adapters HCA Hardware Overview AB286C Host Channel Adapter Connector View AB286C Host Channel Adapter Side View AB286A Host Channel Adapter Connector View AB286A Host Channel Adapter Side View Figureigure Hardware Components Other Product Elements Switch Hardware Overview Preliminary Considerations Installation PlanningApplications Preliminary Considerations Site Set-up Installation PlanningApplication Availability HP Fabric Clustering System Installation Prerequisites Installing HP Fabric Clustering SystemEnter your product name Click the double arrow Installing the AH304A Host Channel Adapter Install HP Fabric Clustering System AdaptersInstalling HP Fabric Clustering System Installing the AD313A Host Channel Adapter Installing the 410533-B21 Host Channel AdapterSecure the card and reassemble the system Inserting the AD313A Host Channel Adapter Installing the AB286C Host Channel Adapter Inserting the AB286C Host Channel Adapter On-Line Addition and Replacement Operations OL Where devicename is the name assigned to the CD-ROM drive Install HP Fabric Clustering System SoftwareThis opens the Software Selection window T-25 Torx screwdrivers Second person for the installation Install HP Fabric Clustering System SwitchesRack Mount Preparation IB subsystem IB Rdma IPoIB IB device driver ibt Fixed and Sliding Rails Installing the Switch Attach Rail to Switch Remove Shipping Sleeve Remove Support Bracket if installedSecurely attach all rails to the rack Cable Routing and Bend Limits Attach Cable Guides & CablesAttach Cable Guides & Cables Attach Cables Cable Installation Minimum Bend Radius Connect Cables to Switch Switch SetupSwitch or Adapter Attach to other HP Fabric devices Enter configure to enter the global-configuration mode Setting up the SwitchSet the default gateway address. This address is an example Enable the management port Syntax and Example nwmgr -S ipoib Internet Protocol over InfiniBand IPoIBPage Supported Features ConfigurationConfiguration Parameters Supported Configurations Non-Supported FeaturesSample Configurations using the AB286A/C or AD313A HCA Configurations up to 24 End Nodes Sample Configurations using the AB286A/C or AD313A HCA Configurations with More Than 24 End Nodes 128 Node 50% non-Blocking Configuration Following is a listing of the major topics in this chapter Administration and Management Using Itutil HP-UX Host Administration and ManagementAdministration and Management Itutil Administrative Commands Summary of Itutil Command OptionsItutil Command Options Following syntax must be used with itutil command options Itutil Management Commands Syntax itutil Syntax Example itutil Output Example Syntax Example itutil -i ib0 Output Example Syntax Example itutil -s-i ib0 Output Example Syntax Example itutil -t IB Output Example Administration and Management Syntax Example itutil -r Output Example Displaying Connectivity Information Using ItutilSyntax Example itutil -c Output Example Example itutil -T Viewing the Itutil Manpage Using NetTL Syntax nettl -llog class -esubsystem Ifconfig Command IPoIB Administration and ManagementIB Tracing IPoIB Tracing Disable the IPoIB Interface To disable the IPoIB interface Lanadmin CommandsDisplaying IPoIB Interface Link-Level Information Level information for a given ipoibppa Syntax Example lanadmin -s Output Example Syntax Example lanadmin -a Output ExampleSyntax Example lanadmin -g Output Example Syntax lanadmin -x-hipoibppa Syntax Example lanadmin -x -h Lanscan Command Serviceguard and IPoIBIntroduction Using Serviceguard and IPoverIB Configuring IPoIB Interfaces for Serviceguard Clusters Switch Administration and Management Switch Administration and Management CLI Overview Using the CLIStarting a CLI Session Privilege Level Entering CLI Modes Administrator Roles Exiting CLI Modes Using Command Completion Quick Help Command Abbreviation Command-Line Editing Exiting the CLI Session Command before returning to user-execute modeSpecifying the Card/Port Key Stroke Shortcuts Ranges Card/Port pairsIndicates ports 2 through 4 on card Lists Configuring the System Hostname Advanced Switch SetupTesting Network Connectivity Enter the global-configuration mode Managing the Switch Setting User Levels and PasswordsLogging Onto the System Logging On Through the CLI Managing Through the CLI Management Methods Configuration, Image, and Log File Overview Configuration, Image, and Log Files Image Upgrade Procedure Summary Understanding the Upgrade ProcessUpgrading Image Files Set-Up the Hardware Connection Check the Image Version Enter the privileged-execute mode Copy/Download the Image Install a New Image Optional View the images by using the dir image command Show the new system -image Specify a New Boot Image Troubleshooting an Image Upgrade Reboot the SystemDeleting System Images and Image Files Viewing Configuration Files Listing Configuration, Image, and Log FilesFile Management Viewing Log Files Saving for System Reboot Saving Configuration FilesSaving the Backup Configuration Specifying the Configuration to Use at System Reboot Saving and Copying Files Arguments to the copy command are described belowExample Show the new system image Downloading Files to the System Deleting Configuration, Image, and Log FilesColon Tslog. The .cfg extension is optional Determine the configuration files in memory Deleting Configuration FilesDeleting Log Files Display the log files that are in memory Verify that you had successfully removed the log file Determine the currently installed system-imagesDeleting Image Files Managing Log Files HP Fabric Switch devices use the following log formatUnderstanding the Log Format Uploading Log Files Switching User Identity Administering the System Broadcasting Messages to Users Notifying UsersSending Messages to Individual Users Default User Names, Passwords and Privileges Understanding Usernames and PasswordsSetting or Changing a Password Creating User Accounts Adding New Users Displaying User Information Deleting a User Account User Account Administrative Commands User Account Configuration CommandsCommunity Strings Setting Administrative Roles Using DNS ServicesFollowing table displays the different access-levels Setting the System Clock Rebooting the System Setting the NTP Servers to Maintain the System ClockSetting Time Through the CLI Save your configuration Reboot the System Through the CLI 108 Diagnosing Problems Monitoring and TroubleshootingDiagnosing Problems HP Fabric Switch System Status HP Fabric Switch Cluster Connection LEDsIB Port Status LED Indicators LED Color, Behavior, and Meaning Rear System Status LED Indicator Front System Status LED Indicator Power supply/ Fan Status LED Indicator Power Supply Troubleshooting Ethernet Management Port LEDs Ethernet Port Status LED IndicatorsHP Fabric HCA Connection LEDs Bottom Top Green- over Green Off Flickering Logical Solid Indicates a HCA Connection LED Colors and MeaningsBeen Top Established None HCA is not Determining if the Switch is Faulty Determining Whether the HCA or Cable is Faulty HP-UX Host Troubleshooting Procedure Monitoring and Troubleshooting the HP-UX HostNext Steps Syntax example itutil Output example Monitoring and Troubleshooting the HP-UX Host Monitoring and Troubleshooting Syntax example itutil -c fe802c9018a08a11 ib0 Description Port failure Sample nettl Log Messages Nettl Sample Log Output Monitoring and Troubleshooting IPoIBSample IB Logs Following are examples of nettl log output PDU in Trace Sample IPoIB Logs Known Problems Linkloop CommandNetTL Health Monitoring Monitoring and Troubleshooting the SwitchIP Filter Product CLI can also be used to monitor the system About HP Fabric Events About Logging and TracingAbout Tracing Ping Troubleshooting the HP Fabric NetworkFlow Enabling Tracing Setting Trace LevelsDisabling Tracing Verify Link Speed Replacing Individual Components Replacing a Power Supply Module Physical and Environmental Specifications SpecificationsHCA Physical Specifications AB286C HCA Environmental Specifications AB286C 130 Using the Documentation Switch Command Line Interface Defaults Show CommandsRelated Commands Examples Show arp ethernet Defaults There are no defaults for this commandShow arp IB Examples To display the authentication method Show authenticationShow backplane Examples To display the InfiniBand ARP table Defaults This command has no defaults Show boot-configTable B-3 show boot-config Command Field Descriptions Show card This command has the following argumentsShow card Syntax Description Image data for internal configuration Defaults show card defaults to show card allOper status Card Table B-7 show card-inventory Command Field Descriptions Table B-6 Show card-inventory Command Syntax DescriptionsShow card-inventory Synopsis Related Commands clock Show configShow clock Table B-8 show fan Command Field Descriptions Related Commands copyShow fan Syntax show fan Show host Show ib sm configurationShow ib Table B-9 show ib Keyword Descriptions Table B-11 Show ib Command Field Descriptions Table B-10 Show ib Command Syntax DescriptionsUser-execute and privileged-execute modes InfiniBand read-only user Show ib sm multicast Table B-12 show ib sm multicast Command Syntax DescriptionsShow ib sm neighbor Arguments associated with this command are described below Table B-13 show ib sm neighbor Command Field DescriptionsShow ib sm node subnet-prefix Class-version Node guid Use with the all keywordType An unknown type Show ib sm partition Table B-17 show ib sm port Command Field Descriptions Table B-16 Show ib sm port Command Syntax DescriptionsShow ib sm port No state change Value may be1x or 12x Transmitted by this port. There is no default value Received by this port. There is no default valuePackets received by this port. There is no default value Packets transmitted by this port. There is no default value Errors and the buffers are not immediately reclaimed Local-phy-error Table B-18 Show ib sm service Command Syntax Descriptions Show ib sm service Table B-19 show ib sm switch Command Syntax Descriptions Show ib sm switchTable B-20 show ib sm switch Command Field Descriptions Life-time-value Partition enforcement is not supported by the switchPort-state-change Lid-per-port Show ib-agent channel-adapter Show ib-agent summary Table B-22 Show ib-agent summary Command Field DescriptionsUsage Guidelines form Slot System chassis slot in which the device resides Type Following example displays a summary of all the SMA nodes Show ib-agent switchAgent Lid Decimal-base LID of this port Display the attributes of a single switch Show ib-agent switch linear-frd-infoSwguid Show ib-agent switch all node-info Show ib-agent switch all mcast-info lidSwguid Guid of a specific InfiniBand switch Type, GUIDs, and capabilities Defaults This command has no defaults Show ib-agent switch port-info Show ib-agent switch all pkey-infoUsage Guidelines None Examples Node-guid Bit Guid of this node In-ib-port Show ib-agent switch sl-vl-mapOut-ib-port SL0 to VL mapping Show ib-agent switch switch-info Show interface ib Table B-30 Show interface ib Command Syntax DescriptionsSyntax is described in the table below Table B-31 Show interface ib Output Descriptions Link-trap Usage Guidelines None Show interface ib sm Show interface ib sm statistics Show interface mgmt-ib Show interface mgmt-ethernet Show ip Show interface mgmt-serial Show location Table B-33 show ip Command Syntax DescriptionsShow logging Show ntp Table B-34 show logging Command Syntax DescriptionSyntax show ntp End Related Commands ntp Show power-supplyShow running-status Usage Guidelines Examples Show sensor Show snmp Show system-services Show terminal Table B-36 show trace Command Syntax DescriptionsShow trace Show user Table B-37 Show user Command Syntax DescriptionsUsername Specify the name of a specific user Shows all users in the user database Show version Table B-38 IP Commands IP CommandsArp ib Clear ib arp-cache Default ip ip-over-ib-mtuTable B-39 Auto-negotiate Syntax Description Enter the IP address of the target host Defaults The default domain name is an empty string Defaults The default ip-over-ib-mtu isIp domain-name Ip ip-over-ib-mtu Table B-42 Command Syntax Description Defaults The default ip-over-ib-mtu unit isDefaults The default is an empty string Ip name-server-one Table B-44 Command Syntax Description Table B-43 Command Syntax DescriptionIp name-server-two Ip route Table B-45 InfiniBand Commands InfiniBand CommandsIb sm subnet-prefix Arp ib Table B-46 ib sm subnet-prefix Syntax Description Following example removes a specified subnet manager Table B-47 Acceptable PKey ValuesFollowing example creates a Partition, and adds Sweep-interval is 10 seconds Response-timeout is 2,000 microseconds Ib-agent switchIb-agent channel-adapter Syntax is described in the following table Table B-50 interface ib Command Syntax Description Config-if-ib submodeInterface ib Link-trap Defaults The default is no link-trap Commands syntax is described in the table belowDefaults The default interface name is card#/port# Name Commands stoats is described in the table below Administrative CommandsTable B-53 Shutdown Command Syntax Description Table B-54 Administrative Commands Logging Configures active log Ftp-server enable Use to enable or disable ftp-servicesConfigures a radius-server. See radius-server Reboots the chassis. See reload Table B-56 boot-config Keywords Boot-configAction Table B-55 action Keywords Table B-58 Broadcast Command Arguments Table B-57 boot-config ArgumentsBroadcast Table B-59 clock Command Argument Descriptions ConfigureCard Clock Table B-61 Copy Command Argument Descriptions Syntax Table B-60 copy Command Syntax DescriptionsSystem upon boot-up Copy Table B-62 Delete Command Argument Descriptions Arguments related to the delete command are described belowDelete Syntax delete fsfile Table B-63 Dir Command Argument Descriptions Related Commands cardTo display installed system-images and image files Dir Enable DisableSyntax disable Syntax enable Exec Ftp-server enableExit Privileged-execute modes Gateway Related Commands None Defaults The default gateway IP address isHelp History Synopsis The hostname command assigns a name to the system InstallTable B-69 hostname Command Argument Description Hostname Table B-71 interface Command Keywords Table B-70 install Command Argument DescriptionsInterface Example Interface mgmt-ethernet Interface mgmt-ib Related Commands ipSyntax ipip mask No ipip mask Table B-72 Location Syntax Descriptions Location Synopsis The logout command ends the current CLI session LoginLogging Logout Related Commands dir Related Commands exitMore Ntp Radius-server PingSyntax ping dest Table B-73 Radius-server Syntax Descriptions Reload Synopsis The reload command reboots the chassisSyntax reload Enabling/Disabling the Ethernet Management Port No snmp-server Snmp-server Table B-75 snmp-server Command Argument Descriptions Table B-74 Snmp-server Command Keyword DescriptionsCommand Modes Privilege Level Usage Guidelines Defaults Telnet access is enabled by default Defaults The default time-out interval is 15 minutes Defaults The default is 24 lines per screenTerminal length Terminal time-out Type Syntax type type Table B-76 type Command Argument Username Who Table B-77 Default User AccountsSyntax who This command has no defaults DefaultsWrite 216 Attaching through Windows HyperTerminal How to Use Windows HyperTerminalHyperTerminal Prerequisite Loading HyperTerminal How to Use Windows HyperTerminal Configuring the HyperTerminal Connection Figure C-3 Connect To Dialog Box Figure C-4 COM Port Properties Dialog Box Verifying the HyperTerminal Connection Figure C-5 HyperTerminal Login 222 223 Glossary Glossary Ietf 225 Snmp 226 Index Ib-rw, 104 setting levels, 104 unrestricted-rw227 Index CLI 229 See also HCAs hostname 231 Index See also ports Snmp About, 104 adding, 101 creating, 100 user information Changing, 104 user access levels changing235 Index