IPoIB Tracing, Nwmgr Utility | HP UX 11i v2 Networking Software

<4002> lan9001 has a new link attached to it with port number 2, P_key value 0xffff and HCA ib0

IB Tracing

Enabling Packet Tracing for IB Description: This command enables packet tracing of specified packet type using the NetTL tracing facility.

Syntax: nettl -tn all -e[subsystem] -f[trace_name]

Syntax Example: nettl -tn all -e IB -f ib.TRC000

Disabling Packet Tracing for IB Description: This command disables packet tracing for IPoIB traffic.

Syntax: nettl -tf-e [subsystem]

Syntax Example: nettl -tf-e IB

IPoIB Tracing

Enabling Packet Tracing for IPoIB Description: This command enables packet tracing of specified packet type using the NetTL tracing facility.

Syntax: nettl -tn all -e[subsystem] -f[trace_name]

Syntax Example: nettl -tn all -e IPOIB -f ipoib.TRC000

Disabling Packet Tracing for IPoIB Description: This command disables packet tracing for IPoIB traffic.

Syntax: nettl -tf-e [subsystem]

Syntax Example: nettl -tf -e IPOIB

IPoIB Administration and Management

IPoIB is managed using the following tools:

•“nwmgr utility” nwmgr Utility

•“ifconfig Command”

•“lanadmin Commands”

•“lanscan Command”

NOTE: IPoIB performance has been enhanced for this release of the IB4X-00 driver (version B.11.23.09). See the IB4X-00 Driver for InfiniBand Release Notes for more information.

nwmgr Utility

The nwmgr utility is a unified command, introduced in HP-UX 11i v3, intended to replace the existing lanadmin, lanscan, and linkloop commands, which are being deprecated, but are still available on HP-UX 11i v3. See nwmgr(1M) for more details.

Listing All IPoIB Interfaces (HP-UX 11i v3 only) To list all IPoIB interfaces.

Syntax and Example: nwmgr -S ipoib

Display Details of an IPoIB Interface (HP-UX 11i v3 only) To display details of a particular interface.

Syntax and Example: nwmgr[-v]-c lan9000

ifconfig Command

The ifconfig command provides information about the IPoIB interface, enables or disables an IPoIB interface, configuring the link to the HP Fabric Clustering System.

HP-UX Host Administration and Management 67

Image 67

HP UX 11i v2 Networking Software IPoIB Administration and Management, IPoIB Tracing, Nwmgr Utility, Ifconfig Command

Contents

HP Fabric Clustering System HP-UX Administrators Guide Copyright 2004-2008 Hewlett-Packard Development Company, L.P Table of Contents Interfaces Configuration Switch Administration and Management 109 131 129 156 152154 155 223 217227 Page List of Figures HyperTerminal LoginPage Show ib Keyword Descriptions Default User Names, Passwords and PrivilegesDescription of Access Levels List of Tables IP Commands Show logging Command Syntax DescriptionShow trace Command Syntax Descriptions Show user Command Syntax Descriptions Publishing History About This DocumentIntended Audience New and Changed Documentation in This Edition Typographical Conventions What’s in This Document Related Documents Related Documents HP Encourages Your CommentsPage Understanding the Fabric Clustering System Introduction to TechnologyUnderstanding InfiniBand About the HP Fabric Clustering System Software Suite About the HP Fabric Clustering System Software Suite User-Space Rdma LibraryKernel Rdma Subsystem Interaction with HyperFabric DriverPage HP offers the following new Host Channel Adapters HCA Hardware OverviewHardware Components Host Channel Adapters Hardware Overview AB286C Host Channel Adapter Connector View AB286C Host Channel Adapter Side View AB286A Host Channel Adapter Connector View AB286A Host Channel Adapter Side View Figureigure Hardware Components Other Product Elements Switch Hardware Overview Preliminary Considerations Installation PlanningPreliminary Considerations Applications Site Set-up Installation PlanningApplication Availability HP Fabric Clustering System Installation Prerequisites Installing HP Fabric Clustering SystemEnter your product name Click the double arrow Installing the AH304A Host Channel Adapter Install HP Fabric Clustering System AdaptersInstalling HP Fabric Clustering System Installing the AD313A Host Channel Adapter Installing the 410533-B21 Host Channel AdapterSecure the card and reassemble the system Inserting the AD313A Host Channel Adapter Installing the AB286C Host Channel Adapter Inserting the AB286C Host Channel Adapter On-Line Addition and Replacement Operations OL Where devicename is the name assigned to the CD-ROM drive Install HP Fabric Clustering System SoftwareThis opens the Software Selection window IB subsystem IB Rdma IPoIB IB device driver ibt Install HP Fabric Clustering System SwitchesT-25 Torx screwdrivers Second person for the installation Rack Mount Preparation Fixed and Sliding Rails Installing the Switch Attach Rail to Switch Remove Shipping Sleeve Remove Support Bracket if installedSecurely attach all rails to the rack Cable Routing and Bend Limits Attach Cable Guides & CablesAttach Cable Guides & Cables Attach Cables Cable Installation Minimum Bend Radius Attach to other HP Fabric devices Switch SetupConnect Cables to Switch Switch or Adapter Enable the management port Setting up the SwitchEnter configure to enter the global-configuration mode Set the default gateway address. This address is an example Syntax and Example nwmgr -S ipoib Internet Protocol over InfiniBand IPoIBPage Supported Features ConfigurationConfiguration Parameters Configurations up to 24 End Nodes Non-Supported FeaturesSupported Configurations Sample Configurations using the AB286A/C or AD313A HCA Sample Configurations using the AB286A/C or AD313A HCA Configurations with More Than 24 End Nodes 128 Node 50% non-Blocking Configuration Following is a listing of the major topics in this chapter Administration and Management Using Itutil HP-UX Host Administration and ManagementAdministration and Management Following syntax must be used with itutil command options Summary of Itutil Command OptionsItutil Administrative Commands Itutil Command Options Itutil Management Commands Syntax itutil Syntax Example itutil Output Example Syntax Example itutil -i ib0 Output Example Syntax Example itutil -s-i ib0 Output Example Syntax Example itutil -t IB Output Example Administration and Management Syntax Example itutil -r Output Example Displaying Connectivity Information Using ItutilSyntax Example itutil -c Output Example Example itutil -T Viewing the Itutil Manpage Using NetTL Syntax nettl -llog class -esubsystem IPoIB Tracing IPoIB Administration and ManagementIfconfig Command IB Tracing Level information for a given ipoibppa Lanadmin CommandsDisable the IPoIB Interface To disable the IPoIB interface Displaying IPoIB Interface Link-Level Information Syntax Example lanadmin -s Output Example Syntax Example lanadmin -a Output ExampleSyntax Example lanadmin -g Output Example Syntax lanadmin -x-hipoibppa Syntax Example lanadmin -x -h Lanscan Command Serviceguard and IPoIBIntroduction Using Serviceguard and IPoverIB Configuring IPoIB Interfaces for Serviceguard Clusters Switch Administration and Management Switch Administration and Management Privilege Level Using the CLICLI Overview Starting a CLI Session Entering CLI Modes Administrator Roles Exiting CLI Modes Using Command Completion Quick Help Command Abbreviation Command-Line Editing Key Stroke Shortcuts Command before returning to user-execute modeExiting the CLI Session Specifying the Card/Port Lists Card/Port pairsRanges Indicates ports 2 through 4 on card Enter the global-configuration mode Advanced Switch SetupConfiguring the System Hostname Testing Network Connectivity Logging On Through the CLI Setting User Levels and PasswordsManaging the Switch Logging Onto the System Managing Through the CLI Management Methods Configuration, Image, and Log File Overview Configuration, Image, and Log Files Set-Up the Hardware Connection Understanding the Upgrade ProcessImage Upgrade Procedure Summary Upgrading Image Files Check the Image Version Enter the privileged-execute mode Copy/Download the Image Install a New Image Optional View the images by using the dir image command Show the new system -image Specify a New Boot Image Troubleshooting an Image Upgrade Reboot the SystemDeleting System Images and Image Files Viewing Log Files Listing Configuration, Image, and Log FilesViewing Configuration Files File Management Specifying the Configuration to Use at System Reboot Saving Configuration FilesSaving for System Reboot Saving the Backup Configuration Show the new system image Arguments to the copy command are described belowSaving and Copying Files Example Tslog. The .cfg extension is optional Deleting Configuration, Image, and Log FilesDownloading Files to the System Colon Display the log files that are in memory Deleting Configuration FilesDetermine the configuration files in memory Deleting Log Files Verify that you had successfully removed the log file Determine the currently installed system-imagesDeleting Image Files Uploading Log Files HP Fabric Switch devices use the following log formatManaging Log Files Understanding the Log Format Switching User Identity Administering the System Broadcasting Messages to Users Notifying UsersSending Messages to Individual Users Creating User Accounts Understanding Usernames and PasswordsDefault User Names, Passwords and Privileges Setting or Changing a Password Adding New Users Displaying User Information Deleting a User Account User Account Administrative Commands User Account Configuration CommandsCommunity Strings Setting Administrative Roles Using DNS ServicesFollowing table displays the different access-levels Setting the System Clock Save your configuration Setting the NTP Servers to Maintain the System ClockRebooting the System Setting Time Through the CLI Reboot the System Through the CLI 108 Diagnosing Problems Monitoring and TroubleshootingDiagnosing Problems LED Color, Behavior, and Meaning HP Fabric Switch Cluster Connection LEDsHP Fabric Switch System Status IB Port Status LED Indicators Rear System Status LED Indicator Front System Status LED Indicator Power supply/ Fan Status LED Indicator Power Supply Troubleshooting Bottom Top Green- over Green Off Flickering Ethernet Port Status LED IndicatorsEthernet Management Port LEDs HP Fabric HCA Connection LEDs Logical Solid Indicates a HCA Connection LED Colors and MeaningsBeen Top Established None HCA is not Determining if the Switch is Faulty Determining Whether the HCA or Cable is Faulty HP-UX Host Troubleshooting Procedure Monitoring and Troubleshooting the HP-UX HostNext Steps Syntax example itutil Output example Monitoring and Troubleshooting the HP-UX Host Monitoring and Troubleshooting Syntax example itutil -c fe802c9018a08a11 ib0 Description Port failure Sample nettl Log Messages Following are examples of nettl log output Monitoring and Troubleshooting IPoIBNettl Sample Log Output Sample IB Logs PDU in Trace Sample IPoIB Logs Known Problems Linkloop CommandNetTL CLI can also be used to monitor the system Monitoring and Troubleshooting the SwitchHealth Monitoring IP Filter Product About HP Fabric Events About Logging and TracingAbout Tracing Ping Troubleshooting the HP Fabric NetworkFlow Verify Link Speed Setting Trace LevelsEnabling Tracing Disabling Tracing Replacing Individual Components Replacing a Power Supply Module HCA Environmental Specifications AB286C SpecificationsPhysical and Environmental Specifications HCA Physical Specifications AB286C 130 Using the Documentation Switch Command Line Interface Examples Show CommandsDefaults Related Commands Show arp ethernet Defaults There are no defaults for this commandShow arp IB Examples To display the InfiniBand ARP table Show authenticationExamples To display the authentication method Show backplane Defaults This command has no defaults Show boot-configTable B-3 show boot-config Command Field Descriptions Show card This command has the following argumentsShow card Syntax Description Card Defaults show card defaults to show card allImage data for internal configuration Oper status Synopsis Table B-6 Show card-inventory Command Syntax DescriptionsTable B-7 show card-inventory Command Field Descriptions Show card-inventory Related Commands clock Show configShow clock Syntax show fan Related Commands copyTable B-8 show fan Command Field Descriptions Show fan Table B-9 show ib Keyword Descriptions Show ib sm configurationShow host Show ib InfiniBand read-only user Table B-10 Show ib Command Syntax DescriptionsTable B-11 Show ib Command Field Descriptions User-execute and privileged-execute modes Show ib sm multicast Table B-12 show ib sm multicast Command Syntax DescriptionsShow ib sm neighbor Arguments associated with this command are described below Table B-13 show ib sm neighbor Command Field DescriptionsShow ib sm node subnet-prefix An unknown type Node guid Use with the all keywordClass-version Type Show ib sm partition Table B-17 show ib sm port Command Field Descriptions Table B-16 Show ib sm port Command Syntax DescriptionsShow ib sm port 12x Value may beNo state change 1x or Packets transmitted by this port. There is no default value Received by this port. There is no default valueTransmitted by this port. There is no default value Packets received by this port. There is no default value Errors and the buffers are not immediately reclaimed Local-phy-error Table B-18 Show ib sm service Command Syntax Descriptions Show ib sm service Table B-19 show ib sm switch Command Syntax Descriptions Show ib sm switchTable B-20 show ib sm switch Command Field Descriptions Lid-per-port Partition enforcement is not supported by the switchLife-time-value Port-state-change Show ib-agent channel-adapter Slot System chassis slot in which the device resides Type Table B-22 Show ib-agent summary Command Field DescriptionsShow ib-agent summary Usage Guidelines form Lid Decimal-base LID of this port Show ib-agent switchFollowing example displays a summary of all the SMA nodes Agent Display the attributes of a single switch Show ib-agent switch linear-frd-infoSwguid Type, GUIDs, and capabilities Show ib-agent switch all mcast-info lidShow ib-agent switch all node-info Swguid Guid of a specific InfiniBand switch Defaults This command has no defaults Show ib-agent switch port-info Show ib-agent switch all pkey-infoUsage Guidelines None Examples SL0 to VL mapping Show ib-agent switch sl-vl-mapNode-guid Bit Guid of this node In-ib-port Out-ib-port Show ib-agent switch switch-info Table B-31 Show interface ib Output Descriptions Table B-30 Show interface ib Command Syntax DescriptionsShow interface ib Syntax is described in the table below Link-trap Usage Guidelines None Show interface ib sm Show interface ib sm statistics Show interface mgmt-ib Show interface mgmt-ethernet Show ip Show interface mgmt-serial Show location Table B-33 show ip Command Syntax DescriptionsShow logging End Table B-34 show logging Command Syntax DescriptionShow ntp Syntax show ntp Usage Guidelines Examples Show power-supplyRelated Commands ntp Show running-status Show sensor Show snmp Show system-services Show terminal Table B-36 show trace Command Syntax DescriptionsShow trace Shows all users in the user database Table B-37 Show user Command Syntax DescriptionsShow user Username Specify the name of a specific user Show version Table B-38 IP Commands IP CommandsArp ib Enter the IP address of the target host Default ip ip-over-ib-mtuClear ib arp-cache Table B-39 Auto-negotiate Syntax Description Ip ip-over-ib-mtu Defaults The default ip-over-ib-mtu isDefaults The default domain name is an empty string Ip domain-name Ip name-server-one Defaults The default ip-over-ib-mtu unit isTable B-42 Command Syntax Description Defaults The default is an empty string Ip route Table B-43 Command Syntax DescriptionTable B-44 Command Syntax Description Ip name-server-two Arp ib InfiniBand CommandsTable B-45 InfiniBand Commands Ib sm subnet-prefix Table B-46 ib sm subnet-prefix Syntax Description Sweep-interval is 10 seconds Table B-47 Acceptable PKey ValuesFollowing example removes a specified subnet manager Following example creates a Partition, and adds Syntax is described in the following table Ib-agent switchResponse-timeout is 2,000 microseconds Ib-agent channel-adapter Link-trap Config-if-ib submodeTable B-50 interface ib Command Syntax Description Interface ib Name Commands syntax is described in the table belowDefaults The default is no link-trap Defaults The default interface name is card#/port# Table B-54 Administrative Commands Administrative CommandsCommands stoats is described in the table below Table B-53 Shutdown Command Syntax Description Reboots the chassis. See reload Ftp-server enable Use to enable or disable ftp-servicesLogging Configures active log Configures a radius-server. See radius-server Table B-55 action Keywords Boot-configTable B-56 boot-config Keywords Action Table B-58 Broadcast Command Arguments Table B-57 boot-config ArgumentsBroadcast Clock ConfigureTable B-59 clock Command Argument Descriptions Card Copy Syntax Table B-60 copy Command Syntax DescriptionsTable B-61 Copy Command Argument Descriptions System upon boot-up Syntax delete fsfile Arguments related to the delete command are described belowTable B-62 Delete Command Argument Descriptions Delete Dir Related Commands cardTable B-63 Dir Command Argument Descriptions To display installed system-images and image files Syntax enable DisableEnable Syntax disable Exec Ftp-server enableExit Privileged-execute modes Gateway History Defaults The default gateway IP address isRelated Commands None Help Hostname InstallSynopsis The hostname command assigns a name to the system Table B-69 hostname Command Argument Description Table B-71 interface Command Keywords Table B-70 install Command Argument DescriptionsInterface Example Interface mgmt-ethernet No ipip mask Related Commands ipInterface mgmt-ib Syntax ipip mask Table B-72 Location Syntax Descriptions Location Logout LoginSynopsis The logout command ends the current CLI session Logging Ntp Related Commands exitRelated Commands dir More Table B-73 Radius-server Syntax Descriptions PingRadius-server Syntax ping dest Enabling/Disabling the Ethernet Management Port Synopsis The reload command reboots the chassisReload Syntax reload No snmp-server Snmp-server Defaults Telnet access is enabled by default Table B-74 Snmp-server Command Keyword DescriptionsTable B-75 snmp-server Command Argument Descriptions Command Modes Privilege Level Usage Guidelines Terminal time-out Defaults The default is 24 lines per screenDefaults The default time-out interval is 15 minutes Terminal length Type Syntax type type Table B-76 type Command Argument Username Who Table B-77 Default User AccountsSyntax who This command has no defaults DefaultsWrite 216 Loading HyperTerminal How to Use Windows HyperTerminalAttaching through Windows HyperTerminal HyperTerminal Prerequisite How to Use Windows HyperTerminal Configuring the HyperTerminal Connection Figure C-3 Connect To Dialog Box Figure C-4 COM Port Properties Dialog Box Verifying the HyperTerminal Connection Figure C-5 HyperTerminal Login 222 223 Glossary Glossary Ietf 225 Snmp 226 Index Ib-rw, 104 setting levels, 104 unrestricted-rw227 Index CLI 229 See also HCAs hostname 231 Index See also ports Snmp About, 104 adding, 101 creating, 100 user information Changing, 104 user access levels changing235 Index