HP Fabric Clustering System HP-UX Administrators Guide
 Copyright 2004-2008 Hewlett-Packard Development Company, L.P
 Table of Contents
 Interfaces
Configuration
 Switch Administration and Management
 109
 131
129
 154
152
155
156
 217
223
227
Page
 List of Figures
HyperTerminal Login
Page
 Description of Access Levels
Default User Names, Passwords and Privileges
List of Tables
Show ib Keyword Descriptions
 Show trace Command Syntax Descriptions
Show logging Command Syntax Description
Show user Command Syntax Descriptions
IP Commands
 Intended Audience
About This Document
New and Changed Documentation in This Edition
Publishing History
 Typographical Conventions
What’s in This Document
 Related Documents
Related Documents HP Encourages Your Comments
Page
 Introduction to Technology
Understanding the Fabric Clustering System
Understanding InfiniBand
 About the HP Fabric Clustering System Software Suite
 Kernel Rdma Subsystem
User-Space Rdma Library
Interaction with HyperFabric Driver
About the HP Fabric Clustering System Software Suite
Page
 Hardware Components
Hardware Overview
Host Channel Adapters
HP offers the following new Host Channel Adapters HCA
 Hardware Overview
 AB286C Host Channel Adapter Connector View
 AB286C Host Channel Adapter Side View
 AB286A Host Channel Adapter Connector View
 AB286A Host Channel Adapter Side View
 Figureigure
 Hardware Components
 Other Product Elements
Switch
 Hardware Overview
 Preliminary Considerations
Installation Planning
Applications
Preliminary Considerations
 Installation Planning
Site Set-up
Application Availability
 Installing HP Fabric Clustering System
HP Fabric Clustering System Installation Prerequisites
Enter your product name Click the double arrow
 Install HP Fabric Clustering System Adapters
Installing the AH304A Host Channel Adapter
Installing HP Fabric Clustering System
 Installing the 410533-B21 Host Channel Adapter
Installing the AD313A Host Channel Adapter
Secure the card and reassemble the system
 Inserting the AD313A Host Channel Adapter
Installing the AB286C Host Channel Adapter
 Inserting the AB286C Host Channel Adapter
On-Line Addition and Replacement Operations OL
 Install HP Fabric Clustering System Software
Where devicename is the name assigned to the CD-ROM drive
This opens the Software Selection window
 T-25 Torx screwdrivers Second person for the installation
Install HP Fabric Clustering System Switches
Rack Mount Preparation
IB subsystem IB Rdma IPoIB IB device driver ibt
 Fixed and Sliding Rails
Installing the Switch
 Attach Rail to Switch
 Remove Support Bracket if installed
Remove Shipping Sleeve
Securely attach all rails to the rack
 Attach Cable Guides & Cables
Cable Routing and Bend Limits
Attach Cable Guides & Cables
 Attach Cables
Cable Installation Minimum Bend Radius
 Connect Cables to Switch
Switch Setup
Switch or Adapter
Attach to other HP Fabric devices
 Enter configure to enter the global-configuration mode
Setting up the Switch
Set the default gateway address. This address is an example
Enable the management port
 Syntax and Example nwmgr -S ipoib
Internet Protocol over InfiniBand IPoIB
Page
 Configuration
Supported Features
Configuration Parameters
 Supported Configurations
Non-Supported Features
Sample Configurations using the AB286A/C or AD313A HCA
Configurations up to 24 End Nodes
 Sample Configurations using the AB286A/C or AD313A HCA
Configurations with More Than 24 End Nodes
 128 Node 50% non-Blocking Configuration
 Following is a listing of the major topics in this chapter
Administration and Management
 HP-UX Host Administration and Management
Using Itutil
Administration and Management
 Itutil Administrative Commands
Summary of Itutil Command Options
Itutil Command Options
Following syntax must be used with itutil command options
 Itutil Management Commands
 Syntax itutil Syntax Example itutil Output Example
 Syntax Example itutil -i ib0 Output Example
 Syntax Example itutil -s-i ib0 Output Example
Syntax Example itutil -t IB Output Example
 Administration and Management
 Displaying Connectivity Information Using Itutil
Syntax Example itutil -r Output Example
Syntax Example itutil -c Output Example
 Example itutil -T
 Viewing the Itutil Manpage
Using NetTL
 Syntax nettl -llog class -esubsystem
 Ifconfig Command
IPoIB Administration and Management
IB Tracing
IPoIB Tracing
 Disable the IPoIB Interface To disable the IPoIB interface
Lanadmin Commands
Displaying IPoIB Interface Link-Level Information
Level information for a given ipoibppa
 Syntax Example lanadmin -a Output Example
Syntax Example lanadmin -s Output Example
Syntax Example lanadmin -g Output Example
 Syntax lanadmin -x-hipoibppa Syntax Example lanadmin -x -h
 Serviceguard and IPoIB
Lanscan Command
Introduction
 Using Serviceguard and IPoverIB
Configuring IPoIB Interfaces for Serviceguard Clusters
 Switch Administration and Management
Switch Administration and Management
 CLI Overview
Using the CLI
Starting a CLI Session
Privilege Level
 Entering CLI Modes
Administrator Roles
 Exiting CLI Modes
Using Command Completion
 Quick Help
Command Abbreviation
 Command-Line Editing
 Exiting the CLI Session
Command before returning to user-execute mode
Specifying the Card/Port
Key Stroke Shortcuts
 Ranges
Card/Port pairs
Indicates ports 2 through 4 on card
Lists
 Configuring the System Hostname
Advanced Switch Setup
Testing Network Connectivity
Enter the global-configuration mode
 Managing the Switch
Setting User Levels and Passwords
Logging Onto the System
Logging On Through the CLI
 Managing Through the CLI
Management Methods
 Configuration, Image, and Log File Overview
Configuration, Image, and Log Files
 Image Upgrade Procedure Summary
Understanding the Upgrade Process
Upgrading Image Files
Set-Up the Hardware Connection
 Check the Image Version
Enter the privileged-execute mode
 Copy/Download the Image
 Install a New Image
Optional View the images by using the dir image command
 Show the new system -image
Specify a New Boot Image
 Reboot the System
Troubleshooting an Image Upgrade
Deleting System Images and Image Files
 Viewing Configuration Files
Listing Configuration, Image, and Log Files
File Management
Viewing Log Files
 Saving for System Reboot
Saving Configuration Files
Saving the Backup Configuration
Specifying the Configuration to Use at System Reboot
 Saving and Copying Files
Arguments to the copy command are described below
Example
Show the new system image
 Downloading Files to the System
Deleting Configuration, Image, and Log Files
Colon
Tslog. The .cfg extension is optional
 Determine the configuration files in memory
Deleting Configuration Files
Deleting Log Files
Display the log files that are in memory
 Determine the currently installed system-images
Verify that you had successfully removed the log file
Deleting Image Files
 Managing Log Files
HP Fabric Switch devices use the following log format
Understanding the Log Format
Uploading Log Files
 Switching User Identity
Administering the System
 Notifying Users
Broadcasting Messages to Users
Sending Messages to Individual Users
 Default User Names, Passwords and Privileges
Understanding Usernames and Passwords
Setting or Changing a Password
Creating User Accounts
 Adding New Users
Displaying User Information
 Deleting a User Account
 User Account Configuration Commands
User Account Administrative Commands
Community Strings
 Using DNS Services
Setting Administrative Roles
Following table displays the different access-levels
 Setting the System Clock
 Rebooting the System
Setting the NTP Servers to Maintain the System Clock
Setting Time Through the CLI
Save your configuration
 Reboot the System Through the CLI
 108
 Monitoring and Troubleshooting
Diagnosing Problems
Diagnosing Problems
 HP Fabric Switch System Status
HP Fabric Switch Cluster Connection LEDs
IB Port Status LED Indicators
LED Color, Behavior, and Meaning
 Rear System Status LED Indicator
Front System Status LED Indicator
 Power supply/ Fan Status LED Indicator
Power Supply Troubleshooting
 Ethernet Management Port LEDs
Ethernet Port Status LED Indicators
HP Fabric HCA Connection LEDs
Bottom Top Green- over Green Off Flickering
 HCA Connection LED Colors and Meanings
Logical Solid Indicates a
Been Top Established None HCA is not
 Determining if the Switch is Faulty
Determining Whether the HCA or Cable is Faulty
 Monitoring and Troubleshooting the HP-UX Host
HP-UX Host Troubleshooting Procedure
Next Steps
 Syntax example itutil Output example
Monitoring and Troubleshooting the HP-UX Host
 Monitoring and Troubleshooting
 Syntax example itutil -c fe802c9018a08a11 ib0
 Description Port failure
Sample nettl Log Messages
 Nettl Sample Log Output
Monitoring and Troubleshooting IPoIB
Sample IB Logs
Following are examples of nettl log output
 PDU in Trace
Sample IPoIB Logs
 Linkloop Command
Known Problems
NetTL
 Health Monitoring
Monitoring and Troubleshooting the Switch
IP Filter Product
CLI can also be used to monitor the system
 About Logging and Tracing
About HP Fabric Events
About Tracing
 Troubleshooting the HP Fabric Network
Ping
Flow
 Enabling Tracing
Setting Trace Levels
Disabling Tracing
Verify Link Speed
 Replacing Individual Components
Replacing a Power Supply Module
 Physical and Environmental Specifications
Specifications
HCA Physical Specifications AB286C
HCA Environmental Specifications AB286C
 130
 Using the Documentation
Switch Command Line Interface
 Defaults
Show Commands
Related Commands
Examples
 Defaults There are no defaults for this command
Show arp ethernet
Show arp IB
 Examples To display the authentication method
Show authentication
Show backplane
Examples To display the InfiniBand ARP table
 Show boot-config
Defaults This command has no defaults
Table B-3 show boot-config Command Field Descriptions
 This command has the following arguments
Show card
Show card Syntax Description
 Image data for internal configuration
Defaults show card defaults to show card all
Oper status
Card
 Table B-7 show card-inventory Command Field Descriptions
Table B-6 Show card-inventory Command Syntax Descriptions
Show card-inventory
Synopsis
 Show config
Related Commands clock
Show clock
 Table B-8 show fan Command Field Descriptions
Related Commands copy
Show fan
Syntax show fan
 Show host
Show ib sm configuration
Show ib
Table B-9 show ib Keyword Descriptions
 Table B-11 Show ib Command Field Descriptions
Table B-10 Show ib Command Syntax Descriptions
User-execute and privileged-execute modes
InfiniBand read-only user
 Table B-12 show ib sm multicast Command Syntax Descriptions
Show ib sm multicast
Show ib sm neighbor
 Table B-13 show ib sm neighbor Command Field Descriptions
Arguments associated with this command are described below
Show ib sm node subnet-prefix
 Class-version
Node guid Use with the all keyword
Type
An unknown type
 Show ib sm partition
 Table B-16 Show ib sm port Command Syntax Descriptions
Table B-17 show ib sm port Command Field Descriptions
Show ib sm port
 No state change
Value may be
1x or
12x
 Transmitted by this port. There is no default value
Received by this port. There is no default value
Packets received by this port. There is no default value
Packets transmitted by this port. There is no default value
 Errors and the buffers are not immediately reclaimed
Local-phy-error
 Table B-18 Show ib sm service Command Syntax Descriptions
Show ib sm service
 Show ib sm switch
Table B-19 show ib sm switch Command Syntax Descriptions
Table B-20 show ib sm switch Command Field Descriptions
 Life-time-value
Partition enforcement is not supported by the switch
Port-state-change
Lid-per-port
 Show ib-agent channel-adapter
 Show ib-agent summary
Table B-22 Show ib-agent summary Command Field Descriptions
Usage Guidelines form
Slot System chassis slot in which the device resides Type
 Following example displays a summary of all the SMA nodes
Show ib-agent switch
Agent
Lid Decimal-base LID of this port
 Show ib-agent switch linear-frd-info
Display the attributes of a single switch
Swguid
 Show ib-agent switch all node-info
Show ib-agent switch all mcast-info lid
Swguid Guid of a specific InfiniBand switch
Type, GUIDs, and capabilities
 Defaults This command has no defaults
 Show ib-agent switch all pkey-info
Show ib-agent switch port-info
Usage Guidelines None Examples
 Node-guid Bit Guid of this node In-ib-port
Show ib-agent switch sl-vl-map
Out-ib-port
SL0 to VL mapping
 Show ib-agent switch switch-info
 Show interface ib
Table B-30 Show interface ib Command Syntax Descriptions
Syntax is described in the table below
Table B-31 Show interface ib Output Descriptions
 Link-trap
 Usage Guidelines None
Show interface ib sm
 Show interface ib sm statistics
 Show interface mgmt-ib
Show interface mgmt-ethernet
 Show ip
Show interface mgmt-serial
 Table B-33 show ip Command Syntax Descriptions
Show location
Show logging
 Show ntp
Table B-34 show logging Command Syntax Description
Syntax show ntp
End
 Related Commands ntp
Show power-supply
Show running-status
Usage Guidelines Examples
 Show sensor
 Show snmp
Show system-services
 Table B-36 show trace Command Syntax Descriptions
Show terminal
Show trace
 Show user
Table B-37 Show user Command Syntax Descriptions
Username Specify the name of a specific user
Shows all users in the user database
 Show version
 IP Commands
Table B-38 IP Commands
Arp ib
 Clear ib arp-cache
Default ip ip-over-ib-mtu
Table B-39 Auto-negotiate Syntax Description
Enter the IP address of the target host
 Defaults The default domain name is an empty string
Defaults The default ip-over-ib-mtu is
Ip domain-name
Ip ip-over-ib-mtu
 Table B-42 Command Syntax Description
Defaults The default ip-over-ib-mtu unit is
Defaults The default is an empty string
Ip name-server-one
 Table B-44 Command Syntax Description
Table B-43 Command Syntax Description
Ip name-server-two
Ip route
 Table B-45 InfiniBand Commands
InfiniBand Commands
Ib sm subnet-prefix
Arp ib
 Table B-46 ib sm subnet-prefix Syntax Description
 Following example removes a specified subnet manager
Table B-47 Acceptable PKey Values
Following example creates a Partition, and adds
Sweep-interval is 10 seconds
 Response-timeout is 2,000 microseconds
Ib-agent switch
Ib-agent channel-adapter
Syntax is described in the following table
 Table B-50 interface ib Command Syntax Description
Config-if-ib submode
Interface ib
Link-trap
 Defaults The default is no link-trap
Commands syntax is described in the table below
Defaults The default interface name is card#/port#
Name
 Commands stoats is described in the table below
Administrative Commands
Table B-53 Shutdown Command Syntax Description
Table B-54 Administrative Commands
 Logging Configures active log
Ftp-server enable Use to enable or disable ftp-services
Configures a radius-server. See radius-server
Reboots the chassis. See reload
 Table B-56 boot-config Keywords
Boot-config
Action
Table B-55 action Keywords
 Table B-57 boot-config Arguments
Table B-58 Broadcast Command Arguments
Broadcast
 Table B-59 clock Command Argument Descriptions
Configure
Card
Clock
 Table B-61 Copy Command Argument Descriptions
Syntax Table B-60 copy Command Syntax Descriptions
System upon boot-up
Copy
 Table B-62 Delete Command Argument Descriptions
Arguments related to the delete command are described below
Delete
Syntax delete fsfile
 Table B-63 Dir Command Argument Descriptions
Related Commands card
To display installed system-images and image files
Dir
 Enable
Disable
Syntax disable
Syntax enable
 Ftp-server enable
Exec
Exit
 Privileged-execute modes
Gateway
 Related Commands None
Defaults The default gateway IP address is
Help
History
 Synopsis The hostname command assigns a name to the system
Install
Table B-69 hostname Command Argument Description
Hostname
 Table B-70 install Command Argument Descriptions
Table B-71 interface Command Keywords
Interface
 Example
Interface mgmt-ethernet
 Interface mgmt-ib
Related Commands ip
Syntax ipip mask
No ipip mask
 Table B-72 Location Syntax Descriptions
Location
 Synopsis The logout command ends the current CLI session
Login
Logging
Logout
 Related Commands dir
Related Commands exit
More
Ntp
 Radius-server
Ping
Syntax ping dest
Table B-73 Radius-server Syntax Descriptions
 Reload
Synopsis The reload command reboots the chassis
Syntax reload
Enabling/Disabling the Ethernet Management Port
 No snmp-server
Snmp-server
 Table B-75 snmp-server Command Argument Descriptions
Table B-74 Snmp-server Command Keyword Descriptions
Command Modes Privilege Level Usage Guidelines
Defaults Telnet access is enabled by default
 Defaults The default time-out interval is 15 minutes
Defaults The default is 24 lines per screen
Terminal length
Terminal time-out
 Type
Syntax type type Table B-76 type Command Argument
 Username
 Table B-77 Default User Accounts
Who
Syntax who
 Defaults
This command has no defaults
Write
 216
 Attaching through Windows HyperTerminal
How to Use Windows HyperTerminal
HyperTerminal Prerequisite
Loading HyperTerminal
 How to Use Windows HyperTerminal
Configuring the HyperTerminal Connection
 Figure C-3 Connect To Dialog Box
 Figure C-4 COM Port Properties Dialog Box
Verifying the HyperTerminal Connection
 Figure C-5 HyperTerminal Login
 222
 223
Glossary
 Glossary
Ietf
 225
Snmp
 226
 Ib-rw, 104 setting levels, 104 unrestricted-rw
Index
227
 Index
CLI
 229
 See also HCAs hostname
 231
 Index
 See also ports
 Snmp
 Changing, 104 user access levels changing
About, 104 adding, 101 creating, 100 user information
235
 Index