SP Switch Router Adapter Guide
 Lucent Technologies
 Contents
 Chapter Configuring the SP Switch Router Adapter
 Chapter
 Appendix a Part Numbers
 Appendix C
 Viii SP Switch Router Adapter Guide 1.4 Update
 Figures
 Figures
 Tables
 Tables
 About 1.4 Update
How to use this Guide
 SP Switch Router manuals
Manual sets
IBM SP system manuals
 Documentation conventions
Convention Meaning
 IP routing publications
 Introduction to the SP Switch Router Adapter card
 What is the RS/6000 SP Switch Router ?
SP Switch Router
 SP Switch Router systems for IBM sites
SP Switch cable
Cables included in your system
 Redundant AC power supplies
Redundant supply safety
Pcmcia 520MB disk
Ethernet cable
 Upgrading system memory
RAM
 Overview of the SP Switch Router Adapter card
Face plate diagram
 Inserting a media card into the SP Switch Router
Media card components
 Card insertion procedure
ESD requirements
 SP Switch Router Adapter card LEDs
LED activity during boot
OFF Error
OFF
 TX HB
 LED activity during normal operations
 STATE1 Bottom two LEDs amber go on during
 SP Switch Router Adapter card specifications
Element Value
 Assigning filters
Tcpdump
 Snmp on the SP Switch Router Adapter card
SP Switch Router Adapter dependent node MIB support
 SP Switch Router Adapter media card states Snmp
 Snmp configuration overview
 Snmp activity during media card start up
 Configuring the SP Switch Router Adapter
 Introduction to installation and configuration
 Pre-installation assumptions
Location of relevant information
 Order of information
 Installing an SP Switch Router Adapter card
Installation overview
 Installing the Pcmcia spinning disk
Managing Pcmcia slots
 Installation steps
Panic dumps sent to external flash device
 file entries should now look like the following
 Save all changes and reboot
 Attaching SP Switch Router cables
SP switch cable
Do not damage the connector ends
Ethernet cable
 Procedure for attaching cables to card and SP Switch
Keep the plastic cap on
 Determining the switch connection for a dependent node
Configuration required on the SP system
 Procedure
 Sources of configuration information
 Multiple frames for multiple system connections
SP system a
 Step-by-step media card configuration
Configuration files and their uses
Overview of steps
 SP Switch Router requires a specific configuration file
 Check Snmp in the SP Switch Router system
Members
 Unspecified Subagents
 Put Snmp changes into effect
ALL GET SET Trap
 Assign IP addresses
Method 1 Recommended, use SP Snmp Manager
Method 2 Optional, edit /etc/grifconfig.conf
 Interface name
Internet address
Netmask
Broadcast / destination address
 Default MTU values
Putting grifconfig.conf additions into effect
Argument field
MTU discovery facility
 Change profile settings
Specify card-level parameters Card profile
Specify Icmp throttling
 Specify different dump settings
Specify different executables
 Configuring the SP Switch Router Adapter
 Look at the SP Switch Router Adapter card settings
Change executables for all dev1 cards Load profile
 Change dump defaults for all dev1 cards Dump profile
 Dump vectors read-only
 Configuring the SP Switch Router Adapter
 How to run the command
Run dev1config to create grdev1.conf
Method 2 Optional, edit /etc/grdev1.conf
 Contents of /etc/grdev1.conf
 Parameter definitions
Extension Node Identifier ibmSPDepNodeName read-only
 Configuration State ibmSPDepConfigState read-only
 Reset card to install files
Saving configuration files
 Verify SP Switch Router Adapter card from router
Verify media card operation using ping
 Verify switch node connectivity using ping
Check media card status using grcard
Media card states
 Reset media card using grreset
 # grreset all -h # grreset slot -h
 Checking connectivity to the SP system
 Procedure
 Configuring the SP Switch Router Adapter
 Monitoring and Management Tools
 SP Switch Router command overview
Csconfig
flashcmd
 Getver
Grarp
Grcard
Grfins
 Grreset
Grms
Grrmb
Grroute
 Grstat
Grwrite
Mountf
Setver
 SP Switch Router Unix tools
Ping
Route
 Traceroute
Grroute.conf file
 Using the netstat command
Netstat -rn
 Netstat -rs
Netstat -in
 Netstat -an
 Netstat -s
 Obtaining layer 2 and 3 statistics grstat
Options
Layer 3 statistics
List of IP stats
 Multicast packets attempted to route
 Layer 2 statistics
List of layer 2 stats
 SP Switch Router Adapter card maint commands
Preparing to use maint commands
 Sample maint commands
Find hardware and software version numbers maint
Find transmit tx binary version maint
Display configuration and status maint
 Maint 5 display switch statistics
Maint 4 display media statistics
 Filtering commands maint 50-58
Maint 6 display combus statistics
 List where filters are assigned maint
List the filters per media card maint
Configure UDP packet discards maint 89
 Display ARP table maint 189
Flush the ARP cache maint 189
 Display switch route table maint 189
Switch route not found
 Checking for hardware problems grdiag
What is tested
Where to find the user guide
Stopping or halting grdiag
 When a media card does not boot after grdiag
Switch receive error can indicate hardware problem
 SP Switch Router dumps
System dumps
Media card dumps
Use grdinfo to collect logs
 Data collection utility grdinfo
Grdinfo -card=slot all
 SP Switch Router example
Grdinfo -all
 ============================================================
 Monitoring and Management Tools
 Monitoring and Management Tools
 SP Switch Router logs
Accessing a log file
 Sample gr.console log
For example
 Sample gr.boot log
Sample entries in the gr.boot log
 Sample messages log
Sample entries in the messages log
 Burning in media card flash memory
 Part Numbers
 Parts list model 04S
 Parts list model 16S
GRF-AC-SWB16
GRF-AC-CB16
GRF-AC-AC16
 Publication numbers IBM manuals
IBM publication number Manual title
 Log Messages
Alphabetical list of messages
 Log Messages
 Access Fifo Sync Error from RC, int1=%d
Access Fifo Sync Error from TC, int1=%d
Message descriptions
ACK Words 0x%08x, 0x%08x, 0x%08x, 0x%08x, 0x%08x, 0x%08x
 ARP added IP= %s, SW-node=%d, state=%d
Bad Hdr/Svc received, Ret code=%d
Board Configuration timed-out, retrying
 Configuration Parameters
Configuring transmit side
CPU ready msg received from TX-CPU
 Descriptor Sync Error from RC, int1=%d
Descriptor Sync Error from TC, int1=%d
Discarding msg, unknown msgtype 0x%x
ERR! Duplicated buffer %d
 Expect Nodeinit but received Stat/Err Request
Expired IP buffer received %d
Hot interrupt detected, ier1=0x%8x, ier2=0x8x
Initializing Main Task
 IOSTB3RX SET TOD service message received
Initializing RX Subsystem data structure
Loopback routes found for IP adr 0x%x, sw-node
Lost of STI clock, Tbic Status = 0x%x
 NetStar GigaRouter %s RX Interface Initializing
NetStar GigaRouter %s TX Interface Initializing
RX Clock is valid
RX-CPU Loaded msg received from TX-CPU
 RX send Sendtod to the switch. or RX Reading TBICs TOD
RX-TBIC outage errors detected IER1=0x%x, IER2=0x%x
RX-TBIC permanent errors detected IER1=0x%x, IER2=0x%x
RX got Tbic Inited fron TX
 RX-TBIC transientt errors detected IER1=0x%x, IER2=0x%x
Send TOD service message received
Sending if Reset message to TX-CPU
Sending Grid Init Sending if Init for if 0x%x
 Sending mib-2 trap, type = %d, state = %d
Sending params to TX
State machine changes from xxx to yyy
 Status/Err service message received
Switch received with errors. Descriptor 0x%8x
Switch route entry not found, node = %d
Svc Msg rxed, svccmd=0x%x %s, nodecmd 0x%x %s
 Switch Route table loaded, %d entries
TB4 segment received in error. TB4-HDR word%d 0x%x
TB4 segment received in wrong state
Tbic Init msg sent to TX-CPU
 Tbus Parity Error from RC, int1=%d
Tbus Parity Error from TC, int1=%d
TBSI-RX TBICs TOD 0x%x, 0x%x
TBSI-TX Unexpected SVC threshold interrupt
 Timeout waiting for Cfgdn bits clear, stat0=%x
Timeout waiting for FPGAINITCOMPLETE, stat0=%x
 RX Setting the RC in operational mode, stat=0x%x
TX-CPU Access Fifo busy, discarding IP packet
Timed out resolving ARP. If %d IP %d.%d.%d.%d
TX-CPU Config Params msg received from RX-CPU
 TX-CPU Tbic Init msg received from RX-CPU
TX Port is connected, stat=0x%x
TX-PROR startnode %d, endnode %d, # entries %d
TX pseudo STI clock is valid
 TX-TBIC outage errors detected IER1=0x%x, IER2=0x%x
TX-TBIC permanent errors detected IER1=0x%x, IER2=0x%x
TX-TBIC transient errors detected IER1=0x%x, IER2=0x%x
Un-expected descriptor from RC, desctype=%d
 Log Messages
 Network Configuration Examples
 Configuration requirements
 Example 2 Multiple cards, single partition
ARP table
 Configuration tasks
Incoming traffic going to SP processor nodes
Outgoing traffic coming from SP processor nodes
 Recovery procedure if an SP Switch Router Adapter card fails
 Example 3 Multiple cards, multiple SP partitions
 SP Switch Router as an IBM product
Support for code installation
Obtaining new machine code
 IBM License Agreement for Machine Code
 Index
ARP
 Index
 GRF
IBM
 Index
 MTU
 Snmp
 Index
 Index