Cisco Systems UBR10012 manual General Information for Troubleshooting Line Card Crashes

Page 50

Chapter 4 Troubleshooting Line Cards

General Information for Troubleshooting Line Card Crashes

General Information for Troubleshooting Line Card Crashes

Line card crashes occur when the hardware or software encounter unexpected situations that are not expected in the current design. As a general rule, they usually indicate a configuration error, a software error, or a hardware problem.

Table 4-1lists the show commands that are most useful in collecting information to troubleshoot line card crashes.

Table 4-1 Relevant Show Commands for Line Card Crashes

Command

Description

 

 

show version

Provides general information about the system's hardware and software

 

configurations

 

 

show logging

Displays the general logs of the router

 

 

show diag [slot/subslot]

Provides specific information about a particular slot: type of engine,

 

hardware revision, firmware revision, memory configuration, and so on.

 

 

show context [summary

Provides context information about the most recent crashes. This is

slot [slot/subslot] ]

often the most useful command for troubleshooting line card crashes.

 

 

Use the following procedure if you suspect that a line card has crashed.

Step 1 If you can identify the particular card that has crashed or is experiencing problems, first use the other sections in this chapter to perform basic troubleshooting. In particular, ensure that the line card is fully inserted into the proper slot, and that all cables are properly connected.

Step 2 If any system messages were displayed on the console or in the SYSLOG logs at the time of the crash, consult the Cisco CMTS System Messages guide and the Cisco IOS System Messages Guide for possible suggestions on the source of the problem.

Step 3 Line cards can crash or appear to crash when an excessive number of debug messages are being generated. In particular, this can happen when using the verbose or detail mode of a debug command, or if the debug command is dumping the contents of packets or packet buffers. If the console contains a large volume of debug output, turn off all debugging with the no debug all command.

Step 4 If the system message log contains messages that indicate the line card is not responding (for example, %IPCOIR-3-TIMEOUT), and the card’s LEDs are not lit, the line card might have shut down because of overheating. Ensure that all chassis slots either have the proper card or module installed in them. If a slot is blank, ensure that the slot has a blank front panel installed, so that proper airflow and cooling can be maintained in the chassis.

Step 5 Use the show context summary command to identify all of the line cards that have experienced a crash:

Router# show context summary

 

 

 

CRASH

INFO SUMMARY

 

 

 

Slot

1/0: 0 crashes

 

 

 

Slot

1/1: 0 crashes

 

 

 

Slot

2/0: 0 crashes

 

 

 

Slot

2/1: 0 crashes

 

 

 

Slot

3/0: 0 crashes

 

 

 

Slot

3/1: 0 crashes

 

 

 

Slot

4/0: 1

crashes

1 -

crash at 04:28:56 EDT Tue Apr 20 1999

 

 

 

Slot

4/1: 0

crashes

 

 

 

Slot

5/0: 0

crashes

 

 

 

Cisco uBR10012 Universal Broadband Router Troubleshooting Guide

 

 

 

 

4-2

 

 

 

OL-1237-01

 

 

 

 

 

 

Image 50
Contents Corporate Headquarters Text Part Number OL-1237-01Copyright 2001-2004, Cisco Systems, Inc All rights reserved N T E N T S ARP Traffic Testing with Digital Multimeters and Cable Testers B-1 OL-1237-01 Purpose AudienceChapter Description Document OrganizationRelated Documentation Cisco.com Obtaining DocumentationDocumentation Feedback Ordering DocumentationOpening a TAC Case Obtaining Technical AssistanceCisco TAC Website Obtaining Additional Publications and Information TAC Case Priority DefinitionsXii Basic Troubleshooting Checklist Basic Troubleshooting Tasks and Startup IssuesConfirming the Hardware Installation Last reset from power-on Displaying the Cisco IOS Software VersionHardware Troubleshooting Flowchart Displaying System Environment InformationCisco uBR10012 System Startup Sequence TCC+Startup Event Event Description PEM Faults and Fan Assembly Failures AC PEM FaultsFault Symptom Corrective Action Color DescriptionDC PEM Faults DC PEM Front Panel original model, UBR10-PWR-DC 2400W AC-Input Power Shelf AC OK Other Electrical ProblemsFault DC OKFan Assembly Module Faults Fan Assembly ModuleFan Assembly Air Circulation Pattern MULTI-FAN Failure LED Symptom Steps to TakeSingle FAN Failure OL-1237-01 Troubleshooting PRE-1 Modules Message Description PRE Module Not SupportedPRE-1 Module Status Screen IOS Intf Booting Up with Redundant PRE-1 ModulesIOS Prot IOS RUNPRE-1 Module Faults Fault Steps to Take LEDEthernet Connection Problems C10000config#interface fastethernet0/0/0Console Port Serial Connection Problems Troubleshooting Common System Problems Troubleshooting System CrashesHigh CPU Utilization Problems ARP TrafficRouterconfig-if# ip access-groupnumber Exec and Virtual Exec Processes Cpuhog ErrorsDebug and System Messages IP Input Processing Invalid Scheduler Allocate ConfigurationInterrupts are Consuming a Large Amount of Resources Snmp Traffic Bus ErrorsProblems with Access Lists Region Manager Start End Sizeb Class Media Name 0x0A000000 Memory Problems Alignment ErrorsLow Memory Errors Memory Parity ErrorsParticle Pool Fallbacks Spurious Interrupts Spurious Memory Accesses OL-1237-01 Troubleshooting Line Cards General Information for Troubleshooting Line Card Crashes Command DescriptionSIG Value SIG Name Error Reason Sigreload Cache Parity ErrorsSigerror Bus Errors Software-Forced Crashes Troubleshooting Line Cards TCC+ Front Panel Status Description PowerMaintenance Fault Type Response Show controllers clock-reference command Troubleshooting the OC-12 Packet-Over-SONET Line Card Fault Corrective Action RX CARRIER-A RX CARRIER-BActive Enabled PASS-THROUGHPOS EnableFail SRPPass Thru SyncWrap Troubleshooting the Gigabit Ethernet Line Card Gigabit Ethernet Line Card Faceplate and LED DescriptionsGigabit Ethernet Line Card Faults and Recommended Responses OL-1237-01 Password Recovery Procedure Overview Password Recovery ProcedurePress Return. The user Exec prompt appears Change all three passwords using the following commands OL-1237-01 Unsupported Commands Unsupported Frame Relay CommandsHccp Commands Mlppp CommandsSpectrum Management Commands Unsupported Mpls VPN CommandsUnsupported PPP Commands Unsupported Telco-Return CommandsOL-1237-01 Testing with Digital Multimeters and Cable Testers Equipment DescriptionTesting with OTDRs Testing with TDRs and OTDRsTesting with TDRs Testing with Network Monitors Testing with Breakout Boxes, Fox Boxes, and BERTs/BLERTsTesting with Network Analyzers Bert Enable LEDActive LED BlertMAINTENANCE, TCC+ ENABLE, OC-48 DPT/POSMAINTENANCE, OC-12 SRP/DPT POWER, OC-12 DPT/SRP POWER, TCC+STATUS, OC-12 DPT/SRP STATUS, TCC+ SYNC, OC-48 DPT/POS Maintenance LEDPower LED TX, OC-48 DPT/POS WRAP, OC-48 DPT/POSRX Carrier LED RX LED OC-12 DPT/SRP TCC+Present LED TCC+ RX Pkts LEDWrap LED TDR B-2TX LED OC-48 DPT/POS IN-6