Page 125
Appendix J Troubleshooting
J.10.12 Service Agent Problems
J.10.12.1.3 Manager Gets Deregistered
The Manager is deregistered from RtmProxy after running for a while.
Step 1 Verify that the keepalive script is running. The Manager will automatically get deregistered if no SNMP is done on any of the tables in RtmProxy. To keep the Manager registered with RtmProxy, run the keepalive script in the background, as follows:
#!/bin/sh
Usage="$0 <Agent Ip Address> <Manager IP address>" if [ $# -lt 2 ]
then
echo "Usage :$Usage" exit 1
fi managerRowStatus=.1.3.6.1.4.1.351.120.1.1.1.3 managerPortNumber=.1.3.6.1.4.1.351.120.1.1.1.2 lastseq=.1.3.6.1.4.1.351.120.1.3.0
while true do
sleep 60
CMD="/opt/OV/bin/snmpget -cpublic -p8161 -t3000 -r0 $1 $managerRowStatus.$2 $lastseq" echo $CMD
$CMD done exit 0
Step 2 Verify that IP reachablity the CTM station is not lost of from the station where the Manager is running.
Defect Information—Collect the following information for further analysis:
•RtmProxy.log* and snmpd.log*
Possible alternative workaround—Reregister the Manager with RtmProxy.
J.10.12.1.4 Nodal Community Strings Do Not Work
Snmpwalk using the nodal community strings returns an error.
Step 1 Verify that the SNMP request is being issued to port 8161.
Step 2 Verify that the community string is correct.
Defect Information—Collect the following information for further analysis:
•RtmProxy.log* and snmpd.log* Possible alternative workaround—None.
J.10.12.2 Audit Trail Logging Mechanism Problems
Audit trail logging provides CTM with the ability to record user activities across different modules in a persistent file. All CTM Java front GUI applications send information about user activities to the Audit Logger server through the CORBA interface. The Audit Logger server then writes the data into the persistent log file.
| | Cisco Transport Manager Release 6.0 User Guide | | | |
| | |
| 78-16845-01 | | | J-125 | |
| | | |
Contents
Troubleshooting
Conditions that Affect CTM Server Performance
Server Problems
CTM Server Does Not Respond
Cannot Connect to the CTM Server
NE Connection State Is Listed as Unavailable
Trap Port Is Unavailable
Launching Tables Results in Database Errors
Snmp Traps Are Not Forwarded from NEs
Performance Monitoring Data Is Not Displayed
Problems with ONS 15530 and ONS 15540 Configuration
ONS 15501, ONS 15540, or ONS 15530 Is Not Reachable
CTC-Based NE Is Not Discovered
CTC-Based NE Is Not Reachable
NE Model Type Appears as Unknown
Circuits Are Not Displayed
Circuit State for Monitor Circuits Reads Duplicate ID
Getinfo.sh Script Fails
Memory Backup, Memory Restore, or Software Download Fails
Cannot Copy CTC Binary to the CTM Server
Database Is Not Available
Using the get nestate Command
Cannot Log In as Provisioner or Operator
Database Timeout Occurs
Are the CTM Client and the CTM Server Connected?
Model Index Is Unknown
Cannot Authenticate User Message Appears
Added a New Software Version to the Wrong NE
Cannot Delete an NE
CTC Fails to Start
Cannot Schedule Jobs
Cannot Delete a Subnetwork
Cannot Move an NE Between Subnetworks
Bandwidth-Intensive Operations Are Blocked
NE Displays Incorrect Configuration Management Data
Cannot Customize the Network Map
Snmptrap
How Do I Collect Thread Dumps?
Click OK
Client Debug Messages
How Do I Replace the Alarm Interface Panel?
CTM GateWay/TL1 Problems
Cisco CRS-1 and Catalyst 6509 Problems
CTM Does Not Receive Traps from the Catalyst
Cat6509 enable# set snmp trap enable all
Syslog
CTM Does Not Receive syslog Events from the Catalyst
CTM Does Not Collect Historical PM Data for the CRS-1
Memory Backup or Restore Fails for the CRS-1
Click NE Service
How Do I Configure SSH on the CRS-1?
Cannot Delete an Out-of-Service NE from CTM
How Do I Configure Telnet on the CRS-1?
How Do I Load a Software Image on the Catalyst 6509?
How Do I View the Snmp Configuration on the Catalyst 6509?
Output is similar to the following example
CTM Cannot Discover an XR 12000 Node
Reporting XR 12000 Issues
5 XR 12000 PM Collection Issues
4 XR 12000 Alarm and Event Reporting Issues
7 XR 12000 NE Explorer Applications Are Disabled
6 XR 12000 BGP and CDP Neighbor Discovery Issues
No Nodes Are Discovered
Discovery Issues at Startup
Discovery Mechanism
Node Name Is Incorrect in the Database
Output of the switch CLI, selnd, and dbnds
Node IP Is Incorrect in the Database
Node Alarm Is Shown Incorrectly in the Database
CTM State Is Incorrect
Reachable Node Is Shown as Unreachable
Discovery Issues at Runtime
Collect the output of the switch CLI, selnd, and dbnds
Equipment Management Problems
Node Mode Remains
Ls -ltr *.9
SMCARD01SRM.CF
SMCARD01RPM.CF
Node Resync Mode Is
EMCSnmpFunccProcFuncGenNodeBulkFile1 entering
Appendix J Troubleshooting Equipment Management Problems
Appendix J Troubleshooting Equipment Management Problems
Appendix J Troubleshooting Equipment Management Problems
Database Table Population Through Traps and Snmp Upload
Appendix J Troubleshooting Equipment Management Problems
Appendix J Troubleshooting Equipment Management Problems
You should see something like the following
Figure J-1shows the end-to-end architecture
Figure J-1 CTM End-to-End Architecture
Basic Issues
Topology Discovery Issues
Appendix J Troubleshooting
CTM CLI
All the Cards Under a Node Are Missing
Network Element Discovery Issues
Cisco Transport Manager Release 6.0 User Guide 78-16845-01
Appendix J Troubleshooting
Alarm Processing Basics
Figure J-2 Client/Server Architecture for Alarm Components
XML Schema for Alarm Rules
Figure J-3 Correlated Alarm Rule Diagram
Figure J-5 Transient Alarm Rule Diagram
Alarm Severity and Object Severity
Cisco Transport Manager Release 6.0 User Guide 78-16845-01
Alarm List Shows Alarm that Does Not Exist on Platform
Transient Event Has Disappeared Unexpectedly
Chassis View Basics
Chassis View Problems
Card Not Displayed in the Chassis View
Lines Not Displayed in the Chassis View
HIST, CBRX, and Cbtx Status Not Updated in MGX Nodes
Ethernet Status Not Updated on PXM Cards
RPM Card Status Not Updated
10.6.4 DCA/DCB Status Not Displayed on PXM Cards
Configuration Center Framework
Configuration Center Management
Lines Not Selectable
Wrong Tooltip Is Displayed
Choose Tools Configuration Center from any application
Cannot Launch the Configuration Center
Appendix J Troubleshooting Configuration Center Management
Element Tab-Internal Frame Does Not Launch
Element Management-Drag and Drop Within Configuration Center
Cross Application-Configuration Center as Drag Source
Appendix J Troubleshooting Configuration Center Management
XML Parsing Error
Configuration Center-Element Management
Details, Create, Delete, and Refresh Buttons Are Not Enabled
Snmp No Data Error
Snmp Set Error
Snmp Timeout Error
Object Not Found In Tree View Error
Element Data Inconsistent with Switch
Config Server Reports Error Messages
Connection Management Problems
Configuration Center GUI-Framework Issues
Appendix J Troubleshooting Connection Management Problems
Appendix J Troubleshooting Connection Management Problems
Cross Application-Connection List as Drag Source
Configuration Centers Connection Tab Does Not Respond
Configuration Center GUI-CM Server-Reported Errors
DATABASEERRORDatabase error %s
Appendix J Troubleshooting Connection Management Problems
Cmsvr Errors
Cannot Create One-Segment Hybrid
Unsupported Service Type-General node-slot-port-version
TestConn or TestDelay Failed with Switch Error
Cmsvr-Connection Diagnostic Issues
Connection Trace Failures
Connection Up/Down/Reroute Failed
Cmgrd
Figure J-6 Connection Management Subsystem
High-Level Connection Management Subsystem Architecture
Cmgrd-Sdbroker Errors
Related key index entries cmgrd, sdbroker, vpi/vci
Appendix J Troubleshooting Connection Management Problems
100
Cmgrd Errors
101
102
103
Cmgrd-Switch Errors
104
105
106
107
Diagnostics Center Problems
108
Diagnostics Center Framework
109
Cannot Launch Diagnostics Center
110
111
Diagnostics Center Does Not Respond GUI Is Grayed Out
Drop Target Displays Incorrect Object or Object Data
112
Diagnostics Center Server-Specific Issues
113
XML Parser Error
Snmpcommtimeout Error While Polling MIB Objects
Node Resync Fails
Node Sync-Up Status Are Not Shown in the Diagnostics Center
Polling of Real-Time Counters Fails
114
115
Some Real-Time Counters Are Not Shown
Unable to Start, Stop, or Modify Bert Operations
116
Cannot Perform Connection Diagnostics
Unable to Start/Stop IMA Link Test Patterns
PM Collection Issues
Performance Management Collection and Parsing Problems
Miscellaneous Issues or Problems in Diagnostics Center
Pmcollector-Generic Troubleshooting
118
119
PM Collection Fails for the Node-Log File Shows Snmp failed
120
PM Collection Fails for the Node-Log File Shows Ftp failed
PM Parsing Issues
Statistics Report Problems
StatsParser-Generic Troubleshooting
121
Statistics Report
You See FDNs for Other Entities when You Generate a Report
You Collected Data but You See No Data Available
You Generated a Report but Do Not See Data for a Long Time
Utilization Report Value Is Greater than 100%
Service Agent Problems
RtmProxy
123
124
Registration with RtmProxy Failed
Not Receiving Any Traps
Manager Gets Deregistered
Audit Trail Logging Mechanism Problems
Nodal Community Strings Do Not Work
125
AuditLogger.conf Usage
Miscellaneous Problems
Audit Trail Log File Naming Convention
126
Config Change or Provisioning Activity Not Reflected on CTM
Nodes Stay in Mode 1 After ColdStart
10.13.1 NTS
127
128
How To Interpret NTS Log
129
Connection Inconsistency Between the Switch and GUI
Data Inconsistency
130
Each output line is similar to this
131
Process ID of the sdbroker will be returned
132
Inconsistent Connection Status
Inconsistent Connection Secondary Status
133
Incomplete Connections
FTP Username and Password
Generic Troubleshooting
CTM FTP Daemon
FTP Daemon Overview
135
Cwmftpd-File Not Available On Switch
FTP Sessions in Switch
136
10.13.3.7 421 Session Limit Reached
10.13.3.8 499 Session Limit Reached
Failed to Acquire Session After All Retries
Failed to Acquire a Session with a Switch
General Log Information
137
138