Cisco Systems 78-16845-01 appendix Related key index entries cmgrd, sdbroker, vpi/vci

Page 98

Appendix J Troubleshooting

J.10.8 Connection Management Problems

Defect Information:

If the sdbroker is processing many traps (more than 20 per second) during the time of the provisioning request, then there is no sdbroker defect. Investigate the switch, NTS, or EM if you feel that there should not be so many requests occurring at the given time.

If the sdbroker appears to be dormant, you need to capture the current status of the sdbroker. Execute the pstack <pid> command twice and save the output.

Possible alternative workaround—Repeated attempts at provisioning should be made. If there is a switch that is sending out many alarms, fixing the problem on the switch is the best solution. If the sdbroker has been 'sleeping' for a long period of time, then it should be killed and restarted.

J.10.8.4.5 Cmgrd—Sdbroker Addition Errors: Adding a Connection Results in "CTM sync-up in progress" Error

Related key index entries: cmgrd, sdbroker, sync-up

While the system is in the process of syncing up, you cannot provision connections. You receive the error "CTM sync-up in progress."

You need to determine if the system is really in sync-up or not. If the system is still syncing up then this is proper operation.

Step 1 View the sync log located in /opt/svplus/log/.DBKR_SYNCHUP_MESSAGE (note the period (.) before the filename). Search for the last "xxx Start Begin at" line where xxx is either Warm or Cold. WarmStart will take a short time compared to coldstart, which could take several hours. If there is a line at the end of the file stating "Declare Sync-Up Complete" or "Warmstart Cache Rebuild Complete" then sync-up is done and there is a problem with DMD.

Step 2 If sync-up is not complete, view the start time of sync-up. Compare this to the maximum sync time identified in the /usr/user/svplus/config/dmd.conf file next to the keyword SYNCHUP_ALL_NODES_SYNC_WAIT_LIMIT. If the time taken to sync is longer than the time identified in the dmd.conf file, then DMD has a problem.

Step 3 If the system is truly still syncing up, then the system behavior is correct.

Defect Information—If there is a DMD problem, save the DMD, cmgrd, sdbroker logs, and message logs along with the .DBKR_SYNCHUP_MESSAGE and .DMD_SYNCHUP_MESSAGE* files located in the /opt/svplus/log directory.

Possible alternative workaround—Force the system to declare sync-up by sending the DMD a forced sync signal. This will not place the nodes into mode '3' any faster, but will allow you to attempt provisioning some nodes, while other nodes are in the process of syncing up.

Step 1 Execute command selnd from the CWM command line. Note the nodes in mode 3. Connections provisioned after forced sync-up can only go through nodes with mode = 3.

Step 2 Send the sync-up signal to the DMD by entering command kill -ALRM dmd.

Step 3 View the .DBKR_SYNCUP_MESSAGE file for the sync-up completion.

J.10.8.4.6 Cmgrd—Sdbroker Addition Errors: Adding a Connection Results in "No more vpi/vci available for local trunk end" Error

Related key index entries: cmgrd, sdbroker, vpi/vci

Cisco Transport Manager Release 6.0 User Guide

 

J-98

78-16845-01

 

 

 

Image 98
Contents Troubleshooting Server Problems Conditions that Affect CTM Server PerformanceCTM Server Does Not Respond Cannot Connect to the CTM Server NE Connection State Is Listed as Unavailable Trap Port Is Unavailable Launching Tables Results in Database ErrorsSnmp Traps Are Not Forwarded from NEs Problems with ONS 15530 and ONS 15540 Configuration Performance Monitoring Data Is Not DisplayedONS 15501, ONS 15540, or ONS 15530 Is Not Reachable CTC-Based NE Is Not DiscoveredCTC-Based NE Is Not Reachable NE Model Type Appears as Unknown Circuits Are Not DisplayedCircuit State for Monitor Circuits Reads Duplicate ID Getinfo.sh Script Fails Memory Backup, Memory Restore, or Software Download FailsCannot Copy CTC Binary to the CTM Server Using the get nestate Command Database Is Not AvailableCannot Log In as Provisioner or Operator Database Timeout OccursAre the CTM Client and the CTM Server Connected? Cannot Authenticate User Message Appears Model Index Is UnknownAdded a New Software Version to the Wrong NE Cannot Delete an NECTC Fails to Start Cannot Schedule Jobs Cannot Delete a SubnetworkCannot Move an NE Between Subnetworks NE Displays Incorrect Configuration Management Data Bandwidth-Intensive Operations Are BlockedCannot Customize the Network Map How Do I Collect Thread Dumps? SnmptrapClick OK How Do I Replace the Alarm Interface Panel? Client Debug MessagesCTM GateWay/TL1 Problems Cisco CRS-1 and Catalyst 6509 Problems Cat6509 enable# set snmp trap enable all CTM Does Not Receive Traps from the CatalystCTM Does Not Receive syslog Events from the Catalyst SyslogCTM Does Not Collect Historical PM Data for the CRS-1 Memory Backup or Restore Fails for the CRS-1 Click NE Service How Do I Configure SSH on the CRS-1? Cannot Delete an Out-of-Service NE from CTMHow Do I Configure Telnet on the CRS-1? How Do I View the Snmp Configuration on the Catalyst 6509? How Do I Load a Software Image on the Catalyst 6509?Output is similar to the following example Reporting XR 12000 Issues CTM Cannot Discover an XR 12000 Node4 XR 12000 Alarm and Event Reporting Issues 5 XR 12000 PM Collection Issues6 XR 12000 BGP and CDP Neighbor Discovery Issues 7 XR 12000 NE Explorer Applications Are DisabledNo Nodes Are Discovered Discovery Issues at StartupDiscovery Mechanism Output of the switch CLI, selnd, and dbnds Node Name Is Incorrect in the DatabaseNode Alarm Is Shown Incorrectly in the Database Node IP Is Incorrect in the DatabaseReachable Node Is Shown as Unreachable CTM State Is IncorrectDiscovery Issues at Runtime Collect the output of the switch CLI, selnd, and dbnds Equipment Management Problems Node Mode Remains Ls -ltr *.9 SMCARD01SRM.CF Node Resync Mode Is SMCARD01RPM.CFEMCSnmpFunccProcFuncGenNodeBulkFile1 entering Appendix J Troubleshooting Equipment Management Problems Appendix J Troubleshooting Equipment Management Problems Appendix J Troubleshooting Equipment Management Problems Database Table Population Through Traps and Snmp Upload Appendix J Troubleshooting Equipment Management Problems Appendix J Troubleshooting Equipment Management Problems You should see something like the following Figure J-1shows the end-to-end architecture Figure J-1 CTM End-to-End Architecture Basic Issues Topology Discovery Issues Appendix J Troubleshooting CTM CLI Network Element Discovery Issues All the Cards Under a Node Are MissingCisco Transport Manager Release 6.0 User Guide 78-16845-01 Appendix J Troubleshooting Alarm Processing Basics XML Schema for Alarm Rules Figure J-2 Client/Server Architecture for Alarm ComponentsFigure J-3 Correlated Alarm Rule Diagram Alarm Severity and Object Severity Figure J-5 Transient Alarm Rule DiagramCisco Transport Manager Release 6.0 User Guide 78-16845-01 Alarm List Shows Alarm that Does Not Exist on Platform Transient Event Has Disappeared Unexpectedly Chassis View Problems Chassis View BasicsLines Not Displayed in the Chassis View Card Not Displayed in the Chassis ViewRPM Card Status Not Updated Ethernet Status Not Updated on PXM CardsHIST, CBRX, and Cbtx Status Not Updated in MGX Nodes 10.6.4 DCA/DCB Status Not Displayed on PXM CardsLines Not Selectable Configuration Center ManagementConfiguration Center Framework Wrong Tooltip Is DisplayedCannot Launch the Configuration Center Choose Tools Configuration Center from any applicationAppendix J Troubleshooting Configuration Center Management Element Management-Drag and Drop Within Configuration Center Element Tab-Internal Frame Does Not LaunchCross Application-Configuration Center as Drag Source Appendix J Troubleshooting Configuration Center Management Configuration Center-Element Management XML Parsing ErrorSnmp No Data Error Details, Create, Delete, and Refresh Buttons Are Not EnabledSnmp Timeout Error Snmp Set ErrorObject Not Found In Tree View Error Element Data Inconsistent with Switch Config Server Reports Error Messages Connection Management ProblemsConfiguration Center GUI-Framework Issues Appendix J Troubleshooting Connection Management Problems Appendix J Troubleshooting Connection Management Problems Cross Application-Connection List as Drag Source Configuration Center GUI-CM Server-Reported Errors Configuration Centers Connection Tab Does Not RespondDATABASEERRORDatabase error %s Appendix J Troubleshooting Connection Management Problems Cmsvr Errors Cannot Create One-Segment Hybrid Unsupported Service Type-General node-slot-port-version Cmsvr-Connection Diagnostic Issues TestConn or TestDelay Failed with Switch ErrorConnection Up/Down/Reroute Failed Connection Trace FailuresCmgrd High-Level Connection Management Subsystem Architecture Figure J-6 Connection Management SubsystemCmgrd-Sdbroker Errors Related key index entries cmgrd, sdbroker, vpi/vci Appendix J Troubleshooting Connection Management Problems Cmgrd Errors 100101 102 Cmgrd-Switch Errors 103104 105 106 Diagnostics Center Problems 107Diagnostics Center Framework 108Cannot Launch Diagnostics Center 109110 111 Diagnostics Center Does Not Respond GUI Is Grayed OutDrop Target Displays Incorrect Object or Object Data Diagnostics Center Server-Specific Issues 112113 XML Parser ErrorSnmpcommtimeout Error While Polling MIB Objects Polling of Real-Time Counters Fails Node Sync-Up Status Are Not Shown in the Diagnostics CenterNode Resync Fails 114115 Some Real-Time Counters Are Not ShownUnable to Start, Stop, or Modify Bert Operations 116 Cannot Perform Connection DiagnosticsUnable to Start/Stop IMA Link Test Patterns Miscellaneous Issues or Problems in Diagnostics Center Performance Management Collection and Parsing ProblemsPM Collection Issues Pmcollector-Generic Troubleshooting118 PM Collection Fails for the Node-Log File Shows Snmp failed 119PM Collection Fails for the Node-Log File Shows Ftp failed 120StatsParser-Generic Troubleshooting Statistics Report ProblemsPM Parsing Issues 121You Collected Data but You See No Data Available You See FDNs for Other Entities when You Generate a ReportStatistics Report You Generated a Report but Do Not See Data for a Long TimeRtmProxy Service Agent ProblemsUtilization Report Value Is Greater than 100% 123124 Registration with RtmProxy FailedNot Receiving Any Traps Nodal Community Strings Do Not Work Audit Trail Logging Mechanism ProblemsManager Gets Deregistered 125Audit Trail Log File Naming Convention Miscellaneous ProblemsAuditLogger.conf Usage 12610.13.1 NTS Nodes Stay in Mode 1 After ColdStartConfig Change or Provisioning Activity Not Reflected on CTM 127How To Interpret NTS Log 128129 Connection Inconsistency Between the Switch and GUIData Inconsistency Each output line is similar to this 130Process ID of the sdbroker will be returned 131132 Inconsistent Connection StatusInconsistent Connection Secondary Status Incomplete Connections 133CTM FTP Daemon Generic TroubleshootingFTP Username and Password FTP Daemon Overview135 Cwmftpd-File Not Available On SwitchFTP Sessions in Switch 136 10.13.3.7 421 Session Limit Reached10.13.3.8 499 Session Limit Reached General Log Information Failed to Acquire a Session with a SwitchFailed to Acquire Session After All Retries 137138
Related manuals
Manual 68 pages 52.71 Kb