T1/T2 Notification Events | Sun Microsystems 3900 Series guide

T1/T2 Notification Events

The example below shows a typical port failure event

Site	:	Lab 3286 - DSQA1 Broomfield
Source	:	diag.xxxxx.xxx.com
Severity :		Error (Actionable)
Category :		Switch
DeviceId :		switch:100000c0dd00b682
EventType:		StateChangeEvent.M.port.8
EventTime:		01/30/2002 11:17:22

’port.8’ in SWITCH diag209-sw2a (ip=192.168.0.32) is now Not-Available (status-state changed from ’Online’ to ’Offline’):

INFORMATION:

A port on the switch has logged out of the fabric and gone offline

PROBABLE-CAUSE:

1.Verify cables, GBICs and connections along Fibre Channel path

2.Check Storage Automated Diagnostic Environment SAN Topology GUI to identify failing segment of the data path

3.Verify correct FC switch configuration

----------------------------------------------------------------------

Site	:	Lab 3286 - DSQA1 Broomfield
Source	:	diag.xxxxx.xxx.com
Severity :		Warning
Category :		Switch
DeviceId :		switch:100000c0dd00b682
EventType:		LogEvent.MessageLog
EventTime:		01/30/2002 11:17:22

Change in Port Statistics on switch diag209-sw2a (ip=192.168.0.32): Port-8: Received 9746 ’InvalidTxWds’ in 0 mins (value=9805 )

FIGURE 8-1Storage Service Processor Event

Chapter 8 Troubleshooting the Sun StorEdge T3+ Array Devices 103

For Internal Use Only

Image 119

Sun Microsystems 3900 Series, 6900 Series manual T1/T2 Notification Events

Contents

Sun StorEdge 3900 Series Troubleshooting Guide Please Recycle Contents Configuration Settings Troubleshooting the Fibre Channel Links Troubleshooting Virtualization Engine Devices Troubleshooting Host Devices Troubleshooting the Sun StorEdge T3+ Array Devices Troubleshooting Ethernet Hubs 123 Page List of Figures 106 103 How This Book Is Organized Preface Solaris Handbook for Sun Peripherals Using Unix Commands Shell Prompts Typographic Conventions Related Documentation Sun Welcomes Your Comments Accessing Sun Documentation OnlinePage Introduction Predictive Failure Analysis Capabilities Troubleshooting Overview Tasks General Troubleshooting Procedures Var/adm/messages Quiesce the I/O along the path to be tested as follows Test and isolate the FRUs using the following tools Verify the fix using the following tools Class Primary State Multipathing Options in the Sun StorEdge 6900 Series# luxadm display To Quiesce the I/O To Unconfigure the c2 PathDetermine the path you want to disable Type Alternatives to Sun StorEdge Traffic Manager Verify that I/O has halted # cfgadm -c unconfigure c22b000060220041f4 # cfgadm -al Verify that I/O has resumed on all paths To Suspend the I/OTo Return the Path to Production # vxdisk list Disk1 To View the VxDisk PropertiesType the following # luxadm display /dev/rdsk/c23t2B000060220041F9d0s2 # luxadm display /dev/rdsk/c20t2B000060220041F4d0s2 To Suspend the I/O on the A3/B3 Link Verify that the path is disabledTo Quiesce the I/O on the A3/B3 Link Verify that the path has been re-enabled by typing Fibre Channel Links 1Sun StorEdge 3900 Series Fibre Channel Link Diagram Fibre Channel Link Diagrams 2Sun StorEdge 6900 Series Fibre Channel Link Diagram Storage Service Processor Side Troubleshooting Host Side Troubleshooting Qlctest1M Command Line Test Examples Switchtest1M 2Event Grid Sorting Criteria Storage Automated Diagnostic Environment Event GridTo Customize an Event Report Page A1/B1 Fibre Channel FC Link 1Data Host Notification of Intermittent Problems 2Data Host Notification of Severe Link Error Offline To Verify the Data Host Code Example 3-2cfgadm -al Display FRU Tests Available for A1/B1 FC Link Segment # ./switchtest -v -o dev=2192.168.0.300 Code Example 3-3switchtest1M called with options To Isolate the A1/B1 FC Link 4A2/B2 FC Link Host Side Event A2/B2 Fibre Channel FC Link 5A2/B2 FC Link Storage Service Processor Side Event To Verify the Host Side # luxadm -e port To Isolate the A2/B2 FC Link To Verify the A2/B2 FC LinkPage From fabric A3/B3 Fibre Channel FC LinkJan 8 182404 WWN2b000060220041f9 Port with DID=104000 7A3/B3 FC Link Storage Service Processor-Side Event # luxadm -e port Code Example 3-5Devices in the connected state FRU Tests Available for the A3/B3 FC Link Segment To Verify the Storage Service Processor To Isolate the A3/B3 FC Link 9A4/B4 FC Link Data Host Notification A4/B4 Fibre Channel FC Link 10Storage Service Processor Notification Sun StorEdge 3900 Series Offline To Isolate the A4/B4 FC Link FRU tests available for the A4/B4 FC Link Segment Rerun switchtest Page Run one of the following scripts Verifying Configuration SettingsTo Verify Configuration Settings # /opt/SUNWsecfg/checkdefaultconfig Code Example 4-1 /opt/SUNWsecfg/checkdefaultconfig output PST To Clear the Lock File Fix the Fail condition, and then verify the settings againType the following command # /opt/SUNWsecfg/bin/checkt3config -n t3b0 Tue Jan 29 161401 MST 2002 savevemap v1 Exit Page Host Event Grid Using the Host Event Grid 1Host Event Grid Troubleshooting Host Devices Host Lun.VE Alarm Red Info The state To Replace the Master Host Install the SUNWstade package on a new Master Host Configure the host as a slave Choose Utilities System Recover ConfigChoose Maintenance General Maintenance Maintain Hosts Install the SUNWstade package on the new host Conclusion Page A P T E R Using the Switch Event Grid Switch Event GridTo Diagnose and Troubleshoot Switch Hardware 1Switch Event Grid 1lists the switch events Switch Enclosure Audit Auditing a new Switch called ras Page Offline To Replace the Master Midplane Replacing the Master Midplane Virtualization Engine Description Troubleshooting Virtualization Engine Devices To Retrieve Service Information Virtualization Engine DiagnosticsService Request Numbers Service and Diagnostic Codes # /opt/svengine/sduc/sreadlog -d To Display Log Files and Retrieve SRNs 1Virtualization Engine LEDs Virtualization Engine LEDs 1Virtualization Engine Front Panel LEDs 2LED Service and Diagnostic Codes 3Speed, Activity, and Validity of the Link Back Panel FeaturesEthernet Port LEDs 4Virtualization Engine Statistical Data Fibre Channel Link Error Status Report Daemon error check the Slic router To Check Fibre Channel Link Error Status Manually # /opt/svengine/sduc/svstat -d Code Example 7-1Fibre Channel Link Error Status Example # luxadm display /dev/rdsk/c4t2B00006022004186d0s2 Translating Host Device NamesCode Example 7-2luxadm Output for a Host Device To Display the Vlun Serial Number Devices That Are Not Sun StorEdge Traffic Manager-Enabled Sun StorEdge Traffic Manager-Enabled Devices # showvemap -n v1 -f To View the Virtualization Engine MapTo view the virtualization engine map, type Virtualization Engine Main Menu To Failback the Virtualization Engine From the Storage Service Processor, type To Replace a Failed Virtualization Engine Power on the new unit Log in to the new unit, for exampleCheck the configuration Verify the new unit by typing Enable the switch portReset the virtualization engine Find the initiator number for the new and old number Enter 9 to clear the SAN database To Reset the SAN Database on Both Virtualization EnginesTo Reset the SAN Database on a Single Virtualization Engine Check whether the Slicd is running Stopping and Restarting the Slic DaemonTo Restart the Slic Daemon # ipcrm -m 301 -m 302 -m 303 -s 196608 -s 196609 -s Remove the segments by typing the followingRestart the Slic daemon Confirm that the Slic daemon is running Sun StorEdge 6900 Series Multipathing Example 2Sun StorEdge 6900 Series Logical View 3Primary Data Paths to the Alternate Master 4Primary Data Paths to the Master Sun StorEdge T3+ Array 5Path Failure-Before the Second Tier of Switches 6Path Failure -I/O Routed through Both HBAs Virtualization Engine Event Grid Using the Virtualization Engine Event Grid 5lists the Virtualization Engine Events For Internal Use Only Page Explorer Data Collection Utility Troubleshooting the Sun StorEdge T3+ Array Devices # vi saninput.txt Code Example 8-1Editing switch information using # vi t3input.txt Troubleshooting the T1/T2 Data Path T1/T2 Notification Events On next 2Virtualization Engine Alert 3Manage Configuration Files Menu T1/T2 FRU Tests Available T1/T2 Isolation Procedures Sun StorEdge T3+ Array Event Grid Using the Sun StorEdge T3+ Array Event Grid StorEdge T3+ array Replace the power Unit is not optimal T3+ array using Luxadm probe T3ofdg Diagnostic Red Power Insert Info Component Has reported a disk Disk State Controller State Red Info/Action Recommended action Change Verify matching LUN has changed Replacing the Master Midplane Troubleshooting Ethernet Hubs Page Table A-1SRN and Snmp Reference Table A-2 SRN/SNMP Single Point of Failure Table Write error is detected by master Read degrade recorded . a mirror drive 70051 Table A-2SRN/SNMP Single Point of Failure Table Table A-3Port Communication Table A-4Service Codes 126 SUNWsecfg Error Messages Table B-1Virtualization Engine SUNWsecfg Error Messages Appendix B SUNWsecfg Error Messages Cannot continue configuration Other components If the switch in question does not Port switch. Check showswitch -s Table B-3Sun StorEdge T3+ Array SUNWsecfg Error Messages Directory. If the snapshot files are not Snapshot file. The Sun StorEdge T3+ Boxtype Table B-4Other SUNWsecfg Error Messages 1setupswitch Exit Values Setupswitch Exit ValuesPage Index Page WWN