Troubleshooting Ethernet Hubs | Sun Microsystems 3900 Series

C H A P T E R 9

Troubleshooting Ethernet Hubs

The Sun StorEdge 3900 and 6900 series uses an Ethernet hub as the backbone for the internal service network. The allocation of Ethernet ports are as follows:

■1—Storage Service Processor (per subsystem)

■1—for each Fibre Channel Switch

■1—for each Virtualization Engine

■2—for each Sun StorEdge T3+ array partner group

■1—for the Ethernet hub that is installed on the second Sun StorEdge Expansion Cabinet in the Sun StorEdge 3960 and 6960 systems

Note –Information about LED Status lights, power information, and front panel settings, can be found in the SuperStack 3 Baseline Hub 12-Port TP (3C16440A) and 24- Port TP (3C16441A) User Guide, pn: DUA1644-0AAA03. This is a 3COM document. Log in to http://www.3com.com to access the documentation.

123

Image 139

Sun Microsystems 3900 Series, 6900 Series manual Troubleshooting Ethernet Hubs

Contents

Sun StorEdge 3900 Series Troubleshooting Guide Please Recycle Contents Configuration Settings Troubleshooting the Fibre Channel Links Troubleshooting Virtualization Engine Devices Troubleshooting Host Devices Troubleshooting the Sun StorEdge T3+ Array Devices Troubleshooting Ethernet Hubs 123 Page List of Figures 106 103 How This Book Is Organized Preface Solaris Handbook for Sun Peripherals Using Unix Commands Shell Prompts Typographic Conventions Related Documentation Sun Welcomes Your Comments Accessing Sun Documentation OnlinePage Introduction Predictive Failure Analysis Capabilities Troubleshooting Overview Tasks General Troubleshooting Procedures Var/adm/messages Quiesce the I/O along the path to be tested as follows Test and isolate the FRUs using the following tools Verify the fix using the following tools # luxadm display Multipathing Options in the Sun StorEdge 6900 SeriesClass Primary State To Quiesce the I/O To Unconfigure the c2 PathDetermine the path you want to disable Type Alternatives to Sun StorEdge Traffic Manager Verify that I/O has halted # cfgadm -c unconfigure c22b000060220041f4 # cfgadm -al To Return the Path to Production To Suspend the I/OVerify that I/O has resumed on all paths Type the following To View the VxDisk Properties# vxdisk list Disk1 # luxadm display /dev/rdsk/c23t2B000060220041F9d0s2 # luxadm display /dev/rdsk/c20t2B000060220041F4d0s2 To Quiesce the I/O on the A3/B3 Link Verify that the path is disabledTo Suspend the I/O on the A3/B3 Link Verify that the path has been re-enabled by typing Fibre Channel Links 1Sun StorEdge 3900 Series Fibre Channel Link Diagram Fibre Channel Link Diagrams 2Sun StorEdge 6900 Series Fibre Channel Link Diagram Storage Service Processor Side Troubleshooting Host Side Troubleshooting Qlctest1M Command Line Test Examples Switchtest1M To Customize an Event Report Storage Automated Diagnostic Environment Event Grid2Event Grid Sorting Criteria Page A1/B1 Fibre Channel FC Link 1Data Host Notification of Intermittent Problems 2Data Host Notification of Severe Link Error Offline To Verify the Data Host Code Example 3-2cfgadm -al Display FRU Tests Available for A1/B1 FC Link Segment # ./switchtest -v -o dev=2192.168.0.300 Code Example 3-3switchtest1M called with options To Isolate the A1/B1 FC Link 4A2/B2 FC Link Host Side Event A2/B2 Fibre Channel FC Link 5A2/B2 FC Link Storage Service Processor Side Event To Verify the Host Side # luxadm -e port To Isolate the A2/B2 FC Link To Verify the A2/B2 FC LinkPage From fabric A3/B3 Fibre Channel FC LinkJan 8 182404 WWN2b000060220041f9 Port with DID=104000 7A3/B3 FC Link Storage Service Processor-Side Event # luxadm -e port Code Example 3-5Devices in the connected state FRU Tests Available for the A3/B3 FC Link Segment To Verify the Storage Service Processor To Isolate the A3/B3 FC Link 9A4/B4 FC Link Data Host Notification A4/B4 Fibre Channel FC Link 10Storage Service Processor Notification Sun StorEdge 3900 Series Offline To Isolate the A4/B4 FC Link FRU tests available for the A4/B4 FC Link Segment Rerun switchtest Page To Verify Configuration Settings Verifying Configuration SettingsRun one of the following scripts # /opt/SUNWsecfg/checkdefaultconfig Code Example 4-1 /opt/SUNWsecfg/checkdefaultconfig output PST To Clear the Lock File Fix the Fail condition, and then verify the settings againType the following command # /opt/SUNWsecfg/bin/checkt3config -n t3b0 Tue Jan 29 161401 MST 2002 savevemap v1 Exit Page Host Event Grid Using the Host Event Grid 1Host Event Grid Troubleshooting Host Devices Host Lun.VE Alarm Red Info The state To Replace the Master Host Install the SUNWstade package on a new Master Host Configure the host as a slave Choose Utilities System Recover ConfigChoose Maintenance General Maintenance Maintain Hosts Install the SUNWstade package on the new host Conclusion Page A P T E R To Diagnose and Troubleshoot Switch Hardware Switch Event GridUsing the Switch Event Grid 1Switch Event Grid 1lists the switch events Switch Enclosure Audit Auditing a new Switch called ras Page Offline To Replace the Master Midplane Replacing the Master Midplane Virtualization Engine Description Troubleshooting Virtualization Engine Devices To Retrieve Service Information Virtualization Engine DiagnosticsService Request Numbers Service and Diagnostic Codes # /opt/svengine/sduc/sreadlog -d To Display Log Files and Retrieve SRNs 1Virtualization Engine LEDs Virtualization Engine LEDs 1Virtualization Engine Front Panel LEDs 2LED Service and Diagnostic Codes Ethernet Port LEDs Back Panel Features3Speed, Activity, and Validity of the Link 4Virtualization Engine Statistical Data Fibre Channel Link Error Status Report Daemon error check the Slic router To Check Fibre Channel Link Error Status Manually # /opt/svengine/sduc/svstat -d Code Example 7-1Fibre Channel Link Error Status Example Code Example 7-2luxadm Output for a Host Device Translating Host Device Names# luxadm display /dev/rdsk/c4t2B00006022004186d0s2 To Display the Vlun Serial Number Devices That Are Not Sun StorEdge Traffic Manager-Enabled Sun StorEdge Traffic Manager-Enabled Devices To view the virtualization engine map, type To View the Virtualization Engine Map# showvemap -n v1 -f Virtualization Engine Main Menu To Failback the Virtualization Engine From the Storage Service Processor, type Check the configuration Power on the new unit Log in to the new unit, for exampleTo Replace a Failed Virtualization Engine Verify the new unit by typing Enable the switch portReset the virtualization engine Find the initiator number for the new and old number To Reset the SAN Database on a Single Virtualization Engine To Reset the SAN Database on Both Virtualization EnginesEnter 9 to clear the SAN database To Restart the Slic Daemon Stopping and Restarting the Slic DaemonCheck whether the Slicd is running # ipcrm -m 301 -m 302 -m 303 -s 196608 -s 196609 -s Remove the segments by typing the followingRestart the Slic daemon Confirm that the Slic daemon is running Sun StorEdge 6900 Series Multipathing Example 2Sun StorEdge 6900 Series Logical View 3Primary Data Paths to the Alternate Master 4Primary Data Paths to the Master Sun StorEdge T3+ Array 5Path Failure-Before the Second Tier of Switches 6Path Failure -I/O Routed through Both HBAs Virtualization Engine Event Grid Using the Virtualization Engine Event Grid 5lists the Virtualization Engine Events For Internal Use Only Page Explorer Data Collection Utility Troubleshooting the Sun StorEdge T3+ Array Devices # vi saninput.txt Code Example 8-1Editing switch information using # vi t3input.txt Troubleshooting the T1/T2 Data Path T1/T2 Notification Events On next 2Virtualization Engine Alert 3Manage Configuration Files Menu T1/T2 FRU Tests Available T1/T2 Isolation Procedures Sun StorEdge T3+ Array Event Grid Using the Sun StorEdge T3+ Array Event Grid StorEdge T3+ array Replace the power Unit is not optimal T3+ array using Luxadm probe T3ofdg Diagnostic Red Power Insert Info Component Has reported a disk Disk State Controller State Red Info/Action Recommended action Change Verify matching LUN has changed Replacing the Master Midplane Troubleshooting Ethernet Hubs Page Table A-1SRN and Snmp Reference Table A-2 SRN/SNMP Single Point of Failure Table Write error is detected by master Read degrade recorded . a mirror drive 70051 Table A-2SRN/SNMP Single Point of Failure Table Table A-3Port Communication Table A-4Service Codes 126 SUNWsecfg Error Messages Table B-1Virtualization Engine SUNWsecfg Error Messages Appendix B SUNWsecfg Error Messages Cannot continue configuration Other components If the switch in question does not Port switch. Check showswitch -s Table B-3Sun StorEdge T3+ Array SUNWsecfg Error Messages Directory. If the snapshot files are not Snapshot file. The Sun StorEdge T3+ Boxtype Table B-4Other SUNWsecfg Error Messages 1setupswitch Exit Values Setupswitch Exit ValuesPage Index Page WWN