Fujitsu Siemens Computers M4000, M5000, M8000, M9000 152

A-36SPARC Enterprise Mx000 Servers Dynamic Reconfiguration User’s Guide • September 2007

Contents

Page Page SPARC® Enterprise M4000/M5000/M8000/M9000 Servers Dynamic Reconﬁguration (DR) User's Guide Page Page Page Contents Checklists for System Configuration 2–11 Reservation of Domain Configuration Changes 2–12 2.2 Conditions and Settings Using XSCF 2–12 Conditions Using XSCF 2–12 3. DR User Interface 3–1 4. Practical Examples of DR 4–1 Examples: Replacing a System Board 4–12 Example: Replacing a Uni-XSBSystem Board 4–13 Example: Replacing a Quad-XSBSystem Board 4–16 Figures Page Tables Page Preface Audience Structure and Contents of This Manual Glossary and Index SPARC Enterprise Mx000 Servers Documentation Note – " x " in the order number is the version number of the manual 1.Manuals on the Web http://manuals.fujitsu-siemens.com 2.Provided in system Man page of the XSCF 3.Documentation and Supporting on the Web Abbreviated References to Other Documents Models Text Conventions Prompt Notations Syntax of the Command Line Interface (CLI) Command syntax Software License Fujitsu Siemens Computers Welcomes Your Comments Reader's Comment Form FOLD AND TAPE BUSINESS REPLY MAIL P O BOX 3470 SUNNYVALE CA Overview of Dynamic Reconfiguration 1.1DR system board cfgadm cfgadm_pci Uni-XSB Quad-XSB TABLE 1-1 and TABLE 1-2 list DR-relatedterms Page 1.2Basic DR Functions 1.2.1Adding a System Board 1.2.2Deleting a System Board 1.2.3Moving a System Board 1.2.4Replacing a System Board 1.3Security 1.4Overview of DR User Interfaces Section 3.1, “How To Use the DR User Interface” on page What You Must Know Before Using 2.1System Configuration 2.1.1System Board Components Page Page 2.1.1.1CPU 2.1.1.2Memory (1) Kernel Memory Board (1.1) Kernel Cage (1.2) Floating Boards (1.3) Kernel Memory Assignment (1.4) Copy-rename (2) User Memory Board (2.1) Locked Pages and ISM Pages 2.1.1.3I/O Device (1) Adding an I/O Device (2) Deleting an I/O Device 2.1.2System Board Configuration Requirements 2.1.3System Board Pool Function 2.1.4Checklists for System Configuration 2.1.5Reservation of Domain Configuration Changes 2.2Conditions and Settings Using XSCF 2.2.1Conditions Using XSCF 2.2.2Settings Using XSCF 2.2.2.1Configuration Policy Option 2.2.2.2Floating Board Option 2.2.2.3Omit-memoryOption 2.2.2.4Omit-I/OOption 2.3Conditions and Settings Using Solaris 2.3.1I/O and Software Requirements 2.3.2Settings of Kernel Cage Memory 2.4Status Management 2.4.1Domain Status 2.4.2System Board Status Page 2.4.3Flow of DR Processing 2.4.3.1Flowchart: Adding a System Board 2.4.3.2Flowchart: Deleting a System Board Page 2.4.3.3Flowchart: Moving a System Board Page 2.4.3.4Flowchart: Replacing System Board Page 2.5Operation Management 2.5.1I/O Device Management 2.5.2Swap Area 2.5.2.1Swap Area at System Board Addition 2.5.2.2Swap Area at System Board Deletion 2.5.3Real-timeProcesses 2.5.4Memory Mirror Mode 2.5.5Capacity on Demand (COD) 2.5.6XSCF Failover 2.5.7Kernel Memory Board Deletion 2.5.8Deletion of Board with DVD Drive DR User Interface 3.1How To Use the DR User Interface 3.1.1Displaying Domain Information Page The table below lists the items displayed by the showdcl(8) command The following shows examples of displays by the showdcl(8) command ■Example 1: Display of information on domain #0 ■Example 2: Display of detailed information on domain #0 3.1.2Displaying Domain Status 3.1.3Displaying System Board Information The table below lists the items displayed by the showboards(8) command Page The following examples show displays of the showboards(8) command ■Example 1: Display of information on all system boards Example 3.1.4 Displaying Device Information Page The following example shows a display by the showdevices(8) command 3.1.5Displaying System Board Configuration Information The table below lists the items displayed by the showfru(8) command The following example shows a display of the showfru(8) command ■Example: Display of configuration information on all system boards 3.1.6Adding a System Board Page 3.1.7Deleting a System Board Page 3.1.8Moving a System Board The following examples show the format and options of the moveboard(8) command Page 3.1.9Replacing a System Board Page 3.1.10Reserving a Domain Configuration Change 3.2Command Reference Page 3.3XSCF Web 3.4RCM Script Page Practical Examples of DR 4.1Flow of DR Operation 4.1.1Flow: Adding a System Board 4.1.2Flow: Deleting a System Board 4.1.3Flow: Moving a System Board 4.1.4Flow: Replacing a System Board 4.2Example: Adding a System Board 4.Add the new system board 5.Check the status of the domain and added system board 4.3Example: Deleting a System Board 3.Check the status of the system board to be deleted 4.Delete the system board 5.Check the status of the domain and deleted system board 4.4Example: Moving a System Board 3.Check the status of the move-destinationdomain 4.Check the status of the system board to be moved 5.Move the system board 6.Check the status of the move-sourcedomain 4.5Examples: Replacing a System Board 4.5.1Example: Replacing a Uni-XSBSystem Board Execute the deleteboard(8) command to delete the system board 5.Check the status of the system board 6.Physically replace the system board replacefru 7.Check the status of the replaced system board 8.Check the status of the domain 9.Add the new system board to the domain 10.Check the status of the domain and added system board 4.5.2Example: Replacing a Quad-XSBSystem Board 3.Check the status of all related system boards 4.Delete all system boards related to the CMU to be replaced 5. Power off Domain #1 so the CMU can be replaced 6.Check the status of all related system boards 7.Physically replace the system board 8.Check the status of the replaced system board 9.Check the status of all related domains 10.Add the new system board to the domain 11.Check the status of the related domains and system boards 4.6Examples: Reserving Domain Configuration Changes 4.6.1Example: Reserving a System Board Add 2.Check the status of the system board to be added 3.Reserve the addition of the system board 4.Check the status of the system board 5.Stop or reboot the domain 4.6.2Example: Reserving a System Board Delete 4.6.3Example: Reserving a System Board Move 5.Reserve the move of the system board 6.Check the reserved status of the system board 7.Stop the move-sourcedomain 8.Check the status of the move-destinationdomain and moved system board 9.Add the system board to the move-destinationdomain 10.Check the status of the move-destinationdomain and moved system board Page Message Meaning and Handling A.1 Solaris OS Messages A.1.1 Transition Messages OS unconfigure dr@0:SBX::memory [Explanation] Unconfigure memory on system board OS unconfigure dr@0:SBX::pciY [Explanation] Unconfigure PCI Y on system board suspending <device name>@<device info> (aka <alias>) A.1.2 PANIC Messages A.1.3 Warning Messages Page dr_status: failed to copyout status for board # dr_status: unknown dev type (#) dr_dev2devset: invalid cpu unit# = # dr_dev2devset: invalid io unit# = # dr_dev2devset: invalid mem unit# = # dr_pre_release_cpu: thread(s) bound to cpu [Explanation] The thread in the process is bound to the detached CPU pbind dr_pre_release_mem: unexpected kphysm_del_release return value # dr_pt_ioctl: invalid passthru args dr_release_mem_done: <device path>: error <error code> noted [Explanation] Error noted for a device during releasing memory drmach_log_sysevent failed (rv #) for SBX [Explanation] There may be minor error in the system unexpected kcage_range_add return value # Page Invalid argument Invalid argument: ######## [Explanation] Invalid argument is passed to the driver Invalid CPU/core state [Explanation] DR finds some faulty CPU that fails to power on Page Failed to off-line:dr@0:SBX::cpuY [Explanation] Failed to off-lineCPU Y on board Failed to on-line:dr@0:SBX::cpuY [Explanation] Failed to online CPU Y on system board Failed to start CPU: dr@0:SBX::cpuY Page Memory operation refused: dr@0:SBX::memory [Explanation] The DR operation is refused [Remedy] Respond in the manner directed by the other message Memory operation cancelled: dr@0:SBX::memory [Explanation] The DR operation is canceled Page Operation already in progress: dr@0:SBX::cpuY [Explanation] The operation on cpu Y on system board X is in progress dr_move_memory: failed to quiesce OS for copy-rename [Explanation] There is a task not suspended in the process No available memory target: dr@0:SBX::memory Page opl_claim_memory - unable to allocate contiguous memory opl_get_fcode: Unable to copy out fcode image opl_get_hwd_va: Unable to copy out cmuch descriptor for <addr [Explanation] Failed to copy out the cmuch HWD to the efcode daemon opl_get_hwd_va: Unable to copy out pcich descriptor for <addr Page I/O callback failed in post-attach Kernel Migration fails. 0x%x Failed to add CMP%d on board %d FMEM error = 0x<error code Cannot proceed; Board is configured or busy Page VM viability test failed: dr@0:SBX::memory [Explanation] There is not enough real memory to detach memory on system board DR parallel copy timeout SCF busy [Explanation] SCF was busy during kernel migration A.2 Command Messages A.2.1 addboard XSB#XX-Xis currently unavailable for DR. Try again later XSB#XX-Xhas not been registered in DCL [Explanation] System board (XSB#XX-X)is not registered to DCL [Remedy] Register DCL information by setdc(8) Another DR operation is in progress. Try again later Page A.2.2 deleteboard Page A.2.3 moveboard Page [Remedy] Power off the domain by specifying "-creserve XSB#XX-Xdetected timeout by DR self test XSB#XX encountered a hardware error. See error log for details Page A.2.4 setdcl A.2.5 setupfru A.2.6 showdevices Page Page Example: Confirm Swap Space Size /dev/dsk/c0t3d0s1 /dev/dsk/c1t1d0s1 Glossary Page Page Page Index