Cmuconsole8 | HP Insight Cluster Management Utility guide

cmu_console(8)

NAME

cmu_console -- Connect to compute node management ports.

SYNOPSIS

#/opt/cmu/bin/cmu_console <compute_node_hostname>

DESCRIPTION

Invoke directly from the operating system shell to connect to compute node management ports (iLO/lo100i).

EXAMPLES

#/opt/cmu/bin/cmu_console <compute_node_hostname>

contacting ilo_ip_address...

Warning: Permanently added 'ilo_ip_address' (RSA) to the list of known hosts. cmu@x.x.x.x's password:

User:cmu logged-in to <domain>(<ilo_ip_address>)

iLO 2 Standard Blade Edition 1.78 at 15:43:13 Jun 10 2009 Server Name: GB8929X6C6

Server Power: On </>hpiLO->

164

Page 164

Image 164

HP Insight Cluster Management Utility manual Cmuconsole8, Cmuconsole -- Connect to compute node management ports

Contents

HP Insight Cluster Management Utility Copyright 2013 Hewlett-Packard Development Company, L.P Contents Defining a cluster with HP Insight CMU Provisioning a cluster with HP Insight CMU Monitoring a cluster with HP Insight CMU Actions Alerts Alert reactions Managing a cluster with HP Insight CMUAdvanced topics 112 Troubleshooting 126 Detailed installation instructions 131Support and other resources 123 HP Insight CMU manpages 139 Glossary 187 Index 189 Figures Examples Date command Dmidecode commandTables Features HP Insight CMU configurationOverview Compute node monitoring Compute node administration System disk replication Management node hardware requirements Installing and upgrading HP Insight CMUInstalling HP Insight CMU Planning for compute node installation Firmware upgrade requirementsConfiguring the local smart array card Configuring the management cards Configuring the Bios NIC 1 PXE boot or PXE enabled NIC 2 Disabled7.1 DL3xx, DL5xx, DL7xx, Blades Speed 9600 Bd 7.2 DL160 G5, DL165c G5, DL165c G6, and DL180 G5 Servers IDE Share NIC mode Disabled Dhcp DisabledNIC1 control Enabled NIC1 PXE Enabled 7.4 SL2x170z G6 and DL170h G6 Servers Bios setting NIC2 on the SL2x170z G6 Server HP Insight CMU kit delivery Preparing for installationPreinstallation limitations Rhel 6 support Operating system supportHP Insight CMU CD-ROM directory structure SELinux and HP Insight CMU HP Insight CMU installation checklistLogin privileges # chkconfig --add cmu Installation proceduresRun /opt/cmu/bin/cmumgtconfig -c Installing HP Insight CMU with high availability Installing and upgrading HP Insight CMU Installing HP Insight CMU under HA HA hardware requirementsSoftware prerequisites Overview Installing and testing Configuring HA control of HP Insight CMUHP Insight CMU HA service requirements # /etc/init.d/cmuserver start Cmuadmin1# /etc/init.d/cmu startStart cmuserver Cmu hacmu service needs restart Var/log/cmuservicehostname.log file for errorsCmuadmin2# /opt/cmu/tools/cmuhapostinstall # /etc/init.d/cmu setaudit # /etc/init.d/cmu stop HP Insight CMU configuration considerations Upgrading HP Insight CMU HA serviceCmuha nothing to backup from the cmu HA share Run cmuhapostinstall on server Stopping the HP Insight CMU service Upgrading HP Insight CMUDependencies Upgrading Java Runtime Environment Saving the HP Insight CMU database Restoring the HP Insight CMU database HP Insight CMU service status Defining a cluster with HP Insight CMULaunching the HP Insight CMU GUI HP Insight CMU main window Administrator mode Quitting administrator modeClick Options→Unprivileged Mode Server requirements High-level checklist for building an HP Insight CMU cluster Cluster administration Node management Node management window Scanning nodes Scan node dialog Management card password window Adding nodes Cluster Administration→Node Management Modifying nodes Network entity management Importing nodesDeleting nodes Exporting nodes Adding network entities Deleting network entities Provisioning a cluster with HP Insight CMU Logical group management Renaming logical groups Modifying logical groupsDeleting logical groups Autoinstall Autoinstall requirementsAutoinstall templates Autoinstall calling methods Using autoinstall from GUI Enabling autoinstallCreating an autoinstall logical group Restart cmuserver Autoinstall compute nodes Registering compute nodes Using autoinstall from CLI Registering an autoinstall logical groupAdding nodes to autoinstall logical group Cmu addtologicalgroup node to logicalgroupname Where nodes.txt is the list of nodes to autoinstall Customization Backing up a disk from a compute node in a logical group Backing upRestrictions # /opt/cmu/image/logicalgroupname Cloning procedure Cloning Preconfiguration Cloning status Reconfiguration Default content of prereconf.sh is Node static info Rescan MAC HP Insight CMU image editor Expanding an imageAfter editing the image, commit changes # cmuimagecommit -i rh5u4x8664 HP Insight CMU diskless environments Modifying an imageSaving a modified cloning image # /opt/cmu/bin/cmuimagecommit -i rh5u4x8664 Modifying the Tftp server configuration Operating systems supportedOn the management node On the golden node Activating the diskless feature Populating the HP Insight CMU databaseCreating a diskless image Creating a diskless logical group Adding a new logical group Adding nodes into the logical group From the CLI# /opt/cmu/cmucli Cmu probekernel Booting the compute nodes Cmu boot net myTestImage node1 nodenUnderstanding the structure of a diskless image Customizing your diskless image Using reconf-diskless-image.sh Do not update the /opt/cmu/image/imageName/root directory Best practices for diskless clustersTemplates and image file Node. /opt/cmu/image/imageName/snapshot/nodeName On Red Hat Configuring additional NFS servers# chkconfig nfs on When a diskless logical group is created # chkconfig nfsserver onOn Sles Sample file When a node is added to the diskless logical group Comments on High Availability HA Deploying the monitoring client Installing the HP Insight CMU monitoring clientMonitoring a cluster with HP Insight CMU Monitoring the cluster Launch the HP Insight CMU GUI Node and group status Selecting the central frame display Global cluster view in the central frame Monitoring window Resource view in the central frame Resource view overview Node view in the central frame Detail mode in resource viewGauge widget Using time view Node details Adaptive stacking Getting startedTagging nodes Bindings and options Mouse control Troubleshooting Technical dependencies Archiving user groups Visualizing history data Tuning HP Insight CMU monitoring Stopping HP Insight CMU monitoringAction and alert files Limitations Actions Alerts Alerts Alert reactions Text of the Description for this reaction Name of the alert that caused the reactionLevel of the alert Using collectl for gathering monitoring data Installing and starting collectl on compute nodes# chkconfig --add collectl # /etc/init.d/collectl start # collectl -c 1 -s+C --export lexpr ActionAndAlertFile.txt file # mkdir /var/log/collectl # vi /etc/exports Var/log/collectl *rw,sync,noallsquash,norootsquash# exportfs -r # cp -a /var/www/html/colplot /opt/cmu/www/colplot # mkdir /var/log/collectl # vi /etc/fstab # vi /etc/collectl.confRestart collectl # /etc/init.d/collectl restart Select plotting options, then click Generate Plot Monitoring GPUs and coprocessorsMonitoring Nvidia GPUs # cmuconfigamd Monitoring AMD GPUs Monitoring Intel coprocessors Review the results and verify no errors are reported # /opt/cmu/bin/cmuconfigintel Extended metric support HP Insight CMU alert converted to SIM event Opt/cmu/bin/cmusubmitextendedmetrics -f datafile Administrator menu Managing a cluster with HP Insight CMUUnprivileged user menu SSH connection Power off Management card connectionVirtual serial port connection Shutdown Change UID LED status BootReboot Dshbak Multiple windows broadcastSingle window pdsh Cmudiff examples Cmupdsh cmudiff -d Cmupdsh dmidecodeCmupdsh cmudiff -h # vi /root/.ssh/config Parallel distributed copy pdcp User group management Adding user groups Viewing and analyzing Bios settings HP Insight firmware managementDeleting user groups Renaming user groups Customizing the GUI menu Checking Bios versionsInstalling and upgrading firmware Saving user settings Basic commandsHP Insight CMU CLI Starting a CLI interactive session Help commands Getting help for a commandFor example, to get more information about the halt command Cmu help Executing a command on one node Specifying nodesDisplaying logical groups of a cluster Displaying nodes of a logical group Executing a command on a list of nodes Executing a command on a range of nodesUsing wildcards Executing a command on all nodes Administration and cloning commands Executing a command on specific nodes of a logical groupBooting a set of nodes Broadcasting commands to a set of nodes Halting a set of nodes Rebooting a set of nodesPowering off a set of nodes Setting the locator LED on or off Cloning a set of nodesCmu locate on o185i192 Cmu locate off o185i192 Backing up a node Adding a new logical groupAdding nodes to a logical group Cmu backup Modifying a management card password Cmu modifypassword ILOILOCMlo100iCmu modifypassword lo100i Discovering MAC address for new nodes Administration utilities pdcp and pdsh HP Insight CMU Linux shell commands# /opt/cmu/bin/pdcp -w cn0001,cn0002 source /tmp/dest # /opt/cmu/bin/pdsh -w cn0001,cn0002 ls Accessing the GUI for non-root users Advanced topics Configuring sudo support Custom menu options for non-root users Cjones ALL = Cmupower Bstevens ALL = Nopasswd Cmupower CmuimageSbarney ALL = Nopasswd Cmupower Cmuimage Cmuetc HP Insight CMU diskless API Name of the new logical group Build diskless imageDelete diskless image Boot diskless node Configure diskless nodeUnconfigure diskless node HP Insight CMU remote hardware control API Diskless checkLo100i None Off OsoffUidoff Uidon CMUVALIDHARDWARETYPES=ILOlo100iILOCM CMUVALIDHARDWARETYPES=ILOlo100iILOCMIPMI CMUvSMPPREFIX=vSMP Support for ScaleMPCloning mechanisms Cloning mechanisms Advanced topics Related information Support and other resourcesContacting HP Command Typographic conventionsComputer output User input Typographic conventions HP Insight CMU logs TroubleshootingNetwork boot issues Troubleshooting network boot Backup issuesTroubleshooting switch issues Cloning issues Administration command problemsGUI problems If not, restart the HP Insight CMU service Certificate error Detailed Java exception is Troubleshooting Detailed installation instructions Install required RPMsActivating xinetd services # chkconfig nfs on # /etc/init.d/nfs start Firewall configuration Java installationVerifying the Dhcpd listen interface On the HP Insight CMU management node Installing HP Insight CMU licensing Setting the Java PathConfiguring the HP Insight CMU management server hostname Method Cmu service needs restart Starting HP Insight CMUEdit the /opt/cmu/etc/cmuserver.conf file # vi /opt/cmu/etc/cmuserver.conf Configuring HP Insight CMU to start automatically Installing HP Insight CMU on the GUI client workstationVerifying the HP Insight CMU state Cmuserver utility reports the state of the daemons Using an X Window server Configuring the GUI client on Linux workstationsUsing an ssh tunnel Launching the HP Insight CMU directly from the Java file Launching the HP Insight CMU GUI using a web browserActivating the HP Insight CMU GUI HP Insight CMU GUI HP Insight CMU manpages Cmushownodes8 # /opt/cmu/bin/cmushownodes -a -o %n %i %k %m default %b %t # /opt/cmu/bin/cmushownodes Cmushowlogicalgroups8 # /opt/cmu/bin/cmushowlogicalgroups -h logicalgroupnameHelp # /opt/cmu/bin/cmushowlogicalgroups Cmushownetworkentities8 # /opt/cmu/bin/cmushownetworkentities -h networkentity# /opt/cmu/bin/cmushownetworkentities # /opt/cmu/bin/cmushownetworkentities rack1 Cmushowusergroups8 # /opt/cmu/bin/cmushowusergroups -h usergroup# /opt/cmu/bin/cmushowusergroups # /opt/cmu/bin/cmushowusergroups user1 Cmushowarchivedusergroups8 # /opt/cmu/bin/cmushowarchivedusergroups# /opt/cmu/bin/cmushowarchivedusergroups -p -f # /opt/cmu/bin/cmushowarchivedusergroups -f -s Node-number num Cmuaddnode8Mgtcardip -T--mgt-card ILOlo100iILOCM -R--arch architecture Command-line mode Processing 1 node# cat nodes.txt # /opt/cmu/bin/cmuaddnode -f nodes.txt Cmuaddnetworkentity8 Filename inputfile# /opt/cmu/bin/cmuaddnetworkentity rack1 rack2 # /opt/cmu/bin/cmuaddnetworkentity -f networkentitylist Cmuaddlogicalgroup8 Filename inputfile input logical groups from inputfile Name# /opt/cmu/bin/cmuaddlogicalgroup -n test -d cciss/c0d0 # /opt/cmu/bin/cmuaddlogicalgroup -f logicalgroupfile Nodenamefile Cmuaddtologicalgroupcandidates8Logicalgroup # /opt/cmu/bin/cmuaddusergroup -f usergrouplist Cmuaddusergroup8# /opt/cmu/bin/cmuaddusergroup user1 user2 Cmuaddtousergroup8 Usergroup# /opt/cmu/bin/cmuaddtousergroup -t group1 cn0003 # /opt/cmu/bin/cmuaddtousergroup -t group1 -f nodenamefile Cmuchangeactivelogicalgroup8 To flag cn0001 active in logical group rh6u0x8664 # /opt/cmu/bin/cmuchangenetworkentity -t rack1 cn0001 Cmuchangenetworkentity8Networkentity Cmudelfromlogicalgroupcandidates8 Delete one or more nodes from a logical groupDelete nodes from this logical group To delete one node from a logical group rh6u0x8664 Cmudelfromnetworkentity8 # /opt/cmu/bin/cmudelfromnetworkentity -t rack1 node1 # /opt/cmu/bin/cmudelarchivedusergroup -h -v-t timeout -d Cmudelarchivedusergroup8Cmudelarchivedusergroup -- Delete an archived user group Delete an archived user group Cmudelfromusergroup8 # /opt/cmu/bin/cmudelfromusergroup -t user1 node1 # /opt/cmu/bin/cmudellogicalgroup -f logicalgrouplist Cmudellogicalgroup8# /opt/cmu/bin/cmudellogicalgroup rh5u5x8664 sles11sp1x8664 # /opt/cmu/bin/cmudelnetworkentity -f networkentitylist Cmudelnetworkentity8# /opt/cmu/bin/cmudelnetworkentity rack1 rack2 # /opt/cmu/bin/cmudelnode -f nodelist Cmudelnode8# /opt/cmu/bin/cmudelnode node1 node2 Cmudelsnapshots8 Delete monitoring snapshots from the history database Cmudelusergroup8 # /opt/cmu/bin/cmudelusergroup user1 user2# /opt/cmu/bin/cmudelusergroup -f usergrouplist # /opt/cmu/bin/cmudelusergroup -a -m 60 -f usergrouplist # /opt/cmu/bin/cmuconsole computenodehostname Cmuconsole8Cmuconsole -- Connect to compute node management ports Cmupower8 Cmupower -p OFF -n cn0001 Cmupower -p OFF -u user1Cmupower -p Boot -l rh6u0x8664 Cmupower -p Uidon -u user2 Cmucustomrun8 Title# /opt/cmu/bin/cmucustomrun -l # /opt/cmu/bin/cmucustomrun -t auditlspci Cmuclone8 =node# /opt/cmu/bin/cmuclone -f /tmp/nodelist -i sles11sp1x8664 # /opt/cmu/bin/cmuclone -n node1 -i rh6u2x8664 Cmubackup -l myimage -n node20 -r 3 -e /tmp/err.log Cmubackup8Cmubackup -l myimage -n node20 -p cciss/c0d0p3,cciss/c0d0p1 # /opt/cmu/bin/cmuscanmacs -h hostname -p hostnameprefix Cmuscanmacs8Options naming Options general Example Example node definitions 173 Cmurescanmac8 Cmurescanmac -- Rescan the MAC address of a node# /opt/cmu/tools/cmurescanmac -n nodename N NICnum -h Node name in the HP Insight CMU database Lg logicalgroup Cmumodnode8Filename # /opt/cmu/bin/cmumodnode -f nodes.txt Cmumonstat8 # /opt/cmu/bin/cmumonstat --nodes=n0001,n0002,n0001-11 # /opt/cmu/bin/cmumonstat --all-sensors --all-nodes# /opt/cmu/bin/cmumonstat --all-nodes --all-sensors --stats # /opt/cmu/bin/cmumonstat --all-nodes --color Cmuimageopen8 # /opt/cmu/bin/cmuimageopen -h -i imagenameTo open the HP Insight CMU image rh5u5x8664 # /opt/cmu/bin/cmuimageopen -i rh5u5x8664 Cmuimagecommit8 # /opt/cmu/bin/cmuimagecommit -i rh5u5x8664 Cmuconfignvidia8 Cmuconfignvidia -- Configure Nvidia GPU monitoring Cmuconfigamd8 Cmuconfigamd -- Configure AMD GPU monitoring # /opt/cmu/bin/cmuconfigintel -h -r -n Cmuconfigintel8Cmuconfigintel -- Configure Intel coprocessor monitoring Cmumgtconfig8 Automatically defaults when reasonableEth num1num2bond num1 Num # /opt/cmu/bin/cmumgtconfig -t # /opt/cmu/bin/cmumgtconfig -c# /opt/cmu/bin/cmumgtconfig -c -s dhcp Cmufirmwaremgmt8 Cmufirmwaremgmt -- Verify and execute firmwareOcmudiffparameters Specifies a text file listing compute nodes Glossary Ebipa Package management Index Index 191

HP Insight Cluster Management Utility Cmuconsole8, # /opt/cmu/bin/cmuconsole computenodehostname

Models: Insight Cluster Management Utility

cmu_console(8)

cmu_console -- Connect to compute node management ports.

#/opt/cmu/bin/cmu_console <compute_node_hostname>

EXAMPLES