Index | HP Insight Cluster Management Utility guide

Index

A

action files, 78 actionsandalerts.txt, 81 adding network entities, 40 adding nodes, 37 adding user groups, 98 administration, 12

cluster, 34

administration command problems, 128 administration utilities, 111 administrator menu, 91 administrator mode, 33

alert files, 77, 79 alert reactions, 79 AMD GPUs, 86 API, 111 autoinstall, 43

adding nodes to logical group from CLI, 46 calling methods, 43

CLI, 46

compute nodes from GUI, 45 creating logical group from GUI, 44 customization, 47

enabling from GUI, 44 GUI, 44

registering logical group from CLI, 46 requirements, 43

restrictions, 48 templates, 43

B

backup, 48 backup issues, 127 BIOS, 15

BIOS checking, 100 BIOS settings, 99 blades, 15

boot, 93 bootopts, 119

C

certificate error, 129 checking state, 135

CLI commands, 101, 103, 105 administrative commands, 105 basic commands, 101 cloning commands, 105 shell interface commands, 111 specifying nodes, 103

CLI session, 101 cloning, 50 cloning issues, 128 cloning mechanisms, 120 cmudiff, 95 cmugui.jar, 137

cmuserver, 134 collectl, 81

installing, 81 colplot, 83 compute nodes

administration, 12 installing, 13 monitoring, 11 monitoring agent, 66 scanning, 36

configuration BIOS, 15 firewall, 132 hostname, 133 management cards, 14 network, 11

OS, 11 tasks, 11 conrep, 99

contacting HP, 123

D

database restoring, 31 saving, 31

deleting logical groups, 42 deleting network entities, 40 deleting nodes, 39 deleting user groups, 99 DHCPD, 132

directory structure, 20 disk replication, 12

disk space requirements, 14 diskless API, 114

diskless environments, 55 activating the diskless feature, 57 adding nodes, 59

best practices, 62 booting nodes, 60 creating image, 57 creating logical group, 57 customizing image, 60 image file, 62

image structure, 60 installation, 56 NFS servers, 63 operating system support, 56

populating HP Insight CMU database, 57 reconf-diskless-image, 60 reconf-diskless-image.sh, 61 reconf-diskless-snapshot.sh, 61

Red Hat, 56 templates, 62

TFTP configuration, 56 dmidecode, 96

189

Image 189

HP Insight Cluster Management Utility manual Index

Contents

HP Insight Cluster Management Utility Copyright 2013 Hewlett-Packard Development Company, L.P Contents Provisioning a cluster with HP Insight CMU Defining a cluster with HP Insight CMU Monitoring a cluster with HP Insight CMU Managing a cluster with HP Insight CMU Advanced topics 112Actions Alerts Alert reactions Detailed installation instructions 131 Troubleshooting 126Support and other resources 123 HP Insight CMU manpages 139 Glossary 187 Index 189 Figures Date command Dmidecode command TablesExamples HP Insight CMU configuration FeaturesOverview Compute node monitoring System disk replication Compute node administration Installing and upgrading HP Insight CMU Installing HP Insight CMUManagement node hardware requirements Firmware upgrade requirements Planning for compute node installationConfiguring the local smart array card Configuring the management cards NIC 1 PXE boot or PXE enabled NIC 2 Disabled Configuring the Bios7.1 DL3xx, DL5xx, DL7xx, Blades Speed 9600 Bd IDE 7.2 DL160 G5, DL165c G5, DL165c G6, and DL180 G5 Servers Dhcp Disabled Share NIC mode DisabledNIC1 control Enabled NIC1 PXE Enabled NIC2 on the SL2x170z G6 Server 7.4 SL2x170z G6 and DL170h G6 Servers Bios setting Preparing for installation Preinstallation limitationsHP Insight CMU kit delivery Operating system support HP Insight CMU CD-ROM directory structureRhel 6 support HP Insight CMU installation checklist Login privilegesSELinux and HP Insight CMU Installation procedures Run /opt/cmu/bin/cmumgtconfig -c# chkconfig --add cmu Installing HP Insight CMU with high availability Installing and upgrading HP Insight CMU HA hardware requirements Installing HP Insight CMU under HASoftware prerequisites Overview Configuring HA control of HP Insight CMU HP Insight CMU HA service requirementsInstalling and testing Cmuadmin1# /etc/init.d/cmu start Start cmuserver# /etc/init.d/cmuserver start Var/log/cmuservicehostname.log file for errors Cmu hacmu service needs restartCmuadmin2# /opt/cmu/tools/cmuhapostinstall # /etc/init.d/cmu setaudit # /etc/init.d/cmu stop Upgrading HP Insight CMU HA service HP Insight CMU configuration considerationsCmuha nothing to backup from the cmu HA share Run cmuhapostinstall on server Upgrading HP Insight CMU Stopping the HP Insight CMU serviceDependencies Upgrading Java Runtime Environment Restoring the HP Insight CMU database Saving the HP Insight CMU database Defining a cluster with HP Insight CMU HP Insight CMU service statusLaunching the HP Insight CMU GUI HP Insight CMU main window Quitting administrator mode Administrator modeClick Options→Unprivileged Mode Server requirements Cluster administration High-level checklist for building an HP Insight CMU cluster Node management window Node management Scan node dialog Scanning nodes Adding nodes Management card password window Modifying nodes Cluster Administration→Node Management Importing nodes Network entity managementDeleting nodes Exporting nodes Deleting network entities Adding network entities Logical group management Provisioning a cluster with HP Insight CMU Modifying logical groups Deleting logical groupsRenaming logical groups Autoinstall requirements AutoinstallAutoinstall templates Autoinstall calling methods Enabling autoinstall Using autoinstall from GUICreating an autoinstall logical group Restart cmuserver Registering compute nodes Autoinstall compute nodes Registering an autoinstall logical group Using autoinstall from CLIAdding nodes to autoinstall logical group Cmu addtologicalgroup node to logicalgroupname Customization Where nodes.txt is the list of nodes to autoinstall Backing up RestrictionsBacking up a disk from a compute node in a logical group # /opt/cmu/image/logicalgroupname Cloning Cloning procedure Cloning status Preconfiguration Default content of prereconf.sh is Reconfiguration Rescan MAC Node static info Expanding an image HP Insight CMU image editorAfter editing the image, commit changes # cmuimagecommit -i rh5u4x8664 Modifying an image HP Insight CMU diskless environmentsSaving a modified cloning image # /opt/cmu/bin/cmuimagecommit -i rh5u4x8664 Operating systems supported Modifying the Tftp server configurationOn the management node On the golden node Populating the HP Insight CMU database Activating the diskless featureCreating a diskless image Creating a diskless logical group Adding a new logical group From the CLI Adding nodes into the logical group# /opt/cmu/cmucli Cmu probekernel Cmu boot net myTestImage node1 noden Booting the compute nodesUnderstanding the structure of a diskless image Customizing your diskless image Using reconf-diskless-image.sh Best practices for diskless clusters Do not update the /opt/cmu/image/imageName/root directoryTemplates and image file Node. /opt/cmu/image/imageName/snapshot/nodeName Configuring additional NFS servers # chkconfig nfs onOn Red Hat # chkconfig nfsserver on When a diskless logical group is createdOn Sles Sample file Comments on High Availability HA When a node is added to the diskless logical group Installing the HP Insight CMU monitoring client Monitoring a cluster with HP Insight CMUDeploying the monitoring client Launch the HP Insight CMU GUI Monitoring the cluster Selecting the central frame display Node and group status Monitoring window Global cluster view in the central frame Resource view overview Resource view in the central frame Detail mode in resource view Gauge widgetNode view in the central frame Node details Using time view Getting started Tagging nodesAdaptive stacking Mouse control Bindings and options Technical dependencies Troubleshooting Visualizing history data Archiving user groups Stopping HP Insight CMU monitoring Tuning HP Insight CMU monitoringAction and alert files Limitations Alerts Actions Alert reactions Alerts Name of the alert that caused the reaction Level of the alertText of the Description for this reaction Installing and starting collectl on compute nodes Using collectl for gathering monitoring data# chkconfig --add collectl # /etc/init.d/collectl start ActionAndAlertFile.txt file # collectl -c 1 -s+C --export lexpr Var/log/collectl *rw,sync,noallsquash,norootsquash # mkdir /var/log/collectl # vi /etc/exports# exportfs -r # cp -a /var/www/html/colplot /opt/cmu/www/colplot # vi /etc/collectl.conf # mkdir /var/log/collectl # vi /etc/fstabRestart collectl # /etc/init.d/collectl restart Monitoring GPUs and coprocessors Monitoring Nvidia GPUsSelect plotting options, then click Generate Plot Monitoring AMD GPUs # cmuconfigamd Monitoring Intel coprocessors # /opt/cmu/bin/cmuconfigintel Review the results and verify no errors are reported HP Insight CMU alert converted to SIM event Extended metric support Opt/cmu/bin/cmusubmitextendedmetrics -f datafile Managing a cluster with HP Insight CMU Administrator menuUnprivileged user menu SSH connection Management card connection Power offVirtual serial port connection Shutdown Boot RebootChange UID LED status Multiple windows broadcast Single window pdshDshbak Cmudiff examples Cmupdsh dmidecode Cmupdsh cmudiff -hCmupdsh cmudiff -d Parallel distributed copy pdcp # vi /root/.ssh/config Adding user groups User group management HP Insight firmware management Viewing and analyzing Bios settingsDeleting user groups Renaming user groups Checking Bios versions Installing and upgrading firmwareCustomizing the GUI menu Basic commands Saving user settingsHP Insight CMU CLI Starting a CLI interactive session Getting help for a command Help commandsFor example, to get more information about the halt command Cmu help Specifying nodes Executing a command on one nodeDisplaying logical groups of a cluster Displaying nodes of a logical group Executing a command on a range of nodes Executing a command on a list of nodesUsing wildcards Executing a command on all nodes Executing a command on specific nodes of a logical group Administration and cloning commandsBooting a set of nodes Broadcasting commands to a set of nodes Rebooting a set of nodes Powering off a set of nodesHalting a set of nodes Cloning a set of nodes Setting the locator LED on or offCmu locate on o185i192 Cmu locate off o185i192 Adding a new logical group Adding nodes to a logical groupBacking up a node Cmu backup Cmu modifypassword ILOILOCMlo100i Modifying a management card passwordCmu modifypassword lo100i Discovering MAC address for new nodes HP Insight CMU Linux shell commands Administration utilities pdcp and pdsh# /opt/cmu/bin/pdcp -w cn0001,cn0002 source /tmp/dest # /opt/cmu/bin/pdsh -w cn0001,cn0002 ls Advanced topics Accessing the GUI for non-root users Custom menu options for non-root users Configuring sudo support Bstevens ALL = Nopasswd Cmupower Cmuimage Cjones ALL = CmupowerSbarney ALL = Nopasswd Cmupower Cmuimage Cmuetc HP Insight CMU diskless API Build diskless image Delete diskless imageName of the new logical group Configure diskless node Unconfigure diskless nodeBoot diskless node Diskless check HP Insight CMU remote hardware control APILo100i None Osoff OffUidoff Uidon CMUVALIDHARDWARETYPES=ILOlo100iILOCMIPMI CMUVALIDHARDWARETYPES=ILOlo100iILOCM Support for ScaleMP Cloning mechanismsCMUvSMPPREFIX=vSMP Cloning mechanisms Advanced topics Support and other resources Contacting HPRelated information Typographic conventions CommandComputer output User input Typographic conventions Troubleshooting Network boot issuesHP Insight CMU logs Backup issues Troubleshooting switch issuesTroubleshooting network boot Administration command problems Cloning issuesGUI problems If not, restart the HP Insight CMU service Detailed Java exception is Certificate error Troubleshooting Install required RPMs Detailed installation instructionsActivating xinetd services # chkconfig nfs on # /etc/init.d/nfs start Java installation Firewall configurationVerifying the Dhcpd listen interface On the HP Insight CMU management node Setting the Java Path Installing HP Insight CMU licensingConfiguring the HP Insight CMU management server hostname Method Starting HP Insight CMU Cmu service needs restartEdit the /opt/cmu/etc/cmuserver.conf file # vi /opt/cmu/etc/cmuserver.conf Installing HP Insight CMU on the GUI client workstation Configuring HP Insight CMU to start automaticallyVerifying the HP Insight CMU state Cmuserver utility reports the state of the daemons Configuring the GUI client on Linux workstations Using an ssh tunnelUsing an X Window server Launching the HP Insight CMU GUI using a web browser Activating the HP Insight CMU GUILaunching the HP Insight CMU directly from the Java file HP Insight CMU GUI HP Insight CMU manpages Cmushownodes8 # /opt/cmu/bin/cmushownodes # /opt/cmu/bin/cmushownodes -a -o %n %i %k %m default %b %t # /opt/cmu/bin/cmushowlogicalgroups -h logicalgroupname Cmushowlogicalgroups8Help # /opt/cmu/bin/cmushowlogicalgroups # /opt/cmu/bin/cmushownetworkentities -h networkentity Cmushownetworkentities8# /opt/cmu/bin/cmushownetworkentities # /opt/cmu/bin/cmushownetworkentities rack1 # /opt/cmu/bin/cmushowusergroups -h usergroup Cmushowusergroups8# /opt/cmu/bin/cmushowusergroups # /opt/cmu/bin/cmushowusergroups user1 # /opt/cmu/bin/cmushowarchivedusergroups Cmushowarchivedusergroups8# /opt/cmu/bin/cmushowarchivedusergroups -p -f # /opt/cmu/bin/cmushowarchivedusergroups -f -s Cmuaddnode8 Mgtcardip -T--mgt-card ILOlo100iILOCM -R--arch architectureNode-number num Processing 1 node Command-line mode# cat nodes.txt # /opt/cmu/bin/cmuaddnode -f nodes.txt Filename inputfile Cmuaddnetworkentity8# /opt/cmu/bin/cmuaddnetworkentity rack1 rack2 # /opt/cmu/bin/cmuaddnetworkentity -f networkentitylist Filename inputfile input logical groups from inputfile Name Cmuaddlogicalgroup8# /opt/cmu/bin/cmuaddlogicalgroup -n test -d cciss/c0d0 # /opt/cmu/bin/cmuaddlogicalgroup -f logicalgroupfile Cmuaddtologicalgroupcandidates8 LogicalgroupNodenamefile Cmuaddusergroup8 # /opt/cmu/bin/cmuaddusergroup user1 user2# /opt/cmu/bin/cmuaddusergroup -f usergrouplist Usergroup Cmuaddtousergroup8# /opt/cmu/bin/cmuaddtousergroup -t group1 cn0003 # /opt/cmu/bin/cmuaddtousergroup -t group1 -f nodenamefile To flag cn0001 active in logical group rh6u0x8664 Cmuchangeactivelogicalgroup8 Cmuchangenetworkentity8 Networkentity# /opt/cmu/bin/cmuchangenetworkentity -t rack1 cn0001 Delete one or more nodes from a logical group Cmudelfromlogicalgroupcandidates8Delete nodes from this logical group To delete one node from a logical group rh6u0x8664 # /opt/cmu/bin/cmudelfromnetworkentity -t rack1 node1 Cmudelfromnetworkentity8 Cmudelarchivedusergroup8 # /opt/cmu/bin/cmudelarchivedusergroup -h -v-t timeout -dCmudelarchivedusergroup -- Delete an archived user group Delete an archived user group # /opt/cmu/bin/cmudelfromusergroup -t user1 node1 Cmudelfromusergroup8 Cmudellogicalgroup8 # /opt/cmu/bin/cmudellogicalgroup rh5u5x8664 sles11sp1x8664# /opt/cmu/bin/cmudellogicalgroup -f logicalgrouplist Cmudelnetworkentity8 # /opt/cmu/bin/cmudelnetworkentity rack1 rack2# /opt/cmu/bin/cmudelnetworkentity -f networkentitylist Cmudelnode8 # /opt/cmu/bin/cmudelnode node1 node2# /opt/cmu/bin/cmudelnode -f nodelist Delete monitoring snapshots from the history database Cmudelsnapshots8 # /opt/cmu/bin/cmudelusergroup user1 user2 Cmudelusergroup8# /opt/cmu/bin/cmudelusergroup -f usergrouplist # /opt/cmu/bin/cmudelusergroup -a -m 60 -f usergrouplist Cmuconsole8 Cmuconsole -- Connect to compute node management ports# /opt/cmu/bin/cmuconsole computenodehostname Cmupower8 Cmupower -p OFF -u user1 Cmupower -p OFF -n cn0001Cmupower -p Boot -l rh6u0x8664 Cmupower -p Uidon -u user2 Title Cmucustomrun8# /opt/cmu/bin/cmucustomrun -l # /opt/cmu/bin/cmucustomrun -t auditlspci =node Cmuclone8# /opt/cmu/bin/cmuclone -f /tmp/nodelist -i sles11sp1x8664 # /opt/cmu/bin/cmuclone -n node1 -i rh6u2x8664 Cmubackup8 Cmubackup -l myimage -n node20 -p cciss/c0d0p3,cciss/c0d0p1Cmubackup -l myimage -n node20 -r 3 -e /tmp/err.log Cmuscanmacs8 Options naming# /opt/cmu/bin/cmuscanmacs -h hostname -p hostnameprefix Options general Example node definitions Example 173 Cmurescanmac -- Rescan the MAC address of a node Cmurescanmac8# /opt/cmu/tools/cmurescanmac -n nodename N NICnum -h Node name in the HP Insight CMU database Cmumodnode8 FilenameLg logicalgroup # /opt/cmu/bin/cmumodnode -f nodes.txt Cmumonstat8 # /opt/cmu/bin/cmumonstat --all-sensors --all-nodes # /opt/cmu/bin/cmumonstat --nodes=n0001,n0002,n0001-11# /opt/cmu/bin/cmumonstat --all-nodes --all-sensors --stats # /opt/cmu/bin/cmumonstat --all-nodes --color # /opt/cmu/bin/cmuimageopen -h -i imagename Cmuimageopen8To open the HP Insight CMU image rh5u5x8664 # /opt/cmu/bin/cmuimageopen -i rh5u5x8664 # /opt/cmu/bin/cmuimagecommit -i rh5u5x8664 Cmuimagecommit8 Cmuconfignvidia -- Configure Nvidia GPU monitoring Cmuconfignvidia8 Cmuconfigamd -- Configure AMD GPU monitoring Cmuconfigamd8 Cmuconfigintel8 Cmuconfigintel -- Configure Intel coprocessor monitoring# /opt/cmu/bin/cmuconfigintel -h -r -n Automatically defaults when reasonable Cmumgtconfig8Eth num1num2bond num1 Num # /opt/cmu/bin/cmumgtconfig -c # /opt/cmu/bin/cmumgtconfig -c -s dhcp# /opt/cmu/bin/cmumgtconfig -t Cmufirmwaremgmt -- Verify and execute firmware Cmufirmwaremgmt8Ocmudiffparameters Specifies a text file listing compute nodes Ebipa Glossary Package management Index Index 191