173 | HP Insight Cluster Management Utility specs

n03_C01_N3 1.2.3.3 255.255.0.0 44-1e-a1-d3-b4-02 default 10.84.202.42 ILOCM x86_64 1 3 n04_C01_N4 1.2.3.4 255.255.0.0 44-1e-a1-d3-b3-de default 10.84.202.42 ILOCM x86_64 1 4

n09_C03_N1 1.2.3.9 255.255.0.0 44-1e-a1-d3-b3-ac default 10.84.202.42 ILOCM x86_64 3 1 n10_C03_N2 1.2.3.10 255.255.0.0 44-1e-a1-d3-ac-68 default 10.84.202.42 ILOCM x86_64 3 2 n11_C03_N3 1.2.3.11 255.255.0.0 44-1e-a1-d3-ac-24 default 10.84.202.42 ILOCM x86_64 3 3 n12_C03_N4 1.2.3.12 255.255.0.0 38-ea-a7-0f-01-dc default 10.84.202.42 ILOCM x86_64 3 4

.

.

Example 4

Adding the option -S 0 to the command line of Example 3 forces %i and the IP generation to effectively ignore slots without cartridges, resulting in sequential values for %i and the IP addresses.

#/opt/cmu/bin/cmu_scan_macs -h n%i_C%c_N%n -i 1.2.3.1 -m 255.255.0.0 -t ILOCM \

-b 10.84.202.42 -S 0 -o nodes.dat

n01_C01_N1 1.2.3.1 255.255.0.0 38-ea-a7-0f-01-6c default 10.84.202.42 ILOCM x86_64 1 1 n02_C01_N2 1.2.3.2 255.255.0.0 44-1e-a1-d3-80-10 default 10.84.202.42 ILOCM x86_64 1 2 n03_C01_N3 1.2.3.3 255.255.0.0 44-1e-a1-d3-b4-02 default 10.84.202.42 ILOCM x86_64 1 3 n04_C01_N4 1.2.3.4 255.255.0.0 44-1e-a1-d3-b3-de default 10.84.202.42 ILOCM x86_64 1 4 n05_C03_N1 1.2.3.5 255.255.0.0 44-1e-a1-d3-b3-ac default 10.84.202.42 ILOCM x86_64 3 1 n06_C03_N2 1.2.3.6 255.255.0.0 44-1e-a1-d3-ac-68 default 10.84.202.42 ILOCM x86_64 3 2 n07_C03_N3 1.2.3.7 255.255.0.0 44-1e-a1-d3-ac-24 default 10.84.202.42 ILOCM x86_64 3 3 n08_C03_N4 1.2.3.8 255.255.0.0 38-ea-a7-0f-01-dc default 10.84.202.42 ILOCM x86_64 3 4

.

.

173

Image 173

HP Insight Cluster Management Utility manual 173

Contents

HP Insight Cluster Management Utility Copyright 2013 Hewlett-Packard Development Company, L.P Contents Provisioning a cluster with HP Insight CMU Defining a cluster with HP Insight CMU Monitoring a cluster with HP Insight CMU Actions Alerts Alert reactions Managing a cluster with HP Insight CMUAdvanced topics 112 Detailed installation instructions 131 Troubleshooting 126Support and other resources 123 HP Insight CMU manpages 139 Glossary 187 Index 189 Figures Examples Date command Dmidecode commandTables HP Insight CMU configuration FeaturesOverview Compute node monitoring System disk replication Compute node administration Management node hardware requirements Installing and upgrading HP Insight CMUInstalling HP Insight CMU Firmware upgrade requirements Planning for compute node installationConfiguring the local smart array card Configuring the management cards NIC 1 PXE boot or PXE enabled NIC 2 Disabled Configuring the Bios7.1 DL3xx, DL5xx, DL7xx, Blades Speed 9600 Bd IDE 7.2 DL160 G5, DL165c G5, DL165c G6, and DL180 G5 Servers Dhcp Disabled Share NIC mode DisabledNIC1 control Enabled NIC1 PXE Enabled NIC2 on the SL2x170z G6 Server 7.4 SL2x170z G6 and DL170h G6 Servers Bios setting HP Insight CMU kit delivery Preparing for installationPreinstallation limitations Rhel 6 support Operating system supportHP Insight CMU CD-ROM directory structure SELinux and HP Insight CMU HP Insight CMU installation checklistLogin privileges # chkconfig --add cmu Installation proceduresRun /opt/cmu/bin/cmumgtconfig -c Installing HP Insight CMU with high availability Installing and upgrading HP Insight CMU HA hardware requirements Installing HP Insight CMU under HASoftware prerequisites Overview Installing and testing Configuring HA control of HP Insight CMUHP Insight CMU HA service requirements # /etc/init.d/cmuserver start Cmuadmin1# /etc/init.d/cmu startStart cmuserver Var/log/cmuservicehostname.log file for errors Cmu hacmu service needs restartCmuadmin2# /opt/cmu/tools/cmuhapostinstall # /etc/init.d/cmu setaudit # /etc/init.d/cmu stop Upgrading HP Insight CMU HA service HP Insight CMU configuration considerationsCmuha nothing to backup from the cmu HA share Run cmuhapostinstall on server Upgrading HP Insight CMU Stopping the HP Insight CMU serviceDependencies Upgrading Java Runtime Environment Restoring the HP Insight CMU database Saving the HP Insight CMU database Defining a cluster with HP Insight CMU HP Insight CMU service statusLaunching the HP Insight CMU GUI HP Insight CMU main window Quitting administrator mode Administrator modeClick Options→Unprivileged Mode Server requirements Cluster administration High-level checklist for building an HP Insight CMU cluster Node management window Node management Scan node dialog Scanning nodes Adding nodes Management card password window Modifying nodes Cluster Administration→Node Management Importing nodes Network entity managementDeleting nodes Exporting nodes Deleting network entities Adding network entities Logical group management Provisioning a cluster with HP Insight CMU Renaming logical groups Modifying logical groupsDeleting logical groups Autoinstall requirements AutoinstallAutoinstall templates Autoinstall calling methods Enabling autoinstall Using autoinstall from GUICreating an autoinstall logical group Restart cmuserver Registering compute nodes Autoinstall compute nodes Registering an autoinstall logical group Using autoinstall from CLIAdding nodes to autoinstall logical group Cmu addtologicalgroup node to logicalgroupname Customization Where nodes.txt is the list of nodes to autoinstall Backing up a disk from a compute node in a logical group Backing upRestrictions # /opt/cmu/image/logicalgroupname Cloning Cloning procedure Cloning status Preconfiguration Default content of prereconf.sh is Reconfiguration Rescan MAC Node static info Expanding an image HP Insight CMU image editorAfter editing the image, commit changes # cmuimagecommit -i rh5u4x8664 Modifying an image HP Insight CMU diskless environmentsSaving a modified cloning image # /opt/cmu/bin/cmuimagecommit -i rh5u4x8664 Operating systems supported Modifying the Tftp server configurationOn the management node On the golden node Populating the HP Insight CMU database Activating the diskless featureCreating a diskless image Creating a diskless logical group Adding a new logical group From the CLI Adding nodes into the logical group# /opt/cmu/cmucli Cmu probekernel Cmu boot net myTestImage node1 noden Booting the compute nodesUnderstanding the structure of a diskless image Customizing your diskless image Using reconf-diskless-image.sh Best practices for diskless clusters Do not update the /opt/cmu/image/imageName/root directoryTemplates and image file Node. /opt/cmu/image/imageName/snapshot/nodeName On Red Hat Configuring additional NFS servers# chkconfig nfs on # chkconfig nfsserver on When a diskless logical group is createdOn Sles Sample file Comments on High Availability HA When a node is added to the diskless logical group Deploying the monitoring client Installing the HP Insight CMU monitoring clientMonitoring a cluster with HP Insight CMU Launch the HP Insight CMU GUI Monitoring the cluster Selecting the central frame display Node and group status Monitoring window Global cluster view in the central frame Resource view overview Resource view in the central frame Node view in the central frame Detail mode in resource viewGauge widget Node details Using time view Adaptive stacking Getting startedTagging nodes Mouse control Bindings and options Technical dependencies Troubleshooting Visualizing history data Archiving user groups Stopping HP Insight CMU monitoring Tuning HP Insight CMU monitoringAction and alert files Limitations Alerts Actions Alert reactions Alerts Text of the Description for this reaction Name of the alert that caused the reactionLevel of the alert Installing and starting collectl on compute nodes Using collectl for gathering monitoring data# chkconfig --add collectl # /etc/init.d/collectl start ActionAndAlertFile.txt file # collectl -c 1 -s+C --export lexpr Var/log/collectl *rw,sync,noallsquash,norootsquash # mkdir /var/log/collectl # vi /etc/exports# exportfs -r # cp -a /var/www/html/colplot /opt/cmu/www/colplot # vi /etc/collectl.conf # mkdir /var/log/collectl # vi /etc/fstabRestart collectl # /etc/init.d/collectl restart Select plotting options, then click Generate Plot Monitoring GPUs and coprocessorsMonitoring Nvidia GPUs Monitoring AMD GPUs # cmuconfigamd Monitoring Intel coprocessors # /opt/cmu/bin/cmuconfigintel Review the results and verify no errors are reported HP Insight CMU alert converted to SIM event Extended metric support Opt/cmu/bin/cmusubmitextendedmetrics -f datafile Managing a cluster with HP Insight CMU Administrator menuUnprivileged user menu SSH connection Management card connection Power offVirtual serial port connection Shutdown Change UID LED status BootReboot Dshbak Multiple windows broadcastSingle window pdsh Cmudiff examples Cmupdsh cmudiff -d Cmupdsh dmidecodeCmupdsh cmudiff -h Parallel distributed copy pdcp # vi /root/.ssh/config Adding user groups User group management HP Insight firmware management Viewing and analyzing Bios settingsDeleting user groups Renaming user groups Customizing the GUI menu Checking Bios versionsInstalling and upgrading firmware Basic commands Saving user settingsHP Insight CMU CLI Starting a CLI interactive session Getting help for a command Help commandsFor example, to get more information about the halt command Cmu help Specifying nodes Executing a command on one nodeDisplaying logical groups of a cluster Displaying nodes of a logical group Executing a command on a range of nodes Executing a command on a list of nodesUsing wildcards Executing a command on all nodes Executing a command on specific nodes of a logical group Administration and cloning commandsBooting a set of nodes Broadcasting commands to a set of nodes Halting a set of nodes Rebooting a set of nodesPowering off a set of nodes Cloning a set of nodes Setting the locator LED on or offCmu locate on o185i192 Cmu locate off o185i192 Backing up a node Adding a new logical groupAdding nodes to a logical group Cmu backup Cmu modifypassword ILOILOCMlo100i Modifying a management card passwordCmu modifypassword lo100i Discovering MAC address for new nodes HP Insight CMU Linux shell commands Administration utilities pdcp and pdsh# /opt/cmu/bin/pdcp -w cn0001,cn0002 source /tmp/dest # /opt/cmu/bin/pdsh -w cn0001,cn0002 ls Advanced topics Accessing the GUI for non-root users Custom menu options for non-root users Configuring sudo support Bstevens ALL = Nopasswd Cmupower Cmuimage Cjones ALL = CmupowerSbarney ALL = Nopasswd Cmupower Cmuimage Cmuetc HP Insight CMU diskless API Name of the new logical group Build diskless imageDelete diskless image Boot diskless node Configure diskless nodeUnconfigure diskless node Diskless check HP Insight CMU remote hardware control APILo100i None Osoff OffUidoff Uidon CMUVALIDHARDWARETYPES=ILOlo100iILOCMIPMI CMUVALIDHARDWARETYPES=ILOlo100iILOCM CMUvSMPPREFIX=vSMP Support for ScaleMPCloning mechanisms Cloning mechanisms Advanced topics Related information Support and other resourcesContacting HP Typographic conventions CommandComputer output User input Typographic conventions HP Insight CMU logs TroubleshootingNetwork boot issues Troubleshooting network boot Backup issuesTroubleshooting switch issues Administration command problems Cloning issuesGUI problems If not, restart the HP Insight CMU service Detailed Java exception is Certificate error Troubleshooting Install required RPMs Detailed installation instructionsActivating xinetd services # chkconfig nfs on # /etc/init.d/nfs start Java installation Firewall configurationVerifying the Dhcpd listen interface On the HP Insight CMU management node Setting the Java Path Installing HP Insight CMU licensingConfiguring the HP Insight CMU management server hostname Method Starting HP Insight CMU Cmu service needs restartEdit the /opt/cmu/etc/cmuserver.conf file # vi /opt/cmu/etc/cmuserver.conf Installing HP Insight CMU on the GUI client workstation Configuring HP Insight CMU to start automaticallyVerifying the HP Insight CMU state Cmuserver utility reports the state of the daemons Using an X Window server Configuring the GUI client on Linux workstationsUsing an ssh tunnel Launching the HP Insight CMU directly from the Java file Launching the HP Insight CMU GUI using a web browserActivating the HP Insight CMU GUI HP Insight CMU GUI HP Insight CMU manpages Cmushownodes8 # /opt/cmu/bin/cmushownodes # /opt/cmu/bin/cmushownodes -a -o %n %i %k %m default %b %t # /opt/cmu/bin/cmushowlogicalgroups -h logicalgroupname Cmushowlogicalgroups8Help # /opt/cmu/bin/cmushowlogicalgroups # /opt/cmu/bin/cmushownetworkentities -h networkentity Cmushownetworkentities8# /opt/cmu/bin/cmushownetworkentities # /opt/cmu/bin/cmushownetworkentities rack1 # /opt/cmu/bin/cmushowusergroups -h usergroup Cmushowusergroups8# /opt/cmu/bin/cmushowusergroups # /opt/cmu/bin/cmushowusergroups user1 # /opt/cmu/bin/cmushowarchivedusergroups Cmushowarchivedusergroups8# /opt/cmu/bin/cmushowarchivedusergroups -p -f # /opt/cmu/bin/cmushowarchivedusergroups -f -s Node-number num Cmuaddnode8Mgtcardip -T--mgt-card ILOlo100iILOCM -R--arch architecture Processing 1 node Command-line mode# cat nodes.txt # /opt/cmu/bin/cmuaddnode -f nodes.txt Filename inputfile Cmuaddnetworkentity8# /opt/cmu/bin/cmuaddnetworkentity rack1 rack2 # /opt/cmu/bin/cmuaddnetworkentity -f networkentitylist Filename inputfile input logical groups from inputfile Name Cmuaddlogicalgroup8# /opt/cmu/bin/cmuaddlogicalgroup -n test -d cciss/c0d0 # /opt/cmu/bin/cmuaddlogicalgroup -f logicalgroupfile Nodenamefile Cmuaddtologicalgroupcandidates8Logicalgroup # /opt/cmu/bin/cmuaddusergroup -f usergrouplist Cmuaddusergroup8# /opt/cmu/bin/cmuaddusergroup user1 user2 Usergroup Cmuaddtousergroup8# /opt/cmu/bin/cmuaddtousergroup -t group1 cn0003 # /opt/cmu/bin/cmuaddtousergroup -t group1 -f nodenamefile To flag cn0001 active in logical group rh6u0x8664 Cmuchangeactivelogicalgroup8 # /opt/cmu/bin/cmuchangenetworkentity -t rack1 cn0001 Cmuchangenetworkentity8Networkentity Delete one or more nodes from a logical group Cmudelfromlogicalgroupcandidates8Delete nodes from this logical group To delete one node from a logical group rh6u0x8664 # /opt/cmu/bin/cmudelfromnetworkentity -t rack1 node1 Cmudelfromnetworkentity8 Cmudelarchivedusergroup8 # /opt/cmu/bin/cmudelarchivedusergroup -h -v-t timeout -dCmudelarchivedusergroup -- Delete an archived user group Delete an archived user group # /opt/cmu/bin/cmudelfromusergroup -t user1 node1 Cmudelfromusergroup8 # /opt/cmu/bin/cmudellogicalgroup -f logicalgrouplist Cmudellogicalgroup8# /opt/cmu/bin/cmudellogicalgroup rh5u5x8664 sles11sp1x8664 # /opt/cmu/bin/cmudelnetworkentity -f networkentitylist Cmudelnetworkentity8# /opt/cmu/bin/cmudelnetworkentity rack1 rack2 # /opt/cmu/bin/cmudelnode -f nodelist Cmudelnode8# /opt/cmu/bin/cmudelnode node1 node2 Delete monitoring snapshots from the history database Cmudelsnapshots8 # /opt/cmu/bin/cmudelusergroup user1 user2 Cmudelusergroup8# /opt/cmu/bin/cmudelusergroup -f usergrouplist # /opt/cmu/bin/cmudelusergroup -a -m 60 -f usergrouplist # /opt/cmu/bin/cmuconsole computenodehostname Cmuconsole8Cmuconsole -- Connect to compute node management ports Cmupower8 Cmupower -p OFF -u user1 Cmupower -p OFF -n cn0001Cmupower -p Boot -l rh6u0x8664 Cmupower -p Uidon -u user2 Title Cmucustomrun8# /opt/cmu/bin/cmucustomrun -l # /opt/cmu/bin/cmucustomrun -t auditlspci =node Cmuclone8# /opt/cmu/bin/cmuclone -f /tmp/nodelist -i sles11sp1x8664 # /opt/cmu/bin/cmuclone -n node1 -i rh6u2x8664 Cmubackup -l myimage -n node20 -r 3 -e /tmp/err.log Cmubackup8Cmubackup -l myimage -n node20 -p cciss/c0d0p3,cciss/c0d0p1 # /opt/cmu/bin/cmuscanmacs -h hostname -p hostnameprefix Cmuscanmacs8Options naming Options general Example node definitions Example 173 Cmurescanmac -- Rescan the MAC address of a node Cmurescanmac8# /opt/cmu/tools/cmurescanmac -n nodename N NICnum -h Node name in the HP Insight CMU database Lg logicalgroup Cmumodnode8Filename # /opt/cmu/bin/cmumodnode -f nodes.txt Cmumonstat8 # /opt/cmu/bin/cmumonstat --all-sensors --all-nodes # /opt/cmu/bin/cmumonstat --nodes=n0001,n0002,n0001-11# /opt/cmu/bin/cmumonstat --all-nodes --all-sensors --stats # /opt/cmu/bin/cmumonstat --all-nodes --color # /opt/cmu/bin/cmuimageopen -h -i imagename Cmuimageopen8To open the HP Insight CMU image rh5u5x8664 # /opt/cmu/bin/cmuimageopen -i rh5u5x8664 # /opt/cmu/bin/cmuimagecommit -i rh5u5x8664 Cmuimagecommit8 Cmuconfignvidia -- Configure Nvidia GPU monitoring Cmuconfignvidia8 Cmuconfigamd -- Configure AMD GPU monitoring Cmuconfigamd8 # /opt/cmu/bin/cmuconfigintel -h -r -n Cmuconfigintel8Cmuconfigintel -- Configure Intel coprocessor monitoring Automatically defaults when reasonable Cmumgtconfig8Eth num1num2bond num1 Num # /opt/cmu/bin/cmumgtconfig -t # /opt/cmu/bin/cmumgtconfig -c# /opt/cmu/bin/cmumgtconfig -c -s dhcp Cmufirmwaremgmt -- Verify and execute firmware Cmufirmwaremgmt8Ocmudiffparameters Specifies a text file listing compute nodes Ebipa Glossary Package management Index Index 191