Manuals / HP / Computer Equipment / Software

HP Insight Cluster Management Utility manual Installing and upgrading HP Insight CMU

Models: Insight Cluster Management Utility

1 191

Page 24

The next figure shows a “classic” HP Insight CMU cluster with one HP Insight CMU management server and compute nodes connected directly to the site network. A unique IP address IP0 is used for compute node management and site network access.

The next figure shows the corresponding configuration with two HP Insight CMU management servers running HP Insight CMU software in active or standby mode under control of HA software. The address IP0 is attached to the server running the HP Insight CMU software. This is the unique address HP Insight CMU recognizes. Each HP Insight CMU management server has its own IP address on the site network, IP2 and IP 3 respectively, unknown to HP Insight CMU.

24 Installing and upgrading HP Insight CMU

Page 24

Image 24

HP Insight Cluster Management Utility manual Installing and upgrading HP Insight CMU

Contents

HP Insight Cluster Management Utility Copyright 2013 Hewlett-Packard Development Company, L.P Contents Defining a cluster with HP Insight CMU Provisioning a cluster with HP Insight CMUMonitoring a cluster with HP Insight CMU Managing a cluster with HP Insight CMU Advanced topics 112Actions Alerts Alert reactions Troubleshooting 126 Detailed installation instructions 131Support and other resources 123 HP Insight CMU manpages 139Glossary 187 Index 189 Figures Date command Dmidecode command TablesExamples Features HP Insight CMU configurationOverview Compute node monitoringCompute node administration System disk replicationInstalling and upgrading HP Insight CMU Installing HP Insight CMUManagement node hardware requirements Planning for compute node installation Firmware upgrade requirementsConfiguring the local smart array card Configuring the management cardsConfiguring the Bios NIC 1 PXE boot or PXE enabled NIC 2 Disabled7.1 DL3xx, DL5xx, DL7xx, Blades Speed 9600 Bd7.2 DL160 G5, DL165c G5, DL165c G6, and DL180 G5 Servers IDEShare NIC mode Disabled Dhcp DisabledNIC1 control Enabled NIC1 PXE Enabled7.4 SL2x170z G6 and DL170h G6 Servers Bios setting NIC2 on the SL2x170z G6 ServerPreparing for installation Preinstallation limitationsHP Insight CMU kit delivery Operating system support HP Insight CMU CD-ROM directory structureRhel 6 support HP Insight CMU installation checklist Login privilegesSELinux and HP Insight CMU Installation procedures Run /opt/cmu/bin/cmumgtconfig -c# chkconfig --add cmu Installing HP Insight CMU with high availability Installing and upgrading HP Insight CMU Installing HP Insight CMU under HA HA hardware requirementsSoftware prerequisites OverviewConfiguring HA control of HP Insight CMU HP Insight CMU HA service requirementsInstalling and testing Cmuadmin1# /etc/init.d/cmu start Start cmuserver# /etc/init.d/cmuserver start Cmu hacmu service needs restart Var/log/cmuservicehostname.log file for errorsCmuadmin2# /opt/cmu/tools/cmuhapostinstall # /etc/init.d/cmu setaudit # /etc/init.d/cmu stopHP Insight CMU configuration considerations Upgrading HP Insight CMU HA serviceCmuha nothing to backup from the cmu HA share Run cmuhapostinstall on serverStopping the HP Insight CMU service Upgrading HP Insight CMUDependencies Upgrading Java Runtime EnvironmentSaving the HP Insight CMU database Restoring the HP Insight CMU databaseHP Insight CMU service status Defining a cluster with HP Insight CMULaunching the HP Insight CMU GUI HP Insight CMU main windowAdministrator mode Quitting administrator modeClick Options→Unprivileged Mode Server requirementsHigh-level checklist for building an HP Insight CMU cluster Cluster administrationNode management Node management windowScanning nodes Scan node dialogManagement card password window Adding nodesCluster Administration→Node Management Modifying nodesNetwork entity management Importing nodesDeleting nodes Exporting nodesAdding network entities Deleting network entitiesProvisioning a cluster with HP Insight CMU Logical group managementModifying logical groups Deleting logical groupsRenaming logical groups Autoinstall Autoinstall requirementsAutoinstall templates Autoinstall calling methodsUsing autoinstall from GUI Enabling autoinstallCreating an autoinstall logical group Restart cmuserverAutoinstall compute nodes Registering compute nodesUsing autoinstall from CLI Registering an autoinstall logical groupAdding nodes to autoinstall logical group Cmu addtologicalgroup node to logicalgroupnameWhere nodes.txt is the list of nodes to autoinstall CustomizationBacking up RestrictionsBacking up a disk from a compute node in a logical group # /opt/cmu/image/logicalgroupname Cloning procedure CloningPreconfiguration Cloning statusReconfiguration Default content of prereconf.sh isNode static info Rescan MACHP Insight CMU image editor Expanding an imageAfter editing the image, commit changes # cmuimagecommit -i rh5u4x8664HP Insight CMU diskless environments Modifying an imageSaving a modified cloning image # /opt/cmu/bin/cmuimagecommit -i rh5u4x8664Modifying the Tftp server configuration Operating systems supportedOn the management node On the golden nodeActivating the diskless feature Populating the HP Insight CMU databaseCreating a diskless image Creating a diskless logical groupAdding a new logical group Adding nodes into the logical group From the CLI# /opt/cmu/cmucli Cmu probekernelBooting the compute nodes Cmu boot net myTestImage node1 nodenUnderstanding the structure of a diskless image Customizing your diskless imageUsing reconf-diskless-image.sh Do not update the /opt/cmu/image/imageName/root directory Best practices for diskless clustersTemplates and image file Node. /opt/cmu/image/imageName/snapshot/nodeNameConfiguring additional NFS servers # chkconfig nfs onOn Red Hat When a diskless logical group is created # chkconfig nfsserver onOn Sles Sample fileWhen a node is added to the diskless logical group Comments on High Availability HAInstalling the HP Insight CMU monitoring client Monitoring a cluster with HP Insight CMUDeploying the monitoring client Monitoring the cluster Launch the HP Insight CMU GUINode and group status Selecting the central frame displayGlobal cluster view in the central frame Monitoring windowResource view in the central frame Resource view overviewDetail mode in resource view Gauge widgetNode view in the central frame Using time view Node detailsGetting started Tagging nodesAdaptive stacking Bindings and options Mouse controlTroubleshooting Technical dependenciesArchiving user groups Visualizing history dataTuning HP Insight CMU monitoring Stopping HP Insight CMU monitoringAction and alert files LimitationsActions AlertsAlerts Alert reactionsName of the alert that caused the reaction Level of the alertText of the Description for this reaction Using collectl for gathering monitoring data Installing and starting collectl on compute nodes# chkconfig --add collectl # /etc/init.d/collectl start# collectl -c 1 -s+C --export lexpr ActionAndAlertFile.txt file# mkdir /var/log/collectl # vi /etc/exports Var/log/collectl *rw,sync,noallsquash,norootsquash# exportfs -r # cp -a /var/www/html/colplot /opt/cmu/www/colplot# mkdir /var/log/collectl # vi /etc/fstab # vi /etc/collectl.confRestart collectl # /etc/init.d/collectl restartMonitoring GPUs and coprocessors Monitoring Nvidia GPUsSelect plotting options, then click Generate Plot # cmuconfigamd Monitoring AMD GPUsMonitoring Intel coprocessors Review the results and verify no errors are reported # /opt/cmu/bin/cmuconfigintelExtended metric support HP Insight CMU alert converted to SIM eventOpt/cmu/bin/cmusubmitextendedmetrics -f datafile Administrator menu Managing a cluster with HP Insight CMUUnprivileged user menu SSH connectionPower off Management card connectionVirtual serial port connection ShutdownBoot RebootChange UID LED status Multiple windows broadcast Single window pdshDshbak Cmudiff examples Cmupdsh dmidecode Cmupdsh cmudiff -hCmupdsh cmudiff -d # vi /root/.ssh/config Parallel distributed copy pdcpUser group management Adding user groupsViewing and analyzing Bios settings HP Insight firmware managementDeleting user groups Renaming user groupsChecking Bios versions Installing and upgrading firmwareCustomizing the GUI menu Saving user settings Basic commandsHP Insight CMU CLI Starting a CLI interactive sessionHelp commands Getting help for a commandFor example, to get more information about the halt command Cmu helpExecuting a command on one node Specifying nodesDisplaying logical groups of a cluster Displaying nodes of a logical groupExecuting a command on a list of nodes Executing a command on a range of nodesUsing wildcards Executing a command on all nodesAdministration and cloning commands Executing a command on specific nodes of a logical groupBooting a set of nodes Broadcasting commands to a set of nodesRebooting a set of nodes Powering off a set of nodesHalting a set of nodes Setting the locator LED on or off Cloning a set of nodesCmu locate on o185i192 Cmu locate off o185i192Adding a new logical group Adding nodes to a logical groupBacking up a node Cmu backup Modifying a management card password Cmu modifypassword ILOILOCMlo100iCmu modifypassword lo100i Discovering MAC address for new nodesAdministration utilities pdcp and pdsh HP Insight CMU Linux shell commands# /opt/cmu/bin/pdcp -w cn0001,cn0002 source /tmp/dest # /opt/cmu/bin/pdsh -w cn0001,cn0002 lsAccessing the GUI for non-root users Advanced topicsConfiguring sudo support Custom menu options for non-root usersCjones ALL = Cmupower Bstevens ALL = Nopasswd Cmupower CmuimageSbarney ALL = Nopasswd Cmupower Cmuimage Cmuetc HP Insight CMU diskless APIBuild diskless image Delete diskless imageName of the new logical group Configure diskless node Unconfigure diskless nodeBoot diskless node HP Insight CMU remote hardware control API Diskless checkLo100i NoneOff OsoffUidoff UidonCMUVALIDHARDWARETYPES=ILOlo100iILOCM CMUVALIDHARDWARETYPES=ILOlo100iILOCMIPMISupport for ScaleMP Cloning mechanismsCMUvSMPPREFIX=vSMP Cloning mechanisms Advanced topics Support and other resources Contacting HPRelated information Command Typographic conventionsComputer output User inputTypographic conventions Troubleshooting Network boot issuesHP Insight CMU logs Backup issues Troubleshooting switch issuesTroubleshooting network boot Cloning issues Administration command problemsGUI problems If not, restart the HP Insight CMU serviceCertificate error Detailed Java exception isTroubleshooting Detailed installation instructions Install required RPMsActivating xinetd services # chkconfig nfs on # /etc/init.d/nfs startFirewall configuration Java installationVerifying the Dhcpd listen interface On the HP Insight CMU management nodeInstalling HP Insight CMU licensing Setting the Java PathConfiguring the HP Insight CMU management server hostname MethodCmu service needs restart Starting HP Insight CMUEdit the /opt/cmu/etc/cmuserver.conf file # vi /opt/cmu/etc/cmuserver.confConfiguring HP Insight CMU to start automatically Installing HP Insight CMU on the GUI client workstationVerifying the HP Insight CMU state Cmuserver utility reports the state of the daemonsConfiguring the GUI client on Linux workstations Using an ssh tunnelUsing an X Window server Launching the HP Insight CMU GUI using a web browser Activating the HP Insight CMU GUILaunching the HP Insight CMU directly from the Java file HP Insight CMU GUI HP Insight CMU manpages Cmushownodes8 # /opt/cmu/bin/cmushownodes -a -o %n %i %k %m default %b %t # /opt/cmu/bin/cmushownodesCmushowlogicalgroups8 # /opt/cmu/bin/cmushowlogicalgroups -h logicalgroupnameHelp # /opt/cmu/bin/cmushowlogicalgroupsCmushownetworkentities8 # /opt/cmu/bin/cmushownetworkentities -h networkentity# /opt/cmu/bin/cmushownetworkentities # /opt/cmu/bin/cmushownetworkentities rack1Cmushowusergroups8 # /opt/cmu/bin/cmushowusergroups -h usergroup# /opt/cmu/bin/cmushowusergroups # /opt/cmu/bin/cmushowusergroups user1Cmushowarchivedusergroups8 # /opt/cmu/bin/cmushowarchivedusergroups# /opt/cmu/bin/cmushowarchivedusergroups -p -f # /opt/cmu/bin/cmushowarchivedusergroups -f -sCmuaddnode8 Mgtcardip -T--mgt-card ILOlo100iILOCM -R--arch architectureNode-number num Command-line mode Processing 1 node# cat nodes.txt # /opt/cmu/bin/cmuaddnode -f nodes.txtCmuaddnetworkentity8 Filename inputfile# /opt/cmu/bin/cmuaddnetworkentity rack1 rack2 # /opt/cmu/bin/cmuaddnetworkentity -f networkentitylistCmuaddlogicalgroup8 Filename inputfile input logical groups from inputfile Name# /opt/cmu/bin/cmuaddlogicalgroup -n test -d cciss/c0d0 # /opt/cmu/bin/cmuaddlogicalgroup -f logicalgroupfileCmuaddtologicalgroupcandidates8 LogicalgroupNodenamefile Cmuaddusergroup8 # /opt/cmu/bin/cmuaddusergroup user1 user2# /opt/cmu/bin/cmuaddusergroup -f usergrouplist Cmuaddtousergroup8 Usergroup# /opt/cmu/bin/cmuaddtousergroup -t group1 cn0003 # /opt/cmu/bin/cmuaddtousergroup -t group1 -f nodenamefileCmuchangeactivelogicalgroup8 To flag cn0001 active in logical group rh6u0x8664Cmuchangenetworkentity8 Networkentity# /opt/cmu/bin/cmuchangenetworkentity -t rack1 cn0001 Cmudelfromlogicalgroupcandidates8 Delete one or more nodes from a logical groupDelete nodes from this logical group To delete one node from a logical group rh6u0x8664Cmudelfromnetworkentity8 # /opt/cmu/bin/cmudelfromnetworkentity -t rack1 node1# /opt/cmu/bin/cmudelarchivedusergroup -h -v-t timeout -d Cmudelarchivedusergroup8Cmudelarchivedusergroup -- Delete an archived user group Delete an archived user groupCmudelfromusergroup8 # /opt/cmu/bin/cmudelfromusergroup -t user1 node1Cmudellogicalgroup8 # /opt/cmu/bin/cmudellogicalgroup rh5u5x8664 sles11sp1x8664# /opt/cmu/bin/cmudellogicalgroup -f logicalgrouplist Cmudelnetworkentity8 # /opt/cmu/bin/cmudelnetworkentity rack1 rack2# /opt/cmu/bin/cmudelnetworkentity -f networkentitylist Cmudelnode8 # /opt/cmu/bin/cmudelnode node1 node2# /opt/cmu/bin/cmudelnode -f nodelist Cmudelsnapshots8 Delete monitoring snapshots from the history databaseCmudelusergroup8 # /opt/cmu/bin/cmudelusergroup user1 user2# /opt/cmu/bin/cmudelusergroup -f usergrouplist # /opt/cmu/bin/cmudelusergroup -a -m 60 -f usergrouplistCmuconsole8 Cmuconsole -- Connect to compute node management ports# /opt/cmu/bin/cmuconsole computenodehostname Cmupower8 Cmupower -p OFF -n cn0001 Cmupower -p OFF -u user1Cmupower -p Boot -l rh6u0x8664 Cmupower -p Uidon -u user2Cmucustomrun8 Title# /opt/cmu/bin/cmucustomrun -l # /opt/cmu/bin/cmucustomrun -t auditlspciCmuclone8 =node# /opt/cmu/bin/cmuclone -f /tmp/nodelist -i sles11sp1x8664 # /opt/cmu/bin/cmuclone -n node1 -i rh6u2x8664Cmubackup8 Cmubackup -l myimage -n node20 -p cciss/c0d0p3,cciss/c0d0p1Cmubackup -l myimage -n node20 -r 3 -e /tmp/err.log Cmuscanmacs8 Options naming# /opt/cmu/bin/cmuscanmacs -h hostname -p hostnameprefix Options general Example Example node definitions173 Cmurescanmac8 Cmurescanmac -- Rescan the MAC address of a node# /opt/cmu/tools/cmurescanmac -n nodename N NICnum -h Node name in the HP Insight CMU databaseCmumodnode8 FilenameLg logicalgroup # /opt/cmu/bin/cmumodnode -f nodes.txt Cmumonstat8 # /opt/cmu/bin/cmumonstat --nodes=n0001,n0002,n0001-11 # /opt/cmu/bin/cmumonstat --all-sensors --all-nodes# /opt/cmu/bin/cmumonstat --all-nodes --all-sensors --stats # /opt/cmu/bin/cmumonstat --all-nodes --colorCmuimageopen8 # /opt/cmu/bin/cmuimageopen -h -i imagenameTo open the HP Insight CMU image rh5u5x8664 # /opt/cmu/bin/cmuimageopen -i rh5u5x8664Cmuimagecommit8 # /opt/cmu/bin/cmuimagecommit -i rh5u5x8664Cmuconfignvidia8 Cmuconfignvidia -- Configure Nvidia GPU monitoringCmuconfigamd8 Cmuconfigamd -- Configure AMD GPU monitoringCmuconfigintel8 Cmuconfigintel -- Configure Intel coprocessor monitoring# /opt/cmu/bin/cmuconfigintel -h -r -n Cmumgtconfig8 Automatically defaults when reasonableEth num1num2bond num1 Num# /opt/cmu/bin/cmumgtconfig -c # /opt/cmu/bin/cmumgtconfig -c -s dhcp# /opt/cmu/bin/cmumgtconfig -t Cmufirmwaremgmt8 Cmufirmwaremgmt -- Verify and execute firmwareOcmudiffparameters Specifies a text file listing compute nodesGlossary EbipaPackage management Index Index 191