Condition

The reaction is performed under this condition.

ReactOnRaise — Execute the reaction whenever the alert shows as raised and the previous state of the alert was lowered.

ReactAlways — Execute the reaction whenever the alert shows as raised, subject to the alert’s time multiple. For example, if the monitoring has a default timer of 5 seconds and the alert’s time multiple is 6, the reaction will trigger every 5x6=30 seconds as long as the alert is raised.

Command

The command to be executed. This can be a single-line shell command, a shell script, or an executable file. Scripts and executable files must be available on the management node.

The following keywords are supported within the “Command”. Each keyword is substituted globally (throughout the command line) using the defined values:

CMU_ALERT_NAME

The name of the alert that caused the reaction.

CMU_ALERT_LEVEL

The level of the alert.

CMU_REACT_MESSAGE

The text of the “Description” for this reaction.

CMU_ALERT_NODES

The list of names of all the nodes that raised the alert during the current monitoring pass. The list is condensed in the form provided by cmu_condense_nodes.

CMU_ALERT_NODES_EXPANDED

The same as CMU_ALERT_NODES only the list is expanded, ordered, and separated by commas.

CMU_ALERT_VALUES

The list of alert values. This list is comma separated and ordered like the names of

CMU_ALERT_NODES_EXPANDED.

CMU_ALERT_TIMES

The time the alert was triggered on each node. This list is comma separated and ordered like the names of CMU_ALERT_NODES_EXPANDED.

CMU_ALERT_SEQUENCE_FILE

The path of the HP Insight CMU “sequence” file containing the alerts and alert values from the monitoring pass that triggered the reaction. Analyze this file with the /opt/cmu/bin/cmu_monstat command.

NOTE: To protect the management node from large numbers of concurrent reactions, a reaction will only launch on behalf of compute nodes that do not have previous instances of the reaction still running. Limit the command runtime of a reaction if the reaction is expected to be triggered frequently.

5.5.5 Modifying the sensors, alerts, and alert reactions monitored by HP Insight CMU

Several optional sensors, alerts, and alert reactions are commented out in the

ActionAndAlertsFile.txt file.

Comment a sensor, alert, or alert reaction to stop monitoring it.

Uncomment a sensor, alert, or alert reaction to start monitoring it.

Modify a sensor, alert, or alert reaction line to change its parameters.

80 Monitoring a cluster with HP Insight CMU

Page 80
Image 80
HP Insight Cluster Management Utility manual Name of the alert that caused the reaction, Level of the alert