Manuals / HP / Computer Equipment / Software

HP Serviceguard Metrocluster manual # Cluster Information

Models: Serviceguard Metrocluster

1 151

Download 151 pages 11.74 Kb

Page 121

#### #### MONITORING_CLUSTER eastcoast			####
#### #### CLUSTER_ALERT	0 MINUTES		####
#### #### NOTIFICATION	EMAIL	admin@secondary.site	####
#### #### "Error in monitoring cluster westcoast."			####
#### ####			####
#### #### CLUSTER_EVENT	<cluster_name>/UNREACHABLE		####
#### #### MONITORING_CLUSTER CLUSTER_ALERT			####

The following is a sample Continentalclusters configuration file with two recovery pairs. Both cluster1 and cluster2 are configured to have cluster3 as their recovery cluster for package pkg1 and pkg2, and cluster3 is configured to have cluster1 as its recovery cluster for pkg3.

# Section1: Cluster Information

#Section1: Cluster Information CONTINENTAL_CLUSTER_NAME sampleCluster CONTINENTAL_CLUSTER_STATE_DIR /opt/cmconcl/statedir

CLUSTER_NAMEcluster1

CLUSTER_DOMAIN cup.hp.com

NODE_NAMEnode11

NODE_NAMEnode12 MONITOR_PACKAGE_NAME ccmonpkg

MONITOR_INTERVAL		60 seconds
CLUSTER_NAME		cluster2
CLUSTER_DOMAIN			cup.hp.com
NODE_NAME			node21
NODE_NAME			node22
CLUSTER_NAME		cluster3
CLUSTER_DOMAIN			cup.hp.com
NODE_NAME			node31
NODE_NAME			node32
MONITOR_PACKAGE_NAME			ccmonpkg
MONITOR_INTERVAL		60 seconds
RECOVERY_GROUP_NAME		ccRG1
PRIMARY_PACKAGE			cluster1/pkg1
RECOVERY_PACKAGE			cluster3/pkg1’
REHEARSAL_PACKAGE			cluster3/pkg4’
RECOVERY_GROUP_NAME			ccRG2
PRIMARY_PACKAGE			cluster2/pkg2
RECOVERY_PACKAGE			cluster3/pkg2’
RECOVERY_GROUP_NAME			ccRG3
RECOVERY_PACKAGE			cluster3/pkg3
DATA_RECEIVER_PACKAGE			cluster1/pkg3’
# Section 3. Monitoring Definitions ####
CLUSTER_EVENT	cluster1/DOWN
MONITORING_CLUSTER			cluster3
CLUSTER_ALERT			30 SECONDS
NOTIFICATION	TEXTLOG /var/opt/resmon/log/CCTextlog
“DRT: (Ora-test)		DOWN alert”
NOTIFICATION		SYSLOG
“DRT: (Ora-test)		cluster1 DOWN alert”
CLUSTER_ALARM			30 SECONDS

NOTIFICATION TEXTLOG /var/opt/resmon/log/CCTextlog “DRT: (Ora-test) DOWN alarm”

NOTIFICATION SYSLOG

“DRT: (Ora-test) cluster1 DOWN alarm”

# Section1: Cluster Information 121

Image 121

HP Serviceguard Metrocluster manual # Cluster Information

Contents

HP Part Number Published February Legal Notices Contents Administering Continentalclusters Disaster recovery rehearsal in ContinentalclustersTroubleshooting Continentalclusters Package attributes Sample Continentalclusters Ascii configuration file 115Legacy packages 100 114Glossary 145 Index 150 Introduction Sample Continentalclusters Configuration Creating the Serviceguard clusters at both the sites Building the Continentalclusters configurationEasy deployment method Traditional deployment method# cmapplyconf -v -C /etc/cmcluster/cluster.config Setting up securityCsshsetup -r -k rsa -f host-list-file # passwd conclusrCreating data replication between the clusters Userhost Anyserviceguardnode Userrole MonitorUsername conclusr Using software based logical replication Using any other array based physical replication technology# mkdir /dev/vgxx # mknod /dev/vgxx/group c 64 0xnn0000 Creating and Exporting LVM Volume Groups# vgchange -a n vgname # vgexport -s -p -m mapfilename vgnameCreating VxVM Disk Groups Dts/xpca/dtspkgdir # cmmakepkg -m dts/ccxpca temp.configDts/xpca/dtspkgdir pkgdirname Devicegroup# cmapplyconf -P temp.config # cmcheckconf -P temp.config# cmmakepkg -m dts/cccaeva temp.config FenceDrgroupname DtapplicationstartuppolicyDC1STORAGEWORLDWIDENAME DC1SMISLISTDts/dts/dtspkgdir # cmmakepkg -m dts/ccsrdf temp.configRdfmode # cmhaltpkg packagename# cmrunpkg -n nodename packagename # cmmakepkg -m dts/cc3parrc pkgName.config# cmmodpkg -e packagename # cmcheckconf -P pkgName.config Configuring the monitor package# cmapplyconf -P pkgName.config # cd /etc/cmcluster # cmqueryconcl -C cmconcl.config Creating a Continentalclusters configurationCluster information # cmcheckconf -P ccmonpkg.confRecovery groups, the following parameters are available Recovery groupsMonitoring definitions has the following parameters Monitoring definitionsVerify the Continentalclusters configuration Checking and applying the Continentalclusters configuration# cmcheckconcl -v -C cmconcl.config # cmapplyconcl -v -C cmconcl.configTesting Individual Packages Testing the ContinentalclustersTesting Continentalclusters Operations Starting the Continentalclusters monitor package# cmviewconcl Testing the ContinentalclustersBuilding the Continentalclusters configuration Verifying that recovery is required Performing recovery in case of disasterPreparing the storage manually in the recovery cluster Receiving notification# cmrecovercl Recovering the entire cluster after a cluster alarm# vxdg deport disk group name Recovering a single cluster in an N-1 configuration Recovering the entire cluster after a cluster alert# cmrecovercl -f Viewing the Continentalclusters statusSwitching the Primary and Recovery Cluster Roles Restoring disaster recovery cluster after a disasterRun this command Check and apply the Continentalclusters configurationRestart the monitor packages on every cluster Creating a new Primary Cluster # cmapplyconf -p ccmonpkg.config Creating a new Recovery ClusterRestart the monitor package on the recovery cluster # cmrunpkg ccmonpkgOverview of Disaster Recovery rehearsal Disaster recovery rehearsal in ContinentalclustersConfiguring Continentalclusters Disaster Recovery rehearsal Configuring maintenance mode in Continentalclusters# vgcreate /dev/vgcc -f /dev/sda1 # cmgetconf -p ccmonpkg ccnew.config# lvcreate -L size vgname Mke2fs -j Lvol # mkdir directorypathModifying Continentalclusters configuration Configuring Continentalclusters rehearsal packages# cmhaltpkg ccmonpkg # cmapplyconf -P ccnew.config # cmcheckconf -P packagenameClient access IP address at recovery cluster Precautions to be taken while performing DR RehearsalCluster role switch during rehearsal Verify data replication environment Move the recovery group into maintenance modePrepare the replication environment for DR rehearsal Start rehearsalRecovering the primary cluster disaster during DR Rehearsal Cleanup of secondary mirror copyRestore replication environment for recovery Move the recovery group out of maintenance modeRun cmrrcovercl command Limitations of DR rehearsal featureSadta Configuration in Continentalclusters Configuring the primary cluster with a single site Setting up replicationSetting up the complex workload in the primary cluster Configuring the recovery cluster with a single site# vxdg -s init cvmdgname replicateddisk1 replicateddisk2 # vxdg -g cvmdgname set activation=sw# cmmakepkg -m sg/cfsall /etc/cmcluster/cfspkg1.ascii # newfs -F vxfs /dev/vx/rdsk/cvmdgname/cvmdgvolname# cmcheckconf -P cfspkg1.ascii # cmapplyconf -P cfspkg1.ascii# mkdir /dev/vgname # mknod /dev/vgname/group c 64 0xnn0000 # cmapplyconf -v -P cvmdgpkgname.conf# lvcreate -L Xxxx /dev/vgname # vgimport -s -m mapfilename vgnameConfiguring the complex workload at the primary cluster # cmmakepkg -m dts/sc -m dts/cccaeva cwsc.config # cmmakepkg -m dts/sc -m dts/ccxpca cwsc.config# cmmakepkg -m dts/sc -m dts/ccsrdf cwsc.config # cmmakepkg -m dts/sc -m dts/cc3parrc cwsc.config# cmapplyconf -v -P /etc/cmcluster/cwsc/cwsc.config Suspending the replication to the recovery cluster# cmviewcl -v -p pkgname # vxdg -stfC import cvmdgname Where node3 and node4 are the nodes at the recovery cluster# cmrunpkg siteBcfspkgname # vgchange -c n vgname # vgchange -c y vgname Configuring Site Safety Latch dependencies# vgchange -c n -S n vgname # vgchange -c y -S y vgname Configuring Continentalclusters Resuming the replication to the recovery clusterChecking the status of clusters, nodes, and packages Administering ContinentalclustersConfigured Event Status Duration Last Notification Sent Package Status State Pkgswitch Node Startup and Switching Characteristics Enabling and disabling maintenance mode# cmrecovercl -d recoverygroup1 Network AttributesStarting a recovery package forcefully Recovering a cluster when the storage array or disks fail# cmrecovercl -e recoverygroup1 # cmrecovercl -g RecoveryGroupName# cmapplyconf -C cluster.config Adding a Recovery Group to ContinentalclustersAdding or Removing a Node from a Cluster # cmforceconcl cmrunpkg -n node3 Pkg1Modifying Continentalclusters configuration Modifying a package in a recovery groupRemoving a recovery group from the Continentalclusters Modifying a recovery group with a new rehearsal package Removing a rehearsal package from a recovery groupBehavior of Serviceguard commands in Continentalclusters Changing monitoring definitionsRenaming the Continentalclusters Verifying the status of Continentalclusters daemons# ps -ef grep cmclsentryd # ps -ef grep cmclapplydMaintaining the data replication environment Deleting the Continentalclusters configuration# what /usr/sbin/cmviewconcl Using the pairresync command Continuous Access EVA Link Suspend and Resume Modes Maintaining 3PAR Remote Copy data replication environment Maintaining EMC Srdf data replication environmentMaintaining a Node Administering Continentalclusters using Sadta configurationMaintaining the Site Maintaining Site Controller Package Starting a Complex Workload Deleting the Site Controller Package# cfsdgadm deleteems pkg1dg /dts/mcsc/cwsc Start the Site Controller package by enabling itShutting Down a Complex Workload Moving a Complex Workload to the Recovery ClusterRestarting a Failed Site Controller Package # cmviewcl -l packageTroubleshooting Continentalclusters Error Messages Troubleshooting ContinentalclustersReviewing Messages and Log Files Reviewing Messages and Log Files of Monitoring DaemonTroubleshooting Continentalclusters Error Messages PackageName on cluster ClusterName Migrating to Continentalclusters A.08.00 Verify the configuration and the status of the clusterContinentalclusters Worksheets Recovery Group WorksheetData Center Worksheet Cluster Event Worksheet Recovery ChecklistReplication configuration Continentalclusters Site configurationConfiguring a CRS sub-cluster using CFS CRS Sub-cluster configuration using CFSRAC database configuration RAC database configurationRAC MNP Site Controller package configurationSite Controller package configuration Configuration file parameters for Continentalclusters Datasenderpackage clustername/packagename Primarypackage Clustername/Packagename Continentalclusters Command and Daemon Reference Cmcluster/cmoncl.config Cmrunpkg or cmmodpkg commandCmrecovercl -f Cmdeleteconcl -fRecovery group name Cmrecovercl -r-gCmviewconcl Autofencedatasplit Package attributesAutopsuepsus Autopsusssws Autosvolpsue AutosvolpfusClustertype AutosvolpsusHorctakeover command, -t timeout. HorctimeoutPkg Startup Timeout Horctimeout Continuous Access link timeout valueWaittime DTS PKG DIRMonpollinterval MonnotificationfrequencyMonnotificationconsole MonnotificationsyslogAutoresync Start with an error Before startup of the package on destination volumeIf Waittime is 0 default value, and if the state of DR Fails to start with an errorPackage Attributes for Continentalcluster with EMC Srdf Querytimeout DefaultEtc/cmcluster/ packagename/FORCEFLAG Consistencygroups is set to Group in an M by N configuration ConfigurationsWhere the Metrocluster Srdf environment file is located Supported mode are sync for synchronous and async forMigrating legacy to modular packages Legacy packagesMigrating legacy monitor package # cmcheckconf -P modularccmonpkg.conf # cmmigratepkg -p packagename -o modularccmonpkg.conf# cmapplyconf -P modularccmonpkg.conf # cmmigratepkg -p packagename -s -o modularsgconfPathtoenvfile modularsgecmcc.conf Validate the new modular package configuration file# cmcheckconf -P modularsgecmcc.conf # cmapplyconf -P modularsgecmcc.conf# cmmigratepkg -p packagename -s -o modularsg.conf Configuring the monitor package in legacy style Configuring legacy packagesValidate the new package configuration file # mkdir /etc/cmcluster/ccmonpkg# cmcheckconf -P ccmonpkg.config Use the cmcheckconf command to validate the package# mkdir /etc/cmcluster/pkgname # cd /etc/cmcluster/pkgname # cmmakepkg -p pkgname.ascii# cmmakepkg -s pkgname.cntl Create a package control scriptEVA Legacy packages # mkdir /etc/cmcluster/pkgname Set Pkgdir to /etc/cmcluster/pkgname Example 1 ExampleEtc/cmcluster/pkgname Configuring storage devices for complex workload# vxdg -s init cvmdgname replicateddisk1\ replicateddisk2 # cfsdgadm add cvmdgnamecvmdgpkgname all=sw\ node1node2# cfsdgadm activate cvmdgname Where node1 and node2 are the nodes in the Source Disk Site# newfs -F vxfs \ Dev/vx/rdsk/cvmdgname/cvmdgvolname # mkdir /cfs # chmod 775 /cfs # mkdir /cfs/cvmdgname# cfsmount /cfs/cvmdgname EVA Continentalclusters Ascii configuration file Sample Continentalclusters Ascii configuration fileSample Continentalclusters Ascii configuration file Clustername #### #### Recoverygroupname Datasenderpackage Notification Console #### #### Clusterevent # Cluster Information Clusteralarm Seconds Notification Recoverygroupname RG2 Sample input and output files for cmswitchconcl commandRecoverygroupname RG2 Primarypackage Oracle RAC instances in a Continentalclusters environment Supported Continentalclusters and RAC configuration # cfsdgadm add disk group name all=sw # vxdctl -c mode# cfsmntadm add racdgl vol4 /cfs/mntl all=rw # cfsdgadm activate diskgroupPage # cd your own directory # cp /opt/cmconcl/scripts/ccrac.config ccrac.config.mycopyCopy the file Copy the edited file to the final directory # cp ccrac.config.mycopy /etc/cmconcl/ccrac/ccrac.configPage Failover of Oracle RAC instances to the recovery site Oracle RAC instance package can be started in sequence Failback of Oracle RAC instances after a failover # cfsumount Mount Point Name Rehearsing Oracle RAC databases in Continentalclusters# cfsdgadm deactivate Disk Group Name # /opt/cmconcl/bin/ccracmgmt.ksh -i indexNumber \ startSample Oracle RAC database with ASM in Sadta Configure a primary cluster with a single site Installing and configuring Oracle Clusterware Configure a recovery cluster with a single siteInstalling Oracle Real Application Clusters RAC software Configuring the ASM disk group in the primary clusterHalting the RAC database in the primary cluster Creating the Oracle RAC database in the primary cluster# chown -R oracleoinstall /opt/app/oracle/admin Page # chown -R oracleoinstall /opt/app/oracle/admin/hrdb Run the following command at the remote site# srvctl status # cmviewcl -v -p ASMDGpkgnameSite cc2site1 # cmapplyconf -v -P sitecontrollerconfigurationfile# cmrunpkg siteController1 See also quorum server GlossarySpan 100s or 1000s of kilometers Or system availability Format /dev/devtype/filename Svol Index Symbols151