# cmrunpkg siteController1 | HP Serviceguard Metrocluster guide

Database with ASM in the Continentalclusters in the primary cluster

The procedure to start the disaster recovery Oracle RAC database with ASM is identical to the procedure for starting a complex workload in a Continentalclusters. Run the cmrunpkg command with the site controller package name managing the Oracle RAC/ASM workload in the primary cluster as the argument.

# cmrunpkg siteController1

144 Configuring Oracle RAC database with ASM in Continentalclusters using SADTA

Image 144

HP Serviceguard Metrocluster manual # cmrunpkg siteController1

Contents

HP Part Number Published February Legal Notices Contents Disaster recovery rehearsal in Continentalclusters Administering Continentalclusters Troubleshooting Continentalclusters Sample Continentalclusters Ascii configuration file 115 Package attributesLegacy packages 100 114 Glossary 145 Index 150 Introduction Sample Continentalclusters Configuration Building the Continentalclusters configuration Creating the Serviceguard clusters at both the sitesEasy deployment method Traditional deployment method Setting up security # cmapplyconf -v -C /etc/cmcluster/cluster.configCsshsetup -r -k rsa -f host-list-file # passwd conclusr Userhost Anyserviceguardnode Userrole Monitor Creating data replication between the clustersUsername conclusr Using any other array based physical replication technology Using software based logical replication Creating and Exporting LVM Volume Groups # mkdir /dev/vgxx # mknod /dev/vgxx/group c 64 0xnn0000# vgchange -a n vgname # vgexport -s -p -m mapfilename vgname Creating VxVM Disk Groups # cmmakepkg -m dts/ccxpca temp.config Dts/xpca/dtspkgdirDts/xpca/dtspkgdir pkgdirname Devicegroup # cmcheckconf -P temp.config # cmapplyconf -P temp.config# cmmakepkg -m dts/cccaeva temp.config Fence Dtapplicationstartuppolicy DrgroupnameDC1STORAGEWORLDWIDENAME DC1SMISLIST # cmmakepkg -m dts/ccsrdf temp.config Dts/dts/dtspkgdirRdfmode # cmhaltpkg packagename # cmmakepkg -m dts/cc3parrc pkgName.config # cmrunpkg -n nodename packagename# cmmodpkg -e packagename Configuring the monitor package # cmcheckconf -P pkgName.config# cmapplyconf -P pkgName.config Creating a Continentalclusters configuration # cd /etc/cmcluster # cmqueryconcl -C cmconcl.configCluster information # cmcheckconf -P ccmonpkg.conf Recovery groups Recovery groups, the following parameters are available Monitoring definitions Monitoring definitions has the following parameters Checking and applying the Continentalclusters configuration Verify the Continentalclusters configuration# cmcheckconcl -v -C cmconcl.config # cmapplyconcl -v -C cmconcl.config Testing the Continentalclusters Testing Individual PackagesTesting Continentalclusters Operations Starting the Continentalclusters monitor package Testing the Continentalclusters # cmviewconcl Building the Continentalclusters configuration Performing recovery in case of disaster Verifying that recovery is requiredPreparing the storage manually in the recovery cluster Receiving notification Recovering the entire cluster after a cluster alarm # cmrecovercl# vxdg deport disk group name Recovering the entire cluster after a cluster alert Recovering a single cluster in an N-1 configuration# cmrecovercl -f Viewing the Continentalclusters status Restoring disaster recovery cluster after a disaster Switching the Primary and Recovery Cluster Roles Check and apply the Continentalclusters configuration Run this commandRestart the monitor packages on every cluster Creating a new Primary Cluster Creating a new Recovery Cluster # cmapplyconf -p ccmonpkg.configRestart the monitor package on the recovery cluster # cmrunpkg ccmonpkg Disaster recovery rehearsal in Continentalclusters Overview of Disaster Recovery rehearsalConfiguring Continentalclusters Disaster Recovery rehearsal Configuring maintenance mode in Continentalclusters # cmgetconf -p ccmonpkg ccnew.config # vgcreate /dev/vgcc -f /dev/sda1# lvcreate -L size vgname Mke2fs -j Lvol # mkdir directorypath Configuring Continentalclusters rehearsal packages Modifying Continentalclusters configuration# cmhaltpkg ccmonpkg # cmapplyconf -P ccnew.config # cmcheckconf -P packagename Precautions to be taken while performing DR Rehearsal Client access IP address at recovery clusterCluster role switch during rehearsal Move the recovery group into maintenance mode Verify data replication environmentPrepare the replication environment for DR rehearsal Start rehearsal Cleanup of secondary mirror copy Recovering the primary cluster disaster during DR RehearsalRestore replication environment for recovery Move the recovery group out of maintenance mode Limitations of DR rehearsal feature Run cmrrcovercl command Sadta Configuration in Continentalclusters Setting up replication Configuring the primary cluster with a single site Configuring the recovery cluster with a single site Setting up the complex workload in the primary cluster# vxdg -s init cvmdgname replicateddisk1 replicateddisk2 # vxdg -g cvmdgname set activation=sw # newfs -F vxfs /dev/vx/rdsk/cvmdgname/cvmdgvolname # cmmakepkg -m sg/cfsall /etc/cmcluster/cfspkg1.ascii# cmcheckconf -P cfspkg1.ascii # cmapplyconf -P cfspkg1.ascii # cmapplyconf -v -P cvmdgpkgname.conf # mkdir /dev/vgname # mknod /dev/vgname/group c 64 0xnn0000# lvcreate -L Xxxx /dev/vgname # vgimport -s -m mapfilename vgname Configuring the complex workload at the primary cluster # cmmakepkg -m dts/sc -m dts/ccxpca cwsc.config # cmmakepkg -m dts/sc -m dts/cccaeva cwsc.config# cmmakepkg -m dts/sc -m dts/ccsrdf cwsc.config # cmmakepkg -m dts/sc -m dts/cc3parrc cwsc.config Suspending the replication to the recovery cluster # cmapplyconf -v -P /etc/cmcluster/cwsc/cwsc.config# cmviewcl -v -p pkgname Where node3 and node4 are the nodes at the recovery cluster # vxdg -stfC import cvmdgname# cmrunpkg siteBcfspkgname Configuring Site Safety Latch dependencies # vgchange -c n vgname # vgchange -c y vgname# vgchange -c n -S n vgname # vgchange -c y -S y vgname Resuming the replication to the recovery cluster Configuring Continentalclusters Administering Continentalclusters Checking the status of clusters, nodes, and packages Configured Event Status Duration Last Notification Sent Package Status State Pkgswitch Node Enabling and disabling maintenance mode Startup and Switching Characteristics# cmrecovercl -d recoverygroup1 Network Attributes Recovering a cluster when the storage array or disks fail Starting a recovery package forcefully# cmrecovercl -e recoverygroup1 # cmrecovercl -g RecoveryGroupName Adding a Recovery Group to Continentalclusters # cmapplyconf -C cluster.configAdding or Removing a Node from a Cluster # cmforceconcl cmrunpkg -n node3 Pkg1 Modifying a package in a recovery group Modifying Continentalclusters configurationRemoving a recovery group from the Continentalclusters Removing a rehearsal package from a recovery group Modifying a recovery group with a new rehearsal packageBehavior of Serviceguard commands in Continentalclusters Changing monitoring definitions Verifying the status of Continentalclusters daemons Renaming the Continentalclusters# ps -ef grep cmclsentryd # ps -ef grep cmclapplyd Deleting the Continentalclusters configuration Maintaining the data replication environment# what /usr/sbin/cmviewconcl Using the pairresync command Continuous Access EVA Link Suspend and Resume Modes Maintaining EMC Srdf data replication environment Maintaining 3PAR Remote Copy data replication environment Administering Continentalclusters using Sadta configuration Maintaining a NodeMaintaining the Site Maintaining Site Controller Package Deleting the Site Controller Package Starting a Complex Workload# cfsdgadm deleteems pkg1dg /dts/mcsc/cwsc Start the Site Controller package by enabling it Moving a Complex Workload to the Recovery Cluster Shutting Down a Complex WorkloadRestarting a Failed Site Controller Package # cmviewcl -l package Troubleshooting Continentalclusters Troubleshooting Continentalclusters Error MessagesReviewing Messages and Log Files Reviewing Messages and Log Files of Monitoring Daemon Troubleshooting Continentalclusters Error Messages PackageName on cluster ClusterName Verify the configuration and the status of the cluster Migrating to Continentalclusters A.08.00 Recovery Group Worksheet Continentalclusters WorksheetsData Center Worksheet Recovery Checklist Cluster Event Worksheet Continentalclusters Site configuration Replication configuration CRS Sub-cluster configuration using CFS Configuring a CRS sub-cluster using CFS RAC database configuration RAC database configuration Site Controller package configuration RAC MNP Site Controller package configuration Configuration file parameters for Continentalclusters Datasenderpackage clustername/packagename Primarypackage Clustername/Packagename Continentalclusters Command and Daemon Reference Cmrunpkg or cmmodpkg command Cmcluster/cmoncl.configCmrecovercl -f Cmdeleteconcl -f Cmrecovercl -r-g Recovery group nameCmviewconcl Package attributes Autofencedatasplit Autopsuepsus Autopsusssws Autosvolpfus Autosvolpsue Autosvolpsus Clustertype Horctimeout Horctakeover command, -t timeout.Pkg Startup Timeout Horctimeout Continuous Access link timeout value DTS PKG DIR WaittimeMonpollinterval Monnotificationfrequency Monnotificationsyslog MonnotificationconsoleAutoresync Before startup of the package on destination volume Start with an errorIf Waittime is 0 default value, and if the state of DR Fails to start with an error Querytimeout Default Package Attributes for Continentalcluster with EMC SrdfEtc/cmcluster/ packagename/FORCEFLAG Consistencygroups is set to Configurations Group in an M by N configurationWhere the Metrocluster Srdf environment file is located Supported mode are sync for synchronous and async for Legacy packages Migrating legacy to modular packagesMigrating legacy monitor package # cmmigratepkg -p packagename -o modularccmonpkg.conf # cmcheckconf -P modularccmonpkg.conf# cmapplyconf -P modularccmonpkg.conf # cmmigratepkg -p packagename -s -o modularsgconf Validate the new modular package configuration file Pathtoenvfile modularsgecmcc.conf# cmcheckconf -P modularsgecmcc.conf # cmapplyconf -P modularsgecmcc.conf # cmmigratepkg -p packagename -s -o modularsg.conf Configuring legacy packages Configuring the monitor package in legacy styleValidate the new package configuration file # mkdir /etc/cmcluster/ccmonpkg Use the cmcheckconf command to validate the package # cmcheckconf -P ccmonpkg.config# mkdir /etc/cmcluster/pkgname # cd /etc/cmcluster/pkgname # cmmakepkg -p pkgname.ascii Create a package control script # cmmakepkg -s pkgname.cntl EVA Legacy packages # mkdir /etc/cmcluster/pkgname Example 1 Example Set Pkgdir to /etc/cmcluster/pkgname Configuring storage devices for complex workload Etc/cmcluster/pkgname# vxdg -s init cvmdgname replicateddisk1\ replicateddisk2 # cfsdgadm add cvmdgnamecvmdgpkgname all=sw\ node1node2 Where node1 and node2 are the nodes in the Source Disk Site # cfsdgadm activate cvmdgname# newfs -F vxfs \ Dev/vx/rdsk/cvmdgname/cvmdgvolname # mkdir /cfs # chmod 775 /cfs # mkdir /cfs/cvmdgname # cfsmount /cfs/cvmdgname EVA Sample Continentalclusters Ascii configuration file Continentalclusters Ascii configuration fileSample Continentalclusters Ascii configuration file Clustername #### #### Recoverygroupname Datasenderpackage Notification Console #### #### Clusterevent # Cluster Information Clusteralarm Seconds Notification Sample input and output files for cmswitchconcl command Recoverygroupname RG2 Recoverygroupname RG2 Primarypackage Oracle RAC instances in a Continentalclusters environment Supported Continentalclusters and RAC configuration # vxdctl -c mode # cfsdgadm add disk group name all=sw# cfsmntadm add racdgl vol4 /cfs/mntl all=rw # cfsdgadm activate diskgroupPage # cp /opt/cmconcl/scripts/ccrac.config ccrac.config.mycopy # cd your own directoryCopy the file # cp ccrac.config.mycopy /etc/cmconcl/ccrac/ccrac.config Copy the edited file to the final directoryPage Failover of Oracle RAC instances to the recovery site Oracle RAC instance package can be started in sequence Failback of Oracle RAC instances after a failover Rehearsing Oracle RAC databases in Continentalclusters # cfsumount Mount Point Name# cfsdgadm deactivate Disk Group Name # /opt/cmconcl/bin/ccracmgmt.ksh -i indexNumber \ start Sample Oracle RAC database with ASM in Sadta Configure a primary cluster with a single site Configure a recovery cluster with a single site Installing and configuring Oracle ClusterwareInstalling Oracle Real Application Clusters RAC software Configuring the ASM disk group in the primary cluster Creating the Oracle RAC database in the primary cluster Halting the RAC database in the primary cluster # chown -R oracleoinstall /opt/app/oracle/admin Page Run the following command at the remote site # chown -R oracleoinstall /opt/app/oracle/admin/hrdb# srvctl status # cmviewcl -v -p ASMDGpkgname # cmapplyconf -v -P sitecontrollerconfigurationfile Site cc2site1 # cmrunpkg siteController1 Glossary See also quorum server Span 100s or 1000s of kilometers Or system availability Format /dev/devtype/filename Svol Symbols Index 151