Manuals / HP / Computer Equipment / Software

HP Serviceguard Metrocluster manual Oracle RAC instances in a Continentalclusters environment

Models: Serviceguard Metrocluster

1 151

Download 151 pages 11.74 Kb

Page 125

JConfiguring Oracle RAC in Continentalclusters in Legacy style

Support for Oracle RAC instances in a Continentalclusters environment

When the primary cluster fails, the clients database requests are served by the support of Oracle RAC instances that are restarted by the Continantalclusters on the recovery cluster. Figure 3 (page 125) is a sample of Oracle RAC instances running in the Continentalclusters environment.

Figure 3 Oracle RAC instances in a Continentalclusters environment

As shown in Figure 3 (page 125), Oracle RAC instances are configured to run in Serviceguard packages. The instance packages are running in the primary cluster and recovered on the recovery cluster upon a primary cluster failure. Figure 4 (page 126) shows a recovery using an Oracle RAC configuration after failover.

Oracle RAC instances are only supported in the Continentalclusters environment for physical replication set up using HP StorageWorks Continuous Access P9000 and XP, HP StorageWorks Continuous Access EVA or EMC Symmetrix Remote Data Facility (SRDF) using an SLVM or Cluster Volume Manager (CVM) or Cluster File System (CFS) or Automatic Storage Management (ASM) for volume management. In Continentalclusters, the Oracle RAC with ASM can be configured using the SADTA. For more information, see “Configuring Oracle RAC database with ASM in Continentalclusters using SADTA” (page 136).

Continentalclusters Oracle RAC support is available for a cluster environment configured with only Serviceguard and SGeRAC (For example, an environment running with Oracle RAC 9i, 10g or 11g).

Starting with Continentalclusters version A.05.01, recovery of an Oracle RAC instance in a cluster environment running Serviceguard and Oracle Clusterware is supported. There is a special configuration required for the environment running both Oracle Clusterware and Serviceguard/Serviceguard Extension for RAC (SGeRAC) for the Continentalclusters RAC instance recovery protection.

For more information, see “Configuring the environment for Continentalclusters to support Oracle RAC” (page 126).

Support for Oracle RAC instances in a Continentalclusters environment 125

Image 125

HP Serviceguard Metrocluster manual Oracle RAC instances in a Continentalclusters environment

Contents

HP Part Number Published February Legal Notices Contents Administering Continentalclusters Disaster recovery rehearsal in ContinentalclustersTroubleshooting Continentalclusters Package attributes Sample Continentalclusters Ascii configuration file 115Legacy packages 100 114Glossary 145 Index 150 Introduction Sample Continentalclusters Configuration Creating the Serviceguard clusters at both the sites Building the Continentalclusters configurationEasy deployment method Traditional deployment method# cmapplyconf -v -C /etc/cmcluster/cluster.config Setting up securityCsshsetup -r -k rsa -f host-list-file # passwd conclusrUsername conclusr Userhost Anyserviceguardnode Userrole MonitorCreating data replication between the clusters Using software based logical replication Using any other array based physical replication technology# mkdir /dev/vgxx # mknod /dev/vgxx/group c 64 0xnn0000 Creating and Exporting LVM Volume Groups# vgchange -a n vgname # vgexport -s -p -m mapfilename vgnameCreating VxVM Disk Groups Dts/xpca/dtspkgdir # cmmakepkg -m dts/ccxpca temp.configDts/xpca/dtspkgdir pkgdirname Devicegroup# cmapplyconf -P temp.config # cmcheckconf -P temp.config# cmmakepkg -m dts/cccaeva temp.config FenceDrgroupname DtapplicationstartuppolicyDC1STORAGEWORLDWIDENAME DC1SMISLISTDts/dts/dtspkgdir # cmmakepkg -m dts/ccsrdf temp.configRdfmode # cmhaltpkg packagename# cmmodpkg -e packagename # cmmakepkg -m dts/cc3parrc pkgName.config# cmrunpkg -n nodename packagename # cmapplyconf -P pkgName.config Configuring the monitor package# cmcheckconf -P pkgName.config # cd /etc/cmcluster # cmqueryconcl -C cmconcl.config Creating a Continentalclusters configurationCluster information # cmcheckconf -P ccmonpkg.confRecovery groups, the following parameters are available Recovery groupsMonitoring definitions has the following parameters Monitoring definitionsVerify the Continentalclusters configuration Checking and applying the Continentalclusters configuration# cmcheckconcl -v -C cmconcl.config # cmapplyconcl -v -C cmconcl.configTesting Individual Packages Testing the ContinentalclustersTesting Continentalclusters Operations Starting the Continentalclusters monitor package# cmviewconcl Testing the ContinentalclustersBuilding the Continentalclusters configuration Verifying that recovery is required Performing recovery in case of disasterPreparing the storage manually in the recovery cluster Receiving notification# vxdg deport disk group name Recovering the entire cluster after a cluster alarm# cmrecovercl Recovering a single cluster in an N-1 configuration Recovering the entire cluster after a cluster alert# cmrecovercl -f Viewing the Continentalclusters statusSwitching the Primary and Recovery Cluster Roles Restoring disaster recovery cluster after a disasterRestart the monitor packages on every cluster Check and apply the Continentalclusters configurationRun this command Creating a new Primary Cluster # cmapplyconf -p ccmonpkg.config Creating a new Recovery ClusterRestart the monitor package on the recovery cluster # cmrunpkg ccmonpkgOverview of Disaster Recovery rehearsal Disaster recovery rehearsal in ContinentalclustersConfiguring Continentalclusters Disaster Recovery rehearsal Configuring maintenance mode in Continentalclusters# vgcreate /dev/vgcc -f /dev/sda1 # cmgetconf -p ccmonpkg ccnew.config# lvcreate -L size vgname Mke2fs -j Lvol # mkdir directorypathModifying Continentalclusters configuration Configuring Continentalclusters rehearsal packages# cmhaltpkg ccmonpkg # cmapplyconf -P ccnew.config # cmcheckconf -P packagenameCluster role switch during rehearsal Precautions to be taken while performing DR RehearsalClient access IP address at recovery cluster Verify data replication environment Move the recovery group into maintenance modePrepare the replication environment for DR rehearsal Start rehearsalRecovering the primary cluster disaster during DR Rehearsal Cleanup of secondary mirror copyRestore replication environment for recovery Move the recovery group out of maintenance modeRun cmrrcovercl command Limitations of DR rehearsal featureSadta Configuration in Continentalclusters Configuring the primary cluster with a single site Setting up replicationSetting up the complex workload in the primary cluster Configuring the recovery cluster with a single site# vxdg -s init cvmdgname replicateddisk1 replicateddisk2 # vxdg -g cvmdgname set activation=sw# cmmakepkg -m sg/cfsall /etc/cmcluster/cfspkg1.ascii # newfs -F vxfs /dev/vx/rdsk/cvmdgname/cvmdgvolname# cmcheckconf -P cfspkg1.ascii # cmapplyconf -P cfspkg1.ascii# mkdir /dev/vgname # mknod /dev/vgname/group c 64 0xnn0000 # cmapplyconf -v -P cvmdgpkgname.conf# lvcreate -L Xxxx /dev/vgname # vgimport -s -m mapfilename vgnameConfiguring the complex workload at the primary cluster # cmmakepkg -m dts/sc -m dts/cccaeva cwsc.config # cmmakepkg -m dts/sc -m dts/ccxpca cwsc.config# cmmakepkg -m dts/sc -m dts/ccsrdf cwsc.config # cmmakepkg -m dts/sc -m dts/cc3parrc cwsc.config# cmviewcl -v -p pkgname Suspending the replication to the recovery cluster# cmapplyconf -v -P /etc/cmcluster/cwsc/cwsc.config # cmrunpkg siteBcfspkgname Where node3 and node4 are the nodes at the recovery cluster# vxdg -stfC import cvmdgname # vgchange -c n -S n vgname # vgchange -c y -S y vgname Configuring Site Safety Latch dependencies# vgchange -c n vgname # vgchange -c y vgname Configuring Continentalclusters Resuming the replication to the recovery clusterChecking the status of clusters, nodes, and packages Administering ContinentalclustersConfigured Event Status Duration Last Notification Sent Package Status State Pkgswitch Node Startup and Switching Characteristics Enabling and disabling maintenance mode# cmrecovercl -d recoverygroup1 Network AttributesStarting a recovery package forcefully Recovering a cluster when the storage array or disks fail# cmrecovercl -e recoverygroup1 # cmrecovercl -g RecoveryGroupName# cmapplyconf -C cluster.config Adding a Recovery Group to ContinentalclustersAdding or Removing a Node from a Cluster # cmforceconcl cmrunpkg -n node3 Pkg1Removing a recovery group from the Continentalclusters Modifying a package in a recovery groupModifying Continentalclusters configuration Modifying a recovery group with a new rehearsal package Removing a rehearsal package from a recovery groupBehavior of Serviceguard commands in Continentalclusters Changing monitoring definitionsRenaming the Continentalclusters Verifying the status of Continentalclusters daemons# ps -ef grep cmclsentryd # ps -ef grep cmclapplyd# what /usr/sbin/cmviewconcl Deleting the Continentalclusters configurationMaintaining the data replication environment Using the pairresync command Continuous Access EVA Link Suspend and Resume Modes Maintaining 3PAR Remote Copy data replication environment Maintaining EMC Srdf data replication environmentMaintaining the Site Administering Continentalclusters using Sadta configurationMaintaining a Node Maintaining Site Controller Package Starting a Complex Workload Deleting the Site Controller Package# cfsdgadm deleteems pkg1dg /dts/mcsc/cwsc Start the Site Controller package by enabling itShutting Down a Complex Workload Moving a Complex Workload to the Recovery ClusterRestarting a Failed Site Controller Package # cmviewcl -l packageTroubleshooting Continentalclusters Error Messages Troubleshooting ContinentalclustersReviewing Messages and Log Files Reviewing Messages and Log Files of Monitoring DaemonTroubleshooting Continentalclusters Error Messages PackageName on cluster ClusterName Migrating to Continentalclusters A.08.00 Verify the configuration and the status of the clusterData Center Worksheet Recovery Group WorksheetContinentalclusters Worksheets Cluster Event Worksheet Recovery ChecklistReplication configuration Continentalclusters Site configurationConfiguring a CRS sub-cluster using CFS CRS Sub-cluster configuration using CFSRAC database configuration RAC database configurationRAC MNP Site Controller package configurationSite Controller package configuration Configuration file parameters for Continentalclusters Datasenderpackage clustername/packagename Primarypackage Clustername/Packagename Continentalclusters Command and Daemon Reference Cmcluster/cmoncl.config Cmrunpkg or cmmodpkg commandCmrecovercl -f Cmdeleteconcl -fCmviewconcl Cmrecovercl -r-gRecovery group name Autofencedatasplit Package attributesAutopsuepsus Autopsusssws Autosvolpsue AutosvolpfusClustertype AutosvolpsusHorctakeover command, -t timeout. HorctimeoutPkg Startup Timeout Horctimeout Continuous Access link timeout valueWaittime DTS PKG DIRMonpollinterval MonnotificationfrequencyAutoresync MonnotificationsyslogMonnotificationconsole Start with an error Before startup of the package on destination volumeIf Waittime is 0 default value, and if the state of DR Fails to start with an errorEtc/cmcluster/ packagename/FORCEFLAG Querytimeout DefaultPackage Attributes for Continentalcluster with EMC Srdf Consistencygroups is set to Group in an M by N configuration ConfigurationsWhere the Metrocluster Srdf environment file is located Supported mode are sync for synchronous and async forMigrating legacy monitor package Legacy packagesMigrating legacy to modular packages # cmcheckconf -P modularccmonpkg.conf # cmmigratepkg -p packagename -o modularccmonpkg.conf# cmapplyconf -P modularccmonpkg.conf # cmmigratepkg -p packagename -s -o modularsgconfPathtoenvfile modularsgecmcc.conf Validate the new modular package configuration file# cmcheckconf -P modularsgecmcc.conf # cmapplyconf -P modularsgecmcc.conf# cmmigratepkg -p packagename -s -o modularsg.conf Configuring the monitor package in legacy style Configuring legacy packagesValidate the new package configuration file # mkdir /etc/cmcluster/ccmonpkg# cmcheckconf -P ccmonpkg.config Use the cmcheckconf command to validate the package# mkdir /etc/cmcluster/pkgname # cd /etc/cmcluster/pkgname # cmmakepkg -p pkgname.ascii# cmmakepkg -s pkgname.cntl Create a package control scriptEVA Legacy packages # mkdir /etc/cmcluster/pkgname Set Pkgdir to /etc/cmcluster/pkgname Example 1 ExampleEtc/cmcluster/pkgname Configuring storage devices for complex workload# vxdg -s init cvmdgname replicateddisk1\ replicateddisk2 # cfsdgadm add cvmdgnamecvmdgpkgname all=sw\ node1node2# cfsdgadm activate cvmdgname Where node1 and node2 are the nodes in the Source Disk Site# newfs -F vxfs \ Dev/vx/rdsk/cvmdgname/cvmdgvolname # mkdir /cfs # chmod 775 /cfs # mkdir /cfs/cvmdgname# cfsmount /cfs/cvmdgname EVA Sample Continentalclusters Ascii configuration file Sample Continentalclusters Ascii configuration fileContinentalclusters Ascii configuration file Clustername #### #### Recoverygroupname Datasenderpackage Notification Console #### #### Clusterevent # Cluster Information Clusteralarm Seconds Notification Recoverygroupname RG2 Sample input and output files for cmswitchconcl commandRecoverygroupname RG2 Primarypackage Oracle RAC instances in a Continentalclusters environment Supported Continentalclusters and RAC configuration # cfsdgadm add disk group name all=sw # vxdctl -c mode# cfsmntadm add racdgl vol4 /cfs/mntl all=rw # cfsdgadm activate diskgroupPage Copy the file # cp /opt/cmconcl/scripts/ccrac.config ccrac.config.mycopy# cd your own directory Copy the edited file to the final directory # cp ccrac.config.mycopy /etc/cmconcl/ccrac/ccrac.configPage Failover of Oracle RAC instances to the recovery site Oracle RAC instance package can be started in sequence Failback of Oracle RAC instances after a failover # cfsumount Mount Point Name Rehearsing Oracle RAC databases in Continentalclusters# cfsdgadm deactivate Disk Group Name # /opt/cmconcl/bin/ccracmgmt.ksh -i indexNumber \ startSample Oracle RAC database with ASM in Sadta Configure a primary cluster with a single site Installing and configuring Oracle Clusterware Configure a recovery cluster with a single siteInstalling Oracle Real Application Clusters RAC software Configuring the ASM disk group in the primary clusterHalting the RAC database in the primary cluster Creating the Oracle RAC database in the primary cluster# chown -R oracleoinstall /opt/app/oracle/admin Page # chown -R oracleoinstall /opt/app/oracle/admin/hrdb Run the following command at the remote site# srvctl status # cmviewcl -v -p ASMDGpkgnameSite cc2site1 # cmapplyconf -v -P sitecontrollerconfigurationfile# cmrunpkg siteController1 See also quorum server GlossarySpan 100s or 1000s of kilometers Or system availability Format /dev/devtype/filename Svol Index Symbols151