Manuals / HP / Computer Equipment / Software

HP Serviceguard Extension for RAC (SGeRAC) Troubleshooting 138 Software Upgrades 139, Index 153

Models: Serviceguard Extension for RAC (SGeRAC)

1 155

Download 155 pages 6.14 Kb

Page 7

Removing Serviceguard Extension for RAC from a System	130
Monitoring Hardware	131
Using Event Monitoring Service	131
Using EMS Hardware Monitors	131
Adding Disk Hardware	131
Replacing Disks	132
Replacing a Mechanism in a Disk Array Configured with LVM	132
Replacing a Mechanism in an HA Enclosure Configured with Exclusive LVM	132
Online Replacement of a Mechanism in an HA Enclosure Configured with Shared LVM (SLVM)...	133
Offline Replacement of a Mechanism in an HA Enclosure Configured with Shared LVM (SLVM)...	134
Replacing a Lock Disk	134
Online Hardware Maintenance with Inline SCSI Terminator	134
Replacement of I/O Cards	136
Replacement of LAN Cards	136
Offline Replacement	136
Online Replacement	136
After Replacing the Card	136
Monitoring RAC Instances	137
6 Troubleshooting	138
A Software Upgrades	139
Rolling Software Upgrades	139
Upgrading Serviceguard to SGeRAC cluster	140
Upgrading from an existing SGeRAC A.11.19 cluster to HP-UX 11i v3 1109
HA-OE/DC-OE	140
Upgrading from an existing Serviceguard A.11.19 cluster to HP-UX 11i v3 1109 HA-OE/DC-OE
along with SGeRAC	140
Upgrading from an existing Serviceguard A.11.19 cluster to HP-UX 11i v3 1109
HA-OE/DC-OE along with SGeRAC (Alternative approach)	141
Upgrading from Serviceguard A.11.18 cluster to HP-UX 11i v3 1109 HA-OE/DC-OE along
with SGeRAC	141
Upgrading from Serviceguard A.11.20 cluster to HP-UX 11i v3 1109 HA-OE/DC-OE along
with SGeRAC	142
Steps for Rolling Upgrades	142
Keeping Kernels Consistent	143
Example of Rolling Upgrade	143
Step 1	144
Step 2	144
Step 3	145
Step 4	146
Step 5	146
Limitations of Rolling Upgrades	147
Non-Rolling Software Upgrades	148
Limitations of Non-Rolling Upgrades	148
Migrating an SGeRAC Cluster with Cold Install	148
Upgrade Using DRD	149
Rolling Upgrade Using DRD	149
Non-Rolling Upgrade Using DRD	149
Restrictions for DRD Upgrades	149
B Blank Planning Worksheets	151
LVM Volume Group and Physical Volume Worksheet	151
Oracle Logical Volume Worksheet	151
Index	153

Contents 7

Image 7

HP Serviceguard Extension for RAC (SGeRAC) manual Troubleshooting 138 Software Upgrades 139, Blank Planning Worksheets 151

Contents

Using Serviceguard Extension for RAC Version A.11.20 Legal Notices Contents Contents SGeRAC Toolkit for Oracle RAC 10g or later Support of Oracle RAC ASM with SGeRACMaintenance 113 Blank Planning Worksheets 151 Troubleshooting 138 Software Upgrades 139Index 153 Advantages of using SGeRAC User Guide Overview Typographical Conventions Problem ReportingWhere to find Documentation on the Web What is a Serviceguard Extension for RAC Cluster? Introduction to Serviceguard Extension for RACGroup Membership Using Packages in a ClusterGroup Membership Daemon Serviceguard Extension for RAC ArchitectureAbout Veritas CFS and CVM from Symantec Storage Configuration OptionsServiceguard Extension for RAC Package DependenciesSMS bundle Overview of SGeRAC and Oracle 10g, 11gR1, and 11gR2 RACHow Cluster Interconnect Subnet Works Overview of SGeRAC Cluster Interconnect Subnet MonitoringConfiguring Packages for Oracle Listeners Configuring Packages for Oracle RAC InstancesBefore Node Failure Node FailureUp to Four Nodes with Scsi Storage Larger ClustersFour-Node RAC Cluster Point-to-Point Connections to Storage DevicesEight-Node Cluster with EVA, XP or EMC Disk Array GMS AuthorizationAdministering Clusters with Serviceguard Manager Overview of Serviceguard ManagerStarting Serviceguard Manager Monitoring Clusters with Serviceguard ManagerConfiguring Clusters with Serviceguard Manager Group Membership API NMAPI2 Cluster TimeoutsServiceguard Cluster Timeout Interface AreasShared Storage Oracle Cluster SoftwareListener Network Monitoring RAC InstancesAutomated Startup and Shutdown Manual Startup and Shutdown Network Planning for Cluster CommunicationPlanning Storage for Oracle 10g/11gR1/11gR2 RAC Planning Storage for Oracle Cluster SoftwareVolume Planning with CVM Volume Planning with SlvmStorage Planning with CFS RAW Logical Volume Name Size MB About Device Special Files Installing Serviceguard Extension for RACAbout Multipathing About Cluster-wide Device Special Files cDSFs Where cDSFs ResideCluster Communication Network Monitoring Configuration File ParametersSingle Network for Cluster Communications Single Network for Cluster CommunicationsSG-HB/RAC-IC Traffic Separation Alternate Configuration-Multiple RAC Databases When Cluster Interconnect Subnet Monitoring is not Used When Cluster Interconnect Subnet Monitoring is usedGuidelines for Changing Cluster Parameters Limitations of Cluster Communication Network Monitor Creating a Storage Infrastructure with LVMCluster Interconnect Monitoring Restrictions Creating Volume Groups and Logical Volumes Building Volume Groups for RAC on Mirrored DisksHP Serviceguard Extension for RAC # ls -l /dev/*/group Building Mirrored Logical Volumes for RAC with LVM Commands# mkdir /dev/vgrac # mknod /dev/vgrac/group c 64 0xhh0000# lvcreate -m 1 -M y -s g -n redo1.log -L 408 /dev/vgrac Creating Mirrored Logical Volumes for RAC Data Files# lvcreate -m 1 -M y -s g -n system.dbf -L 408 dev/vgrac Creating RAC Volume Groups on Disk Arrays Oracle Demo Database Files Creating Logical Volumes for RAC on Disk ArraysExporting the Logical Volume Infrastructure Displaying the Logical Volume InfrastructureExporting with LVM Commands Creating a Storage Infrastructure with CFS Installing Oracle Real Application Clusters# cmapplyconf -C clm.asc Initializing the Veritas Volume Manager# cmruncl # cmviewcl # vxdg -s init cfsdg1 c4t4d0 # cfscluster config -s# vxdctl -c mode # /etc/vx/bin/vxdisksetup -i c4t4d0#cfsmntadm add cfsdg1 vol2 /cfs/mnt2 all=rw # newfs -F vxfs /dev/vx/rdsk/cfsdg1/vol2# newfs -F vxfs /dev/vx/rdsk/cfsdg1/vol3 # cfsmntadm add cfsdg1 vol1 /cfs/mnt1 all=rw# cfsmntadm delete /cfs/mnt2 Deleting CFS from the Cluster# bdf grep cfs # cfsmntadm delete /cfs/mnt1# cfsdgadm delete cfsdg1 # cfscluster unconfig# vxinstall Creating a Storage Infrastructure with CVMUsing CVM 5.x or later # vxdg -s init opsdg c4t4d0 # cmapplyconf -P /etc/cmcluster/cvm/VxVM-CVM-pkg.conf Using CVMPreparing the Cluster for Use with CVM # vxedit set diskdetpolicy=global DiskGroupName# vxdg list # /usr/lib/vxvm/bin/vxdisksetup -i /dev/dsk/c0t3d2# cmruncl # vxdg -s init opsdg c0t3d2# vxassist -g opsdg make logfiles 1024m Creating VolumesOracle Demo Database Files Mirror Detachment Policies with CVMAdding Disk Groups to the Cluster Configuration # mkdir -p /mnt/app/crs/oracle/product/10.2.0/crs # groupadd oinstall # groupadd dba # groupadd oper# useradd -u 203 -g oinstall -G dba,oper oracle # passwd oracle# chmod 755 /dev/vgrac # usermod -d /cfs/mnt1/oracle oracleMnt/app/oracle/oradata/ver10/ver10raw.conf Installing RAC Binaries on a Local File System Installing Oracle 10g, 11gR1, or 11gR2 Cluster SoftwareInstalling Oracle 10g/11gR1/11gR2 RAC Binaries Installing on Local File System$ netca Installing RAC Binaries on Cluster File SystemCreating a RAC Demo Database Creating a RAC Demo Database on Slvm or CVMCreating a RAC Demo Database on CFS Verifying Oracle Disk Manager is Configured#swlist VRTSodm # cat /dev/odm/stats Configuring Oracle to Use Oracle Disk Manager LibraryVerify that Oracle Disk Manager is Running #ll -L /opt/VRTSodm/lib/libodm.sl$ cd $ORACLEHOME/lib # kcmodule -P state odm$ORACLEHOME/bin/srvctl modify database -d dbname -y manual Preparing Oracle Cluster Software for Serviceguard PackagesConfigure Serviceguard Packages $ORACRSHOME/bin/crsctl disable crsSbin/init.d/init.crs start Overview Why ASM over SLVM?Introduction SG/SGeRAC Support for ASM on HP-UX 11iConfiguring Slvm Volume Groups for ASM Disk Groups Sample Command Sequence for Configuring Slvm Volume Groups Support of Oracle RAC ASM with SGeRAC ASM support with SG/SGeRAC A.11.17.01 or later ASM over SlvmConfiguring Slvm Volume Groups for ASM Disk Groups Sample Command Sequence for Configuring Slvm Volume Groups ASM over Raw disk Additional Hints on ASM Integration with SGeRAC Installation, Configuration, Support, and Troubleshooting ASM may require Modified Backup/Restore ProceduresAdditional Documentation on the Web and Scripts Background SGeRAC Toolkit for Oracle RAC 10g or laterBackground SGeRAC Toolkit for Oracle RAC 10g or later Page Serviceguard Extension for RAC Toolkit operation Startup and shutdown of the combined Oracle RAC-SGeRAC stack SGeRAC Toolkit for Oracle RAC 10g or later Asmdg MNP Use case 3 Database storage in ASM over Slvm Use Case 2 SetupUse Case 2 performing maintenance with ASM disk groups Use Case 1 Performing maintenance with Oracle ClusterwareSGeRAC Toolkit for Oracle RAC 10g or later Internal structure of SGeRAC for Oracle Clusterware Support for the SGeRAC Toolkit ContentsSupport for the SGeRAC Toolkit CFS-DG1-MNP CFS-DG2-MNP Readme SGeRAC Toolkit for Oracle RAC 10g or later DEPENDENCYCONDITIONDG-MNP-PKG=UP Dependencylocationsamenode ORACLEHOME, CHECKINTERVAL...MAINTENANCEFLAG Dependencyname DEPENDENCYCONDITIONOC-MNP-PKG=UP Dependencylocationsamenode Set to any name desired for the RAC MNP For a package using CFS Oracrshome Asmdisk Group Asmtkitdir SGeRAC Toolkit for Oracle RAC 10g or later Asmdg MNP SGeRAC Toolkit for Oracle RAC 10g or later Support for the SGeRAC Toolkit SGeRAC Toolkit for Oracle RAC 10g or later DEPENDENCYCONDITIONOC-DGMP-PKG=UP Dependencylocationsamenode Additional Documentation on the Web ConclusionExamples of Cluster and Package States Types of Cluster and Package States# cmviewcl -r A.11.16 Name Status State Types of Cluster and Package States Node Status and State Cluster StatusPackage Status and State Service Status Package Switching AttributesStatus of Group Membership Normal Running Status Examples of Cluster and Package StatesNetwork Status Failover and Failback PoliciesCVM Package Status Quorum Server StatusStatus After Moving the Package to Another Node Output of the cmviewcl -vcommand is as followsStatus After Halting a Node Status After Package Switching is EnabledViewing Data on Unowned Packages Status Nodename Name Checking the Cluster Configuration and ComponentsVerifying Cluster Components Checking Cluster ComponentsCmcheckconf -P Example Setting up Periodic Cluster VerificationLimitations Online ReconfigurationOnline Node Addition and Deletion Managing the Shared Storage Making LVM Volume Groups ShareableDeactivating a Shared Volume Group Activating an LVM Volume Group in Shared ModeMaking Offline Changes to Shared Volume Groups Making a Volume Group UnshareableOn node 2, issue the following command Adding Additional Shared LVM Volume Groups Removing Serviceguard Extension for RAC from a SystemChanging the CVM Storage Configuration Adding Disk Hardware Using Event Monitoring ServiceUsing EMS Hardware Monitors Monitoring Hardware# lvreduce -m 0 /dev/vgsg01/lvolname /dev/dsk/c2t3d0 Replacing a Mechanism in a Disk Array Configured with LVM# vgcfgrestore /dev/vgsg01 /dev/dsk/c2t3d0 Replacing Disks# pvchange -a n pv path # vgcfgrestore -n vg name pv raw path# lvextend -m 1 /dev/vgsg01 /dev/dsk/c2t3d0 # lvsync /dev/vgsg01/lvolnameReplacing a Lock Disk Online Hardware Maintenance with Inline Scsi TerminatorW Scsi Buses with Inline Terminators Online Replacement Replacement of I/O CardsReplacement of LAN Cards Offline ReplacementMonitoring RAC Instances Troubleshooting Rolling Software Upgrades Software UpgradesUpgrading Serviceguard to SGeRAC cluster Cmhaltnode nodename Autostartcmcld = Steps for Rolling UpgradesKeeping Kernels Consistent Example of Rolling UpgradeStep Running Cluster Before Rolling UpgradeNode 1 Upgraded to SG/SGeRAC # cmhaltnode -f node2 Running Cluster After Upgrades Limitations of Rolling UpgradesLimitations of Non-Rolling Upgrades Non-Rolling Software UpgradesMigrating an SGeRAC Cluster with Cold Install Restrictions for DRD Upgrades Upgrade Using DRDRolling Upgrade Using DRD Non-Rolling Upgrade Using DRDSoftware Upgrades Oracle Logical Volume Worksheet LVM Volume Group and Physical Volume WorksheetBlank Planning Worksheets Index RAC 155