HP Serviceguard Extension for SAP (SGeSAP) manual Planning the Volume Manager Setup

Page 95

The detection of volumes that need replication as part of the standby startup is dynamically identified within the startup procedure of the standby. It does not require manual maintenance steps to trigger volume pair synchronizations and subsequent split operations. Usually, synchronizations occur only in rare cases, for example for the first startup of a standby or if a standby got intentionally shut down for a longer period of time. In all other cases, the liveCache logging devspaces will contain enough delta information to update the standby data without the requirement to do hardware replications of full LUNs.

The ongoing operation of the standby as well as the master failover does not require the business copy mechanisms. The standby synchronizes the data regularly by accessing the master log files, which therefore reside on CVM/CFS volumes. No liveCache content data needs to be transferred via LAN at any point in time.

The liveCache logging gets continuously verified during operation. An invalid entry in the log files gets detected immediately. This avoids the hazardous situation of not becoming aware of corrupted log files until they fail to restore a production liveCache instance.

A data storage corruption that could happen during operation of the master does not get replicated to the only logically coupled standby. The standby LUNs used for devspace content do not necessarily keep the same data as the master LUNs. At least not on a physical level. But logically the standby keeps consistency and stays close to the content of the master LUNs. The standby can then be promoted to become the new master immediately. With access to the original log of the master, it is able to update itself without any data loss.

Planning the Volume Manager Setup

In the following, the lc package of SGeSAP gets described. The lc package was developed according to the SAP recommendations and fulfills all SAP requirements for liveCache failover solutions.

liveCache distinguishes an instance dependant path /sapdb/<LCSID> and two instance independent paths IndepData and IndepPrograms. By default all three point to a directory below /sapdb.

NOTE: <LCSID> denotes the three-letter database name of the liveCache instance in uppercase. <lcsid> is the same name in lowercase.

There are different configuration options for the storage layout and the filesystems caused by a trade-off between simplicity and flexibility. The options are described below ordered by increasing complexity. The cluster layout constraints that need to be fulfilled to allow the simplifications of a given option are stated within a bullet list.

The subsequent sections refer to the options by the numbers that are introduced here.

Option 1: Simple Clusters with Separated Packages

Cluster Layout Constraints:

The liveCache package does not share a failover node with the APO Central Instance package.

There is no MAXDB or additional liveCache running on cluster nodes.

There is no intention to install additional APO Application Servers within the cluster.

There is no hot standby liveCache system configured.

Table 4-2 File System Layout for liveCache Package running separate from APO (Option 1)

Storage Type

Package

Mount Point

shared

lc<LCSID>

/sapdb/data

shared

lc<LCSID>

/sapdb/<LCSID>/datan

shared

lc<LCSID>

/sapdb/<LCSID>/logn

shared

lc<LCSID>

/var/spool/sql

shared

lc<LCSID>

/sapdb/programs

In the above layout all relevant files get shared via standard procedures. The setup causes no administrative overhead for synchronizing local files. SAP default paths are used.

Planning the Volume Manager Setup 95

Image 95
Contents Managing Serviceguard Extension for SAP Version B.05.00 Page Table of Contents SAP Master Data Management MDM 111 SGeSAP Cluster Administration 137SAP Supply Chain Management List of Figures Page List of Tables Page About this Manual Printing HistoryINSTNR, INR Related DocumentationGeneral Concepts of SGeSAP Designing SGeSAP Cluster ScenariosMutual Failover Scenarios Using the Two Package Concept Mutual Failover Scenarios Using the Two Package Concept Robust Failover Using the One Package Concept Follow-and-Push Clusters with Replicated Enqueue Applications/sap/enqor/SID ersINSTNR Replicated Enqueue Clustering for Abap and Java InstancesDedicated NFS Packages Handling of Redundant Dialog Instances Dedicated Failover Host Replicated Enqueue Clustering for Abap and Java Instances SAP Instance Storage Considerations Planning the Storage LayoutCommon Directories that are Kept Local Option 1 SGeSAP NFS ClusterDirectories that Reside on Shared Disks Option 2 SGeSAP NFS Idle Standby Cluster System and Environment Specific Volume GroupsOption 3 SGeSAP CFS Cluster Directories that Reside on CFS Database Instance Storage ConsiderationsOracle Single Instance Rdbms $ORACLEHOME/common/nls/admin/dataFile System Layout for NFS-based Oracle Clusters Oracle Real Application ClustersMaxdb Storage Considerations Globals IndepData=/sapdb/data IndepPrograms=/sapdb/programs Sapnfs Planning the Storage Layout Pgname = pkgtypeINSTNRSID Step-by-Step Cluster ConversionStep-by-Step Cluster Conversion SAP Netweaver High Availability SAP Pre-Installation ConsiderationsSAP Preparation Cmmakepkg -m sgesap/scs Cmmakepkg -m sgesap/ers Cmmakepkg -m sgesap/sapinstance -m ... /sap.configCmmakepkg -m sgesap/db -m sgesap/ci Cmmakepkg -m sgesap/db Cmmakepkg -m sgesap/ciPage Replicated Enqueue Conversion SAPINSTMASTERDVD/IMXOS/SAPINST/UNIX/OSSu sidadm Mkdir /usr/sap/SID/ASCSINSTNR Volume group needs to be created for the Ascs instanceSplitting an Abap Central Instance Create a new mountpointSapsystemname =SID If the used SAP kernel has a release older thanSAPLOCALHOST=DRELOC Instancename =ASCSINSTNRSAPSYSTEM=INSTNR2 Su sidadm Mkdir /usr/sap/SID/ERSINSTNR Volume group needs to be created for the ERS instanceCreation of Replication Instance Sapstartsrv Sapcontrol Servicehttp Mkdir -p exe/servicehttp/sapmcPF = $DIRPROFILE/SIDERSINSTNRAREPRELOC Scsid = INRHP-UX Configuration Ls -d /usr/sap/???/*INSTNR Directory Structure ConfigurationCluster Filesystem Configuration Installation Step IS049 Mkdir /usr/sap/SID.new Non-CFS Directory Structure ConversionMaxdb Database Step SD040 Filename localcopy checkexist Installation Step IS050Open the groupfile, /etc/group, on the primary side Open the password file, /etc/passwd, on the primary sideCluster Node Synchronization Copy the sidadm home directory to the backup nodes Look at the service file, /etc/services, on the primary sideSu sqddbsid Mkdir -p /sapdb/DBSID STARTPROFILE=STARTDVEBMGSINRprimarySTARTPROFILE=STARTDVEBMGSINRsecondary Su orasid Mkdir -p /oracle/SID ExitMkdir -p /usr/sap/tmp Cluster Node ConfigurationMkdir /dev/vgdbSIDmknod /dev/vgdbSID/group c 64 Ssh hostN date Ssh -l sidadm hostN date Swlist grep sshSsh-keygen -t dsa Iddsa Iddsa.pubSet -u External Application Server Host ConfigurationConfigure /etc/nsswitch.conf to avoid problems Hosts filesNOTFOUND=continue UNAVAIL=continue TRYAGAIN=nsDBRELOC=0.0.0.0 Modular Package ConfigurationDB=ORACLE Sapsystem C11 Modular Package Configuration Step-by-Step Cluster Conversion Example entries for the package configuration file Sapextinstance DVEBMGS10 Sapextsystem QAS Sbin/init.d/sapinit referenced by /sbin/rc3.d/S###sapinit Cmapplyconf -P ./sap.config Mkdir -p /etc/cmcluster/SID Legacy Package ConfigurationServiceguard Configuration Created configuration files need to be editedTouch /etc/cmcluster/SID/debug Servicename ciC11msServicefailfastenabled YES Servicehalttimeout Servicename ciC11dispApplications/sap/enqor/SIDersinstnr Resourcename /applications/sap/enqor/C11ascsENQORSCSPKGNAMEC11=foobar ENQORREPPKGNAMEC11=foorep Distribute the package setup to all failover nodes SGeSAP ConfigurationSpecification of the Packaged SAP Components NFSRELOC=0.0.0.0 DNAME1=D CINAME=DVEBMGS CINR=00AREPNAME=ERS AREPNR=01 AREPRELOC=0.0.0.0 DNAME0=DREPNAME=ERS REPNR=00 Configuration of Application Server HandlingJCINAME=SCS JCINR=01 JCIRELOC=0.0.0.0Page Restart Stop Start $STARTWITHPKG, $STOPWITHPKG, $RESTARTDURINGFAILOVERWAITOWNAS=1 ASTREAT0=$RESTARTDURINGFAILOVER ASPLATFORM0=SG-PACKAGEASPSTART=1 WAITOWNAS=0 Optional Parameters and Customizable FunctionsWAITOWNAS=2 RFCADAPTERCMD=runadapter.sh SAPROUTERSTART0=1 SAPROUTERPORT0=-S3299RFCADAPTERSTART=1 SAPSTARTSRVSTART=1 SAPSTARTSRVSTOP=1 Global DefaultsSAPCCMSRSTART=1 Legacy Package Configuration Packagename sapnfs HA NFS Toolkit ConfigurationEXEDIR= /usr/sap/SID/SYS/exe/runU JMSSERVBASE=3600Sapmnt/SID Usr/sap/trans Auto FS ConfigurationHANFSSCRIPTEXTENSION=pkgtype Export/sapmnt/SID Export/usr/sap/transNFSCLIENT=1 NFSSERVER=1 NUMNFSD=4 NUMNFSIOD=4 AUTOMASTER=/etc/automaster AUTOMOUNTOPTIONS=-f $AUTOMASTERAUTOMOUNTDOPTIONS= -L AUTOFS=1 AUTOMASTER=/etc/automaster AUTOOPTIONS=-f $AUTOMASTERDatabase Configuration Perform the following steps as orasid Additional Steps for OraclePerform the following step as sidadm Lsnrctl start LISTENERSID1/2 If you use more than one SAP system inside of your clusterAdditional steps for Oracle 10g Rdbms Additional Steps for MaxdbAdditional steps for Oracle 9i Rdbms SAP Application Server Configuration Sapmnt/SID/profile/SIDINSTNAMEINR SAP Abap Engine specific configuration stepsCdpro Rdisp/enqname = relocciSIDinstnrBatch jobs can be scheduled to run on a particular instance SaplocalhostsidinstnrSID/dbhost = relocdb Icm/hostnamefull=relocatibleip SAP J2EE Engine specific installation stepsRdisp/starticman=TRUE Jdbc/pool/SID/Url jdbcoraclethin@relocdb1527SID Admin/host/SID relocdbPage SAP Supply Chain Management More About Hot Standby Option 1 Simple Clusters with Separated Packages Planning the Volume Manager SetupOption 3 Full Flexibility Option 2 Non-MAXDB EnvironmentsOption 4 Hot Standby liveCache Maxdb Storage ConsiderationsLiveCache Installation Step LC010 Synchronize the /etc/group and /etc/passwd files HP-UX Setup for Options 1, 2Mkdir -p /sapdb/data Mkdir /sapdb/LCSID Do the following to continueCopy file /etc/opt/sdb to the second cluster node Mkdir /sapdbHORCCMRCF=1 HORCMINST=0 HP-UX Setup for OptionIf you use DNS Hosts filesNOTFOUND=continue UNAVAIL=continue \ TRYAGAIN=nsPackagename lcLCSID SGeSAP Modular Package ConfigurationCmmakepkg -m sgesap/livecache lcLCSID.config SGeSAP Modular Package Configuration Packagetype Failover SGeSAP Legacy Package ConfigurationCreate standard package control and configuration files Cp /opt/cmcluster/sap/*.functions /etc/cmclusterLCPRIMARYROLE=primarynode LCSECONDARYROLE=secondarynode Cold Admin Warm OnlineLCSTANDBYRESTART=1 Livecache Service MonitoringLCCOPYMECHANISM=BUSINESSCOPY AVOIDWWIDCHECK=1APO Setup Changes # dbmcli on hostname Lcsid quit Su lcsidadm Dbmcli -ux SAPLCSID,password -ulMv .XUSER.62 .XUSER.62.ORG Default key Sapdb/programsrelocsapnfss/export/sapdb/programs General Serviceguard Setup ChangesFor option Last step is to reconfigure the cluster with cmapplyconf1m Master Data Management User Interface Components Master Data Management OverviewSAP Netweaver XI components MDM Server ComponentsOracle/MDM Installation and Configuration ConsiderationsPrerequisites MDM SGeSAP File System LayoutOpt/MDM Single or Multiple MDM Serviceguard Package ConfigurationsSingle MDM Serviceguard Package ONE Multiple MDM Serviceguard packages FOUR+ONEMkdir -p /export/home/mdmuser Mkdir -p /home/mdmuser Run ioscan and insf to probe/install new disk devicesMkdir -p /oracle/MDM Mkdir -p /opt/MDM Installation and Configuration Considerations Runscript /etc/cmcluster/MDMNFS/mdmNFS.control.script Runscripttimeout NotimeoutHaltscripttimeout Notimeout NodenameSbin/init.d/nfs.client stop Sbin/init.d/nfs.client start Scp -rp /etc/cmcluster/MDMNFS clunode2/etc/cmcluster/MDMNFSScp -p /etc/auto.direct clunode2/etc/auto.direct Runscript /etc/cmcluster/MDM/mdbMDM.control.script Runscript /etc/cmcluster/MDM/mgroupMDM.control.scriptHaltscript /etc/cmcluster/MDM/mgroupMDM.control.script Haltscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdbMDM.control.scriptRunscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdssMDM.control.script Runscript /etc/cmcluster/MDM/mdisMDM.control.scriptHaltscript /etc/cmcluster/MDM/mdisMDM.control.script Runscript /etc/cmcluster/MDM/mdssMDM.control.scriptSsh -X clunode1 -l oramdm Runscript /etc/cmcluster/MDM/masterMDM.control.scriptHaltscript /etc/cmcluster/MDM/masterMDM.control.script KITS/ora9208/Disk1/runInstller Specify File Locations SidmdmSetup Step MDM218 SAP Master Data Management MDM MDM = Description = Addresslist = Sidlistlistener = Sidlist = Siddesc = Globaldbname = MDM Connectdata = Server = Dedicated Servicename = MDMListener = Descriptionlist = Description = Addresslist = Installation and Configuration Considerations Create a /home/mdmuser/mdss directory Global SAP Master Data Management MDM MDMUSER=mdmuser Single Serviceguard package configure sap.configMDMLISTENERNAME=LISTENER MDMMGROUPDEPEND=mdb mds mdis mdss MDMPASSWORD= MDMREPOSITORYSPEC=MDMMDSRELOC=172.16.11.96 MDMMONITORINTERVAL=60Cmrunpkg mgroupMDM Cmhaltpkg mgroupMDM Servicefailfastenabled no ServicehalttimeoutVi /etc/cmcluster/MDM/mdsMDM.config Servicename mdsMDMmon Cmapplyconf -P /etc/cmcluster/MDM/mdsMDM.configCmrunpkg masterMDM Cmhaltpkg masterMDM System Level Changes Change ManagementSGeSAP Cluster Administration SAP Software Changes Swlist -l bundle B7885BA T2803BA Upgrading SAP SoftwareMixed Clusters Swlist -l bundle T2357BA T2803BACd /sapmnt Ln -s /sapmnt/SID/exepa /sapmnt/SIDexelocal Cd /sapmnt/SID Mv exe exepaCd /sapmnt/SID Mkdir exeipf Cd /sapmnt/SID Ln -s /sapmnt/SIDexelocal exe
Related manuals
Manual 35 pages 22.06 Kb