HP Serviceguard Extension for SAP (SGeSAP) manual Option 3 SGeSAP CFS Cluster

Page 25

/etc/cmcluster — the directory in which Serviceguard keeps its legacy configuration files and the node specific package runtime directories

Local database client software needs to be stored locally on each node. Details can be found in the database sections below.

Part of the content of the local group of directories must be synchronized manually between all nodes of the cluster.

SAP instance (startup) profile names contain either local hostnames or virtual hostnames. SGeSAP will always prefer profiles that use local hostnames to allow individual startup profiles for each host, which might be useful if the failover hardware differs in size.

In clustered SAP environments prior to 7.x releases it is required to install local executables. Local executables help to prevent several causes for package startup or package shutdown hangs due to the unavailability of the centralized executable directory. Availability of executables delivered with packaged SAP components is mandatory for proper package operation. Experience has shown that it is a good practice to create local copies for all files in the central executable directory. This includes shared libraries delivered by SAP.

To automatically synchronize local copies of the executables, SAP components deliver the sapcpe mechanism. With every startup of the instance, sapcpe matches new executables stored centrally with those stored locally.

Directories that Reside on Shared Disks

Volume groups on a SAN shard storage get configured as part of the SGeSAP package.

Instance specific volume groups are required by only one SAP instance or one database instance. They usually get included with exactly the package that is set up for this instance. In this configuration option the instance specific volume groups are included in package.

System specific volume groups get accessed from all instances that belong to a particular SAP System. Environment specific volume groups get accessed from all instances that belong to any SAP System installed in the whole SAP scenario. System and environment specific volume groups should be set up using HA NFS to provide access capabilities to SAP instances on nodes outside of the cluster. The cross-mounting concept of option 1 is not required.

A valuable naming convention for most of these shared volume groups is vg<INSTNAME><SID> or alternatively vg<INSTNAME><SID><INR>. Table 2-4 provide an overview of SAP shared storage for this special setup and maps them to the component and package type for which they occur.

Table 2-4 File systems for the SGeSAP package in NFS Idle Standby Clusters

Mount Point

Access Point

Remarks

VG Name

Device minor number

/sapmnt/<SID>

shared disk and HA

required

 

 

 

NFS

 

 

 

/usr/sap/<SID>

shared disk

 

 

 

/usr/sap/trans

shared disk and HA

optional

 

 

 

NFS

 

 

 

The table can be used to document used device minor numbers. The device minor numbers of logical volumes need to be identical for each distributed volume group across all cluster nodes.

If you have more than one system, place/usr/sap/put on separate volume groups created on shared drives. The directory should not be added to any package. This ensures that they are independent from any SAP WAS system and you can mount them on any host by hand if needed.

Option 3: SGeSAP CFS Cluster

SGeSAP supports the use of HP Serviceguard Cluster File System for concurrent shared access. CFS is available with selected HP Serviceguard Storage Management Suite bundles. CFS replaces NFS technology for all SAP related file systems. All related instances need to run on cluster nodes to have access to the shared files.

SAP related file systems that reside on CFS are accessible from all nodes in the cluster. Concurrent reads or writes are handled by the CFS layer. Each required CFS disk group and each required CFS mount point

SAP Instance Storage Considerations 25

Image 25
Contents Managing Serviceguard Extension for SAP Version B.05.00 Page Table of Contents SAP Supply Chain Management SGeSAP Cluster Administration 137SAP Master Data Management MDM 111 List of Figures Page List of Tables Page About this Manual Printing HistoryINSTNR, INR Related DocumentationGeneral Concepts of SGeSAP Designing SGeSAP Cluster ScenariosMutual Failover Scenarios Using the Two Package Concept Mutual Failover Scenarios Using the Two Package Concept Robust Failover Using the One Package Concept Follow-and-Push Clusters with Replicated Enqueue Applications/sap/enqor/SID ersINSTNR Replicated Enqueue Clustering for Abap and Java InstancesDedicated NFS Packages Handling of Redundant Dialog Instances Dedicated Failover Host Replicated Enqueue Clustering for Abap and Java Instances SAP Instance Storage Considerations Planning the Storage LayoutCommon Directories that are Kept Local Option 1 SGeSAP NFS ClusterDirectories that Reside on Shared Disks Option 2 SGeSAP NFS Idle Standby Cluster System and Environment Specific Volume GroupsOption 3 SGeSAP CFS Cluster Directories that Reside on CFS Database Instance Storage ConsiderationsOracle Single Instance Rdbms $ORACLEHOME/common/nls/admin/dataFile System Layout for NFS-based Oracle Clusters Oracle Real Application ClustersMaxdb Storage Considerations Globals IndepData=/sapdb/data IndepPrograms=/sapdb/programs Sapnfs Planning the Storage Layout Pgname = pkgtypeINSTNRSID Step-by-Step Cluster ConversionStep-by-Step Cluster Conversion SAP Preparation SAP Pre-Installation ConsiderationsSAP Netweaver High Availability Cmmakepkg -m sgesap/db -m sgesap/ci Cmmakepkg -m sgesap/sapinstance -m ... /sap.configCmmakepkg -m sgesap/db Cmmakepkg -m sgesap/ci Cmmakepkg -m sgesap/scs Cmmakepkg -m sgesap/ersPage Replicated Enqueue Conversion SAPINSTMASTERDVD/IMXOS/SAPINST/UNIX/OSSplitting an Abap Central Instance Volume group needs to be created for the Ascs instanceCreate a new mountpoint Su sidadm Mkdir /usr/sap/SID/ASCSINSTNRSapsystemname =SID If the used SAP kernel has a release older thanSAPSYSTEM=INSTNR2 Instancename =ASCSINSTNRSAPLOCALHOST=DRELOC Creation of Replication Instance Volume group needs to be created for the ERS instanceSu sidadm Mkdir /usr/sap/SID/ERSINSTNR Sapstartsrv Sapcontrol Servicehttp Mkdir -p exe/servicehttp/sapmcPF = $DIRPROFILE/SIDERSINSTNRAREPRELOC Scsid = INRHP-UX Configuration Cluster Filesystem Configuration Directory Structure ConfigurationLs -d /usr/sap/???/*INSTNR Installation Step IS049 Mkdir /usr/sap/SID.new Non-CFS Directory Structure ConversionMaxdb Database Step SD040 Filename localcopy checkexist Installation Step IS050Cluster Node Synchronization Open the password file, /etc/passwd, on the primary sideOpen the groupfile, /etc/group, on the primary side Copy the sidadm home directory to the backup nodes Look at the service file, /etc/services, on the primary sideSTARTPROFILE=STARTDVEBMGSINRsecondary STARTPROFILE=STARTDVEBMGSINRprimarySu orasid Mkdir -p /oracle/SID Exit Su sqddbsid Mkdir -p /sapdb/DBSIDMkdir /dev/vgdbSIDmknod /dev/vgdbSID/group c 64 Cluster Node ConfigurationMkdir -p /usr/sap/tmp Ssh-keygen -t dsa Swlist grep sshIddsa Iddsa.pub Ssh hostN date Ssh -l sidadm hostN dateConfigure /etc/nsswitch.conf to avoid problems External Application Server Host ConfigurationHosts filesNOTFOUND=continue UNAVAIL=continue TRYAGAIN=ns Set -uDB=ORACLE Modular Package ConfigurationDBRELOC=0.0.0.0 Sapsystem C11 Modular Package Configuration Step-by-Step Cluster Conversion Example entries for the package configuration file Sapextinstance DVEBMGS10 Sapextsystem QAS Sbin/init.d/sapinit referenced by /sbin/rc3.d/S###sapinit Cmapplyconf -P ./sap.config Serviceguard Configuration Legacy Package ConfigurationCreated configuration files need to be edited Mkdir -p /etc/cmcluster/SIDServicefailfastenabled YES Servicehalttimeout Servicename ciC11msServicename ciC11disp Touch /etc/cmcluster/SID/debugApplications/sap/enqor/SIDersinstnr Resourcename /applications/sap/enqor/C11ascsENQORSCSPKGNAMEC11=foobar ENQORREPPKGNAMEC11=foorep Specification of the Packaged SAP Components SGeSAP ConfigurationDistribute the package setup to all failover nodes NFSRELOC=0.0.0.0 AREPNAME=ERS AREPNR=01 AREPRELOC=0.0.0.0 CINAME=DVEBMGS CINR=00DNAME0=D DNAME1=DJCINAME=SCS JCINR=01 Configuration of Application Server HandlingJCIRELOC=0.0.0.0 REPNAME=ERS REPNR=00Page Restart Stop Start $STARTWITHPKG, $STOPWITHPKG, $RESTARTDURINGFAILOVERASPSTART=1 ASTREAT0=$RESTARTDURINGFAILOVER ASPLATFORM0=SG-PACKAGEWAITOWNAS=1 WAITOWNAS=2 Optional Parameters and Customizable FunctionsWAITOWNAS=0 RFCADAPTERSTART=1 SAPROUTERSTART0=1 SAPROUTERPORT0=-S3299RFCADAPTERCMD=runadapter.sh SAPCCMSRSTART=1 Global DefaultsSAPSTARTSRVSTART=1 SAPSTARTSRVSTOP=1 Legacy Package Configuration EXEDIR= /usr/sap/SID/SYS/exe/runU HA NFS Toolkit ConfigurationJMSSERVBASE=3600 Packagename sapnfsHANFSSCRIPTEXTENSION=pkgtype Auto FS ConfigurationExport/sapmnt/SID Export/usr/sap/trans Sapmnt/SID Usr/sap/transAUTOMOUNTDOPTIONS= -L AUTOFS=1 AUTOMASTER=/etc/automaster AUTOMOUNTOPTIONS=-f $AUTOMASTERAUTOMASTER=/etc/automaster AUTOOPTIONS=-f $AUTOMASTER NFSCLIENT=1 NFSSERVER=1 NUMNFSD=4 NUMNFSIOD=4Database Configuration Perform the following step as sidadm Additional Steps for OraclePerform the following steps as orasid Lsnrctl start LISTENERSID1/2 If you use more than one SAP system inside of your clusterAdditional steps for Oracle 9i Rdbms Additional Steps for MaxdbAdditional steps for Oracle 10g Rdbms SAP Application Server Configuration Cdpro SAP Abap Engine specific configuration stepsRdisp/enqname = relocciSIDinstnr Sapmnt/SID/profile/SIDINSTNAMEINRSID/dbhost = relocdb SaplocalhostsidinstnrBatch jobs can be scheduled to run on a particular instance Rdisp/starticman=TRUE SAP J2EE Engine specific installation stepsIcm/hostnamefull=relocatibleip Jdbc/pool/SID/Url jdbcoraclethin@relocdb1527SID Admin/host/SID relocdbPage SAP Supply Chain Management More About Hot Standby Option 1 Simple Clusters with Separated Packages Planning the Volume Manager SetupOption 3 Full Flexibility Option 2 Non-MAXDB EnvironmentsOption 4 Hot Standby liveCache Maxdb Storage ConsiderationsLiveCache Installation Step LC010 Synchronize the /etc/group and /etc/passwd files HP-UX Setup for Options 1, 2Copy file /etc/opt/sdb to the second cluster node Do the following to continueMkdir /sapdb Mkdir -p /sapdb/data Mkdir /sapdb/LCSIDIf you use DNS HP-UX Setup for OptionHosts filesNOTFOUND=continue UNAVAIL=continue \ TRYAGAIN=ns HORCCMRCF=1 HORCMINST=0Cmmakepkg -m sgesap/livecache lcLCSID.config SGeSAP Modular Package ConfigurationPackagename lcLCSID SGeSAP Modular Package Configuration Create standard package control and configuration files SGeSAP Legacy Package ConfigurationCp /opt/cmcluster/sap/*.functions /etc/cmcluster Packagetype FailoverLCPRIMARYROLE=primarynode LCSECONDARYROLE=secondarynode Cold Admin Warm OnlineLCCOPYMECHANISM=BUSINESSCOPY Livecache Service MonitoringAVOIDWWIDCHECK=1 LCSTANDBYRESTART=1APO Setup Changes Mv .XUSER.62 .XUSER.62.ORG Default key Su lcsidadm Dbmcli -ux SAPLCSID,password -ul# dbmcli on hostname Lcsid quit For option General Serviceguard Setup ChangesSapdb/programsrelocsapnfss/export/sapdb/programs Last step is to reconfigure the cluster with cmapplyconf1m Master Data Management User Interface Components Master Data Management OverviewSAP Netweaver XI components MDM Server ComponentsPrerequisites Installation and Configuration ConsiderationsMDM SGeSAP File System Layout Oracle/MDMSingle MDM Serviceguard Package ONE Single or Multiple MDM Serviceguard Package ConfigurationsMultiple MDM Serviceguard packages FOUR+ONE Opt/MDMMkdir -p /oracle/MDM Run ioscan and insf to probe/install new disk devicesMkdir -p /export/home/mdmuser Mkdir -p /home/mdmuser Mkdir -p /opt/MDM Installation and Configuration Considerations Haltscripttimeout Notimeout Runscripttimeout NotimeoutNodename Runscript /etc/cmcluster/MDMNFS/mdmNFS.control.scriptScp -p /etc/auto.direct clunode2/etc/auto.direct Scp -rp /etc/cmcluster/MDMNFS clunode2/etc/cmcluster/MDMNFSSbin/init.d/nfs.client stop Sbin/init.d/nfs.client start Haltscript /etc/cmcluster/MDM/mgroupMDM.control.script Runscript /etc/cmcluster/MDM/mgroupMDM.control.scriptRunscript /etc/cmcluster/MDM/mdbMDM.control.script Runscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdbMDM.control.scriptHaltscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdisMDM.control.script Runscript /etc/cmcluster/MDM/mdisMDM.control.scriptRunscript /etc/cmcluster/MDM/mdssMDM.control.script Haltscript /etc/cmcluster/MDM/mdssMDM.control.scriptHaltscript /etc/cmcluster/MDM/masterMDM.control.script Runscript /etc/cmcluster/MDM/masterMDM.control.scriptSsh -X clunode1 -l oramdm KITS/ora9208/Disk1/runInstller Specify File Locations SidmdmSetup Step MDM218 SAP Master Data Management MDM MDM = Description = Addresslist = Listener = Descriptionlist = Description = Addresslist = Connectdata = Server = Dedicated Servicename = MDMSidlistlistener = Sidlist = Siddesc = Globaldbname = MDM Installation and Configuration Considerations Create a /home/mdmuser/mdss directory Global SAP Master Data Management MDM MDMLISTENERNAME=LISTENER Single Serviceguard package configure sap.configMDMUSER=mdmuser MDMMDSRELOC=172.16.11.96 MDMPASSWORD= MDMREPOSITORYSPEC=MDMMONITORINTERVAL=60 MDMMGROUPDEPEND=mdb mds mdis mdssVi /etc/cmcluster/MDM/mdsMDM.config Servicename mdsMDMmon Servicefailfastenabled no ServicehalttimeoutCmapplyconf -P /etc/cmcluster/MDM/mdsMDM.config Cmrunpkg mgroupMDM Cmhaltpkg mgroupMDMCmrunpkg masterMDM Cmhaltpkg masterMDM System Level Changes Change ManagementSGeSAP Cluster Administration SAP Software Changes Mixed Clusters Upgrading SAP SoftwareSwlist -l bundle T2357BA T2803BA Swlist -l bundle B7885BA T2803BACd /sapmnt/SID Mkdir exeipf Cd /sapmnt/SID Mv exe exepaCd /sapmnt/SID Ln -s /sapmnt/SIDexelocal exe Cd /sapmnt Ln -s /sapmnt/SID/exepa /sapmnt/SIDexelocal
Related manuals
Manual 35 pages 22.06 Kb