HP Serviceguard Extension for SAP (SGeSAP) manual Database Instance Storage Considerations

Page 26

requires a Serviceguard multi-node package. SGeSAP packages are Serviceguard single-node packages. Thus, a package can not combine SGeSAP and CFS related functionality.

Common Directories that are Kept Local

Most common file systems reside on CFS, but there are some directories and files that are kept local on each node of the cluster:

/etc/cmcluster — the directory in which Serviceguard keeps its configuration files and the node specific package runtime directories.

/home/<SID>adm — the home directory of the SAP system administrator with node specific startup log files.

/usr/sap/tmp — the directory in which the SAP operating system collector keeps monitoring data of the local operating system.

/usr/sap/<SID>/SYS/exe/run — optional directory for usage with sapcpe, i.e. a local copy of executables (optional for kernel 7.x and higher).

/usr/sap/hostctrl — the directory in which SAP control services for the local host are kept (kernel 7.x and higher)

Depending on database vendor and version, it might in addition be required to keep local database client software. Details can be found in the database sections below.

Content of the local group of directories must be synchronized manually between all nodes of the cluster. An exception is the optional local directory for SAP executables /usr/sap/<SID>/SYS/exe/run. It gets automatically synchronized as part of every instance startup and shutdown operation. A symbolic link called/usr/sap/<SID>/SYS/exe/ctrun needs to be created to access the centrally shared location.

Directories that Reside on CFS

The following table shows a recommended example on how to design SAP file systems for CFS shared access.

Table 2-5 File System Layout for SGeSAP CFS Clusters

Mount Point

Access Point

Package Name Example

DG Name

/sapmnt/<SID>

shared disk and CFS SG-CFS-DG-<NR1>SG-CFS-MP-<NR1>

 

/usr/sap/trans

 

SG-CFS-DG-<NR2>SG-CFS-MP-<NR2>

 

/usr/sap/<SID>

 

SG-CFS-DG-<NR1>SG-CFS-MP-<NR3>

 

The table can be used to document used volume or disk groups across all cluster nodes.

The /usr/sap/tmp might or might not be part of the local root file system. This is the working directory of the operating system collector process saposcol. The size of this directory will rarely be beyond a few Megabytes.

Database Instance Storage Considerations

SGeSAP internally supports clustering of database technologies of different vendors. The vendors have implemented individual database architectures. The storage layout for SGeSAP cluster environments needs to be discussed individually for each:

Oracle Single Instance RDBMS

Oracle Real Application Clusters

MAXDB Storage Considerations

26 Planning the Storage Layout

Image 26
Contents Managing Serviceguard Extension for SAP Version B.05.00 Page Table of Contents SAP Master Data Management MDM 111 SGeSAP Cluster Administration 137SAP Supply Chain Management List of Figures Page List of Tables Page Printing History About this ManualRelated Documentation INSTNR, INRDesigning SGeSAP Cluster Scenarios General Concepts of SGeSAPMutual Failover Scenarios Using the Two Package Concept Mutual Failover Scenarios Using the Two Package Concept Robust Failover Using the One Package Concept Follow-and-Push Clusters with Replicated Enqueue Replicated Enqueue Clustering for Abap and Java Instances Applications/sap/enqor/SID ersINSTNRDedicated NFS Packages Handling of Redundant Dialog Instances Dedicated Failover Host Replicated Enqueue Clustering for Abap and Java Instances Planning the Storage Layout SAP Instance Storage ConsiderationsOption 1 SGeSAP NFS Cluster Common Directories that are Kept LocalDirectories that Reside on Shared Disks System and Environment Specific Volume Groups Option 2 SGeSAP NFS Idle Standby ClusterOption 3 SGeSAP CFS Cluster Database Instance Storage Considerations Directories that Reside on CFS$ORACLEHOME/common/nls/admin/data Oracle Single Instance RdbmsOracle Real Application Clusters File System Layout for NFS-based Oracle ClustersMaxdb Storage Considerations Globals IndepData=/sapdb/data IndepPrograms=/sapdb/programs Sapnfs Planning the Storage Layout Step-by-Step Cluster Conversion Pgname = pkgtypeINSTNRSIDStep-by-Step Cluster Conversion SAP Netweaver High Availability SAP Pre-Installation ConsiderationsSAP Preparation Cmmakepkg -m sgesap/db Cmmakepkg -m sgesap/ci Cmmakepkg -m sgesap/sapinstance -m ... /sap.configCmmakepkg -m sgesap/db -m sgesap/ci Cmmakepkg -m sgesap/scs Cmmakepkg -m sgesap/ersPage SAPINSTMASTERDVD/IMXOS/SAPINST/UNIX/OS Replicated Enqueue ConversionCreate a new mountpoint Volume group needs to be created for the Ascs instanceSplitting an Abap Central Instance Su sidadm Mkdir /usr/sap/SID/ASCSINSTNRIf the used SAP kernel has a release older than Sapsystemname =SIDSAPLOCALHOST=DRELOC Instancename =ASCSINSTNRSAPSYSTEM=INSTNR2 Su sidadm Mkdir /usr/sap/SID/ERSINSTNR Volume group needs to be created for the ERS instanceCreation of Replication Instance Mkdir -p exe/servicehttp/sapmc Sapstartsrv Sapcontrol ServicehttpScsid = INR PF = $DIRPROFILE/SIDERSINSTNRAREPRELOCHP-UX Configuration Ls -d /usr/sap/???/*INSTNR Directory Structure ConfigurationCluster Filesystem Configuration Installation Step IS049 Non-CFS Directory Structure Conversion Mkdir /usr/sap/SID.newMaxdb Database Step SD040 Installation Step IS050 Filename localcopy checkexistOpen the groupfile, /etc/group, on the primary side Open the password file, /etc/passwd, on the primary sideCluster Node Synchronization Look at the service file, /etc/services, on the primary side Copy the sidadm home directory to the backup nodesSu orasid Mkdir -p /oracle/SID Exit STARTPROFILE=STARTDVEBMGSINRprimarySTARTPROFILE=STARTDVEBMGSINRsecondary Su sqddbsid Mkdir -p /sapdb/DBSIDMkdir -p /usr/sap/tmp Cluster Node ConfigurationMkdir /dev/vgdbSIDmknod /dev/vgdbSID/group c 64 Iddsa Iddsa.pub Swlist grep sshSsh-keygen -t dsa Ssh hostN date Ssh -l sidadm hostN dateHosts filesNOTFOUND=continue UNAVAIL=continue TRYAGAIN=ns External Application Server Host ConfigurationConfigure /etc/nsswitch.conf to avoid problems Set -uDBRELOC=0.0.0.0 Modular Package ConfigurationDB=ORACLE Sapsystem C11 Modular Package Configuration Step-by-Step Cluster Conversion Example entries for the package configuration file Sapextinstance DVEBMGS10 Sapextsystem QAS Sbin/init.d/sapinit referenced by /sbin/rc3.d/S###sapinit Cmapplyconf -P ./sap.config Created configuration files need to be edited Legacy Package ConfigurationServiceguard Configuration Mkdir -p /etc/cmcluster/SIDServicename ciC11disp Servicename ciC11msServicefailfastenabled YES Servicehalttimeout Touch /etc/cmcluster/SID/debugResourcename /applications/sap/enqor/C11ascs Applications/sap/enqor/SIDersinstnrENQORSCSPKGNAMEC11=foobar ENQORREPPKGNAMEC11=foorep Distribute the package setup to all failover nodes SGeSAP ConfigurationSpecification of the Packaged SAP Components NFSRELOC=0.0.0.0 DNAME0=D CINAME=DVEBMGS CINR=00AREPNAME=ERS AREPNR=01 AREPRELOC=0.0.0.0 DNAME1=DJCIRELOC=0.0.0.0 Configuration of Application Server HandlingJCINAME=SCS JCINR=01 REPNAME=ERS REPNR=00Page $STARTWITHPKG, $STOPWITHPKG, $RESTARTDURINGFAILOVER Restart Stop StartWAITOWNAS=1 ASTREAT0=$RESTARTDURINGFAILOVER ASPLATFORM0=SG-PACKAGEASPSTART=1 WAITOWNAS=0 Optional Parameters and Customizable FunctionsWAITOWNAS=2 RFCADAPTERCMD=runadapter.sh SAPROUTERSTART0=1 SAPROUTERPORT0=-S3299RFCADAPTERSTART=1 SAPSTARTSRVSTART=1 SAPSTARTSRVSTOP=1 Global DefaultsSAPCCMSRSTART=1 Legacy Package Configuration JMSSERVBASE=3600 HA NFS Toolkit ConfigurationEXEDIR= /usr/sap/SID/SYS/exe/runU Packagename sapnfsExport/sapmnt/SID Export/usr/sap/trans Auto FS ConfigurationHANFSSCRIPTEXTENSION=pkgtype Sapmnt/SID Usr/sap/transAUTOMASTER=/etc/automaster AUTOOPTIONS=-f $AUTOMASTER AUTOMASTER=/etc/automaster AUTOMOUNTOPTIONS=-f $AUTOMASTERAUTOMOUNTDOPTIONS= -L AUTOFS=1 NFSCLIENT=1 NFSSERVER=1 NUMNFSD=4 NUMNFSIOD=4Database Configuration Perform the following steps as orasid Additional Steps for OraclePerform the following step as sidadm If you use more than one SAP system inside of your cluster Lsnrctl start LISTENERSID1/2Additional steps for Oracle 10g Rdbms Additional Steps for MaxdbAdditional steps for Oracle 9i Rdbms SAP Application Server Configuration Rdisp/enqname = relocciSIDinstnr SAP Abap Engine specific configuration stepsCdpro Sapmnt/SID/profile/SIDINSTNAMEINRBatch jobs can be scheduled to run on a particular instance SaplocalhostsidinstnrSID/dbhost = relocdb Icm/hostnamefull=relocatibleip SAP J2EE Engine specific installation stepsRdisp/starticman=TRUE Admin/host/SID relocdb Jdbc/pool/SID/Url jdbcoraclethin@relocdb1527SIDPage SAP Supply Chain Management More About Hot Standby Planning the Volume Manager Setup Option 1 Simple Clusters with Separated PackagesOption 2 Non-MAXDB Environments Option 3 Full FlexibilityMaxdb Storage Considerations Option 4 Hot Standby liveCacheLiveCache Installation Step LC010 HP-UX Setup for Options 1, 2 Synchronize the /etc/group and /etc/passwd filesMkdir /sapdb Do the following to continueCopy file /etc/opt/sdb to the second cluster node Mkdir -p /sapdb/data Mkdir /sapdb/LCSIDHosts filesNOTFOUND=continue UNAVAIL=continue \ TRYAGAIN=ns HP-UX Setup for OptionIf you use DNS HORCCMRCF=1 HORCMINST=0Packagename lcLCSID SGeSAP Modular Package ConfigurationCmmakepkg -m sgesap/livecache lcLCSID.config SGeSAP Modular Package Configuration Cp /opt/cmcluster/sap/*.functions /etc/cmcluster SGeSAP Legacy Package ConfigurationCreate standard package control and configuration files Packagetype FailoverCold Admin Warm Online LCPRIMARYROLE=primarynode LCSECONDARYROLE=secondarynodeAVOIDWWIDCHECK=1 Livecache Service MonitoringLCCOPYMECHANISM=BUSINESSCOPY LCSTANDBYRESTART=1APO Setup Changes # dbmcli on hostname Lcsid quit Su lcsidadm Dbmcli -ux SAPLCSID,password -ulMv .XUSER.62 .XUSER.62.ORG Default key Sapdb/programsrelocsapnfss/export/sapdb/programs General Serviceguard Setup ChangesFor option Last step is to reconfigure the cluster with cmapplyconf1m Master Data Management Overview Master Data Management User Interface ComponentsMDM Server Components SAP Netweaver XI componentsMDM SGeSAP File System Layout Installation and Configuration ConsiderationsPrerequisites Oracle/MDMMultiple MDM Serviceguard packages FOUR+ONE Single or Multiple MDM Serviceguard Package ConfigurationsSingle MDM Serviceguard Package ONE Opt/MDMMkdir -p /export/home/mdmuser Mkdir -p /home/mdmuser Run ioscan and insf to probe/install new disk devicesMkdir -p /oracle/MDM Mkdir -p /opt/MDM Installation and Configuration Considerations Nodename Runscripttimeout NotimeoutHaltscripttimeout Notimeout Runscript /etc/cmcluster/MDMNFS/mdmNFS.control.scriptSbin/init.d/nfs.client stop Sbin/init.d/nfs.client start Scp -rp /etc/cmcluster/MDMNFS clunode2/etc/cmcluster/MDMNFSScp -p /etc/auto.direct clunode2/etc/auto.direct Runscript /etc/cmcluster/MDM/mdbMDM.control.script Runscript /etc/cmcluster/MDM/mgroupMDM.control.scriptHaltscript /etc/cmcluster/MDM/mgroupMDM.control.script Haltscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdbMDM.control.scriptRunscript /etc/cmcluster/MDM/mdsMDM.control.script Runscript /etc/cmcluster/MDM/mdssMDM.control.script Runscript /etc/cmcluster/MDM/mdisMDM.control.scriptHaltscript /etc/cmcluster/MDM/mdisMDM.control.script Haltscript /etc/cmcluster/MDM/mdssMDM.control.scriptSsh -X clunode1 -l oramdm Runscript /etc/cmcluster/MDM/masterMDM.control.scriptHaltscript /etc/cmcluster/MDM/masterMDM.control.script Sidmdm KITS/ora9208/Disk1/runInstller Specify File LocationsSetup Step MDM218 SAP Master Data Management MDM MDM = Description = Addresslist = Sidlistlistener = Sidlist = Siddesc = Globaldbname = MDM Connectdata = Server = Dedicated Servicename = MDMListener = Descriptionlist = Description = Addresslist = Installation and Configuration Considerations Create a /home/mdmuser/mdss directory Global SAP Master Data Management MDM MDMUSER=mdmuser Single Serviceguard package configure sap.configMDMLISTENERNAME=LISTENER MDMMONITORINTERVAL=60 MDMPASSWORD= MDMREPOSITORYSPEC=MDMMDSRELOC=172.16.11.96 MDMMGROUPDEPEND=mdb mds mdis mdssCmapplyconf -P /etc/cmcluster/MDM/mdsMDM.config Servicefailfastenabled no ServicehalttimeoutVi /etc/cmcluster/MDM/mdsMDM.config Servicename mdsMDMmon Cmrunpkg mgroupMDM Cmhaltpkg mgroupMDMCmrunpkg masterMDM Cmhaltpkg masterMDM Change Management System Level ChangesSGeSAP Cluster Administration SAP Software Changes Swlist -l bundle T2357BA T2803BA Upgrading SAP SoftwareMixed Clusters Swlist -l bundle B7885BA T2803BACd /sapmnt/SID Ln -s /sapmnt/SIDexelocal exe Cd /sapmnt/SID Mv exe exepaCd /sapmnt/SID Mkdir exeipf Cd /sapmnt Ln -s /sapmnt/SID/exepa /sapmnt/SIDexelocal
Related manuals
Manual 35 pages 22.06 Kb