HP Serviceguard Extension for SAP (SGeSAP) manual Directories that Reside on Shared Disks

Page 23

Directories that Reside on Shared Disks

Volume groups on SAN shard storage are configured as part of the SGeSAP packages. They can be either:

instance specific or

system specific or

environment specific.

Instance specific volume groups are required by only one SAP instance or one database instance. They usually get included with exactly the package that is set up for this instance.

System specific volume groups get accessed from all instances that belong to a particular SAP System. Environment specific volume groups get accessed from all instances that belong to all SAP Systems installed in the whole SAP environment. System and environment specific volume groups are set up using HA NFS to provide access for all instances. They shouldn't be part of a package that is only dedicated to a single SAP instance if there are several of them. If this package is down, then other instances would also be impacted. As a rule of thumb, it is a good default to put all these volume groups into a package that holds the database of the system. These filesystems often provide tools for database handling that don't require the SAP instance at all.

In consolidated environments with more than one SAP application component it is recommended to separate the environment specific volume groups to a dedicated HA NFS package. This package will be referred to as sapnfs package. It should remain running all the time, since it is of central importance for the whole setup. Since sapnfs is just serving networked file systems, there is rarely needed to stop this package at any time. If environment specific volume groups become part of a database package, there will be a potential dependency between packages of different SAP Systems. Stopping one SAP System by halting all related Serviceguard packages will then lead to a lack of necessary NFS resources for otherwise unrelated SAP Systems. The sapnfs package avoids this unpleasant dependency. It is an option to also move the system specific volume groups to the sapnfs package. This can be done, to keep HA NFS mechanisms completely separate.

A valuable naming convention for most of these shared volume groups is vg<INSTNAME><SID> or alternatively vg<INSTNAME><SID><INR>. Table 2-2 and Table 2-3 provide an overview of SAP shared storage and maps them to the component and package type for which they occur.

Table 2-2 Instance Specific Volume Groups for exclusive activation with a package

Mount Point

Access Point

Recommended packages

VG Name

Device minor

 

 

 

 

number

/usr/sap/<SID>/SCS<INR>

Shared disk

jci<SID> (scs<SID>)

 

 

 

 

jdbjci<SID>

 

 

/usr/sap/<SID>/ASCS<INR>

 

ci<SID> (ascs<SID>)

 

 

 

 

dbci<SID>

 

 

/usr/sap/<SID>/ERS<INR>

 

ers<INR><SID>

 

 

/usr/sap/<SID>/DVEBMGS<INR>

 

ci<SID>

 

 

 

 

dbci<SID>

 

 

 

 

d<INR><SID>

 

 

 

 

(SAP kernel 7.x)

 

 

/usr/sap/<SID>/D<INR>

 

d<INR><SID>

 

 

SAP Instance Storage Considerations 23

Image 23
Contents Managing Serviceguard Extension for SAP Version B.05.00 Page Table of Contents SAP Master Data Management MDM 111 SGeSAP Cluster Administration 137SAP Supply Chain Management List of Figures Page List of Tables Page About this Manual Printing HistoryINSTNR, INR Related DocumentationGeneral Concepts of SGeSAP Designing SGeSAP Cluster ScenariosMutual Failover Scenarios Using the Two Package Concept Mutual Failover Scenarios Using the Two Package Concept Robust Failover Using the One Package Concept Follow-and-Push Clusters with Replicated Enqueue Applications/sap/enqor/SID ersINSTNR Replicated Enqueue Clustering for Abap and Java InstancesDedicated NFS Packages Handling of Redundant Dialog Instances Dedicated Failover Host Replicated Enqueue Clustering for Abap and Java Instances SAP Instance Storage Considerations Planning the Storage LayoutCommon Directories that are Kept Local Option 1 SGeSAP NFS ClusterDirectories that Reside on Shared Disks Option 2 SGeSAP NFS Idle Standby Cluster System and Environment Specific Volume GroupsOption 3 SGeSAP CFS Cluster Directories that Reside on CFS Database Instance Storage ConsiderationsOracle Single Instance Rdbms $ORACLEHOME/common/nls/admin/dataFile System Layout for NFS-based Oracle Clusters Oracle Real Application ClustersMaxdb Storage Considerations Globals IndepData=/sapdb/data IndepPrograms=/sapdb/programs Sapnfs Planning the Storage Layout Pgname = pkgtypeINSTNRSID Step-by-Step Cluster ConversionStep-by-Step Cluster Conversion SAP Netweaver High Availability SAP Pre-Installation ConsiderationsSAP Preparation Cmmakepkg -m sgesap/scs Cmmakepkg -m sgesap/ers Cmmakepkg -m sgesap/sapinstance -m ... /sap.configCmmakepkg -m sgesap/db -m sgesap/ci Cmmakepkg -m sgesap/db Cmmakepkg -m sgesap/ciPage Replicated Enqueue Conversion SAPINSTMASTERDVD/IMXOS/SAPINST/UNIX/OSSu sidadm Mkdir /usr/sap/SID/ASCSINSTNR Volume group needs to be created for the Ascs instanceSplitting an Abap Central Instance Create a new mountpointSapsystemname =SID If the used SAP kernel has a release older thanSAPLOCALHOST=DRELOC Instancename =ASCSINSTNRSAPSYSTEM=INSTNR2 Su sidadm Mkdir /usr/sap/SID/ERSINSTNR Volume group needs to be created for the ERS instanceCreation of Replication Instance Sapstartsrv Sapcontrol Servicehttp Mkdir -p exe/servicehttp/sapmcPF = $DIRPROFILE/SIDERSINSTNRAREPRELOC Scsid = INRHP-UX Configuration Ls -d /usr/sap/???/*INSTNR Directory Structure ConfigurationCluster Filesystem Configuration Installation Step IS049 Mkdir /usr/sap/SID.new Non-CFS Directory Structure ConversionMaxdb Database Step SD040 Filename localcopy checkexist Installation Step IS050Open the groupfile, /etc/group, on the primary side Open the password file, /etc/passwd, on the primary sideCluster Node Synchronization Copy the sidadm home directory to the backup nodes Look at the service file, /etc/services, on the primary sideSu sqddbsid Mkdir -p /sapdb/DBSID STARTPROFILE=STARTDVEBMGSINRprimarySTARTPROFILE=STARTDVEBMGSINRsecondary Su orasid Mkdir -p /oracle/SID ExitMkdir -p /usr/sap/tmp Cluster Node ConfigurationMkdir /dev/vgdbSIDmknod /dev/vgdbSID/group c 64 Ssh hostN date Ssh -l sidadm hostN date Swlist grep sshSsh-keygen -t dsa Iddsa Iddsa.pubSet -u External Application Server Host ConfigurationConfigure /etc/nsswitch.conf to avoid problems Hosts filesNOTFOUND=continue UNAVAIL=continue TRYAGAIN=nsDBRELOC=0.0.0.0 Modular Package ConfigurationDB=ORACLE Sapsystem C11 Modular Package Configuration Step-by-Step Cluster Conversion Example entries for the package configuration file Sapextinstance DVEBMGS10 Sapextsystem QAS Sbin/init.d/sapinit referenced by /sbin/rc3.d/S###sapinit Cmapplyconf -P ./sap.config Mkdir -p /etc/cmcluster/SID Legacy Package ConfigurationServiceguard Configuration Created configuration files need to be editedTouch /etc/cmcluster/SID/debug Servicename ciC11msServicefailfastenabled YES Servicehalttimeout Servicename ciC11dispApplications/sap/enqor/SIDersinstnr Resourcename /applications/sap/enqor/C11ascsENQORSCSPKGNAMEC11=foobar ENQORREPPKGNAMEC11=foorep Distribute the package setup to all failover nodes SGeSAP ConfigurationSpecification of the Packaged SAP Components NFSRELOC=0.0.0.0 DNAME1=D CINAME=DVEBMGS CINR=00AREPNAME=ERS AREPNR=01 AREPRELOC=0.0.0.0 DNAME0=DREPNAME=ERS REPNR=00 Configuration of Application Server HandlingJCINAME=SCS JCINR=01 JCIRELOC=0.0.0.0Page Restart Stop Start $STARTWITHPKG, $STOPWITHPKG, $RESTARTDURINGFAILOVERWAITOWNAS=1 ASTREAT0=$RESTARTDURINGFAILOVER ASPLATFORM0=SG-PACKAGEASPSTART=1 WAITOWNAS=0 Optional Parameters and Customizable FunctionsWAITOWNAS=2 RFCADAPTERCMD=runadapter.sh SAPROUTERSTART0=1 SAPROUTERPORT0=-S3299RFCADAPTERSTART=1 SAPSTARTSRVSTART=1 SAPSTARTSRVSTOP=1 Global DefaultsSAPCCMSRSTART=1 Legacy Package Configuration Packagename sapnfs HA NFS Toolkit ConfigurationEXEDIR= /usr/sap/SID/SYS/exe/runU JMSSERVBASE=3600Sapmnt/SID Usr/sap/trans Auto FS ConfigurationHANFSSCRIPTEXTENSION=pkgtype Export/sapmnt/SID Export/usr/sap/transNFSCLIENT=1 NFSSERVER=1 NUMNFSD=4 NUMNFSIOD=4 AUTOMASTER=/etc/automaster AUTOMOUNTOPTIONS=-f $AUTOMASTERAUTOMOUNTDOPTIONS= -L AUTOFS=1 AUTOMASTER=/etc/automaster AUTOOPTIONS=-f $AUTOMASTERDatabase Configuration Perform the following steps as orasid Additional Steps for OraclePerform the following step as sidadm Lsnrctl start LISTENERSID1/2 If you use more than one SAP system inside of your clusterAdditional steps for Oracle 10g Rdbms Additional Steps for MaxdbAdditional steps for Oracle 9i Rdbms SAP Application Server Configuration Sapmnt/SID/profile/SIDINSTNAMEINR SAP Abap Engine specific configuration stepsCdpro Rdisp/enqname = relocciSIDinstnrBatch jobs can be scheduled to run on a particular instance SaplocalhostsidinstnrSID/dbhost = relocdb Icm/hostnamefull=relocatibleip SAP J2EE Engine specific installation stepsRdisp/starticman=TRUE Jdbc/pool/SID/Url jdbcoraclethin@relocdb1527SID Admin/host/SID relocdbPage SAP Supply Chain Management More About Hot Standby Option 1 Simple Clusters with Separated Packages Planning the Volume Manager SetupOption 3 Full Flexibility Option 2 Non-MAXDB EnvironmentsOption 4 Hot Standby liveCache Maxdb Storage ConsiderationsLiveCache Installation Step LC010 Synchronize the /etc/group and /etc/passwd files HP-UX Setup for Options 1, 2Mkdir -p /sapdb/data Mkdir /sapdb/LCSID Do the following to continueCopy file /etc/opt/sdb to the second cluster node Mkdir /sapdbHORCCMRCF=1 HORCMINST=0 HP-UX Setup for OptionIf you use DNS Hosts filesNOTFOUND=continue UNAVAIL=continue \ TRYAGAIN=nsPackagename lcLCSID SGeSAP Modular Package ConfigurationCmmakepkg -m sgesap/livecache lcLCSID.config SGeSAP Modular Package Configuration Packagetype Failover SGeSAP Legacy Package ConfigurationCreate standard package control and configuration files Cp /opt/cmcluster/sap/*.functions /etc/cmclusterLCPRIMARYROLE=primarynode LCSECONDARYROLE=secondarynode Cold Admin Warm OnlineLCSTANDBYRESTART=1 Livecache Service MonitoringLCCOPYMECHANISM=BUSINESSCOPY AVOIDWWIDCHECK=1APO Setup Changes # dbmcli on hostname Lcsid quit Su lcsidadm Dbmcli -ux SAPLCSID,password -ulMv .XUSER.62 .XUSER.62.ORG Default key Sapdb/programsrelocsapnfss/export/sapdb/programs General Serviceguard Setup ChangesFor option Last step is to reconfigure the cluster with cmapplyconf1m Master Data Management User Interface Components Master Data Management OverviewSAP Netweaver XI components MDM Server ComponentsOracle/MDM Installation and Configuration ConsiderationsPrerequisites MDM SGeSAP File System LayoutOpt/MDM Single or Multiple MDM Serviceguard Package ConfigurationsSingle MDM Serviceguard Package ONE Multiple MDM Serviceguard packages FOUR+ONEMkdir -p /export/home/mdmuser Mkdir -p /home/mdmuser Run ioscan and insf to probe/install new disk devicesMkdir -p /oracle/MDM Mkdir -p /opt/MDM Installation and Configuration Considerations Runscript /etc/cmcluster/MDMNFS/mdmNFS.control.script Runscripttimeout NotimeoutHaltscripttimeout Notimeout NodenameSbin/init.d/nfs.client stop Sbin/init.d/nfs.client start Scp -rp /etc/cmcluster/MDMNFS clunode2/etc/cmcluster/MDMNFSScp -p /etc/auto.direct clunode2/etc/auto.direct Runscript /etc/cmcluster/MDM/mdbMDM.control.script Runscript /etc/cmcluster/MDM/mgroupMDM.control.scriptHaltscript /etc/cmcluster/MDM/mgroupMDM.control.script Haltscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdbMDM.control.scriptRunscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdssMDM.control.script Runscript /etc/cmcluster/MDM/mdisMDM.control.scriptHaltscript /etc/cmcluster/MDM/mdisMDM.control.script Runscript /etc/cmcluster/MDM/mdssMDM.control.scriptSsh -X clunode1 -l oramdm Runscript /etc/cmcluster/MDM/masterMDM.control.scriptHaltscript /etc/cmcluster/MDM/masterMDM.control.script KITS/ora9208/Disk1/runInstller Specify File Locations SidmdmSetup Step MDM218 SAP Master Data Management MDM MDM = Description = Addresslist = Sidlistlistener = Sidlist = Siddesc = Globaldbname = MDM Connectdata = Server = Dedicated Servicename = MDMListener = Descriptionlist = Description = Addresslist = Installation and Configuration Considerations Create a /home/mdmuser/mdss directory Global SAP Master Data Management MDM MDMUSER=mdmuser Single Serviceguard package configure sap.configMDMLISTENERNAME=LISTENER MDMMGROUPDEPEND=mdb mds mdis mdss MDMPASSWORD= MDMREPOSITORYSPEC=MDMMDSRELOC=172.16.11.96 MDMMONITORINTERVAL=60Cmrunpkg mgroupMDM Cmhaltpkg mgroupMDM Servicefailfastenabled no ServicehalttimeoutVi /etc/cmcluster/MDM/mdsMDM.config Servicename mdsMDMmon Cmapplyconf -P /etc/cmcluster/MDM/mdsMDM.configCmrunpkg masterMDM Cmhaltpkg masterMDM System Level Changes Change ManagementSGeSAP Cluster Administration SAP Software Changes Swlist -l bundle B7885BA T2803BA Upgrading SAP SoftwareMixed Clusters Swlist -l bundle T2357BA T2803BACd /sapmnt Ln -s /sapmnt/SID/exepa /sapmnt/SIDexelocal Cd /sapmnt/SID Mv exe exepaCd /sapmnt/SID Mkdir exeipf Cd /sapmnt/SID Ln -s /sapmnt/SIDexelocal exe
Related manuals
Manual 35 pages 22.06 Kb