HP Serviceguard Extension for SAP (SGeSAP) manual Sapnfs

Page 31

this directory to a backup location. This information is then used to determine the reason of the crash. In HA scenarios, for SAPDB/MAXDB lower that version 7.6, this directory should move with the package. Therefore, SAP provided a way to redefine this path for each SAPBDB/MAXDB individually. SGeSAP expects the work directory to be part of the database package. The mount point moves from /sapdb/data/wrk to /sapdb/data/<DBSID>/wrk for the clustered setup. This directory should not be mixed up with the directory /sapdb/data/<DBSID>/db/wrk that might also exist. Core files of the kernel processes are written into the working directory. These core files have file sizes of several Gigabytes. Sufficient free space needs to be configured for the shared logical volume to allow core dumps.

NOTE: For MAXDB RDBMS starting with version 7.6 these limitations do not exist any more. The working directory is utilized by all instances (IndepData/wrk) and can be globally shared.

/var/spool/sql: This directory hosts local runtime data of all locally running MAXDB instances. Most of the data in this directory would become meaningless in the context of a different host after failover. The only critical portion that still has to be accessible after failover is the initialization data in /var/spool/sql/ini. This directory is usually very small (< 1Megabyte). With MAXDB and liveCache 7.5 or higher, the only local files are contained in /var/spool/sql/ini, other paths are just links to local runtime data in IndepData path:

dbspeed -> /sapdb/data/dbspeed diag -> /sapdb/data/diag fifo -> /sapdb/data/fifo

ipc -> /sapdb/data/ipc pid -> /sapdb/data/pid pipe -> /sapdb/data/pipe ppid -> /sapdb/data/ppid

The links need to exist on every possible failover node the MAXDB or liveCache instance is able to run:

/etc/opt/sdb: Only existent when using MAXDB or liveCache 7.5, needs to be local on each node together with entries in /etc/passwd and /etc/group.

Table 2-10 shows the file system layout for SAPDB clusters.

NOTE: In HA scenarios, valid for SAPDB/MAXDB versions up to 7.6, the runtime directory /sapdb/data/wrk is configured to be located at /sapdb/<DBSID>/wrk to support consolidated failover environments with several MAXDB instances. The local directory /sapdb/data/wrk though is still referred to by the VSERVER processes (vserver, niserver), which means VSERVER core dump and log files will be located there.

Table 2-10 File System Layout for SAPDB Clusters

Mount Point

Access Point

Potential Owning

VG Type

VG Name Device Minor

 

 

Packages

 

Number

/sapdb/<DBSID>

shared disk

db<DBSID>

database specific

 

/sapdb/<DBSID>/wrk*

 

dbci<DBSID>

 

 

/sapdb/<DBSID>/data<nr>

 

jdb<dbsid>

 

 

/sapdb/<dbsid>/saplog<nr>

 

jdbjci<DBSID>

 

 

/export/sapdb/programs

shared disk

db<DBSID>

environment

 

/export/sapdb/data

and HA NFS

dbci<DBSID>

specific

 

/export/var/spool/sql/ini

 

jdb<DBSID>

 

 

 

 

jdbjci<DBSID>

 

 

 

 

SAPNFS

 

 

/etc/opt/sdb

local

none

 

 

* only valid for SAPDB/MAXDB versions lower than 7.6

 

 

 

Database Instance Storage Considerations

31

Image 31
Contents Managing Serviceguard Extension for SAP Version B.05.00 Page Table of Contents SAP Supply Chain Management SGeSAP Cluster Administration 137SAP Master Data Management MDM 111 List of Figures Page List of Tables Page About this Manual Printing HistoryINSTNR, INR Related DocumentationGeneral Concepts of SGeSAP Designing SGeSAP Cluster ScenariosMutual Failover Scenarios Using the Two Package Concept Mutual Failover Scenarios Using the Two Package Concept Robust Failover Using the One Package Concept Follow-and-Push Clusters with Replicated Enqueue Applications/sap/enqor/SID ersINSTNR Replicated Enqueue Clustering for Abap and Java InstancesDedicated NFS Packages Handling of Redundant Dialog Instances Dedicated Failover Host Replicated Enqueue Clustering for Abap and Java Instances SAP Instance Storage Considerations Planning the Storage LayoutCommon Directories that are Kept Local Option 1 SGeSAP NFS ClusterDirectories that Reside on Shared Disks Option 2 SGeSAP NFS Idle Standby Cluster System and Environment Specific Volume GroupsOption 3 SGeSAP CFS Cluster Directories that Reside on CFS Database Instance Storage ConsiderationsOracle Single Instance Rdbms $ORACLEHOME/common/nls/admin/dataFile System Layout for NFS-based Oracle Clusters Oracle Real Application ClustersMaxdb Storage Considerations Globals IndepData=/sapdb/data IndepPrograms=/sapdb/programs Sapnfs Planning the Storage Layout Pgname = pkgtypeINSTNRSID Step-by-Step Cluster ConversionStep-by-Step Cluster Conversion SAP Preparation SAP Pre-Installation ConsiderationsSAP Netweaver High Availability Cmmakepkg -m sgesap/scs Cmmakepkg -m sgesap/ers Cmmakepkg -m sgesap/sapinstance -m ... /sap.configCmmakepkg -m sgesap/db -m sgesap/ci Cmmakepkg -m sgesap/db Cmmakepkg -m sgesap/ciPage Replicated Enqueue Conversion SAPINSTMASTERDVD/IMXOS/SAPINST/UNIX/OSSu sidadm Mkdir /usr/sap/SID/ASCSINSTNR Volume group needs to be created for the Ascs instanceSplitting an Abap Central Instance Create a new mountpointSapsystemname =SID If the used SAP kernel has a release older thanSAPSYSTEM=INSTNR2 Instancename =ASCSINSTNRSAPLOCALHOST=DRELOC Creation of Replication Instance Volume group needs to be created for the ERS instanceSu sidadm Mkdir /usr/sap/SID/ERSINSTNR Sapstartsrv Sapcontrol Servicehttp Mkdir -p exe/servicehttp/sapmcPF = $DIRPROFILE/SIDERSINSTNRAREPRELOC Scsid = INRHP-UX Configuration Cluster Filesystem Configuration Directory Structure ConfigurationLs -d /usr/sap/???/*INSTNR Installation Step IS049 Mkdir /usr/sap/SID.new Non-CFS Directory Structure ConversionMaxdb Database Step SD040 Filename localcopy checkexist Installation Step IS050Cluster Node Synchronization Open the password file, /etc/passwd, on the primary sideOpen the groupfile, /etc/group, on the primary side Copy the sidadm home directory to the backup nodes Look at the service file, /etc/services, on the primary sideSu sqddbsid Mkdir -p /sapdb/DBSID STARTPROFILE=STARTDVEBMGSINRprimarySTARTPROFILE=STARTDVEBMGSINRsecondary Su orasid Mkdir -p /oracle/SID ExitMkdir /dev/vgdbSIDmknod /dev/vgdbSID/group c 64 Cluster Node ConfigurationMkdir -p /usr/sap/tmp Ssh hostN date Ssh -l sidadm hostN date Swlist grep sshSsh-keygen -t dsa Iddsa Iddsa.pubSet -u External Application Server Host ConfigurationConfigure /etc/nsswitch.conf to avoid problems Hosts filesNOTFOUND=continue UNAVAIL=continue TRYAGAIN=nsDB=ORACLE Modular Package ConfigurationDBRELOC=0.0.0.0 Sapsystem C11 Modular Package Configuration Step-by-Step Cluster Conversion Example entries for the package configuration file Sapextinstance DVEBMGS10 Sapextsystem QAS Sbin/init.d/sapinit referenced by /sbin/rc3.d/S###sapinit Cmapplyconf -P ./sap.config Mkdir -p /etc/cmcluster/SID Legacy Package ConfigurationServiceguard Configuration Created configuration files need to be editedTouch /etc/cmcluster/SID/debug Servicename ciC11msServicefailfastenabled YES Servicehalttimeout Servicename ciC11dispApplications/sap/enqor/SIDersinstnr Resourcename /applications/sap/enqor/C11ascsENQORSCSPKGNAMEC11=foobar ENQORREPPKGNAMEC11=foorep Specification of the Packaged SAP Components SGeSAP ConfigurationDistribute the package setup to all failover nodes NFSRELOC=0.0.0.0 DNAME1=D CINAME=DVEBMGS CINR=00AREPNAME=ERS AREPNR=01 AREPRELOC=0.0.0.0 DNAME0=DREPNAME=ERS REPNR=00 Configuration of Application Server HandlingJCINAME=SCS JCINR=01 JCIRELOC=0.0.0.0Page Restart Stop Start $STARTWITHPKG, $STOPWITHPKG, $RESTARTDURINGFAILOVERASPSTART=1 ASTREAT0=$RESTARTDURINGFAILOVER ASPLATFORM0=SG-PACKAGEWAITOWNAS=1 WAITOWNAS=2 Optional Parameters and Customizable FunctionsWAITOWNAS=0 RFCADAPTERSTART=1 SAPROUTERSTART0=1 SAPROUTERPORT0=-S3299RFCADAPTERCMD=runadapter.sh SAPCCMSRSTART=1 Global DefaultsSAPSTARTSRVSTART=1 SAPSTARTSRVSTOP=1 Legacy Package Configuration Packagename sapnfs HA NFS Toolkit ConfigurationEXEDIR= /usr/sap/SID/SYS/exe/runU JMSSERVBASE=3600Sapmnt/SID Usr/sap/trans Auto FS ConfigurationHANFSSCRIPTEXTENSION=pkgtype Export/sapmnt/SID Export/usr/sap/transNFSCLIENT=1 NFSSERVER=1 NUMNFSD=4 NUMNFSIOD=4 AUTOMASTER=/etc/automaster AUTOMOUNTOPTIONS=-f $AUTOMASTERAUTOMOUNTDOPTIONS= -L AUTOFS=1 AUTOMASTER=/etc/automaster AUTOOPTIONS=-f $AUTOMASTERDatabase Configuration Perform the following step as sidadm Additional Steps for OraclePerform the following steps as orasid Lsnrctl start LISTENERSID1/2 If you use more than one SAP system inside of your clusterAdditional steps for Oracle 9i Rdbms Additional Steps for MaxdbAdditional steps for Oracle 10g Rdbms SAP Application Server Configuration Sapmnt/SID/profile/SIDINSTNAMEINR SAP Abap Engine specific configuration stepsCdpro Rdisp/enqname = relocciSIDinstnrSID/dbhost = relocdb SaplocalhostsidinstnrBatch jobs can be scheduled to run on a particular instance Rdisp/starticman=TRUE SAP J2EE Engine specific installation stepsIcm/hostnamefull=relocatibleip Jdbc/pool/SID/Url jdbcoraclethin@relocdb1527SID Admin/host/SID relocdbPage SAP Supply Chain Management More About Hot Standby Option 1 Simple Clusters with Separated Packages Planning the Volume Manager SetupOption 3 Full Flexibility Option 2 Non-MAXDB EnvironmentsOption 4 Hot Standby liveCache Maxdb Storage ConsiderationsLiveCache Installation Step LC010 Synchronize the /etc/group and /etc/passwd files HP-UX Setup for Options 1, 2Mkdir -p /sapdb/data Mkdir /sapdb/LCSID Do the following to continueCopy file /etc/opt/sdb to the second cluster node Mkdir /sapdbHORCCMRCF=1 HORCMINST=0 HP-UX Setup for OptionIf you use DNS Hosts filesNOTFOUND=continue UNAVAIL=continue \ TRYAGAIN=nsCmmakepkg -m sgesap/livecache lcLCSID.config SGeSAP Modular Package ConfigurationPackagename lcLCSID SGeSAP Modular Package Configuration Packagetype Failover SGeSAP Legacy Package ConfigurationCreate standard package control and configuration files Cp /opt/cmcluster/sap/*.functions /etc/cmclusterLCPRIMARYROLE=primarynode LCSECONDARYROLE=secondarynode Cold Admin Warm OnlineLCSTANDBYRESTART=1 Livecache Service MonitoringLCCOPYMECHANISM=BUSINESSCOPY AVOIDWWIDCHECK=1APO Setup Changes Mv .XUSER.62 .XUSER.62.ORG Default key Su lcsidadm Dbmcli -ux SAPLCSID,password -ul# dbmcli on hostname Lcsid quit For option General Serviceguard Setup ChangesSapdb/programsrelocsapnfss/export/sapdb/programs Last step is to reconfigure the cluster with cmapplyconf1m Master Data Management User Interface Components Master Data Management OverviewSAP Netweaver XI components MDM Server ComponentsOracle/MDM Installation and Configuration ConsiderationsPrerequisites MDM SGeSAP File System LayoutOpt/MDM Single or Multiple MDM Serviceguard Package ConfigurationsSingle MDM Serviceguard Package ONE Multiple MDM Serviceguard packages FOUR+ONEMkdir -p /oracle/MDM Run ioscan and insf to probe/install new disk devicesMkdir -p /export/home/mdmuser Mkdir -p /home/mdmuser Mkdir -p /opt/MDM Installation and Configuration Considerations Runscript /etc/cmcluster/MDMNFS/mdmNFS.control.script Runscripttimeout NotimeoutHaltscripttimeout Notimeout NodenameScp -p /etc/auto.direct clunode2/etc/auto.direct Scp -rp /etc/cmcluster/MDMNFS clunode2/etc/cmcluster/MDMNFSSbin/init.d/nfs.client stop Sbin/init.d/nfs.client start Haltscript /etc/cmcluster/MDM/mgroupMDM.control.script Runscript /etc/cmcluster/MDM/mgroupMDM.control.scriptRunscript /etc/cmcluster/MDM/mdbMDM.control.script Runscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdbMDM.control.scriptHaltscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdssMDM.control.script Runscript /etc/cmcluster/MDM/mdisMDM.control.scriptHaltscript /etc/cmcluster/MDM/mdisMDM.control.script Runscript /etc/cmcluster/MDM/mdssMDM.control.scriptHaltscript /etc/cmcluster/MDM/masterMDM.control.script Runscript /etc/cmcluster/MDM/masterMDM.control.scriptSsh -X clunode1 -l oramdm KITS/ora9208/Disk1/runInstller Specify File Locations SidmdmSetup Step MDM218 SAP Master Data Management MDM MDM = Description = Addresslist = Listener = Descriptionlist = Description = Addresslist = Connectdata = Server = Dedicated Servicename = MDMSidlistlistener = Sidlist = Siddesc = Globaldbname = MDM Installation and Configuration Considerations Create a /home/mdmuser/mdss directory Global SAP Master Data Management MDM MDMLISTENERNAME=LISTENER Single Serviceguard package configure sap.configMDMUSER=mdmuser MDMMGROUPDEPEND=mdb mds mdis mdss MDMPASSWORD= MDMREPOSITORYSPEC=MDMMDSRELOC=172.16.11.96 MDMMONITORINTERVAL=60Cmrunpkg mgroupMDM Cmhaltpkg mgroupMDM Servicefailfastenabled no ServicehalttimeoutVi /etc/cmcluster/MDM/mdsMDM.config Servicename mdsMDMmon Cmapplyconf -P /etc/cmcluster/MDM/mdsMDM.configCmrunpkg masterMDM Cmhaltpkg masterMDM System Level Changes Change ManagementSGeSAP Cluster Administration SAP Software Changes Swlist -l bundle B7885BA T2803BA Upgrading SAP SoftwareMixed Clusters Swlist -l bundle T2357BA T2803BACd /sapmnt Ln -s /sapmnt/SID/exepa /sapmnt/SIDexelocal Cd /sapmnt/SID Mv exe exepaCd /sapmnt/SID Mkdir exeipf Cd /sapmnt/SID Ln -s /sapmnt/SIDexelocal exe
Related manuals
Manual 35 pages 22.06 Kb