HP Serviceguard Extension for SAP (SGeSAP) manual Oracle Real Application Clusters

Page 28

1.The Oracle RDBMS and database tools rely on an ORA_NLS[<nls_version>] setting that refers to NLS files that are compatible to the version of the RDBMS. Oracle 9.x needs NLS files as delivered with Oracle 9.x.

2.The SAP executables rely on an ORA_NLS[<nls_version>] setting that refers to NLS files of the same versions as those that were used during kernel link time by SAP development. This is not necessarily identical to the installed database release.

The Oracle database server and SAP server might need different types of NLS files. The server NLS files are part of the database Serviceguard package. The client NLS files are installed locally on all hosts. Special care has to be taken to not mix the access paths for ORACLE server and client processes.

The discussion of NLS files has no impact on the treatment of other parts of the ORACLE client files. The following directories need to exist locally on all hosts on which an Application Server might run. They can not be relocated to different paths. The content needs to be identical to the content of the corresponding directories that are shared as part of the database SGeSAP package. The setup for these directories follows the "on top" mount approach, i.e., the directories might become hidden beneath identical copies that are part of the package:

$ORACLE_HOME/rdbms/mesg

$ORACLE_HOME/oracore/zoneinfo

$ORACLE_HOME/network/admin

Table 2-8 File System Layout for NFS-based Oracle Clusters

Mount Point

Access

Potential Owning

VG Type

Volume Group

Device Minor

 

Point

Packages

 

Name

Number

$ORACLE_HOME

shared disk

dbci<DBSID>

db instance

 

 

/oracle/<SID>/saparch

 

jdb”<DBSID”

specific

 

 

 

 

 

 

/oracle/<SID>/sapreorgjdbjci<DBSID>

/oracle/<SID>/sapdata1dbcijci<DBSID>

...

/oracle/<SID>/sapdatan

/oracle/<SID>/origlogA

/oracle/<SID>/origlogB

/oracle/<SID>/mirrlogA

/oracle/<SID>/mirrlogB

/oracle/client

local

none

environment

 

 

 

specific

some local Oracle client files reside in

local

none

db instance

/oracle/<SID> as part of the root

 

 

specific

filesystem

 

 

 

Oracle Real Application Clusters

Oracle Real Application Clusters (RAC) is an option to the Single Instance Oracle Database Enterprise Edition. Oracle RAC is a cluster database with shared cache architecture. The SAP certified solution is based on HP Serviceguard Cluster File System for RAC.

Handling of a RAC database is not included in SGeSAP itself. RAC databases are treated by SGeRAC and Oracle tools, which integrate with SGeSAP. The configuration of SGeSAP packages for non-database components is identical to non-RAC environments.

NOTE: The configurations are designed to be compliant to SAP OSS note 830982. The note describes SAP recommendations for Oracle RAC configurations. A support statement from SAP regarding RAC clusters on HP-UX can be found as part of SAP OSS note 527843. A current support statement in note 527843 is required, before any of the described RAC options can be implemented. The note maintenance is done by

28 Planning the Storage Layout

Image 28
Contents Managing Serviceguard Extension for SAP Version B.05.00 Page Table of Contents SAP Supply Chain Management SGeSAP Cluster Administration 137SAP Master Data Management MDM 111 List of Figures Page List of Tables Page Printing History About this ManualRelated Documentation INSTNR, INRDesigning SGeSAP Cluster Scenarios General Concepts of SGeSAPMutual Failover Scenarios Using the Two Package Concept Mutual Failover Scenarios Using the Two Package Concept Robust Failover Using the One Package Concept Follow-and-Push Clusters with Replicated Enqueue Replicated Enqueue Clustering for Abap and Java Instances Applications/sap/enqor/SID ersINSTNRDedicated NFS Packages Handling of Redundant Dialog Instances Dedicated Failover Host Replicated Enqueue Clustering for Abap and Java Instances Planning the Storage Layout SAP Instance Storage ConsiderationsOption 1 SGeSAP NFS Cluster Common Directories that are Kept LocalDirectories that Reside on Shared Disks System and Environment Specific Volume Groups Option 2 SGeSAP NFS Idle Standby ClusterOption 3 SGeSAP CFS Cluster Database Instance Storage Considerations Directories that Reside on CFS$ORACLEHOME/common/nls/admin/data Oracle Single Instance RdbmsOracle Real Application Clusters File System Layout for NFS-based Oracle ClustersMaxdb Storage Considerations Globals IndepData=/sapdb/data IndepPrograms=/sapdb/programs Sapnfs Planning the Storage Layout Step-by-Step Cluster Conversion Pgname = pkgtypeINSTNRSIDStep-by-Step Cluster Conversion SAP Preparation SAP Pre-Installation ConsiderationsSAP Netweaver High Availability Cmmakepkg -m sgesap/sapinstance -m ... /sap.config Cmmakepkg -m sgesap/db -m sgesap/ciCmmakepkg -m sgesap/db Cmmakepkg -m sgesap/ci Cmmakepkg -m sgesap/scs Cmmakepkg -m sgesap/ersPage SAPINSTMASTERDVD/IMXOS/SAPINST/UNIX/OS Replicated Enqueue ConversionVolume group needs to be created for the Ascs instance Splitting an Abap Central InstanceCreate a new mountpoint Su sidadm Mkdir /usr/sap/SID/ASCSINSTNRIf the used SAP kernel has a release older than Sapsystemname =SIDSAPSYSTEM=INSTNR2 Instancename =ASCSINSTNRSAPLOCALHOST=DRELOC Creation of Replication Instance Volume group needs to be created for the ERS instanceSu sidadm Mkdir /usr/sap/SID/ERSINSTNR Mkdir -p exe/servicehttp/sapmc Sapstartsrv Sapcontrol ServicehttpScsid = INR PF = $DIRPROFILE/SIDERSINSTNRAREPRELOCHP-UX Configuration Cluster Filesystem Configuration Directory Structure ConfigurationLs -d /usr/sap/???/*INSTNR Installation Step IS049 Non-CFS Directory Structure Conversion Mkdir /usr/sap/SID.newMaxdb Database Step SD040 Installation Step IS050 Filename localcopy checkexistCluster Node Synchronization Open the password file, /etc/passwd, on the primary sideOpen the groupfile, /etc/group, on the primary side Look at the service file, /etc/services, on the primary side Copy the sidadm home directory to the backup nodesSTARTPROFILE=STARTDVEBMGSINRprimary STARTPROFILE=STARTDVEBMGSINRsecondarySu orasid Mkdir -p /oracle/SID Exit Su sqddbsid Mkdir -p /sapdb/DBSIDMkdir /dev/vgdbSIDmknod /dev/vgdbSID/group c 64 Cluster Node ConfigurationMkdir -p /usr/sap/tmp Swlist grep ssh Ssh-keygen -t dsaIddsa Iddsa.pub Ssh hostN date Ssh -l sidadm hostN dateExternal Application Server Host Configuration Configure /etc/nsswitch.conf to avoid problemsHosts filesNOTFOUND=continue UNAVAIL=continue TRYAGAIN=ns Set -uDB=ORACLE Modular Package ConfigurationDBRELOC=0.0.0.0 Sapsystem C11 Modular Package Configuration Step-by-Step Cluster Conversion Example entries for the package configuration file Sapextinstance DVEBMGS10 Sapextsystem QAS Sbin/init.d/sapinit referenced by /sbin/rc3.d/S###sapinit Cmapplyconf -P ./sap.config Legacy Package Configuration Serviceguard ConfigurationCreated configuration files need to be edited Mkdir -p /etc/cmcluster/SIDServicename ciC11ms Servicefailfastenabled YES ServicehalttimeoutServicename ciC11disp Touch /etc/cmcluster/SID/debugResourcename /applications/sap/enqor/C11ascs Applications/sap/enqor/SIDersinstnrENQORSCSPKGNAMEC11=foobar ENQORREPPKGNAMEC11=foorep Specification of the Packaged SAP Components SGeSAP ConfigurationDistribute the package setup to all failover nodes NFSRELOC=0.0.0.0 CINAME=DVEBMGS CINR=00 AREPNAME=ERS AREPNR=01 AREPRELOC=0.0.0.0DNAME0=D DNAME1=DConfiguration of Application Server Handling JCINAME=SCS JCINR=01JCIRELOC=0.0.0.0 REPNAME=ERS REPNR=00Page $STARTWITHPKG, $STOPWITHPKG, $RESTARTDURINGFAILOVER Restart Stop StartASPSTART=1 ASTREAT0=$RESTARTDURINGFAILOVER ASPLATFORM0=SG-PACKAGEWAITOWNAS=1 WAITOWNAS=2 Optional Parameters and Customizable FunctionsWAITOWNAS=0 RFCADAPTERSTART=1 SAPROUTERSTART0=1 SAPROUTERPORT0=-S3299RFCADAPTERCMD=runadapter.sh SAPCCMSRSTART=1 Global DefaultsSAPSTARTSRVSTART=1 SAPSTARTSRVSTOP=1 Legacy Package Configuration HA NFS Toolkit Configuration EXEDIR= /usr/sap/SID/SYS/exe/runUJMSSERVBASE=3600 Packagename sapnfsAuto FS Configuration HANFSSCRIPTEXTENSION=pkgtypeExport/sapmnt/SID Export/usr/sap/trans Sapmnt/SID Usr/sap/transAUTOMASTER=/etc/automaster AUTOMOUNTOPTIONS=-f $AUTOMASTER AUTOMOUNTDOPTIONS= -L AUTOFS=1AUTOMASTER=/etc/automaster AUTOOPTIONS=-f $AUTOMASTER NFSCLIENT=1 NFSSERVER=1 NUMNFSD=4 NUMNFSIOD=4Database Configuration Perform the following step as sidadm Additional Steps for OraclePerform the following steps as orasid If you use more than one SAP system inside of your cluster Lsnrctl start LISTENERSID1/2Additional steps for Oracle 9i Rdbms Additional Steps for MaxdbAdditional steps for Oracle 10g Rdbms SAP Application Server Configuration SAP Abap Engine specific configuration steps CdproRdisp/enqname = relocciSIDinstnr Sapmnt/SID/profile/SIDINSTNAMEINRSID/dbhost = relocdb SaplocalhostsidinstnrBatch jobs can be scheduled to run on a particular instance Rdisp/starticman=TRUE SAP J2EE Engine specific installation stepsIcm/hostnamefull=relocatibleip Admin/host/SID relocdb Jdbc/pool/SID/Url jdbcoraclethin@relocdb1527SIDPage SAP Supply Chain Management More About Hot Standby Planning the Volume Manager Setup Option 1 Simple Clusters with Separated PackagesOption 2 Non-MAXDB Environments Option 3 Full FlexibilityMaxdb Storage Considerations Option 4 Hot Standby liveCacheLiveCache Installation Step LC010 HP-UX Setup for Options 1, 2 Synchronize the /etc/group and /etc/passwd filesDo the following to continue Copy file /etc/opt/sdb to the second cluster nodeMkdir /sapdb Mkdir -p /sapdb/data Mkdir /sapdb/LCSIDHP-UX Setup for Option If you use DNSHosts filesNOTFOUND=continue UNAVAIL=continue \ TRYAGAIN=ns HORCCMRCF=1 HORCMINST=0Cmmakepkg -m sgesap/livecache lcLCSID.config SGeSAP Modular Package ConfigurationPackagename lcLCSID SGeSAP Modular Package Configuration SGeSAP Legacy Package Configuration Create standard package control and configuration filesCp /opt/cmcluster/sap/*.functions /etc/cmcluster Packagetype FailoverCold Admin Warm Online LCPRIMARYROLE=primarynode LCSECONDARYROLE=secondarynodeLivecache Service Monitoring LCCOPYMECHANISM=BUSINESSCOPYAVOIDWWIDCHECK=1 LCSTANDBYRESTART=1APO Setup Changes Mv .XUSER.62 .XUSER.62.ORG Default key Su lcsidadm Dbmcli -ux SAPLCSID,password -ul# dbmcli on hostname Lcsid quit For option General Serviceguard Setup ChangesSapdb/programsrelocsapnfss/export/sapdb/programs Last step is to reconfigure the cluster with cmapplyconf1m Master Data Management Overview Master Data Management User Interface ComponentsMDM Server Components SAP Netweaver XI componentsInstallation and Configuration Considerations PrerequisitesMDM SGeSAP File System Layout Oracle/MDMSingle or Multiple MDM Serviceguard Package Configurations Single MDM Serviceguard Package ONEMultiple MDM Serviceguard packages FOUR+ONE Opt/MDMMkdir -p /oracle/MDM Run ioscan and insf to probe/install new disk devicesMkdir -p /export/home/mdmuser Mkdir -p /home/mdmuser Mkdir -p /opt/MDM Installation and Configuration Considerations Runscripttimeout Notimeout Haltscripttimeout NotimeoutNodename Runscript /etc/cmcluster/MDMNFS/mdmNFS.control.scriptScp -p /etc/auto.direct clunode2/etc/auto.direct Scp -rp /etc/cmcluster/MDMNFS clunode2/etc/cmcluster/MDMNFSSbin/init.d/nfs.client stop Sbin/init.d/nfs.client start Haltscript /etc/cmcluster/MDM/mgroupMDM.control.script Runscript /etc/cmcluster/MDM/mgroupMDM.control.scriptRunscript /etc/cmcluster/MDM/mdbMDM.control.script Runscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdbMDM.control.scriptHaltscript /etc/cmcluster/MDM/mdsMDM.control.script Runscript /etc/cmcluster/MDM/mdisMDM.control.script Haltscript /etc/cmcluster/MDM/mdisMDM.control.scriptRunscript /etc/cmcluster/MDM/mdssMDM.control.script Haltscript /etc/cmcluster/MDM/mdssMDM.control.scriptHaltscript /etc/cmcluster/MDM/masterMDM.control.script Runscript /etc/cmcluster/MDM/masterMDM.control.scriptSsh -X clunode1 -l oramdm Sidmdm KITS/ora9208/Disk1/runInstller Specify File LocationsSetup Step MDM218 SAP Master Data Management MDM MDM = Description = Addresslist = Listener = Descriptionlist = Description = Addresslist = Connectdata = Server = Dedicated Servicename = MDMSidlistlistener = Sidlist = Siddesc = Globaldbname = MDM Installation and Configuration Considerations Create a /home/mdmuser/mdss directory Global SAP Master Data Management MDM MDMLISTENERNAME=LISTENER Single Serviceguard package configure sap.configMDMUSER=mdmuser MDMPASSWORD= MDMREPOSITORYSPEC= MDMMDSRELOC=172.16.11.96MDMMONITORINTERVAL=60 MDMMGROUPDEPEND=mdb mds mdis mdssServicefailfastenabled no Servicehalttimeout Vi /etc/cmcluster/MDM/mdsMDM.config Servicename mdsMDMmonCmapplyconf -P /etc/cmcluster/MDM/mdsMDM.config Cmrunpkg mgroupMDM Cmhaltpkg mgroupMDMCmrunpkg masterMDM Cmhaltpkg masterMDM Change Management System Level ChangesSGeSAP Cluster Administration SAP Software Changes Upgrading SAP Software Mixed ClustersSwlist -l bundle T2357BA T2803BA Swlist -l bundle B7885BA T2803BACd /sapmnt/SID Mv exe exepa Cd /sapmnt/SID Mkdir exeipfCd /sapmnt/SID Ln -s /sapmnt/SIDexelocal exe Cd /sapmnt Ln -s /sapmnt/SID/exepa /sapmnt/SIDexelocal
Related manuals
Manual 35 pages 22.06 Kb