HP Serviceguard Extension for SAP (SGeSAP) manual Planning the Storage Layout

Page 21

2 Planning the Storage Layout

Volume managers are tools that let you create units of disk storage known as storage groups. Storage groups contain logical volumes for use on single systems and in high availability clusters. In Serviceguard clusters, package control scripts activate storage groups. Two volume managers can be used with Serviceguard: the standard Logical Volume Manager (LVM) of HP-UX and the Veritas Volume Manager (VxVM). SGeSAP can be used with both volume managers. The following steps describe two standard setups for the LVM volume manager. VxVM setups can be configured accordingly. A third storage layout option describes a Cluster File System configuration for SGeSAP.In this case, VxVM must be used and all Application Servers need to run on cluster nodes. Chapter three explores the concepts and details the implementation steps discussed in this chapter.

Database storage layouts for usage with parallel databases are only briefly described for Oracle Real Application Clusters. Detailed configuration steps for parallel database technologies are not covered in this manual. Additional information about SGeSAP and parallel databases is being released as whitepapers from HP. Refer to the Additional Reading section of the relevant SGeSAP release notes to verify the availability of whitepapers in this area.

This chapter discusses disk layout for clustered SAP components and database components of several vendors on a conception level. It is divided into two main sections:

SAP Instance Storage Considerations

Database Instance Storage Considerations

SAP Instance Storage Considerations

In general, it is important to stay as close as possible to the original layout intended by SAP. But certain cluster specific considerations might suggest a slightly different approach in some cases. SGeSAP supports various combinations of providing shared access to file systems in the cluster. The possible storage layout and file system configuration options include:

Each filesystem that gets added by the SAP installation routines needs to be classified and a decision has to be made.

Refer to table 2-1 for more information.

Table 2-1 Option descriptions

Option:

Description

1 - SGeSAP NFS Cluster

optimized to provide maximum flexibility. Following the recommendations given below allows

 

for expansion of existing clusters without limitations caused by the cluster. Another important

 

design goal of SGeSAP option 1 is, that a redesign of the storage layout is not imperative when

 

adding additional SAP components later on. Effective change management is an important aspect

 

for production environments. The disk layout needs to be as flexible as possible to allow growth

 

to be done by just adding storage for newly added components. If the design is planned carefully

 

at the beginning, it is not required to make changes to already existing file systems. Option 1 is

 

recommended for environments that implement clusters with server consolidation if CFS is not

 

available.

2 - SGeSAP NFS Idle Standby

optimized to provide maximum simplicity. The option is only feasible for very simple clusters. It

Cluster

needs to be foreseeable that their layout and configuration won't change over time. It comes

 

with the disadvantage of being locked into restricted configurations with a single SAP System

 

and idle standby nodes. HP recommends option 1 in case of uncertainty about potential future

 

layout changes.

3 - SGeSAP CFS Cluster

combines maximum flexibility with the convenience of a Cluster File System. It is the most advanced

 

option. CFS should be used with SAP if available. The HP Serviceguard Cluster File System

 

requires a set of multi-node packages. The number of packages varies with the number of disk

 

groups and mountpoints for Cluster File Systems. This can be a limiting factor for highly

 

consolidated SGeSAP environments.

Each filesystem that gets added to a system by SAP installation routines needs to be classified and a decision has to be made:

SAP Instance Storage Considerations 21

Image 21
Contents Managing Serviceguard Extension for SAP Version B.05.00 Page Table of Contents SGeSAP Cluster Administration 137 SAP Supply Chain ManagementSAP Master Data Management MDM 111 List of Figures Page List of Tables Page About this Manual Printing HistoryINSTNR, INR Related DocumentationGeneral Concepts of SGeSAP Designing SGeSAP Cluster ScenariosMutual Failover Scenarios Using the Two Package Concept Mutual Failover Scenarios Using the Two Package Concept Robust Failover Using the One Package Concept Follow-and-Push Clusters with Replicated Enqueue Applications/sap/enqor/SID ersINSTNR Replicated Enqueue Clustering for Abap and Java InstancesDedicated NFS Packages Handling of Redundant Dialog Instances Dedicated Failover Host Replicated Enqueue Clustering for Abap and Java Instances SAP Instance Storage Considerations Planning the Storage LayoutCommon Directories that are Kept Local Option 1 SGeSAP NFS ClusterDirectories that Reside on Shared Disks Option 2 SGeSAP NFS Idle Standby Cluster System and Environment Specific Volume GroupsOption 3 SGeSAP CFS Cluster Directories that Reside on CFS Database Instance Storage ConsiderationsOracle Single Instance Rdbms $ORACLEHOME/common/nls/admin/dataFile System Layout for NFS-based Oracle Clusters Oracle Real Application ClustersMaxdb Storage Considerations Globals IndepData=/sapdb/data IndepPrograms=/sapdb/programs Sapnfs Planning the Storage Layout Pgname = pkgtypeINSTNRSID Step-by-Step Cluster ConversionStep-by-Step Cluster Conversion SAP Pre-Installation Considerations SAP PreparationSAP Netweaver High Availability Cmmakepkg -m sgesap/db -m sgesap/ci Cmmakepkg -m sgesap/sapinstance -m ... /sap.configCmmakepkg -m sgesap/db Cmmakepkg -m sgesap/ci Cmmakepkg -m sgesap/scs Cmmakepkg -m sgesap/ersPage Replicated Enqueue Conversion SAPINSTMASTERDVD/IMXOS/SAPINST/UNIX/OSSplitting an Abap Central Instance Volume group needs to be created for the Ascs instanceCreate a new mountpoint Su sidadm Mkdir /usr/sap/SID/ASCSINSTNRSapsystemname =SID If the used SAP kernel has a release older thanInstancename =ASCSINSTNR SAPSYSTEM=INSTNR2SAPLOCALHOST=DRELOC Volume group needs to be created for the ERS instance Creation of Replication InstanceSu sidadm Mkdir /usr/sap/SID/ERSINSTNR Sapstartsrv Sapcontrol Servicehttp Mkdir -p exe/servicehttp/sapmcPF = $DIRPROFILE/SIDERSINSTNRAREPRELOC Scsid = INRHP-UX Configuration Directory Structure Configuration Cluster Filesystem ConfigurationLs -d /usr/sap/???/*INSTNR Installation Step IS049 Mkdir /usr/sap/SID.new Non-CFS Directory Structure ConversionMaxdb Database Step SD040 Filename localcopy checkexist Installation Step IS050Open the password file, /etc/passwd, on the primary side Cluster Node SynchronizationOpen the groupfile, /etc/group, on the primary side Copy the sidadm home directory to the backup nodes Look at the service file, /etc/services, on the primary sideSTARTPROFILE=STARTDVEBMGSINRsecondary STARTPROFILE=STARTDVEBMGSINRprimarySu orasid Mkdir -p /oracle/SID Exit Su sqddbsid Mkdir -p /sapdb/DBSIDCluster Node Configuration Mkdir /dev/vgdbSIDmknod /dev/vgdbSID/group c 64Mkdir -p /usr/sap/tmp Ssh-keygen -t dsa Swlist grep sshIddsa Iddsa.pub Ssh hostN date Ssh -l sidadm hostN dateConfigure /etc/nsswitch.conf to avoid problems External Application Server Host ConfigurationHosts filesNOTFOUND=continue UNAVAIL=continue TRYAGAIN=ns Set -uModular Package Configuration DB=ORACLEDBRELOC=0.0.0.0 Sapsystem C11 Modular Package Configuration Step-by-Step Cluster Conversion Example entries for the package configuration file Sapextinstance DVEBMGS10 Sapextsystem QAS Sbin/init.d/sapinit referenced by /sbin/rc3.d/S###sapinit Cmapplyconf -P ./sap.config Serviceguard Configuration Legacy Package ConfigurationCreated configuration files need to be edited Mkdir -p /etc/cmcluster/SIDServicefailfastenabled YES Servicehalttimeout Servicename ciC11msServicename ciC11disp Touch /etc/cmcluster/SID/debugApplications/sap/enqor/SIDersinstnr Resourcename /applications/sap/enqor/C11ascsENQORSCSPKGNAMEC11=foobar ENQORREPPKGNAMEC11=foorep SGeSAP Configuration Specification of the Packaged SAP ComponentsDistribute the package setup to all failover nodes NFSRELOC=0.0.0.0 AREPNAME=ERS AREPNR=01 AREPRELOC=0.0.0.0 CINAME=DVEBMGS CINR=00DNAME0=D DNAME1=DJCINAME=SCS JCINR=01 Configuration of Application Server HandlingJCIRELOC=0.0.0.0 REPNAME=ERS REPNR=00Page Restart Stop Start $STARTWITHPKG, $STOPWITHPKG, $RESTARTDURINGFAILOVERASTREAT0=$RESTARTDURINGFAILOVER ASPLATFORM0=SG-PACKAGE ASPSTART=1WAITOWNAS=1 Optional Parameters and Customizable Functions WAITOWNAS=2WAITOWNAS=0 SAPROUTERSTART0=1 SAPROUTERPORT0=-S3299 RFCADAPTERSTART=1RFCADAPTERCMD=runadapter.sh Global Defaults SAPCCMSRSTART=1SAPSTARTSRVSTART=1 SAPSTARTSRVSTOP=1 Legacy Package Configuration EXEDIR= /usr/sap/SID/SYS/exe/runU HA NFS Toolkit ConfigurationJMSSERVBASE=3600 Packagename sapnfsHANFSSCRIPTEXTENSION=pkgtype Auto FS ConfigurationExport/sapmnt/SID Export/usr/sap/trans Sapmnt/SID Usr/sap/transAUTOMOUNTDOPTIONS= -L AUTOFS=1 AUTOMASTER=/etc/automaster AUTOMOUNTOPTIONS=-f $AUTOMASTERAUTOMASTER=/etc/automaster AUTOOPTIONS=-f $AUTOMASTER NFSCLIENT=1 NFSSERVER=1 NUMNFSD=4 NUMNFSIOD=4Database Configuration Additional Steps for Oracle Perform the following step as sidadmPerform the following steps as orasid Lsnrctl start LISTENERSID1/2 If you use more than one SAP system inside of your clusterAdditional Steps for Maxdb Additional steps for Oracle 9i RdbmsAdditional steps for Oracle 10g Rdbms SAP Application Server Configuration Cdpro SAP Abap Engine specific configuration stepsRdisp/enqname = relocciSIDinstnr Sapmnt/SID/profile/SIDINSTNAMEINRSaplocalhostsidinstnr SID/dbhost = relocdbBatch jobs can be scheduled to run on a particular instance SAP J2EE Engine specific installation steps Rdisp/starticman=TRUEIcm/hostnamefull=relocatibleip Jdbc/pool/SID/Url jdbcoraclethin@relocdb1527SID Admin/host/SID relocdbPage SAP Supply Chain Management More About Hot Standby Option 1 Simple Clusters with Separated Packages Planning the Volume Manager SetupOption 3 Full Flexibility Option 2 Non-MAXDB EnvironmentsOption 4 Hot Standby liveCache Maxdb Storage ConsiderationsLiveCache Installation Step LC010 Synchronize the /etc/group and /etc/passwd files HP-UX Setup for Options 1, 2Copy file /etc/opt/sdb to the second cluster node Do the following to continueMkdir /sapdb Mkdir -p /sapdb/data Mkdir /sapdb/LCSIDIf you use DNS HP-UX Setup for OptionHosts filesNOTFOUND=continue UNAVAIL=continue \ TRYAGAIN=ns HORCCMRCF=1 HORCMINST=0SGeSAP Modular Package Configuration Cmmakepkg -m sgesap/livecache lcLCSID.configPackagename lcLCSID SGeSAP Modular Package Configuration Create standard package control and configuration files SGeSAP Legacy Package ConfigurationCp /opt/cmcluster/sap/*.functions /etc/cmcluster Packagetype FailoverLCPRIMARYROLE=primarynode LCSECONDARYROLE=secondarynode Cold Admin Warm OnlineLCCOPYMECHANISM=BUSINESSCOPY Livecache Service MonitoringAVOIDWWIDCHECK=1 LCSTANDBYRESTART=1APO Setup Changes Su lcsidadm Dbmcli -ux SAPLCSID,password -ul Mv .XUSER.62 .XUSER.62.ORG Default key# dbmcli on hostname Lcsid quit General Serviceguard Setup Changes For optionSapdb/programsrelocsapnfss/export/sapdb/programs Last step is to reconfigure the cluster with cmapplyconf1m Master Data Management User Interface Components Master Data Management OverviewSAP Netweaver XI components MDM Server ComponentsPrerequisites Installation and Configuration ConsiderationsMDM SGeSAP File System Layout Oracle/MDMSingle MDM Serviceguard Package ONE Single or Multiple MDM Serviceguard Package ConfigurationsMultiple MDM Serviceguard packages FOUR+ONE Opt/MDMRun ioscan and insf to probe/install new disk devices Mkdir -p /oracle/MDMMkdir -p /export/home/mdmuser Mkdir -p /home/mdmuser Mkdir -p /opt/MDM Installation and Configuration Considerations Haltscripttimeout Notimeout Runscripttimeout NotimeoutNodename Runscript /etc/cmcluster/MDMNFS/mdmNFS.control.scriptScp -rp /etc/cmcluster/MDMNFS clunode2/etc/cmcluster/MDMNFS Scp -p /etc/auto.direct clunode2/etc/auto.directSbin/init.d/nfs.client stop Sbin/init.d/nfs.client start Runscript /etc/cmcluster/MDM/mgroupMDM.control.script Haltscript /etc/cmcluster/MDM/mgroupMDM.control.scriptRunscript /etc/cmcluster/MDM/mdbMDM.control.script Haltscript /etc/cmcluster/MDM/mdbMDM.control.script Runscript /etc/cmcluster/MDM/mdsMDM.control.scriptHaltscript /etc/cmcluster/MDM/mdsMDM.control.script Haltscript /etc/cmcluster/MDM/mdisMDM.control.script Runscript /etc/cmcluster/MDM/mdisMDM.control.scriptRunscript /etc/cmcluster/MDM/mdssMDM.control.script Haltscript /etc/cmcluster/MDM/mdssMDM.control.scriptRunscript /etc/cmcluster/MDM/masterMDM.control.script Haltscript /etc/cmcluster/MDM/masterMDM.control.scriptSsh -X clunode1 -l oramdm KITS/ora9208/Disk1/runInstller Specify File Locations SidmdmSetup Step MDM218 SAP Master Data Management MDM MDM = Description = Addresslist = Connectdata = Server = Dedicated Servicename = MDM Listener = Descriptionlist = Description = Addresslist =Sidlistlistener = Sidlist = Siddesc = Globaldbname = MDM Installation and Configuration Considerations Create a /home/mdmuser/mdss directory Global SAP Master Data Management MDM Single Serviceguard package configure sap.config MDMLISTENERNAME=LISTENERMDMUSER=mdmuser MDMMDSRELOC=172.16.11.96 MDMPASSWORD= MDMREPOSITORYSPEC=MDMMONITORINTERVAL=60 MDMMGROUPDEPEND=mdb mds mdis mdssVi /etc/cmcluster/MDM/mdsMDM.config Servicename mdsMDMmon Servicefailfastenabled no ServicehalttimeoutCmapplyconf -P /etc/cmcluster/MDM/mdsMDM.config Cmrunpkg mgroupMDM Cmhaltpkg mgroupMDMCmrunpkg masterMDM Cmhaltpkg masterMDM System Level Changes Change ManagementSGeSAP Cluster Administration SAP Software Changes Mixed Clusters Upgrading SAP SoftwareSwlist -l bundle T2357BA T2803BA Swlist -l bundle B7885BA T2803BACd /sapmnt/SID Mkdir exeipf Cd /sapmnt/SID Mv exe exepaCd /sapmnt/SID Ln -s /sapmnt/SIDexelocal exe Cd /sapmnt Ln -s /sapmnt/SID/exepa /sapmnt/SIDexelocal
Related manuals
Manual 35 pages 22.06 Kb