HP Serviceguard Extension for SAP (SGeSAP) manual SGeSAP Cluster Administration

Page 138

needed. Servers outside of the cluster that have External Dialog Instances installed are set up in a similar way. Refer to /etc/auto.direct for a full list of automounter file systems of SGeSAP.

It enhances the security of the installation if the directories below /export are exported without root permissions. The effect is, that the root user cannot modify these directories or their contents. With standard permissions set, the root user cannot even see the files. If changes need to be done as root, the equivalent directory below /export on the host the package runs on can be used as access point.

If the system is badly configured, it might be possible that the system hangs if a logon is attempted as <sid>adm user. The reason for this is, that /usr/sap/<SID>/SYS/exe is part of the path of <sid>adm. Without local binaries this directory links to /sapmnt/<SID> which in fact is handled by the automounter. The automounter cannot contact the host belonging to the relocatable address that is configured because the package is down. The system hangs. To avoid this, always keep local copies of the executables.

NOTE: If the database package with HA NFS services is halted, you cannot log in as <sid>adm unless you keep a local copy of the SAP binaries using sapcpe.

Figure 6-1 SGeSAP cluster displayed in the HP System Management Homepage

To allow proper troubleshooting there is a verbose package startup log in the package directory. It should be checked first in case of trouble. The level of information can be adjusted by changing the parameter LOGLEVEL in the sap.config file. If problems with package startup remain, a general debug mode can be activated by creating a file:

touch /var/adm/cmcluster/debug - debug mode for all modular SGeSAP package

touch /var/adm/cmcluster/debug<packagename> - debug mode for the SGeSAP modules of package <packagename>

touch /etc/cmcluster/debug - debug mode for all legacy SGeSAP packages

touch /etc/cmcluster/<SID>/debug - debug mode for the SGeSAP legacy SGeSAP packages of SAP system<SID>

The whole SGeSAP node will now be in debug mode. If the file is created in the package directory /etc/cmcluster/<SID>, it will only turn on the debug mode for packages in that directory.

The debug mode allows package start up to the level of SAP specific steps. All instance startup attempts will be skipped. Service monitors will be started, but they don't report failures as long as the debug mode is turned on.

In this mode it is possible to attempt manual startups of the database and/or SAP software. All rules of manual troubleshooting of SAP instances apply now. It is possible to access the application work directories to have a look at the trace files. After removal of the error cause it is vital to remove the debug file that got created:

138 SGeSAP Cluster Administration

Image 138
Contents Managing Serviceguard Extension for SAP Version B.05.00 Page Table of Contents SGeSAP Cluster Administration 137 SAP Supply Chain ManagementSAP Master Data Management MDM 111 List of Figures Page List of Tables Page Printing History About this ManualRelated Documentation INSTNR, INRDesigning SGeSAP Cluster Scenarios General Concepts of SGeSAPMutual Failover Scenarios Using the Two Package Concept Mutual Failover Scenarios Using the Two Package Concept Robust Failover Using the One Package Concept Follow-and-Push Clusters with Replicated Enqueue Replicated Enqueue Clustering for Abap and Java Instances Applications/sap/enqor/SID ersINSTNRDedicated NFS Packages Handling of Redundant Dialog Instances Dedicated Failover Host Replicated Enqueue Clustering for Abap and Java Instances Planning the Storage Layout SAP Instance Storage ConsiderationsOption 1 SGeSAP NFS Cluster Common Directories that are Kept LocalDirectories that Reside on Shared Disks System and Environment Specific Volume Groups Option 2 SGeSAP NFS Idle Standby ClusterOption 3 SGeSAP CFS Cluster Database Instance Storage Considerations Directories that Reside on CFS$ORACLEHOME/common/nls/admin/data Oracle Single Instance RdbmsOracle Real Application Clusters File System Layout for NFS-based Oracle ClustersMaxdb Storage Considerations Globals IndepData=/sapdb/data IndepPrograms=/sapdb/programs Sapnfs Planning the Storage Layout Step-by-Step Cluster Conversion Pgname = pkgtypeINSTNRSIDStep-by-Step Cluster Conversion SAP Pre-Installation Considerations SAP PreparationSAP Netweaver High Availability Cmmakepkg -m sgesap/db Cmmakepkg -m sgesap/ci Cmmakepkg -m sgesap/sapinstance -m ... /sap.configCmmakepkg -m sgesap/db -m sgesap/ci Cmmakepkg -m sgesap/scs Cmmakepkg -m sgesap/ersPage SAPINSTMASTERDVD/IMXOS/SAPINST/UNIX/OS Replicated Enqueue ConversionCreate a new mountpoint Volume group needs to be created for the Ascs instanceSplitting an Abap Central Instance Su sidadm Mkdir /usr/sap/SID/ASCSINSTNRIf the used SAP kernel has a release older than Sapsystemname =SIDInstancename =ASCSINSTNR SAPSYSTEM=INSTNR2SAPLOCALHOST=DRELOC Volume group needs to be created for the ERS instance Creation of Replication InstanceSu sidadm Mkdir /usr/sap/SID/ERSINSTNR Mkdir -p exe/servicehttp/sapmc Sapstartsrv Sapcontrol ServicehttpScsid = INR PF = $DIRPROFILE/SIDERSINSTNRAREPRELOCHP-UX Configuration Directory Structure Configuration Cluster Filesystem ConfigurationLs -d /usr/sap/???/*INSTNR Installation Step IS049 Non-CFS Directory Structure Conversion Mkdir /usr/sap/SID.newMaxdb Database Step SD040 Installation Step IS050 Filename localcopy checkexistOpen the password file, /etc/passwd, on the primary side Cluster Node SynchronizationOpen the groupfile, /etc/group, on the primary side Look at the service file, /etc/services, on the primary side Copy the sidadm home directory to the backup nodesSu orasid Mkdir -p /oracle/SID Exit STARTPROFILE=STARTDVEBMGSINRprimarySTARTPROFILE=STARTDVEBMGSINRsecondary Su sqddbsid Mkdir -p /sapdb/DBSIDCluster Node Configuration Mkdir /dev/vgdbSIDmknod /dev/vgdbSID/group c 64Mkdir -p /usr/sap/tmp Iddsa Iddsa.pub Swlist grep sshSsh-keygen -t dsa Ssh hostN date Ssh -l sidadm hostN dateHosts filesNOTFOUND=continue UNAVAIL=continue TRYAGAIN=ns External Application Server Host ConfigurationConfigure /etc/nsswitch.conf to avoid problems Set -uModular Package Configuration DB=ORACLEDBRELOC=0.0.0.0 Sapsystem C11 Modular Package Configuration Step-by-Step Cluster Conversion Example entries for the package configuration file Sapextinstance DVEBMGS10 Sapextsystem QAS Sbin/init.d/sapinit referenced by /sbin/rc3.d/S###sapinit Cmapplyconf -P ./sap.config Created configuration files need to be edited Legacy Package ConfigurationServiceguard Configuration Mkdir -p /etc/cmcluster/SIDServicename ciC11disp Servicename ciC11msServicefailfastenabled YES Servicehalttimeout Touch /etc/cmcluster/SID/debugResourcename /applications/sap/enqor/C11ascs Applications/sap/enqor/SIDersinstnrENQORSCSPKGNAMEC11=foobar ENQORREPPKGNAMEC11=foorep SGeSAP Configuration Specification of the Packaged SAP ComponentsDistribute the package setup to all failover nodes NFSRELOC=0.0.0.0 DNAME0=D CINAME=DVEBMGS CINR=00AREPNAME=ERS AREPNR=01 AREPRELOC=0.0.0.0 DNAME1=DJCIRELOC=0.0.0.0 Configuration of Application Server HandlingJCINAME=SCS JCINR=01 REPNAME=ERS REPNR=00Page $STARTWITHPKG, $STOPWITHPKG, $RESTARTDURINGFAILOVER Restart Stop StartASTREAT0=$RESTARTDURINGFAILOVER ASPLATFORM0=SG-PACKAGE ASPSTART=1WAITOWNAS=1 Optional Parameters and Customizable Functions WAITOWNAS=2WAITOWNAS=0 SAPROUTERSTART0=1 SAPROUTERPORT0=-S3299 RFCADAPTERSTART=1RFCADAPTERCMD=runadapter.sh Global Defaults SAPCCMSRSTART=1SAPSTARTSRVSTART=1 SAPSTARTSRVSTOP=1 Legacy Package Configuration JMSSERVBASE=3600 HA NFS Toolkit ConfigurationEXEDIR= /usr/sap/SID/SYS/exe/runU Packagename sapnfsExport/sapmnt/SID Export/usr/sap/trans Auto FS ConfigurationHANFSSCRIPTEXTENSION=pkgtype Sapmnt/SID Usr/sap/transAUTOMASTER=/etc/automaster AUTOOPTIONS=-f $AUTOMASTER AUTOMASTER=/etc/automaster AUTOMOUNTOPTIONS=-f $AUTOMASTERAUTOMOUNTDOPTIONS= -L AUTOFS=1 NFSCLIENT=1 NFSSERVER=1 NUMNFSD=4 NUMNFSIOD=4Database Configuration Additional Steps for Oracle Perform the following step as sidadmPerform the following steps as orasid If you use more than one SAP system inside of your cluster Lsnrctl start LISTENERSID1/2Additional Steps for Maxdb Additional steps for Oracle 9i RdbmsAdditional steps for Oracle 10g Rdbms SAP Application Server Configuration Rdisp/enqname = relocciSIDinstnr SAP Abap Engine specific configuration stepsCdpro Sapmnt/SID/profile/SIDINSTNAMEINRSaplocalhostsidinstnr SID/dbhost = relocdbBatch jobs can be scheduled to run on a particular instance SAP J2EE Engine specific installation steps Rdisp/starticman=TRUEIcm/hostnamefull=relocatibleip Admin/host/SID relocdb Jdbc/pool/SID/Url jdbcoraclethin@relocdb1527SIDPage SAP Supply Chain Management More About Hot Standby Planning the Volume Manager Setup Option 1 Simple Clusters with Separated PackagesOption 2 Non-MAXDB Environments Option 3 Full FlexibilityMaxdb Storage Considerations Option 4 Hot Standby liveCacheLiveCache Installation Step LC010 HP-UX Setup for Options 1, 2 Synchronize the /etc/group and /etc/passwd filesMkdir /sapdb Do the following to continueCopy file /etc/opt/sdb to the second cluster node Mkdir -p /sapdb/data Mkdir /sapdb/LCSIDHosts filesNOTFOUND=continue UNAVAIL=continue \ TRYAGAIN=ns HP-UX Setup for OptionIf you use DNS HORCCMRCF=1 HORCMINST=0SGeSAP Modular Package Configuration Cmmakepkg -m sgesap/livecache lcLCSID.configPackagename lcLCSID SGeSAP Modular Package Configuration Cp /opt/cmcluster/sap/*.functions /etc/cmcluster SGeSAP Legacy Package ConfigurationCreate standard package control and configuration files Packagetype FailoverCold Admin Warm Online LCPRIMARYROLE=primarynode LCSECONDARYROLE=secondarynodeAVOIDWWIDCHECK=1 Livecache Service MonitoringLCCOPYMECHANISM=BUSINESSCOPY LCSTANDBYRESTART=1APO Setup Changes Su lcsidadm Dbmcli -ux SAPLCSID,password -ul Mv .XUSER.62 .XUSER.62.ORG Default key# dbmcli on hostname Lcsid quit General Serviceguard Setup Changes For optionSapdb/programsrelocsapnfss/export/sapdb/programs Last step is to reconfigure the cluster with cmapplyconf1m Master Data Management Overview Master Data Management User Interface ComponentsMDM Server Components SAP Netweaver XI componentsMDM SGeSAP File System Layout Installation and Configuration ConsiderationsPrerequisites Oracle/MDMMultiple MDM Serviceguard packages FOUR+ONE Single or Multiple MDM Serviceguard Package ConfigurationsSingle MDM Serviceguard Package ONE Opt/MDMRun ioscan and insf to probe/install new disk devices Mkdir -p /oracle/MDMMkdir -p /export/home/mdmuser Mkdir -p /home/mdmuser Mkdir -p /opt/MDM Installation and Configuration Considerations Nodename Runscripttimeout NotimeoutHaltscripttimeout Notimeout Runscript /etc/cmcluster/MDMNFS/mdmNFS.control.scriptScp -rp /etc/cmcluster/MDMNFS clunode2/etc/cmcluster/MDMNFS Scp -p /etc/auto.direct clunode2/etc/auto.directSbin/init.d/nfs.client stop Sbin/init.d/nfs.client start Runscript /etc/cmcluster/MDM/mgroupMDM.control.script Haltscript /etc/cmcluster/MDM/mgroupMDM.control.scriptRunscript /etc/cmcluster/MDM/mdbMDM.control.script Haltscript /etc/cmcluster/MDM/mdbMDM.control.script Runscript /etc/cmcluster/MDM/mdsMDM.control.scriptHaltscript /etc/cmcluster/MDM/mdsMDM.control.script Runscript /etc/cmcluster/MDM/mdssMDM.control.script Runscript /etc/cmcluster/MDM/mdisMDM.control.scriptHaltscript /etc/cmcluster/MDM/mdisMDM.control.script Haltscript /etc/cmcluster/MDM/mdssMDM.control.scriptRunscript /etc/cmcluster/MDM/masterMDM.control.script Haltscript /etc/cmcluster/MDM/masterMDM.control.scriptSsh -X clunode1 -l oramdm Sidmdm KITS/ora9208/Disk1/runInstller Specify File LocationsSetup Step MDM218 SAP Master Data Management MDM MDM = Description = Addresslist = Connectdata = Server = Dedicated Servicename = MDM Listener = Descriptionlist = Description = Addresslist =Sidlistlistener = Sidlist = Siddesc = Globaldbname = MDM Installation and Configuration Considerations Create a /home/mdmuser/mdss directory Global SAP Master Data Management MDM Single Serviceguard package configure sap.config MDMLISTENERNAME=LISTENERMDMUSER=mdmuser MDMMONITORINTERVAL=60 MDMPASSWORD= MDMREPOSITORYSPEC=MDMMDSRELOC=172.16.11.96 MDMMGROUPDEPEND=mdb mds mdis mdssCmapplyconf -P /etc/cmcluster/MDM/mdsMDM.config Servicefailfastenabled no ServicehalttimeoutVi /etc/cmcluster/MDM/mdsMDM.config Servicename mdsMDMmon Cmrunpkg mgroupMDM Cmhaltpkg mgroupMDMCmrunpkg masterMDM Cmhaltpkg masterMDM Change Management System Level ChangesSGeSAP Cluster Administration SAP Software Changes Swlist -l bundle T2357BA T2803BA Upgrading SAP SoftwareMixed Clusters Swlist -l bundle B7885BA T2803BACd /sapmnt/SID Ln -s /sapmnt/SIDexelocal exe Cd /sapmnt/SID Mv exe exepaCd /sapmnt/SID Mkdir exeipf Cd /sapmnt Ln -s /sapmnt/SID/exepa /sapmnt/SIDexelocal
Related manuals
Manual 35 pages 22.06 Kb