Whether it needs to be kept as a local copy on internal disks of each node of the cluster.

Whether it needs to be shared on a SAN storage device to allow failover and exclusive activation.

Whether it needs to provide shared access to more than one node of the cluster at the same time.

NOTE: SGeSAP packages and service monitors require SAP tools. Patching the SAP kernel sometimes also patches SAP tools. Depending on what SAP changed, this might introduce additional dependencies on shared libraries that weren't required before the patch. Depending on the SHLIB_PATH settings of the root user it might no longer be possible for SGeSAP to execute the SAP tools after applying the patch. The introduced additional libraries are not found. Creating local copies of the complete central executable directory prevents this issue.

The following sections detail the three different storage options.

Option 1: SGeSAP NFS Cluster

With this storage setup SGeSAP makes extensive use of exclusive volume group activation. Concurrent shared access is provided via NFS services. Automounter and cross-mounting concepts are used in order to allow each node of the cluster to switch roles between serving and using NFS shares. It is possible to access the NFS file systems from servers outside of the cluster, which is an intrinsic part of many SAP configurations.

Common Directories that are Kept Local

The following common directories and their files are kept local on each node of the cluster:

/home/<SID>adm — the home directory of the SAP system administrator with node specific startup log files

/usr/sap/<SID>/SYS/exe/run — the directory that holds a local copy of all SAP instance executables, libraries and tools (optional for kernel 7.x and higher)

/usr/sap/tmp — the directory in which the SAP operating system collector keeps monitoring data of the local operating system

/usr/sap/hostctrl — the directory in which SAP control services for the local host are kept (kernel 7.x and higher)

/etc/cmcluster — the directory in which Serviceguard keeps its legacy configuration files and the node specific package runtime directories

Depending on database vendor and version, it might in addition be required to keep local database client software. Details can be found in the database sections below.

Part of the content of the local group of directories must be synchronized manually between all nodes of the cluster. Serviceguard provides a tool cmcp(1m) that allows easy replication of a file to all cluster nodes.

SAP instance (startup) profile names contain either local hostnames or virtual hostnames. SGeSAP will always prefer profiles that use local hostnames to allow individual startup profiles for each host, which might be useful if the failover hardware differs in size.

In clustered SAP environments prior to 7.x releases it is required to install local executables. Local executables help to prevent several causes for package startup or package shutdown hangs due to the unavailability of the centralized executable directory. Availability of executables delivered with packaged SAP components is mandatory for proper package operation. Experience has shown that it is a good practice to create local copies for all files in the central executable directory. This includes shared libraries delivered by SAP.

NOTE: SGeSAP packages and service monitors require SAP tools. Patching the SAP kernel sometimes also patches SAP tools. Depending on what SAP changed, this might introduce additional dependencies on shared libraries that weren't required before the patch. Depending on the SHLIB_PATH settings of the root user it might no longer be possible for SGeSAP to execute the SAP tools after applying the patch. The introduced additional libraries are not found. Creating local copies of the complete central executable directory prevents this issue.

To automatically synchronize local copies of the executables, SAP components deliver the sapcpe mechanism. With every startup of the instance, sapcpe matches new executables stored centrally with those stored locally.

22 Planning the Storage Layout

Page 22
Image 22
HP Serviceguard Extension for SAP (SGeSAP) manual Option 1 SGeSAP NFS Cluster, Common Directories that are Kept Local