Sample UNIX installation directories
|
|
|
|
|
| LSF_TOP |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||
|
|
|
| 1 |
|
|
|
|
| 2 |
|
| 3 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||
| conf |
| work |
| log |
|
| version |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||||||||||||||||
|
|
|
|
| 5 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||
|
| lsbatch |
| cluster_name |
|
|
|
|
|
|
|
| 6 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||
|
|
|
|
|
|
|
|
|
|
|
|
| logdir |
|
|
|
|
|
|
| man |
|
|
|
|
|
|
|
|
|
| 7 |
| |||||||||||
|
|
|
| cluster_name |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||
|
|
|
|
|
|
|
|
|
|
|
|
|
| lsb.event.lock |
| include 8 |
|
|
|
|
|
|
|
|
|
|
|
| .. | 7 | ||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| . |
|
| ||||||
|
|
|
| configdir |
|
|
|
|
|
|
| info |
|
|
|
|
|
|
|
| lsf |
|
|
|
|
|
|
|
|
| 9 |
|
| 10 |
| 11 |
| |||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||||||||
|
|
|
| lsb.hosts |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| bin | etc | lib |
| |||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| lsbatch.h |
| |||||||||||||||||||||||||
|
|
|
| lsb.params |
|
| lsf_indir |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| lsf.h |
|
|
|
| badmin |
| lim | locale |
| |||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||||||||||||||||
|
|
|
| lsb.queues |
|
| lsf_cmdir |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| bjobs |
| res |
| ||||||||||||||||
|
|
|
| … |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| lsadmin |
| sbatchd |
|
|
|
|
| ||||
|
| license.dat |
|
|
|
|
|
|
|
|
|
|
| misc |
| 12 |
|
|
|
|
|
| … |
|
|
| … | uid |
|
| ||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||||
|
| lsf.cluster.cluster_name |
|
|
|
|
| conf_tmpl |
|
|
|
|
|
|
|
| ckpt_crt0.o |
| ||||||||||||||||||||||||||
|
| lsf.conf |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| libampi.a |
| ||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||||||||
|
| lsf.shared |
|
|
|
|
|
|
|
|
|
|
|
| examples |
|
|
|
|
|
|
|
| … |
| |||||||||||||||||||
|
| lsf.task |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||||
|
| profile.lsf |
|
|
|
|
|
|
|
|
|
|
|
|
| make.def | 1 | LSF_CONFDIR = LSF_ENVDIR |
| |||||||||||||||||||||||||
|
| cshrc.lsf |
|
|
|
|
|
|
|
|
|
|
|
|
| make.misc |
| |||||||||||||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 | LSB_SHAREDIR |
|
|
|
|
| |||||||||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| … |
|
|
|
|
|
|
|
|
| ||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| install |
|
|
|
|
|
| 3 | LSF_LOGDIR |
|
|
|
|
| |||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 | LSF_VERSION |
|
|
|
|
| |||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| instlib |
|
|
|
| 5 | LSB_CONFDIR |
|
|
|
|
| ||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 | LSF_MANDIR |
|
|
|
|
| |||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| scripts |
|
|
|
| 7 |
| |||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| lsfinstall |
|
|
|
| 8 | LSF_INCLUDEDIR |
|
|
|
|
| |||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 | LSF_BINDIR |
|
|
|
|
| ||||||||||||
| Key |
|
|
|
|
|
|
|
|
|
|
|
| hostsetup |
|
|
|
|
| |||||||||||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| LSF_SERVERDIR |
|
|
|
|
| ||||||||||||||||||||||||
|
|
| directories |
|
|
|
|
|
|
|
|
|
|
|
| ... |
|
|
|
|
|
|
|
|
| 10 |
|
|
|
|
| |||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 | LSF_LIBDIR |
|
|
|
|
| ||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||||||
|
|
| files |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 | LSF_MISC |
|
|
|
|
| |||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Daemon error log files
Daemon error log files are stored in the directory defined by LSF_LOGDIR in lsf.conf.
LSF base system daemon log files | LSF batch system daemon log files |
lim.log.hostname | mbatchd.log.hostname |
|
|
res.log.hostname | sbatchd.log.hostname |
pim.log.hostname | mbschd.log.hostname |
Configuration files
lsf.conf, lsf.shared, and lsf.cluster.cluster_name are located in LSF_CONFDIR.
lsb.params, lsb.queues, lsb.modules, and lsb.resources are located in LSB_CONFDIR/ cluster_name/configdir/.
File | Description |
install.config | Options for Platform LSF installation and configuration |
|
|
lsf.conf | Generic environment configuration file describing the |
| configuration and operation of the cluster |
lsf.shared | Definition file shared by all clusters. Used to define cluster |
| name, host types, host models and |
lsf.cluster.cluster_name Cluster configuration files used to define hosts, administrators, and locality of
lsf.licensescheduler | Configures Platform LSF License Scheduler |
lsb.params | Configures LSF batch parameters |
lsb.queues | Batch queue configuration file |
|
|
File | Description |
lsb.modules | Configures LSF scheduler and resource broker plugin |
| modules |
lsb.resources | Configures resource allocation limits, exports, and resource |
| usage limits |
|
|
lsb.serviceclasses | Defines |
| service classes, which define the properties of the SLA |
lsb.users | Configures user groups, hierarchical fairshare for users and |
| user groups, and job slot limits for users and user groups |
| |
Cluster configuration parameters (lsf.conf) |
Variable | Description | UNIX Default |
LSF_TOP | /usr/local/lsf | |
| be accessible from all hosts in the cluster |
|
|
|
|
LSF_BINDIR | Directory containing LSF user commands, | LSF_TOP/version/ |
| shared by all hosts of the same type | platform/bin |
LSF_CONFDIR | Directory for all LSF configuration files | LSF_TOP/conf |
|
|
|
LSF_ENVDIR | Directory containing the lsf.conf file, must | /etc (if LSF_CONFDIR |
| be owned by root | is not defined) |
LSF_INCLUDEDIR Directory containing LSF API header files | LSF_TOP/version/ | |
| lsf.h and lsbatch.h | include |
|
|
|
LSF_LIBDIR | LSF libraries, shared by all hosts of the | LSF_TOP/version/ |
| same type | platform/lib |
LSF_LOGDIR | (Optional) Directory for LSF daemon logs, | /tmp |
| must be owned by root |
|
|
|
|
LSF_LOG_MASK | Specifies the logging level of error | LOG_WARNING |
| messages from LSF commands |
|
LSF_MANDIR | Directory containing LSF man pages | LSF_TOP/version/man |
|
|
|
LSF_MISC | Help files for the LSF GUI tools, sample C | LSF_TOP/version/ |
| programs and shell scripts, and a template | misc |
| for an external LIM (elim) |
|
LSF_SERVERDIR | Directory for all server binaries and shell | LSF_TOP/version/ |
| scripts, and external executables invoked | platform/etc |
| by LSF daemons, must be owned by root, |
|
| and shared by all hosts of the same type |
|
|
|
|
LSB_CONFDIR | Directory for LSF Batch configuration | LSF_CONFDIR/ |
| directories, containing user and host lists, | lsbatch |
| operation parameters, and batch queues |
|
LSB_SHAREDIR | Directory for LSF Batch job history and | LSF_TOP/work |
| accounting log files for each cluster, must |
|
| be owned by primary LSF administrator |
|
|
|
|
LSF_LIM_PORT | TCP service port used for communication | 6879 |
| with lim |
|
LSF_RES_PORT | TCP service port used for communication | 6878 |
| with res |
|
|
|
|
LSB_MBD_PORT | TCP service port used for communication | 6881 |
| with mbatchd |
|
LSB_SBD_PORT | TCP service port used for communication | 6882 |
| with sbatchd |
|
|
|
|
P l a t f o r m L S F®
Q u i c k R e f e r e n c e
Version 6.2
Administration and accounting commands
Only LSF administrators or root can use these commands.
Command | Description |
lsacct | Displays accounting statistics on finished RES tasks in the LSF system |
|
|
lsadmin | LSF administrative tool to control the operation of the LIM and RES |
| daemons in an LSF cluster. lsadmin help shows all subcommands. |
lsfinstall | Install LSF using install.config input file |
|
|
lsfrestart | Restart the LSF daemons on all hosts in the local cluster |
lsfshutdown | Shut down the LSF daemons on all hosts in the local cluster |
|
|
lsfstartup | Start the LSF daemons on all hosts in the local cluster |
bacct | Reports accounting statistics on completed LSF jobs |
|
|
badmin | LSF administrative tool to control the operation of the LSF Batch |
| system including sbatchd, mbatchd, hosts and queues. badmin help |
| shows all subcommands. |
bladmin | reconfigures the Platform LSF License Scheduler daemon (bld) |
|
|
brun | Forces LSF to run a submitted, pending job immediately on a specified |
| host |
brsvadd | Creates an advance reservation |
|
|
brsvdel | Deletes an advance reservation |
|
|
Daemons
Executable Name | Description |
lim | Load Information Manager |
| information about all server hosts in the cluster and provides host |
| selection services to applications through LSLIB. LIM maintains |
| information on static system resources and dynamic load indices. |
|
|
mbatchd | Master Batch Daemon |
| MBD periodically checks load indices on all server hosts by |
| contacting the Master LIM. |
mbschd | Master Batch Scheduler Daemon— performs the scheduling |
| functions of LSF and sends job scheduling decisions to MBD for |
| dispatch. Runs on the LSF master server host. |
|
|
sbatchd | Slave Batch Daemon |
| from MBD, and monitors the progress of jobs. Controls job |
| execution, enforces batch policies, reports job status to MBD, and |
| launches MBD. |
pim | Process Information Manager |
| by submitted jobs while they are running. PIM is used to enforce |
| resource limits and load thresholds, and for fairshare scheduling. |
|
|
res | Remote Execution Server |
| requests from all load sharing applications and handles I/O on the |
| remote host for load sharing processes. |
|
|