Refer to the LSF bsub command manpage for additional information about using the external scheduler (-ext) option. See the srun manpage for more details about the above options and their arguments.

Consider an HP XC system configuration in which lsfhost.localdomain is the LSF execution host and nodes n[1-10]are compute nodes in the lsf partition. All nodes contain two cores, providing 20 cores for use by LSF-HPC jobs.

Example 9-1shows one way to submit a parallel job to run on a specific node or nodes.

Example 9-1 Using the External Scheduler to Submit a Job to Run on Specific Nodes

$ bsub -n4 -ext "SLURM[nodelist=n6,n8]" -I srun hostname Job <70> is submitted to default queue <normal>. <<Waiting for dispatch ...>>

<<Starting on lsfhost.localdomain>> n6

n6

n8

n8

In the previous example, the job output shows that the job was launched from the LSF execution host lsfhost.localdomain, and it ran on four cores on the specified nodes, n6 and n8.

Example 9-2shows one way to submit a parallel job to run one task per node.

Example 9-2 Using the External Scheduler to Submit a Job to Run One Task per Node

$ bsub -n4 -ext "SLURM[nodes=4]" -I srun hostname Job <71> is submitted to default queue <normal>. <<Waiting for dispatch ...>>

<<Starting on lsfhost.localdomain>> n1

n2

n3

n4

In the previous example, the job output shows that the job was launched from the LSF execution host lsfhost.localdomain, and it ran on four cores on four different nodes (one task per node).

Example 9-3shows one way to submit a parallel job to avoid running on a particular node.

Example 9-3 Using the External Scheduler to Submit a Job That Excludes One or More Nodes

$ bsub -n4 -ext "SLURM[nodes=4; exclude=n3]" -I srun hostname Job <72> is submitted to default queue <normal>.

<<Waiting for dispatch ...>> <<Starting on lsfhost.localdomain>> n1

n2

n4

n5

This example runs the job exactly the same as in Example 9-2, “Using the External Scheduler to Submit a Job to Run One Task per Node”, but additionally requests that node n3 is not to be used to run the job. Note that this command could have been written to exclude additional nodes.

Submitting a Job from a Non-HP XC Host

To submit a job from a non-HP XC host to the HP XC system, use the LSF -Roption, and the HP XC host type SLINUX64 (defined in lsf.shared) in the job submission resource requirement string. The necessary resource requirement string to submit a job from a non-HP XC host is specified as follows:

-R "type=SLINUX64"

The following example shows this resource requirement string in an LSF command:

$ bsub -R "type=SLINUX64" -n4 -I srun hostname

Using LSF-HPC 79

Page 79
Image 79
HP XC System 3.x Software manual Submitting a Job from a Non-HP XC Host, Starting on lsfhost.localdomain n6, Type=SLINUX64