8.2

HP-MPI Directory Structure .........................................................

8-2

8.3

Compiling and Running Applications ...............................................

8-2

8.3.1

Setting Environment Variables .................................................

8-2

8.3.2

Building and Running an Example Application ..............................

8-2

8.3.2.1

Example Application hello_world ...................................

8-3

8.3.2.2

Building and Running hello_world ..................................

8-3

8.3.3

Using srun with HP-MPI ......................................................

8-4

8.3.3.1

Launching MPI Jobs .......................................................

8-4

8.3.3.2

Creating Subshells and Launching Jobsteps ..............................

8-5

8.3.3.3

System Interconnect Selection ............................................

8-5

8.3.4

Using LSF and HP-MPI .........................................................

8-6

8.3.5

MPI Versioning ..................................................................

8-7

8.4

System Interconnect Support ........................................................

8-7

8.4.1

HP-MPI Performance on HP XC with Multiple System Interconnects .....

8-7

8.4.2

Global Environment Variable Settings on the mpirun Command Line ...

8-8

8.5

32-Bit Builds on XC4000 ............................................................

8-8

8.6

Truncated Messages ..................................................................

8-8

8.7

Allowing Windows to Use Exclusive Locks .......................................

8-8

8.8

The mpirun Command Options ....................................................

8-9

8.9

Environment Variables ...............................................................

8-10

8.9.1

MPIRUN_OPTIONS ............................................................

8-10

8.9.2

MPIRUN_SYSTEM_OPTIONS ...............................................

8-10

8.9.3

MPI_IC_ORDER ................................................................

8-10

8.9.4

MPI_PHYSICAL_MEMORY ..................................................

8-10

8.9.5

MPI_PIN_PERCENTAGE .....................................................

8-11

8.9.6

MPI_PAGE_ALIGN_MEM ....................................................

8-11

8.9.7

MPI_MAX_WINDOW .........................................................

8-11

8.9.8

MPI_ELANLOCK ..............................................................

8-11

8.9.9

MPI_USE_LIBELAN ...........................................................

8-11

8.9.10

MPI_USE_LIBELAN_SUB ....................................................

8-12

8.10

MPICH Object Compatibility ........................................................

8-12

8.11 HP-MPI Documentation and Manpages ............................................

8-13

8.12 Additional Information, Known Problems, and Work-arounds ...................

8-14

9 Using HP MLIB

9.1

Overview ..............................................................................

9-1

9.1.1

Intel Compiler Notes ............................................................

9-1

9.1.2

MLIB and Module Files .........................................................

9-2

9.2

HP MLIB for the HP XC6000 Platform ............................................

9-2

9.2.1

Platform Support .................................................................

9-2

9.2.2

Library Support ..................................................................

9-2

9.2.3

MPI Parallelism ..................................................................

9-2

9.2.4

Modulefiles and MLIB ..........................................................

9-3

9.2.5

Using Intel Compilers with HP MLIB .........................................

9-3

9.2.6

Compiling and Linking ..........................................................

9-3

9.2.6.1

Linking VECLIB ...........................................................

9-3

9.2.6.2

Linking LAPACK ..........................................................

9-3

9.2.6.3

Linking ScaLAPACK ......................................................

9-3

9.2.6.4

Linking SuperLU_DIST ...................................................

9-4

9.2.7

Licensing .........................................................................

9-4

9.2.8

MLIB Manpages .................................................................

9-4

9.3

HP MLIB for the HP XC4000 Platform ............................................

9-4

Contents vii