8.8 The mpirun Command Options

HP-MPI on the HP XC system provides the following additional mpirun command line options:

-srun

-subnet

-elan,-ELAN,-gm,-GM,

-itapi,

-ITAPI

The -srunoption is required in mpirun command in the HP XC environment. The preferred method for startup for HP XC is:

mpirun mpirun options -srunsrun options

Starting up directly from srun is not supported. In this context, mpirun sets a few environment variables and invokes /opt/hptc/bin/srun. Any arguments on the mpirun command line that follow -srunare passed down to the srun command.

This release supports the -subnetoption that allows you to select which default system interconnect should be used for communication for TCP/IP. The system interconnect is chosen by using the subnet associated with the hostname or IP address specified with the -subnetoption.

mpirun -subnethostname-or-IP-address

The hostname-or-IP-addressoperand is a hostname or IP address that resolves to a real IP address.

These options are provided for explicit command line system interconnect selection. The lower case option is taken as advisory and means use the system interconnect if it is available. The upper case option is taken as mandatory and instructs MPI to abort if the system interconnect is unavailable. The interaction between these options and the related MPI_IC_ORDER variable is that any command line system interconnect selection here is implicitly prepended to

MPI_IC_ORDER.

-TCP

-dd

-ndd

If both Quadrics and Gigabit Ethernet are installed, Elan4 is the default. In order to use Gigabit Ethernet, add -TCPand verify that hostname -ipreturns the subnet of the Gigabit Ethernet private network. For example:

$ mpirun -TCP -srun -N8 ./a.out

Use deferred deregistration when registering and deregistering memory for RDMA message transfers. The default is to use deferred deregistration. However, using this option also produces a statistical summary of the deferred deregistration activity when MPI_Finalize is called. The option is ignored if the underlying system interconnect does not use and RDMA transfer mechanism, or if the deferred deregistration is managed directly by the system interconnect library.

Do not use deferred deregistration when registering memory for RDMA message transfers. To enable deferred deregistration, the HP-MPI library must intercept calls allocated by libc memory allocation routines. In the rare case that these changes are incompatible with a particular application, this option can be used to disallow the use of deferred deregistration.

-T

This option prints user and system times for each MPI rank.

-prot

This option prints the communication protocol between each host (for example,

 

TCP/IP, Elan, or shared memory).

Using HP-MPI 8-9