Escali 4.4 AbsRank MPIcallcommNamerankcall-dependant-parameters where, +relSecs S eTime where

Page 51

-t<call-list>

Enable for MPI_calls in <call-list>.

 

MPI_call = 'MPI_call' 'call'

-x<call-list>

Disable for MPI_calls in <call-list>.

 

MPI_call = 'MPI_call' 'call'

-f<format-list>

Define format: 'timing', 'arguments', 'rate'

-v

Verbose

-h

Print this list of options

By default only one line is written per MPI-call.

Calls may be specified with or without the "MPI_"-prefix, and in upper- or lower-case. The default format of the output has the following parts:

<absRank>: <MPIcall><commName>_<rank><call-dependant-parameters> where

<absRank>

is the rank within MPI_COMM_WORLD

<MPIcall>

is the name of the MPI-call

<commName>

is the name of the communicator

<rank>

is the rank within the communicator used

This format can be extended by using the "-f"-option. Adding "-f arguments" will provide some additional information concerning message length. If "-f timing" is given some timing information between the <absRank>and <MPIcall>-fields is provided.

The extra field has the following format:

+<relSecs> S <eTime> where

<relSecs>

is the elapsed time in seconds since returning to the application

 

from MPI_Init

<eTime>

is the elapsed execution time for the current call

"-f rate" will add some rate-related information. The rate is calculated by dividing the number of bytes transferred by the elapsed time to execute the call. All parameters to -f can be abbreviated and can occur in any mix.

Normally no error messages are provided concerning the options which have been selected. But if -verbose is added as a command-line option to mpimon, errors will be printed.

Trace provides information about which MPI routines were called and possibly information about parameters and timing.

Example using the test application:

%SCAMPI_TRACE="-p all" mpimon ./kollektive-8 ./uf256-8.pgm -- r1 r2

Prints a trace of all MPI calls for this run that is relatively simple:

0:MPI_Init

0:MPI_Comm_rank Rank: 0

0: MPI_Comm_size Size: 2

Scali MPI Connect Release 4.4 Users Guide

39

Image 51
Contents Scali MPI ConnectTM Users Guide Copyright 1999-2005 Scali AS. All rights reserved AcknowledgementScali Bronze Software Certificate Maintenance II Software License Terms CommencementGrant of License Export Requirements SupportLicense Manager Sub-license and distributionLICENSEE’s Obligations SCALI’s ObligationsTransfer Title to Intellectual Property RightsCompliance with Licenses Warranty of Title and Substantial PerformanceScali MPI Connect Release 4.4 Users Guide Vii Limitation on Remedies and LiabilitiesMiscellaneous Proprietary InformationGoverning Law Scali MPI Connect Release 4.4 Users Guide Table of contents Profiling with Scali MPI Connect Appendix a Example MPI code Scali MPI Connect Release 4.4 Users Guide Scali MPI Connect product context ChapterPlatforms supported Scali mailing lists SMC FAQ SMC release documentsProblem reports SupportFeedback How to read this guideAcronyms and abbreviations LicensingNIC Terms and conventions Typographic conventionsGUI style font Typographic conventions Scali MPI Connect components Description of Scali MPI ConnectSMC network devices Ethernet Devices Direct Access Transport DATNetwork devices Shared Memory DeviceUsing detctl Using detstat3.2 DET 5.1 IB MyrinetInfiniband 4.1 GMCommunication protocols on DAT-devices 6 SCIChannel buffer Inlining protocol Eagerbuffering protocolTransporter protocol MPI-2 Features Support for other interconnectsZerocopy protocol Scali MPI Connect Release 4.4 Users Guide MPI-2 Features Running Setting up a Scali MPI Connect environmentCompiling and linking Scali MPI Connect environment variablesLinker flags Compiler supportNaming conventions Running Scali MPI Connect programsMpimon monitor program Basic usageIdentity of parallel processes Program spec Controlling options to mpimonStandard input Standard outputNetwork options How to provide options to mpimonMpirun usage Mpirun wrapper scriptPart part Running with tcp error detection TfdrSuspending and resuming jobs Running with dynamic interconnect failover capabilitiesDebugging with a sequential debugger Debugging and profilingDebugging with Etnus Totalview Using built-in segment protect violation handlerBuilt-in-tools for debugging Assistance for external profilingControlling communication resources Communication resources on DAT-devicesChannelinlinethreshold size to set threshold for inlining Matching MPIRecv with MPIProbe Using MPIIsend, MPIIrecvUsing MPIBsend Good programming practice with SMCUnsafe MPI programs Error and warning messagesUser interface errors and warnings Fatal errorsMpimon options Giving numeric values to mpimon PrefixPostfix Scali MPI Connect Release 4.4 Users Guide Example Profiling with Scali MPI ConnectTracing Using Scali MPI Connect built-in trace+relSecs S eTime where AbsRank MPIcallcommNamerankcall-dependant-parameters whereExample FeaturesTiming Using Scali MPI Connect built-in timingMPIcallDcallsDtimeDfreq TcallsTtimeTfreq Count!avrLen!zroLen!inline!eager!transporter! where Using the scanalyzeCommrank recv from fromworldFromcommonFields Commrank send to toworldTocommonFields whereFor timing This produces the following report Using SMCs built-in CPU-usage functionalityScali MPI Connect Release 4.4 Users Guide Automatic buffer management Tuning communication resourcesFirst iteration is very slow How to optimize MPI performanceBenchmarking Caching the application program on the nodesMemory consumption increase after warm-up Collective operationsFinding the best algorithm Appendix a Programs in the ScaMPItst packageImage contrast enhancement Scali MPI Connect Release 4.4 Users Guide Original File formatWhen things do not work troubleshooting Why does not my program start to run?Appendix B Why can I not start mpid? Why does my program terminate abnormally?General problems Appendix C Per node installation of Scali MPI ConnectExample Install Scali MPI Connect for TCP/IPInstall Scali MPI Connect for Direct Ethernet Install Scali MPI Connect for MyrinetLicense options Install Scali MPI Connect for InfinibandInstall Scali MPI Connect for SCI Install and configure SCI management softwareUninstalling SMC Troubleshooting Network providersScali kernel drivers Troubleshooting the GM provider Troubleshooting 3rdparty DAT providersScali MPI Connect Release 4.4 Users Guide Appendix D Bracket expansion and grouping Bracket expansionGrouping Scali MPI Connect Release 4.4 Users Guide Related documentation Appendix EScali MPI Connect Release 4.4 Users Guide List of figures Scali MPI Connect Release 4.4 Users Guide Transporter protocol IndexSSP