Escali 4.4 manual Install Scali MPI Connect for Infiniband, Install Scali MPI Connect for SCI

Page 70

Section:

C-5 Install Scali MPI Connect for Infiniband

When installing for InfiniBand you must obtain a software stack from your vendor. The different vendors provide stacks that differs. If you got a binary release, install it before SMC and give the path to the infiniband software to the -b option to smcinstall.

Example:

root# ./smcinstall -b /opt/Infinicon

It is no problem if you install the InfiniBand software after SMC, you only need to modify /opt/scali/etc/ScaMPI.conf to have the line:

networks = smp,ib0,tcp

and ensure that the VAPI library (libvapi.so) is in a directory listed in /etc/ld.so.conf.

If you're using the Mellanox source distribution you can give the path to the tarball directly and smcinstall will compile, make a rpm and install it for you.

Example:

root# ./smcinstall -b /tmp/mellanox_sdk.tar.gz

C-6 Install Scali MPI Connect for SCI

To install Scali MPI Connect for SCI, please specify the -s option to smcinstall. When this option is selected, SMC will default to SCI as the default transport device .If this is not desired, modify the networks line in the global /opt/scali/etc/ScaMPI.conf configuration file. See “SMC network devices” on page 12 for more information regarding network selection.

C-7 Install and configure SCI management software

This option must be used separately, and is needed when you are installing Scali MPI Connect for SCI. It must be installed on only one node in your system, and it doesn’t have to be one of the nodes you’re installing the other MPI software on, i.e it can be an management only node, the only requirement is that this node must be connected and on the same TCP/IP subnet as the others.

When using this option you are asked for the names of the other nodes in your cluster, and also the topology of your SCI network (ring, 2D torus or 3D torus).

C-8 License options

-u <licensefile> - Install/upgrade license file and software.

If not specified during install, only the license manager software is installed. Without a license file (license.dat), the software expects a centralized license scheme and looks for a license server (specified in /opt/scali/etc/scalm.conf)

If smcinstall is run as:

root# /opt/scali/sbin/smcinstall -u <licfile>

the specified license file is installed and the Scali license manager software (scalm) is installed.

Scali MPI Connect Release 4.4 Users Guide

58

Image 70
Contents Scali MPI ConnectTM Users Guide Acknowledgement Copyright 1999-2005 Scali AS. All rights reservedScali Bronze Software Certificate II Software License Terms Commencement MaintenanceGrant of License Sub-license and distribution SupportLicense Manager Export RequirementsSCALI’s Obligations LICENSEE’s ObligationsTitle to Intellectual Property Rights TransferWarranty of Title and Substantial Performance Compliance with LicensesLimitation on Remedies and Liabilities Scali MPI Connect Release 4.4 Users Guide ViiProprietary Information MiscellaneousGoverning Law Scali MPI Connect Release 4.4 Users Guide Table of contents Profiling with Scali MPI Connect Appendix a Example MPI code Scali MPI Connect Release 4.4 Users Guide Chapter Scali MPI Connect product contextSupport Scali mailing lists SMC FAQ SMC release documentsProblem reports Platforms supportedLicensing How to read this guideAcronyms and abbreviations FeedbackNIC Typographic conventions Terms and conventionsGUI style font Typographic conventions Description of Scali MPI Connect Scali MPI Connect componentsSMC network devices Shared Memory Device Direct Access Transport DATNetwork devices Ethernet DevicesUsing detstat Using detctl3.2 DET 4.1 GM MyrinetInfiniband 5.1 IB6 SCI Communication protocols on DAT-devicesChannel buffer Eagerbuffering protocol Inlining protocolTransporter protocol Support for other interconnects MPI-2 FeaturesZerocopy protocol Scali MPI Connect Release 4.4 Users Guide MPI-2 Features Scali MPI Connect environment variables Setting up a Scali MPI Connect environmentCompiling and linking RunningCompiler support Linker flagsRunning Scali MPI Connect programs Naming conventionsBasic usage Mpimon monitor programIdentity of parallel processes Standard output Controlling options to mpimonStandard input Program specHow to provide options to mpimon Network optionsMpirun wrapper script Mpirun usageRunning with dynamic interconnect failover capabilities Running with tcp error detection TfdrSuspending and resuming jobs Part partDebugging and profiling Debugging with a sequential debuggerAssistance for external profiling Using built-in segment protect violation handlerBuilt-in-tools for debugging Debugging with Etnus TotalviewCommunication resources on DAT-devices Controlling communication resourcesChannelinlinethreshold size to set threshold for inlining Good programming practice with SMC Using MPIIsend, MPIIrecvUsing MPIBsend Matching MPIRecv with MPIProbeFatal errors Error and warning messagesUser interface errors and warnings Unsafe MPI programsMpimon options Prefix Giving numeric values to mpimonPostfix Scali MPI Connect Release 4.4 Users Guide Profiling with Scali MPI Connect ExampleUsing Scali MPI Connect built-in trace TracingAbsRank MPIcallcommNamerankcall-dependant-parameters where +relSecs S eTime whereFeatures ExampleUsing Scali MPI Connect built-in timing TimingMPIcallDcallsDtimeDfreq TcallsTtimeTfreq Commrank send to toworldTocommonFields where Using the scanalyzeCommrank recv from fromworldFromcommonFields Count!avrLen!zroLen!inline!eager!transporter! whereFor timing Using SMCs built-in CPU-usage functionality This produces the following reportScali MPI Connect Release 4.4 Users Guide Tuning communication resources Automatic buffer managementCaching the application program on the nodes How to optimize MPI performanceBenchmarking First iteration is very slowCollective operations Memory consumption increase after warm-upFinding the best algorithm Programs in the ScaMPItst package Appendix aImage contrast enhancement Scali MPI Connect Release 4.4 Users Guide File format OriginalWhy does not my program start to run? When things do not work troubleshootingAppendix B Why does my program terminate abnormally? Why can I not start mpid?General problems Per node installation of Scali MPI Connect Appendix CInstall Scali MPI Connect for Myrinet Install Scali MPI Connect for TCP/IPInstall Scali MPI Connect for Direct Ethernet ExampleInstall and configure SCI management software Install Scali MPI Connect for InfinibandInstall Scali MPI Connect for SCI License optionsTroubleshooting Network providers Uninstalling SMCScali kernel drivers Troubleshooting 3rdparty DAT providers Troubleshooting the GM providerScali MPI Connect Release 4.4 Users Guide Bracket expansion Appendix D Bracket expansion and groupingGrouping Scali MPI Connect Release 4.4 Users Guide Appendix E Related documentationScali MPI Connect Release 4.4 Users Guide List of figures Scali MPI Connect Release 4.4 Users Guide Index Transporter protocolSSP