IBM pSeries manual LoadLeveler daemons, Reducing the number of daemons running, Reducing logging

Page 17

4.2 LoadLeveler daemons

The LoadLeveler® daemons are needed for MPI applications using HPS. However, you can lower the impact on a parallel application by changing the default settings for these daemons. You can lower the impact of the LoadLeveler daemons by:

Reducing the number of daemons running

Reducing daemon communication or placing daemons on a switch

Reducing logging

4.2.1 Reducing the number of daemons running

Stop the keyboard daemon

On LoadL_config:

# Specify whether to start the keyboard daemon

X_RUNS_HERE

= False

Allow only a few public schedd to run for submitting jobs or POE On LoadL_config:

LOCAL_CONFIG = $(tilde)/LoadL_config.local.$(hostname)

On LoadL_config.local.plainnode:

SCHEDD_RUNS_HERE = False

On LoadL_config.local.scheddnode:

SCHEDD_RUNS_HERE = True

On LoadL_admin for schedd node to make public: node_name.xxx.xxx.xxx: type = machine

alias = node_name1.xxx.xxx.xxx node_name2.xxx.xxx.xxx schedd_host=true

4.2.2Reducing daemon communication and placing daemons on a switch

On LoadL_config:

# Set longer to reduce daemon messages. This will slow response to failures.

POLLING_FREQUENCY

= 600

 

POLLS_PER_UPDATE

= 1

 

MACHINE_UPDATE_INTERVAL

= 1200

Use the switch traffic for daemon communication.

4.2.3 Reducing logging

On LoadL_config:

#reduce LoadLeveler activity to minimum. Warning: You will not be notified of failures.

NEGOTIATOR_DEBUG= -D_ALWAYS

NEGOTIATOR_DEBUG= -D_ALWAYS

STARTD_DEBUG = -D_ALWAYS

pshpstuningguidewp040105.doc

Page 17

Image 17
Contents IBM ~pSeries High Performance Switch Contents Mpprintenv Mpstatistics Introduction MPI tunables for Parallel Environment Tunables and settings for switch softwareMpeagerlimit MppollingintervalMemoryaffinity Mprexmitbufsize and MprexmitbufcntMPI-IO MptaskaffinityMpcssinterrupt Chgsni command File cache Tunables and settings for AIX 5LIP tunables Svmon and vmstat commands Vsid Esid Type Description LPage Inuse Pin Pgsp Virtual SvmonPin Pgsp Virtual VmstatLarge page sizing Pshpstuningguidewp040105.doc Amount of memory available Large pages and IP supportMemory affinity for a single Lpar Rsct daemons Debug settings in the AIX 5L kernelDaemon configuration Reducing logging LoadLeveler daemonsReducing the number of daemons running AIX 5L mail, spool, and sync daemons Settings for AIX 5L threadsPlacement of POE managers and LoadLeveler scheduler Lsattr tuning Debug settings and data collection toolsDriverdebug setting Iptrclvl settingDeconfigured L3 cache Small Real Mode Address Region on HMC GUIService focal point Affinity LPARsMultiple versions of MPI libraries Errpt commandHMC error logging Mpprintenv Memoryaffinity MpstatisticsDropped switch packets Nddipacketsmsw 0x00000000 Nddipacketslsw Packets dropped in the ML0 interface Packets dropped because of a hardware problem on an endpoint Mpinfolevel Packets dropped in the switch hardwareLapidebugperf LapidebugcommtimeoutConclusions and summary AIX 5L trace for daemon activityAdditional reading HPS documentationMPI documentation POWER4AIX 5L performance guides IBM RedbooksPshpstuningguidewp040105.doc