IBM pSeries manual AIX 5L trace for daemon activity, Conclusions and summary, Additional reading

Page 30

5.16 AIX 5L trace for daemon activity

If you suspect that a system daemon is causing a performance problem on your system, run AIX 5L trace to check for daemon activity. For example, to find out which daemons are taking up CPU time, use the following process:

trace -j 001,002,106,200,10c,134,139,465 -a -o /tmp/trace.aux -L 40000000 -T 20000000 sleep XX (XX is the time for your trace)

trcstop

trcrpt -O 'cpuid=on exec=on pid=on tid=on' /tmp/trace.aux > /tmp/trace.out Look at /tmp/trace.out

pprof XX (XX is the time for your trace) Look at:

pprof.cpu

pprof.famcpu

pprof.famind

pprof.flow

pprof.namecpu

pprof.start

pprof.cpu

You will find all these files on the $PWD at the time you run it.

tprof -c -A all -x sleep XX (XX is the time for your trace)

Look at: sleep.prof (you will find this file on the $PWD at the time you run it)

6.0 Conclusions and summary

Peak performance of HPS systems depends on properly tuning the HPS, and on correctly setting application shell variables and AIX 5L tunables.

Because there are many sources of performance data, correct tuning takes time. As has been demonstrated, the HPS performs very well. If tuning is needed, there are several good tools to use to determine performance problems.

7.0 Additional reading

This section lists documents that contain additional information about the topics in this white paper.

7.1 HPS documentation

pSeries High Performance Switch - Planning, Installation and Service, GA22-7951-02

pshpstuningguidewp040105.doc

Page 30

Image 30
Contents IBM ~pSeries High Performance Switch Contents Mpprintenv Mpstatistics Introduction Mpeagerlimit Tunables and settings for switch softwareMPI tunables for Parallel Environment MppollingintervalMprexmitbufsize and Mprexmitbufcnt MemoryaffinityMptaskaffinity MpcssinterruptMPI-IO Chgsni command Tunables and settings for AIX 5L IP tunablesFile cache Svmon and vmstat commands Svmon Vsid Esid Type Description LPage Inuse Pin Pgsp VirtualVmstat Pin Pgsp VirtualLarge page sizing Pshpstuningguidewp040105.doc Large pages and IP support Memory affinity for a single LparAmount of memory available Debug settings in the AIX 5L kernel Daemon configurationRsct daemons LoadLeveler daemons Reducing the number of daemons runningReducing logging Settings for AIX 5L threads Placement of POE managers and LoadLeveler schedulerAIX 5L mail, spool, and sync daemons Driverdebug setting Debug settings and data collection toolsLsattr tuning Iptrclvl settingService focal point Small Real Mode Address Region on HMC GUIDeconfigured L3 cache Affinity LPARsErrpt command HMC error loggingMultiple versions of MPI libraries Mpprintenv Mpstatistics MemoryaffinityDropped switch packets Nddipacketsmsw 0x00000000 Nddipacketslsw Packets dropped in the ML0 interface Packets dropped because of a hardware problem on an endpoint Packets dropped in the switch hardware MpinfolevelLapidebugcommtimeout LapidebugperfAdditional reading AIX 5L trace for daemon activityConclusions and summary HPS documentationAIX 5L performance guides POWER4MPI documentation IBM RedbooksPshpstuningguidewp040105.doc