IBM pSeries Affinity LPARs, Small Real Mode Address Region on HMC GUI, Deconfigured L3 cache

Page 20

5.3 Affinity LPARs

On p690 systems, if you are running with more than one LPAR for each CEC, make sure you are running affinity LPARs. To check affinity between CPU, memory, and HPS links, run the associativity scripts on the LPARs.

To check the memory affinity setting, run the vmo command.

5.4 Small Real Mode Address Region on HMC GUI

Because the HMC and hypervisor code on POWER4 systems uses up physical memory, some physical memory is unavailable to the LPARs. To make sure that Small Real Mode Address Region on the HMC GUI is set on, make sure the ulimit –aoutput shows you all unlimited.

Here are some examples of physical memory and available memory. Actual values depend on your hardware configuration.

Physical Real Memory

Maximum Memory Available

64GB

61.5GB

128GB

120GB

256GB

240GB

512GB

495GB

5.5 Deconfigured L3 cache

The p690 and p655 systems can continue running if parts of the hardware fail. However, this can lead to unexpectedly lower performance on a long-running job. One of the degradations observed has been the deconfiguration of the L3 cache. To check for this condition, run the following command on each LPAR to make sure that no L3 cache has been deconfigured:

/usr/lib/boot/bin/dmpdt_chrp > /tmp/dmpdt_chrp.out vi /tmp/dmpdt_chrp.out

Search for L3 and

 

 

i-cache-size

 

 

08000000

[

]

d-cache-size

 

 

08000000

[

]

If you get a value other than the one above, then part or all of your L3 is deconfigured.

5.6 Service focal point

The Service Focal Point (SFP) application runs on the HMC and provides a user interface for viewing events and performing problem determination. SFP resource managers monitor the system and record information about serviceable events.

pshpstuningguidewp040105.doc

Page 20

Image 20
Contents IBM ~pSeries High Performance Switch Contents Mpprintenv Mpstatistics Introduction Tunables and settings for switch software MPI tunables for Parallel EnvironmentMpeagerlimit MppollingintervalMprexmitbufsize and Mprexmitbufcnt MemoryaffinityMPI-IO MptaskaffinityMpcssinterrupt Chgsni command File cache Tunables and settings for AIX 5LIP tunables Svmon and vmstat commands Svmon Vsid Esid Type Description LPage Inuse Pin Pgsp VirtualVmstat Pin Pgsp VirtualLarge page sizing Pshpstuningguidewp040105.doc Amount of memory available Large pages and IP supportMemory affinity for a single Lpar Rsct daemons Debug settings in the AIX 5L kernelDaemon configuration Reducing logging LoadLeveler daemonsReducing the number of daemons running AIX 5L mail, spool, and sync daemons Settings for AIX 5L threadsPlacement of POE managers and LoadLeveler scheduler Debug settings and data collection tools Lsattr tuningDriverdebug setting Iptrclvl settingSmall Real Mode Address Region on HMC GUI Deconfigured L3 cacheService focal point Affinity LPARsMultiple versions of MPI libraries Errpt commandHMC error logging Mpprintenv Mpstatistics MemoryaffinityDropped switch packets Nddipacketsmsw 0x00000000 Nddipacketslsw Packets dropped in the ML0 interface Packets dropped because of a hardware problem on an endpoint Packets dropped in the switch hardware MpinfolevelLapidebugcommtimeout LapidebugperfAIX 5L trace for daemon activity Conclusions and summaryAdditional reading HPS documentationPOWER4 MPI documentationAIX 5L performance guides IBM RedbooksPshpstuningguidewp040105.doc