To help mitigate this, when the thread pool is full, the System Manager notifies al l the threads in the
thread pool that are waiting on list updates to return to the client as if they just timed out as normal. This
could be as many as 15 threads per client that are awakened and told to return, which makes those
threads free to do other work.
If the client interface RPC thread pool is still full (as it could be if, for example, there were 15 threads in
the client interface RPC request queue that took over the 15 that were just released), then the System
Manager sets the wait time for the new RPCs to 1 second rather than whatever the client requested. This
way the RPC won't try to hang around too long.
Realize that once the System Manager gets in this mode (constantly having a full client interface RPC
thread pool and having to cut short the thread wait times), the System Manager starts working hard and
the CPU usage will start to increase. If you close some windows and/or some clients things should start
to stabilize again.
You can see whether the System Manager client interface RPC thread pool has ever been full by looking
at the Maximum Active/Queued RPCs field in the Client column of the RPC Interface Information
group in the System Manager Statistics window (Section 3.9.4.1: System Manager Stat istics Window on
page 63). If this number is greater than or equal to the corresponding client interface's Threa d Pool Size
(default 100), then the thread pool was full at some time during the System Manager execution (al though
it may not be full currently).
To tell whether the thread pool is currently full, look at the number of Queued RPCs. If Queued RPCs is
0 then the thread pool is not full at the moment.
If Active RPCs is equal to Thread Pool Size then the thread pool for the interface is currently full.
Active RPCs should never be greater than Thread Pool Size. When it reaches Thread Pool Size then the
new RPCs will be queued and Queued RPCs become greater than 0.
When the thread pool gets full, the System Manager tries harder to clear them out before accepting new
ones, so one hopes that if the thread pool fills up, it doesn't stay full for long.
If the site runs with low refresh rates and more than 40 clients, the recommendation is to set the client
interface RPC thread pool size to 150 or 200 and the client interface RPC request queue size to 1000 in
the System Manager Server Configuration window (Section 5.1.1.2: Interface Controls on page 92 ).
Otherwise, the default values should work well.
3.1.3. Labeling the Syste m Manager RPC Program Number Labeling the System Manager RPC program number is not required but can be a useful debugging aid.
The SSM System Manager registers with the RPC portmapper at initialization. As part of this
registration, it tells the portmapper its RPC program number. Each HPSS server configuration contains
the server's RPC program number. To find the System Manager's program number, open the Servers
window, select the SSM System Manager, and click the Configure button to open the SSM Syst em
Manager Configuration window. The System Manager's RPC program number is in the Program
Number field on the Execution Controls tab of this window.
The rpcinfo utility with the -p option will list all registered programs, their RPC program numbers, and
the port on which they are currently listening for RPCs. When diagnosing SSM problems, it can be
useful to run the rpcinfo program and search for the System Manager RPC program number in the
output, to see whether the System Manager has successfully initialized its rpc inter face and to see which
HPSS Management Guide November 2009
Release 7.3 (Revision 1.0) 32