Q

2 – InfiniPath Cluster Administration Performance and Management Tips

For SUSE 9.3 and 10.0 run this command as root:

#/sbin/chkconfig --level 12345 powersaved off

After running either of these commands, the system will need to be rebooted for these changes to take effect.

2.10.3

Balanced Processor Power

Higher processor speed is good. However, adding more processors is good only if processor speed is balanced. Adding processors with different speeds can result in load imbalance.

2.10.4

SDP Module Parameters for Best Performance

To get the best performance from SDP, especially for bandwidth tests, edit one of these files:

/etc/modprobe.conf (on Fedora and RHEL) /etc/modprobe.conf.local (on SUSE and SLES)

Add the line:

options ib_sdp sdp_debug_level=4

sdp_zcopy_thrsh_src_default=10000000

This should be a single line in the file. This sets both the debug level and the zero copy threshold.

2.10.5

CPU Affinity

InfiniPath will attempt to run each node program with CPU affinity set to a separate logical processor, up to the number of available logical processors. If CPU affinity is already set (with sched_setaffinity(), or with the taskset utility), then InfiniPath will not change the setting.

The taskset utility can be used with mpirun to specify the mapping of MPI processes to logical processors. This is useful, for example, to make best use of available memory bandwidth or cache locality when running on dual-core SMP cluster nodes.

In the following example we use the NAS Parallel Benchmark’s MG (multi-grid) benchmark and the -coption to taskset.

$ mpirun -np 4 -ppn 2 -m $hosts taskset -c 0,2 bin/mg.B.4 $ mpirun -np 4 -ppn 2 -m $hosts taskset -c 1,3 bin/mg.B.4

The first command forces the programs to run on CPUs (or cores) 0 and 2. The second forces the programs to run on CPUs 1 and 3. Please see the man page for taskset for more information on usage.

IB6054601-00 D

2-19

Page 37
Image 37
Q-Logic IB6054601-00 D Balanced Processor Power, SDP Module Parameters for Best Performance, CPU Affinity, Add the line

IB6054601-00 D specifications

The Q-Logic IB6054601-00 D is a high-performance InfiniBand adapter card designed for data centers and enterprise applications requiring robust connectivity and low-latency communication. This adapter is part of QLogic's extensive portfolio of networking solutions, catering to the needs of high-performance computing (HPC), cloud computing, and virtualization environments.

One of the standout features of the IB6054601-00 D is its capability to support data transfer rates of up to 56 Gbps. This makes it ideal for applications demanding large bandwidth and quick data processing. The adapter is optimized for RDMA (Remote Direct Memory Access) technology, which allows data to be transferred directly between the memory of different computers without involving the CPU. This reduces latency and CPU overhead, leading to enhanced overall system performance.

The architecture of the IB6054601-00 D includes support for a dual-port design, which offers increased bandwidth, redundancy, and fault tolerance. This dual-port configuration is especially advantageous for environments that require high availability and reliability, such as financial services and mission-critical applications.

The adapter utilizes advanced error detection and correction mechanisms, ensuring that data integrity is maintained during transmission. With features like adaptive routing and congestion management, the IB6054601-00 D is capable of optimizing the handling of data flows, thereby enhancing performance even under heavy loads.

In terms of compatibility, the Q-Logic IB6054601-00 D supports a wide range of operating systems and virtualization technologies, making it easy to integrate into diverse IT environments. It also includes drivers and software packages that facilitate seamless deployment and management.

In addition to high-speed connectivity, the adapter is designed with power efficiency in mind. It adheres to Energy Star regulations, helping organizations lower their operational costs while minimizing their environmental footprint.

Overall, the Q-Logic IB6054601-00 D stands out for its high throughput, low latency, and reliability. Its combination of advanced features and technologies positions it as an excellent choice for organizations looking to enhance their data center performance and maximize the efficiency of their network infrastructure. With the growing demands for faster and more efficient data transfer, solutions like the IB6054601-00 D are essential in meeting the evolving needs of modern enterprises.