Cisco Systems GEM318P, ST373307LC Preface

vii

Cisco SFS InfiniBand Host Drivers User Guide for Linux

OL-12309-01

Preface

This preface describes who should read the Cisco SFS InfiniBand Host Drivers User Guide for Linux,

how it is organized, and its document conventions. It includes the following sections:

•Audience, page vii

•Organization, page vii

•Conventions, pageviii

•Root and Non-root Conventions in Examples, pageix

•Related Documentation, page ix

•Obtaining Documentation, Obtaining Support, and Security Guidelines, pageix

Audience

The intended audience is the administrator responsible for installing, configuring, and managing host

drivers and host card adapters. This administrator should have experience administering similar

networking or storage equipment.

Organization

This publication is organized as follows:

Chapter Title Description

Chapter 1 About Host Drivers Describes the Cisco commercial host driver.

Chapter 2 Installing Host Drivers Describes the installation of host drivers.

Chapter 3 IP over IB Protocol Describes how to configure IPoIB to run IP

traffic over an IB network.

Chapter 4 SCSI RDMA Protocol Describes how to configure SRP.

Chapter 5 Sockets Direct Protocol Describes how to configure and run SDP.

Chapter 6 uDAPL Describes how to build and configure

uDAPL.

Chapter 7 MVAPICH MPI Describes the setup and configuration

information for MVAPICH MPI.

Contents

Main Page CONTENTS Page Page Page Preface Audience Organization Conventions Root and Non-root Conventions in Examples Related Documentation Obtaining Documentation, Obtaining Support, and Security Guidelines Page About Host Drivers 1-2 Note See the Root and Non-root Conventions in Examples section on pageix for details about the User Space Mid-Layer Architecture Figure 1-1 HCA Supported Protocols and API Architecture Upper Layer Protocol User APIs Kernel Space Application Level Supported Protocols IPoIB SRP SDP Supported APIs MVAPICH MPI uDAPL Intel MPI HP MPI Installing Host Drivers Contents of ISO Image Installing Host Drivers from an ISO Image Uninstalling Host Drivers from an ISO Image Page IP over IB Protocol Manually Configuring IPoIB for Default IB Partition Subinterfaces Creating a Subinterface Associated with a Specific IB Partition Removing a Subinterface Associated with a Specific IB Partition 3-5 Verifying IPoIB Functionality To verify your configuration and your IPoIB functionality, perform the following steps: Step 1 Log in to your hosts. Step 2 Verify the IPoIB functionality by using the ifconfig command. Step 3 Enter the ping command from 192.168.0.1 to 192.168.0.2. The following example shows how to enter the ping command: IPoIB Performance Page Sample Startup Configuration File IPoIB High Availability Merging Physical Ports Unmerging Physical Ports Page SCSI RDMA Protocol Configuring SRP Configuring ITLs when Using Fibre Channel Gateway Configuring ITLs with Element Manager while No Global Policy Restrictions Apply Page Configuring ITLs with Element Manager while Global Policy Restrictions Apply Page Configuring SRP Host Verifying SRP Verifying SRP Functionality Verifying with Element Manager Sockets Direct Protocol Configuring IPoIB Interfaces Converting Sockets-Based Application Explicit/Source Code Conversion Type Automatic Conversion Type Log Statement Match Statement SDP Performance Page Netperf Server with IPoIB and SDP Page Page uDAPL Introduction uDAPL Test Performance uDAPL Throughput Test Performance uDAPL Latency Test Performance Compiling uDAPL Programs MVAPICH MPI Initial Setup Configuring SSH Page Page Editing Environment Variables Setting Environment Variables in System-Wide Startup Files Editing Environment Variables in the Users Shell Startup Files Editing Environment Variables Manually MPI Bandwidth Test Performance MPI Latency Test Performance Intel MPI Benchmarks (IMB) Test Performance Page 7-11 When the test completes successfully, you see output similar to the following: Compiling MPI Programs Page Page HCA Utilities and Diagnostics hca_self_test Utility Page tvflash Utility Viewing Card Type and Firmware Version Upgrading Firmware 8-5 Diagnostics Page APPENDIX A Acronyms and Abbreviations Page INDEX A B C D E H I K L M N O P R S T U V W