Cisco Systems 5709 INDUSTRY CANADA, CLASSE B, INDUSTRY CANADA, CLASSE A

NetXtreme II User Guide

January 2010

Broadcom Corporation

Page 224 Canadian Regulator y Information (Canada Only) Document ENGSRVT52-CDUM100-R

INDUSTRY CANADA, CLASSE B

Broadcom NetXtreme II Gigabit Ethernet Controller

Broadcom Corporation

190 Mathilda Place

Sunnyvale, California 94086 USA

Cet appareil numérique de la classe B est conforme à la norme canadienne ICES-003.

Avis : Dans le cadre des réglementations d'Industry Canada, vos droits d'utilisation de cet équipement peuvent être annulés

si des changements ou modifications non expressément approuvés par Broadcom y sont apportés.

INDUSTRY CANADA, CLASSE A

Broadcom NetXtreme II Gigabit Ethernet Controller

Broadcom NetXtreme II 10 Gigabit Ethernet Controller

Broadcom Corporation

190 Mathilda Place

Sunnyvale, California 94086 USA

Cet appareil numérique de classe A est conforme à la norme canadienne ICES-003.

Avis : Dans le cadre des réglementations d'Industry Canada, vos droits d'utilisation de cet équipement peuvent être annulés

si des changements ou modifications non expressément approuvés par Broadcom y sont apportés.

Contents

Main Page Functionality and Features: Broadcom NetXtreme II Network Adapter User Guide FUNCTIONAL DESCRIPTION F TCP OFFLOAD ENGINE (TOE) INTERNET SMALL COMPUTER SYSTEMS INTERFACE (ISCSI) POWER MANAGEMENT ADAPTIVE INTERRUPT FREQUENCY ASIC WITH EMBEDDED RISC PROCESSOR BROADCOM ADVANCED CONTROL SUITE 3 S UPPORTED O PERATING E NETWORK LINK AND ACTIVITY INDICATION Configuring Teaming: Broadcom NetXtreme II Network Adapter User Guide BROADCOM ADVANCED SERVER PROGRAM OVERVIEW LOAD BALANCING AND FAULT TOLERANCE SMART LOAD BALANCING AND FAILOVER LINK AGGREGATION (802.3AD) G ENERIC T RUNKING (FEC/GEC)/802.3 AD -D RAFT S SLB (AUTO-FALLBACK DISABLE) LIMITATIONS OF SMART LOAD BALANCING AND FAILOVER/SLB (AUTO-FALLBACK DISABLE) T EAMING AND L ARGE S END O FFLOAD /C HECKSUM O FFLOAD S Broadcom Gigabit Ethernet Teaming Services: Broadcom NetXtreme II Network Adapter User Guide EXECUTIVE SUMMARY G Table 1: Glossary Item Definition Page T EAMING C Network Addressing Teaming and Network Addresses Description of Teaming Types Smart Load Balancing and Failover Page Generic Trunking Link Aggregation (IEEE 802.3ad LACP) SLB (Auto-Fallback Disable) TOE Teaming Limitations of Teaming with Offloading SOFTWARE COMPONENTS Architecture Windows File Name HARDWARE REQUIREMENTS Repeater Hub Switching Hub Router TEAMING SUPPORT BY PROCESSOR CONFIGURING TEAMING SUPPORTED FEATURES BY TEAM TYPE Page SELECTING A TEAM TYPE TEAMING MECHANISMS A Outbound Traffic Flow Inbound Traffic Flow (SLB Only) Protocol Support Performance Switch-Independent Smart Load Balancing and Failover Page Switch-Dependent Generic Static Trunking Gigabit EtherChannel Open Trunk Fast EtherChannel Dynamic Trunking (IEEE 802.3ad Link Aggregation) LiveLink ATTRIBUTES OF THE FEATURES ASSOCIATED WITH EACH TYPE OF TEAM Table 5: Attributes Feature Attribute SPEEDS SUPPORTED FOR EACH TYPE OF TEAM TEAMING AND OTHER ADVANCED NETWORKING PROPERTIES CHECKSUM OFFLOAD IEEE 802.1P QOS TAGGING L ARGE S END O TCP OFFLOAD ENGINE (TOE) J UMBO F WAKE ON LAN PREBOOT EXECUTION ENVIRONMENT GENERAL NETWORK CONSIDERATIONS TEAMING WITH MICROSOFT VIRTUAL SERVER 2005 T EAMING A CROSS S Page Page Page SPANNING TREE ALGORITHM Topology Change Notice (TCN) LAYER 3 ROUTING/SWITCHING TEAMING WITH HUBS (FOR TROUBLESHOOTING PURPOSES ONLY) TEAMING WITH MICROSOFT NLB APPLICATION CONSIDERATIONS T EAMING AND C public adapter private adapter heartbeat Page High-Performance Computing Cluster Advanced Features Page TEAMING AND NETWORK BACKUP Load Balancing and Failover load balance inform Fault Tolerance Page TROUBLESHOOTING TEAMING PROBLEMS T EAMING C ONFIGURATION T T ROUBLESHOOTING G are not FREQUENTLY ASKED QUESTIONS Page Page APPENDIX A: EVENT LOG MESSAGES WINDOWS SYSTEM EVENT LOG MESSAGES BASE DRIVER (PHYSICAL ADAPTER/MINIPORT) Table 8: Base Driver Event Log Messages Message Page Table 8: Base Driver Event Log Messages (Cont.) Message INTERMEDIATE DRIVER (VIRTUAL ADAPTER/TEAM) Table 9: Intermediate Driver Event Log Messages System Event Message Number Blf Severity Message Cause Corrective Action Table 9: Intermediate Driver Event Log Messages (Cont.) System Event Message Number Severity Message Cause Corrective Action Virtual LANs: Broadcom NetXtreme II Network Adapter User Guide VLAN O Table 1: Example VLAN Network Topology Component Description ADDING VLANS TO TEAMS Manageability: Broadcom NetXtreme II Network Adapter User Guide CIM SNMP BASP S BASP EXTENSIBLE-AGENT Installing the Hardware: Broadcom NetXtreme II Network Adapter User Guide SYSTEM REQUIREMENTS HARDWARE REQUIREMENTS O PERATING S YSTEM R Novell NetWare SAFETY PRECAUTIONS PREINSTALLATION CHECKLIST INSTALLATION OF THE ADD-IN NIC INSTALLING THE ADD-IN NIC CONNECTING THE NETWORK CABLES Fiber Optic Table 1: 10/100/1000BASE-T and 10GBASE-T Cable Specifications Table 2: 1000/2500BASE-X Fiber Optic Specifications Broadcom Boot Agent Driver Software: Broadcom NetXtreme II Network Adapter User Guide S ETTING UP MBA IN A C LIENT E E NABLING THE MBA D CONFIGURING THE MBA DRIVER SETTING UP THE BIOS S ETTING UP MBA IN A S ERVER E initial ram disk boot kernel RED HAT LINUX PXE SERVER MS-DOS UNDI/INTEL APITEST iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide ISCSI BOOT SUPPORTED OPERATING SYSTEMS FOR ISCSI BOOT WINDOWS ISCSI BOOT SETUP Configuring the iSCSI Boot Parameters Table 1: Configuration Options Option Description MBA Boot Protocol Configuration Static iSCSI Boot Configuration Table 1: Configuration Options Option Description Dynamic iSCSI Boot Configuration Page Configure Parameters for a Secondary Adapter Preparing the Image on the Local Hard Drive Initial Windows Install Transferring the OS Image to the iSCSI Target Booting Enabling CHAP Authentication Configuring the DHCP Server to Support iSCSI Boot DHCP iSCSI Boot Configurations for IPv4 Table 2: DHCP Option 17 Parameter Definition Parameter Definition Configuring the DHCP Server Table 3: DHCP Option 43 Suboption Definition Suboption Definition DHCP iSCSI Boot Configuration for IPv6 Table 4: DHCP Option 17 Suboption Definition Suboption Definition L INUX I SCSI B OOT S O THER I SCSI B OOT C Page Windows Server 2008 (Non-OIS) Windows Server 2008 (OIS) TROUBLESHOOTING ISCSI BOOT ISCSI CRASH DUMP ISCSI OFFLOAD CONFIGURING ISCSI OFFLOAD Configuring Broadcom iSCSI Using BACS 3 Page Page Configure Microsoft Initiator to Use Broadcoms iSCSI Offload Page Page Page Page Page Page ISCSI OFFLOAD FAQS Installing Management Applications: Broadcom NetXtreme II Network Adapter User Guide INSTALLING BROADCOM ADVANCED CONTROL SUITE 3 AND RELATED MANAGEMENT APPLICATIONS .NET FRAMEWORK REQUIREMENT USING THE INSTALLER Table 1: Minimum and Recommended .NET Framework Versions for BACS 3 Operating System Minimum Required Recommended Version How to Obtain Version How to Obtain USING SILENT INSTALLATION MODIFYING MANAGEMENT APPLICATIONS REPAIRING MANAGEMENT APPLICATIONS REMOVING MANAGEMENT APPLICATIONS Page NDIS2 Driver Software: Broadcom NetXtreme II Network Adapter User Guide PREINSTALLATION REQUIREMENTS INSTALLING THE NDIS2 DRIVER SOFTWARE FOR USE ON MS-DOS P Modifying the Startup Disk Page Page I NSTALLING THE DOS NDIS2 D RIVER S OFTWARE ON THE H ARD D USING KEYWORDS FOR THE DRIVERS Page ODI Driver Software: Broadcom NetXtreme II Network Adapter User Guide ODI CLIENT32 INSTALLING THE DRIVER SOFTWARE Preinstallation Requirements Installing the Novell NetWare Client32 Driver for MS-DOS CONFIGURING THE DRIVER SOFTWARE Page DOS ODI INSTALLING THE DRIVER SOFTWARE Preinstallation Requirements Installing the DOS ODI Driver on DOS 6.22 CONFIGURING PARAMETERS FOR THE BX2.COM/BX2EV.COM DRIVER (IN THE NET.CFG FILE) Page Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide I Table 1: Broadcom NetXtreme II Linux Drivers Linux Driver Description L P I NSTALLING L INUX D RIVER S I NSTALLING THE S OURCE RPM P BUILDING THE DRIVER FROM THE SOURCE TAR FILE LOAD AND RUN NECESSARY ISCSI SOFTWARE COMPONENTS Page UNLOADING/REMOVING THE LINUX DRIVER UNLOADING/REMOVING THE DRIVER FROM AN RPM INSTALLATION REMOVING THE DRIVER FROM A TAR INSTALLATION PATCHING PCI FILES (OPTIONAL) NETWORK INSTALLATIONS SETTING VALUES FOR OPTIONAL PROPERTIES disable_msi disable_tpa int_mode dropless_fc Page DRIVER DEFAULTS DRIVER MESSAGES BNX2 AND BNX2X DRIVER Page Page TEAMING WITH CHANNEL BONDING S LINUX ISCSI OFFLOAD U SER APPLICATION - BNX 2 O PEN I SCSI U SER A BIND ISCSI TARGET TO BROADCOM NX2 ISCSI TRANSPORT NAME M AKING C ONNECTIONS TO I SCSI T M AXIMIZE O FFLOAD I SCSI C LINUX ISCSI OFFLOAD FAQ NetWare Driver Software: Broadcom NetXtreme II Network Adapter User Guide P REINSTALLATION R Table 1: NetWare Support Files NetWare Version Support Pack Files to be Installed I NSTALLING N ET W ARE S ERVER 6.5 D RIVER S V IEWING OR M ODIFYING A DAPTER P RxBuffers= Speed= Link= RxTicks= TxTicks= TxPacketsPer= RxPacketsPer= CheckSum= FlowCtrl= PDriver= NODE= nnnnnnnnnnnn FRAME= SLOT= n Spuriousfix= Poll= Wirespeed= Model= MagicP= Page REMOVING DRIVERS FROM AUTOEXEC.NCF Windows Driver Software: Broadcom NetXtreme II Network Adapter User Guide I NSTALLING THE D RIVER S USING THE INSTALLER USING SILENT INSTALLATION REMOVING THE DEVICE DRIVERS USING THE NETXTREME II MONOLITHIC DRIVER INSERTING THE NETXTREME II MONOLITHIC DRIVER IN A WINPE 2.0 I Page CONFIGURING THE SPEED/DUPLEX SETTING FOR THE NETXTREME II MONOLITHIC DRIVER VIEWING OR CHANGING THE PROPERTIES OF THE ADAPTER SETTING POWER MANAGEMENT OPTIONS Page Using Broadcom Advanced Control Suite 3: Broadcom NetXtreme II Network Adapter User BROADCOM ADVANCED CONTROL SUITE 3 OVERVIEW STARTING BROADCOM ADVANCED CONTROL SUITE 3 USING BROADCOM ADVANCED CONTROL SUITE 3 USING THE INTERFACE Table 1: Minimum and Recommended .NET Framework Versions for BACS 3 Operating System Minimum Required Recommended Version How to Obtain Version How to Obtain Device Management Device Icons Team Management CONFIGURING BACS USER INTERFACE OPTIONS CONFIGURING BACS USER INTERFACE APPEARANCE VIEWING VITAL SIGNS Page VIEWING DRIVER INFORMATION VIEWING RESOURCE INFORMATION Page Page VIEWING HARDWARE INFORMATION T ESTING THE N Page RUNNING DIAGNOSTIC TESTS Page ANALYZING CABLES Page SETTING ADAPTER PROPERTIES Page Page Page CONFIGURING SYSTEM SETTINGS VIEWING STATISTICS Page Page VIEWING RESOURCE RESERVATIONS Page Page Configuring the IP Address for iSCSI Offload VIEWING LICENSES CONFIGURING TEAMING TEAM TYPES STANDBY TEAM MEMBER AND AUTO-FALLBACK DISABLE MODE LIVELINK USING THE BROADCOM TEAMING WIZARD Page Page Page Page Page Page Page Page Page Page USING EXPERT MODE Page Page Modifying a Team Adding a VLAN Viewing VLAN Properties and Statistics and Running VLAN Tests Deleting a VLAN Configuring LiveLink for a Smart Load Balancing and Failover and SLB (Auto-Fallback Disable) Team Saving and Restoring a Configuration the path and file name of the new configuration file VIEWING BASP STATISTICS CONFIGURING WITH THE COMMAND LINE INTERFACE UTILITY Specifications: Broadcom NetXtreme II Network Adapter User Guide 10/100/1000BASE-T AND 10GBASE-T CABLE SPECIFICATIONS Table 1: 10/100/1000BASE-T Cable Specifications Table 2: 10GBASE-T Cable Specifications 1000/2500BASE-X FIBER OPTIC SPECIFICATIONS I NTERFACE S Table 3: 1000/2500BASE-X Fiber Optic Specifications Table 4: 10/100/1000BASE-T Performance Specifications Feature Specification Table 5: 10GBASE-T Performance Specifications Feature Specification NIC PHYSICAL CHARACTERISTICS NIC POWER REQUIREMENTS WAKE ON LAN POWER REQUIREMENTS E NVIRONMENTAL S Table 10: BCM5708C Wake On LAN Power Requirements (Nominal Conditions) Table 11: BCM5709C Wake On LAN Power Requirements (Nominal Conditions) Table 13: BCM5709 Environmental Specifications Parameter Condition Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide FCC NOTICE FCC, CLASS B FCC, CLASS A VCCI N CLASS B VCCI Class B Statement (Japan) CLASS A CE N CLASS B CLASS A Page Page Page Page Page CANADIAN REGULATORY INFORMATION (CANADA ONLY) INDUSTRY CANADA, CLASS B INDUSTRY CANADA, CLASS A INDUSTRY CANADA, CLASSE B INDUSTRY CANADA, CLASSE A KOREA COMMUNICATIONS COMMISSION (KCC) NOTICE (REPUBLIC OF KOREA ONLY) A CLASS DEVICE User Diagnostics: Broadcom NetXtreme II Network Adapter User Guide INTRODUCTION SYSTEM REQUIREMENTS P ERFORMING D Table 1: uxdiag Command Options Table 1: uxdiag Command Options (Cont.) Table 2: uediag Command Options Page DIAGNOSTIC TEST DESCRIPTIONS Table 3: Diagnostic Tests Test Description Number Name Table 3: Diagnostic Tests (Cont.) Test Description Number Name Page Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide HARDWARE DIAGNOSTICS C HECKING PORT LED TROUBLESHOOTING CHECKLIST CHECKING IF CURRENT DRIVERS ARE LOADED W N ET W L RUNNING A CABLE LENGTH TEST TESTING NETWORK CONNECTIVITY W Module Size Used by size n N ET W L MICROSOFT VIRTUALIZATION WITH HYPER-V SINGLE NETWORK ADAPTER Windows Server 2008 Windows Server 2008 R2 T EAMED N ETWORK A Windows Server 2008 Windows Server 2008 R2 REMOVING THE BROADCOM NETXTREME II DEVICE DRIVERS UPGRADING WINDOWS 2000 SERVER TO WINDOWS SERVER 2003 UPGRADING WINDOWS OPERATING SYSTEMS PREPARING AN ANSWER FILE FOR UNATTENDED INSTALLATION BROADCOM BOOT AGENT BROADCOM ADVANCED SERVER PROGRAM (BASP) Page L M