User’s Guide | Q-Logic 8100 SERIES instruction

User’s Guide

Converged Network Adapter

8100 Series

FE0254601-00 A

Image 1

Q-Logic 8100 SERIES manual User’s Guide

Contents

User’s Guide Document Revision History Table of Contents Management Tools Installation in a Windows Environment Installation in a Linux Environment Installation in a VMware Environment FE0254601-00 a Vii Configuring FCoE in a Linux Environment Configuring FCoE in a Windows Environment User’s Guide Converged Network Adapter Series Adapters Offline Utilities Brocade CEE/FCoE Switch/Blade Configuration List of Figures Xii FE0254601-00 a Xiii Xiv FE0254601-00 a User’s Guide Converged Network Adapter Series Adapters List of Tables FE0254601-00 a Xvii Page What’s in This Guide Preface Related Materials Intended AudienceDocumentation Conventions License Agreements  See Installation Checklist on Training Technical SupportContact Information Laser Safety WarrantyLegal Notices Knowledge Database CNS 13438 Class a QLE8xxx EMI and EMC Requirements MIC Class a QLE81xx Product Safety Compliance Preface Legal Notices Xxvi FE0254601-00 a Verify the Package Contents Installation InstructionsInstall the Adapter Hardware Figure i Illustration of Sample Motherboard and Slots Install the Adapter Drivers Additional Resources Install QConvergeConsole Management Tools Quick Start Additional Resources Xxx FE0254601-00 a QLogic 8100 Series Converged Network Adapters What is a Converged Network Adapter?Product Part Number What is Fibre Channel over Ethernet FCoE? What is Enhanced Ethernet? QLogic Converged Network Adapter Series Converged Network Adapters FCoE Network Deployment FCoE Deployment Hardware Components Function Series Adapter Components Hardware Function Component Software Components Operating System Driver Boot Code Management Tools and Utilities Firmware Component Operating System Comments QLogic Supported a Software and Firmware Components  Bios Physical and Electrical Specification Adapter SpecificationsSpecification Description Feature Description FCoE SpecificationsTransceiver Requirements Active Passive SR Optics Optics Not Adapter Sold by Ethernet Specifications Ethernet Specifications Management Specifications QConvergeConsole Web Management GUI Overview QConvergeConsole Management Agents qlremote/netqlremote Offline Utilities QConvergeConsole CLI Management Tools Offline Utilities System Requirements Server and Switch RequirementsOperating Systems Requirements Cabling Requirements Downloading QLogic DriversOther Requirements Select an Adapter and a Windows Operating System Download Drivers for Windows Servers Installing Hardware Install the Adapter Adapter Hardware Verify the Adapter Installation Drivers Command Output Installing Software Identifying Unnamed Devices Device Properties Installing the NIC Driver for Windows Server Installing and Updating Drivers Using Device Manager QLogic 8100 Series Adapter Device Entries Typical QLogic 8100 Series Ethernet Adapter Port Entries 11. Starting the Hardware Update Wizard 12. Confirming the Ethernet Adapter Installing the FCoE Driver for Windows Server 13. QLogic 8100 Series Adapter Device Entries 16. Updating an FCoE Driver 18. QLogic 8100 Series Adapter Device Entries-Windows 19. Installing an NIC Driver-Windows 22. Starting the Update Driver Software Wizard 24. QLogic 8100 Series Adapter Device Entries for Windows 25. Installing an FCoE Driver for Windows 28. Starting the Update Driver Software Wizard Downloading the Windows SuperInstaller 30. Prompt to Reboot 31. Select an Adapter and a Windows Operating System 33. Specify Additional Device 34. Insert Driver Disk 36. Install Additional Drivers 37. Windows Installation Type 39. Insert the Driver Disk Removing the Driver 41. Select Disk/LUN on which to Install Windows 42. Confirming Port Classification and Health Verifying Driver Installation 43. Network Adapters and Storage Controllers Obtaining the QLogic Firmware/Boot Code Firmware Upgrades 46. Download the Multi-boot Image Determining the Installed Firmware Version 47. Displaying the Adapter Firmware Version Using QConvergeConsole GUI or QConvergeConsole CLI Upgrading the Firmware/Boot Code 49. QConvergeConsole-Update Entire Image Updating Firmware Using QLogic Bios and Uefi Utilities Installing Management Tools 50. QConvergeConsole Download Selections Example Obtaining QLogic Adapter Management Utilities 51. Install the QConvergeConsole Introduction Installing and Launching the QConvergeConsole 53. Install the QConvergeConsole Pre-Installation Summary 54. Install the QConvergeConsole Installation Status To open QConvergeConsole locally on the server To open QConvergeConsole from a remote computer 58. Entering QConvergeConsole Web Address Example Standard Windows Interactive CLI Installation Installing and Launching the QConvergeConsole CLIQuiet or Unattended Windows Installation Passive Windows Installation QCCCLI.msi /i forceinstall=true Overwrite Previous Windows InstallationsStarting the QConvergeConsole CLI Page Operating System Requirements Installation in a Linux Environment Installation in a Linux Environment Installing Hardware External components Adapter Hardware Verify the Adapter Installation Click QLogic Products Click Adapters Installing the FCoE Driver qla2xxx Select an Adapter and a Linux Operating System #cd /media/RHEL 5.4 x8664 DVD/Server Compiling the QLogic Driver Executing the build.sh Script # ./extras/build.sh install # mkinitrd -f initrd-kernel version.img `uname -r` # cd /boot# shutdown -r now # modprobe -r qla2xxx Select an Adapter and Linux Operating System Installing the FCoE Driver for Rhel 5.3 Boot-from-SAN Download the FC-FCoE DD-Kit Rhel 5.3 Boot Screen Enter Installing the Networking Driver 11. Select an Adapter and a Linux Operating System # cd /media/RHEL 5.4 x8664 DVD/Server # tar -xzvf qlgex.x.x.xx-ddmmyyxxx.x.xx.tgz # cd qlge # make install # modprobe -v qlge # modprobe -r qlge # lsmod grep qla2xxx Verifying the Driver Installation# lsmod grep qlgc Removing Drivers # make uninstall# modinfo -F version qla2xxx 8.03.01.06.05.06-k # modinfo -F version qlgc 14. Select an Adapter and a Linux Operating System Displaying the Firmware Version Using the QConvergeConsole 15. Download the Multi-boot Image 16. Displaying the Adapter Firmware Version Displaying the Firmware Version Using sysfs Upgrading the Boot Code FirmwareUpgrading the Boot Code Using the QConvergeConsole GUI #cat /sys/class/scsihost/hostX/fwversion 5.03.02 8d4 18. QConvergeConsole-Update Entire Image Using QLogic Bios and Uefi Utilities Management Tool Installation 19. Download Linux Adapter Management Tools Obtaining the QLogic Adapter Management Tools 22. Install the QConvergeConsole Run in Terminal Selection Installing and Launching QConvergeConsole 23. Install the QConvergeConsole Installer Extracts FIles 25. Install the QConvergeConsole Pre-Installation Summary 26. Install the QConvergeConsole Installation Status Install Complete dialog box -27 opens To open QConvergeConsole from a remote computer 29. Entering QConvergeConsole Web Address Example QLogic Linux Utility Directories and Commands Installing and Launching the QLogic Linux ToolsDirectory Command QLogic Linux Utilities QLogic Linux Utility Directories and Commands Installation in a VMware Environment Installation in a VMware Environment Installing Hardware Installing the FCoE and Networking Drivers Select Adapter Software for VMware by Operating System Selecting the Summary Tab Opening the Temporary Driver Folder # esxupdate --bundle=network driver file.zip update # cd /vmfs/volumes/Storage1/esxconsole/temp# esxupdate --bundle=fcoe driver file.zip update # cd /mnt/cdrom/offline-bundle Validating Driver and Firmware Versions Verifying Driver Installation# ls /proc/scsi # ls /proc/scsi/qla2xxx 10. Displaying FCoE Adapter Driver Details Ifconfig -a 11. Displaying Networking Adapter Driver Details # ethtool -i vmnicN Identifying QLogic Adapters Using vSphere Client 13. Displaying Storage Adapters Using the vSphere Client Configuring NIC Using the vSphere Client 15. Configuring Networking Adapters 17. Selecting the Virtual Switch # esxcfg-boot -b Configuring the Driver Parameters# esxcfg-module -g qla2xxx # esxcfg-module -s options qla2xxx Driver Parameter Description # reboot Esxcfg-module Configurable Driver Parameters 19. Exiting Maintenance Mode Configuring a Hard Drive in a Virtual Machine 21. Virtual Machine Properties Window 22. Add Hardware-Device Type 24. Add Hardware-Select Target LUN 26. Add Hardware-Compatibility Mode 28. Add Hardware-Ready to Complete 30. Exiting Maintenance Mode Configuring a Network Adapter in a Virtual Machine 32. Virtual Machine Properties Window 33. Add Hardware-Select Adapter 35. Add Hardware-Ready to Complete Deploying Npiv for VMware ESX/ESXi Requirements for Using Npiv 37. Selecting a Managed Host Assigning WWNs to Virtual Machines 39. Create New Virtual Machine-Select a Disk 40. Create New Virtual Machine-Select Target LUN 42. Create New Virtual Machine-Compatibility Mode 44. Virtual Machine Properties-Generate New WWNs 45. Confirm Node and Port WWNs Managing the NIC Function with Windows Property pages Configuring the NIC in a Windows Environment Accessing Device Manager Adapters Properties Dialog Box Managing the NIC Function with the QConvergeConsole CLI Main Interactive Menu NIC Driver Parameters Windows Advanced tab or NIC Driver Parameters for Windows NIC Driver Parameters for Windows NIC Driver Parameters for Windows NIC Driver Parameters for Windows Offload Support Receive Side Scaling Concepts Receive Side Scaling Netsh int tcp show global Netsh int tcp set global rss = enabled Enabling RSS-Windows Advanced Properties Netsh int tcp set global rss = disabled Disable RSS-Windows Header Data Split HDS Disable RSS Per Port 10. Enabling or Disabling HDS NIC Teaming Switch Dependent Teaming Switch Independent Teaming 11. Host Level Info and Operations Menu Creating and Configuring a Team 12. Confirm VLAN/Teaming Driver Installation 13. Creating a Team 15. Deleting a Team Deleting a Team Vlan Tagging Configuring Vlan Tagging Using the Adapter NIC Function 16. Host Level Info & Operations Menu 18. Adding a Vlan to a Team Removing Vlan ID Assignment 19. Vlan Local Area Connection Entry Prerequisites for PXE Boot PXE Boot FE0254601-00 a PXE Protocol Operation 21. Boot Order in Bios 22. PXE Operation Parameter Name Description Default Allowed Configuration Configuring the NIC in a Linux EnvironmentNIC Driver Parameters Linux NIC Driver Parameters for Linux NIC Driver Parameters for Linux Modifying NIC Driver Parameters Linux Using modprobe #vi /etc/modprobe.conf # modprobe -v qlge qlgeirqtype =1 qlgempicoredump=0 23. Example modprobe.conf Sysfs Locations and Parameters Using sysfsSysfs Location Modifiable Driver Parameters # cd /sys/module/qlge/parameters # ethtool -K eth0 rx off Using ethtool# ethtool -k eth0 # /etc/sysconfig/network-scripts/ifdown eth0 # vi /etc/sysconfig/network-scripts/ifcfg-eth0# /etc/sysconfig/network-scripts/ifup eth0 # vi /etc/udev/rules.d/50-ethtool.rules Identifying the QLogic 8100 Adapter Network ID Using ifconfig # cd /sys/bus/pci/drivers/qla2xxx # ls -l 28. Verify NIC Driver qlge Ethtool -1 eth0 Offload Support Interrupt SupportNIC Bonding Linux Switch Dependent Bonding Switch Independent BondingBonding Prerequisites Ethernet Channel Bonding Driver Parameter Unit Description Default Allowed Values NameBonding Driver Parameters Linux Bonding Driver Parameters Created FE0254601-00 a Linux Bonding Driver Parameters # lsmod grep bonding Loading the Bonding Driver Changing Bonding Driver Parameters Unloading the Bonding Driver# modprobe -r bonding # modinfo bonding # vi /etc/modprobe.conf # modprobe -v miimon=100 mode=0Alias bond0 bonding Options bonding miimon=100 mode=0 # ifenslave bond0 eth0 eth1 Bonding Configuration # vi /etc/sysconfig/network-scripts/ifcfg-bond0 Persistent Bonding Configuration # service network restart Verify the Bonding ConfigurationMASTER=bond0 SLAVE=yes # ifconfig bond0 down # ifconfig bondX downDisabling a Bonding Network Interface # ifenslave -d bondX ethY Vlan Prerequisites Vlan Configuration Loading the Vlan 802.1q Kernel Module Configuring a VlanUnloading the Vlan 802.1q Kernel Module # vconfig add eth0 Etc/sysconfig/network-scripts/ directory # cat /proc/net/bonding/bond0 Verify the Vlan configuration Creating a Vlan on a Bond Interface Disabling a Vlan interface Wake On LAN 38. PXE Flow Diagram 39. Boot Order in Bios Setting the Client Servers Bios Boot OrderPage Driver Parameters Parameter Description Default Range Configuration MethodDriver Parameters Configuring FCoE in a Windows Environment Driver Parameters Driver Parameters Operation Mode ZIO Operation Mode Values Interrupt Delay Timer IDTNPort ID Virtualization Npiv Deployment Requirements QLogic CNA Npiv Solution Creating Virtual Ports Select Port to Create a Virtual Port Verifying Additional Virtual Ports Verifying the Virtual Ports Deleting Virtual Ports Select Virtual Ports to Delete Verifying Deletion of Virtual Ports  VPD Virtual Port Features and Limitations Priority and Bandwidth-Based QoS Implementing Adapter-Based Quality of Service Setting QoS by Bandwidth Boot-from-SAN Requirements Boot from SANHost/Server Requirements Converged Network Adapter Requirements FCoE Switch RequirementsStorage Array Requirements Boot-from-SAN Topologies Boot-from-SAN Configuration Single-Path Topology Single-Path Configuration Multipath Topology Multipath Topology Configuring an Adapter to Boot-from-SAN Selectable Boot Settings Menu Drvcfg -sdriverhandle controllerhandle Driver Configuration Main Menu 10. Edit Boot Settings Menu Configuring FCoE in a Windows Environment Boot from SAN Page FCoE Driver Parameters for Linux FCoE Driver Parameters for Linux Fast!UTIL Interrupt Delay Timer Time interval, in 100ms 255 LIP Bios Making Nonpersistent Changes Using modprobe Configuring Driver Parameters Using modprobe#modprobe -r qla2xxx Adding the Options Line to modprobe.conf Making Persistent Changes Using modprobe Configuring Driver Parameters Using sysfs FCoE Driver Parameters that can be Modified with Sysfs Configuring FCoE Parameters Using QLogic UtilitiesSysfs Location Driver Parameters Utility Installation Online or Offline How to Access Configuring FCoE Driver Parameters Using QConvergeConsoleQConvergeConsole and Fast!UTIL Comparison QConvergeConsole GUI FCoE Driver Parameters QConvergeConsole HBA Parameters QConvergeConsole Advanced HBA Parameters Configuring FCoE Driver Parameters Using Fast!UTIL Fast!UTIL FCoE Driver Parameters Adapter Settings Advanced Adapter Settings Fast!UTIL Advanced Adapter Settings Displaying FCoE Driver Parameters Using sysfs Sysfs Location Parameters Description Sysfs FCoE Driver Parameters and File Locations OstX/statistics Sys/class/scsihost Fwstate Firmware state #lspci grep QLogic Corp Identifying the Scsi Host ID #cd /sys/bus/pci/drivers/qla2xxx #ls -l 00008500.2/host #ls -l /sys/bus/pci/drivers/qla2xxx Displaying and Modifying sysfs Entries Online Storage Configuration Reconfiguration#cat /sys/class/scsihost/host6/fwversion #echo 1 /sys/class/scsihost/host6/beacon Interrupt Delay Timer ziotimer Adapter FCoE Performance TuningOperation Mode Parameter Queue Depth qla2xmaxqdepth QLogic CNA Npiv Solution #echo wwpnwwnn /sys/class/scsihost/hostX/vportcreate #cat /sys/class/scsihost/hostX/state Link Up FPort #ls -l /sys/class/scsihost/hostX Verifying the Creation of Virtual Ports# ls -l /sys/class/scsihost/host4/device #echo wwpnwwnn /sys/class/scsihost/hostX/vportdelete #cat /sys/class/scsihost/hostX/vportstate Differentiating Virtual Ports from Physical Ports in sysfs #echo 1 /sys/class/scsihost/hostX/vportdisableUnique Physical and Virtual Port sysfs Parameters 11. Comparing Npiv Physical and Virtual Ports Boot-from-SAN Boot-from-SAN Requirements Converged Network Adapter Requirements Single-Path Topology Boot-from-SAN Configuration Topologies 12. Single-Path Topology 13. Multipath Topology Configuring an Adapter to Boot-from-SAN 14. Selectable Boot Settings menu Drvcfg -sdriverhandle controllerhandle 15. Driver Configuration Main Menu 16. Edit Boot Settings Menu 17. Select Advanced Boot Loader Options Rhel 5 Install Booting from SAN Using a LUN Other Than LUN File Name Description Using the QLogic Linux Utilities Dynamic TGT-LUN Discovery Utility Package Contents10. Dynamic TGT-LUN Discovery Utility Package Files File Description 11. TGT-LUN Discovery Utility Command Line Options Using the Utility# ./ql-dynamic-tgt-lun-disc.sh command line options Option Description Abbreviation Task Command Examples 12. TGT-LUN Discovery Utility Tasks and Commands# ./ql-dynamic-tgt-lun-disc.sh --interactive 14. Select Host to Scan Menu 13. Dynamic TGT-LUN Main MenuOption Description HBA Collect Utility # ./ql-hba-collect.sh 15. HBA Collect Utility Package Files 16. FC HBA Snapshot Utility Package Files FC HBA Snapshot Utility# ./ql-hba-snapshot.sh Host number -a/--all options 18. FC HBA Snapshot Utility Command Example 17. FC HBA Snapshot Utility Command Line OptionsTask Command Example 19. FC HBA Change LUN State Utility Package Files FC HBA Change LUN State Utility# ./ql-hba-snapshot.sh --parameters 21. HBA Change LUN State Utility Command Examples 20. FC HBA Change LUN State Utility Command Line Options# ./ql-lun-state-online.sh 2 # ./ql-lun-state-online.sh --interactive # ./ql-lun-state-online.sh -interactive Set Device Command Timeout Utility # ./ql-set-cmd-timeout.sh Host # 22. Set Device Command Timeout Utility Package Files# ./ql-set-cmd-timeout.sh Host # Target # Sys/class/scsihost/hostX 23. Set Device Command Timeout Utility Command Options 24. Set Device Command Timeout Utility Command Examples 25. Set Device Command Timeout Utility Main Menu Options 22. Set Device Command Timeout Utility Main Menu 26. Select Target for HostX Menu Options 23. Select Target for HostX Menu 27. Modify/Display Timeout Menu Options Offline Utilities Starting Fast!UTIL Fast!UTIL Selecting an Adapter Adapter Settings Configuration Settings Parameter Description Adapter Setting Parameters Selectable Boot Setting Window Selectable Boot Settings Select Fibre Channel Device Window Selectable Boot Settings Window Parameters Restore Default Settings Advanced Adapter SettingsRaw Nvram Data Advanced Settings Window Parameters Scan Fibre Channel Devices Loopback Data Test Fibre Disk UtilitySelect Host Adapter Exit Fast!UTIL Eficfg FlasUTIL Installing FlasUTIL FlasUTIL Command Line Options Using FlasUTILOption Function Installing the Multi-boot Image Efiutil Efiutil Efiutil Adapter Port LEDs Link/Ethernet Storage Traffic Hardware State Traffic LED Table A-1. Configuration Options for Virtual Ports Cisco Nexus 5000 Series Switch Configuration Nexusmv1# show feature Enable FCoE on the Switch Configure the Physical Ethernet Interface Switch Port Create and Configure the Vlan Create and Configure a Virtual Fibre Channel Interface # copy running-config startup-config Verify that the Adapter Is Logged into the Switch# show interface vfc Page Brocade CEE/FCoE Switch/Blade Configuration Admin fosconfig -show Enable the Ethernet Switch ServiceAdmin slotpoweroff 7 admin slotpoweron Admin slotshow -m # configure terminal Create and Configure FCoE VlanConfig# interface vlan Config# cee-map demo Create and Configure CEE-MAPConf-ceemap#priority-group- weight 40 pfc Conf-ceemap#priority-group- weight Config# do show cee maps CEE Map demo Configure LLDP/DCBX for FCoEConfig# protocol lldp Config# advertise dcbx-fcoe-app-tlv Config# interface tengigabitethernet 0/19 Configure CEE PortConf-if-te-0/19#switchport mode converged Conf-if-te-0/19#vlan classifier activate group 1 vlan Conf-if-te-0/19#do fos fcoe --loginshow Page Page Corporate Headquarters QLogic Corporation