Q-Logic 8100 SERIES instruction

C–Brocade CEE/FCoE Switch/Blade Configuration Verify that the Adapter is Logged into the Switch

C-8	FE0254601-00 A

Image 346

Q-Logic 8100 SERIES manual

Contents

User’s Guide Document Revision History Table of Contents Installation in a Windows Environment Management Tools Installation in a Linux Environment Installation in a VMware Environment FE0254601-00 a Vii Configuring FCoE in a Windows Environment Configuring FCoE in a Linux Environment User’s Guide Converged Network Adapter Series Adapters Brocade CEE/FCoE Switch/Blade Configuration Offline Utilities List of Figures Xii FE0254601-00 a Xiii Xiv FE0254601-00 a User’s Guide Converged Network Adapter Series Adapters List of Tables FE0254601-00 a Xvii Page Preface What’s in This Guide Related Materials Intended AudienceDocumentation Conventions  See Installation Checklist on License Agreements Training Technical SupportContact Information Legal Notices WarrantyLaser Safety Knowledge Database EMI and EMC Requirements CNS 13438 Class a QLE8xxx Product Safety Compliance MIC Class a QLE81xx Preface Legal Notices Xxvi FE0254601-00 a Verify the Package Contents Installation InstructionsInstall the Adapter Hardware Install the Adapter Drivers Figure i Illustration of Sample Motherboard and Slots Install QConvergeConsole Management Tools Additional Resources Quick Start Additional Resources Xxx FE0254601-00 a QLogic 8100 Series Converged Network Adapters What is a Converged Network Adapter?Product Part Number What is Enhanced Ethernet? What is Fibre Channel over Ethernet FCoE? QLogic Converged Network Adapter FCoE Network Deployment Series Converged Network Adapters Hardware Components FCoE Deployment Series Adapter Components Function Software Components Hardware Function Component Boot Code Operating System Driver Firmware Management Tools and Utilities Software and Firmware Components Component Operating System Comments QLogic Supported a  Bios Physical and Electrical Specification Adapter SpecificationsSpecification Description Transceiver Requirements FCoE SpecificationsFeature Description Active Passive SR Optics Optics Not Adapter Sold by Ethernet Specifications Ethernet Specifications Management Specifications Overview QConvergeConsole Web Management GUI QConvergeConsole Management Agents qlremote/netqlremote QConvergeConsole CLI Offline Utilities Management Tools Offline Utilities System Requirements Server and Switch RequirementsOperating Systems Requirements Cabling Requirements Downloading QLogic DriversOther Requirements Select an Adapter and a Windows Operating System Installing Hardware Download Drivers for Windows Servers Install the Adapter Verify the Adapter Installation Adapter Hardware Installing Software Drivers Command Output Identifying Unnamed Devices Device Properties Installing and Updating Drivers Using Device Manager Installing the NIC Driver for Windows Server QLogic 8100 Series Adapter Device Entries Typical QLogic 8100 Series Ethernet Adapter Port Entries 11. Starting the Hardware Update Wizard Installing the FCoE Driver for Windows Server 12. Confirming the Ethernet Adapter 13. QLogic 8100 Series Adapter Device Entries 16. Updating an FCoE Driver 18. QLogic 8100 Series Adapter Device Entries-Windows 19. Installing an NIC Driver-Windows 22. Starting the Update Driver Software Wizard 24. QLogic 8100 Series Adapter Device Entries for Windows 25. Installing an FCoE Driver for Windows 28. Starting the Update Driver Software Wizard 30. Prompt to Reboot Downloading the Windows SuperInstaller 31. Select an Adapter and a Windows Operating System 33. Specify Additional Device 34. Insert Driver Disk 36. Install Additional Drivers 37. Windows Installation Type 39. Insert the Driver Disk 41. Select Disk/LUN on which to Install Windows Removing the Driver Verifying Driver Installation 42. Confirming Port Classification and Health 43. Network Adapters and Storage Controllers Firmware Upgrades Obtaining the QLogic Firmware/Boot Code Determining the Installed Firmware Version 46. Download the Multi-boot Image 47. Displaying the Adapter Firmware Version Upgrading the Firmware/Boot Code Using QConvergeConsole GUI or QConvergeConsole CLI 49. QConvergeConsole-Update Entire Image Installing Management Tools Updating Firmware Using QLogic Bios and Uefi Utilities Obtaining QLogic Adapter Management Utilities 50. QConvergeConsole Download Selections Example Installing and Launching the QConvergeConsole 51. Install the QConvergeConsole Introduction 53. Install the QConvergeConsole Pre-Installation Summary 54. Install the QConvergeConsole Installation Status To open QConvergeConsole locally on the server To open QConvergeConsole from a remote computer 58. Entering QConvergeConsole Web Address Example Quiet or Unattended Windows Installation Installing and Launching the QConvergeConsole CLIStandard Windows Interactive CLI Installation Passive Windows Installation QCCCLI.msi /i forceinstall=true Overwrite Previous Windows InstallationsStarting the QConvergeConsole CLI Page Installation in a Linux Environment Operating System Requirements Installation in a Linux Environment Installing Hardware External components Adapter Hardware Verify the Adapter Installation Installing the FCoE Driver qla2xxx Click QLogic Products Click Adapters Select an Adapter and a Linux Operating System Compiling the QLogic Driver #cd /media/RHEL 5.4 x8664 DVD/Server # ./extras/build.sh install Executing the build.sh Script # shutdown -r now # cd /boot# mkinitrd -f initrd-kernel version.img `uname -r` # modprobe -r qla2xxx Installing the FCoE Driver for Rhel 5.3 Boot-from-SAN Select an Adapter and Linux Operating System Download the FC-FCoE DD-Kit Rhel 5.3 Boot Screen Installing the Networking Driver Enter 11. Select an Adapter and a Linux Operating System # cd /media/RHEL 5.4 x8664 DVD/Server # make install # tar -xzvf qlgex.x.x.xx-ddmmyyxxx.x.xx.tgz # cd qlge # modprobe -r qlge # modprobe -v qlge # lsmod grep qla2xxx Verifying the Driver Installation# lsmod grep qlgc # modinfo -F version qla2xxx 8.03.01.06.05.06-k # make uninstallRemoving Drivers # modinfo -F version qlgc 14. Select an Adapter and a Linux Operating System 15. Download the Multi-boot Image Displaying the Firmware Version Using the QConvergeConsole 16. Displaying the Adapter Firmware Version Upgrading the Boot Code Using the QConvergeConsole GUI Upgrading the Boot Code FirmwareDisplaying the Firmware Version Using sysfs #cat /sys/class/scsihost/hostX/fwversion 5.03.02 8d4 18. QConvergeConsole-Update Entire Image Management Tool Installation Using QLogic Bios and Uefi Utilities Obtaining the QLogic Adapter Management Tools 19. Download Linux Adapter Management Tools Installing and Launching QConvergeConsole 22. Install the QConvergeConsole Run in Terminal Selection 23. Install the QConvergeConsole Installer Extracts FIles 25. Install the QConvergeConsole Pre-Installation Summary 26. Install the QConvergeConsole Installation Status Install Complete dialog box -27 opens To open QConvergeConsole from a remote computer 29. Entering QConvergeConsole Web Address Example Directory Command Installing and Launching the QLogic Linux ToolsQLogic Linux Utility Directories and Commands QLogic Linux Utilities QLogic Linux Utility Directories and Commands Installation in a VMware Environment Installation in a VMware Environment Installing Hardware Installing the FCoE and Networking Drivers Select Adapter Software for VMware by Operating System Selecting the Summary Tab Opening the Temporary Driver Folder # esxupdate --bundle=fcoe driver file.zip update # cd /vmfs/volumes/Storage1/esxconsole/temp# esxupdate --bundle=network driver file.zip update # cd /mnt/cdrom/offline-bundle # ls /proc/scsi Verifying Driver InstallationValidating Driver and Firmware Versions # ls /proc/scsi/qla2xxx Ifconfig -a 10. Displaying FCoE Adapter Driver Details 11. Displaying Networking Adapter Driver Details Identifying QLogic Adapters Using vSphere Client # ethtool -i vmnicN Configuring NIC Using the vSphere Client 13. Displaying Storage Adapters Using the vSphere Client 15. Configuring Networking Adapters 17. Selecting the Virtual Switch # esxcfg-module -g qla2xxx Configuring the Driver Parameters# esxcfg-boot -b # esxcfg-module -s options qla2xxx # reboot Driver Parameter Description Esxcfg-module Configurable Driver Parameters Configuring a Hard Drive in a Virtual Machine 19. Exiting Maintenance Mode 21. Virtual Machine Properties Window 22. Add Hardware-Device Type 24. Add Hardware-Select Target LUN 26. Add Hardware-Compatibility Mode 28. Add Hardware-Ready to Complete Configuring a Network Adapter in a Virtual Machine 30. Exiting Maintenance Mode 32. Virtual Machine Properties Window 33. Add Hardware-Select Adapter 35. Add Hardware-Ready to Complete Requirements for Using Npiv Deploying Npiv for VMware ESX/ESXi Assigning WWNs to Virtual Machines 37. Selecting a Managed Host 39. Create New Virtual Machine-Select a Disk 40. Create New Virtual Machine-Select Target LUN 42. Create New Virtual Machine-Compatibility Mode 44. Virtual Machine Properties-Generate New WWNs 45. Confirm Node and Port WWNs Configuring the NIC in a Windows Environment Managing the NIC Function with Windows Property pages Accessing Device Manager Managing the NIC Function with the QConvergeConsole CLI Adapters Properties Dialog Box NIC Driver Parameters Windows Main Interactive Menu NIC Driver Parameters for Windows Advanced tab or NIC Driver Parameters for Windows NIC Driver Parameters for Windows NIC Driver Parameters for Windows Offload Support Receive Side Scaling Receive Side Scaling Concepts Netsh int tcp set global rss = enabled Netsh int tcp show global Enabling RSS-Windows Advanced Properties Disable RSS-Windows Netsh int tcp set global rss = disabled Disable RSS Per Port Header Data Split HDS NIC Teaming 10. Enabling or Disabling HDS Switch Independent Teaming Switch Dependent Teaming Creating and Configuring a Team 11. Host Level Info and Operations Menu 12. Confirm VLAN/Teaming Driver Installation 13. Creating a Team Deleting a Team 15. Deleting a Team Configuring Vlan Tagging Using the Adapter NIC Function Vlan Tagging 16. Host Level Info & Operations Menu 18. Adding a Vlan to a Team 19. Vlan Local Area Connection Entry Removing Vlan ID Assignment PXE Boot Prerequisites for PXE Boot FE0254601-00 a 21. Boot Order in Bios PXE Protocol Operation 22. PXE Operation NIC Driver Parameters Linux Configuring the NIC in a Linux EnvironmentParameter Name Description Default Allowed Configuration NIC Driver Parameters for Linux NIC Driver Parameters for Linux Using modprobe Modifying NIC Driver Parameters Linux # modprobe -v qlge qlgeirqtype =1 qlgempicoredump=0 #vi /etc/modprobe.conf 23. Example modprobe.conf Sysfs Location Modifiable Driver Parameters Using sysfsSysfs Locations and Parameters # cd /sys/module/qlge/parameters # ethtool -K eth0 rx off Using ethtool# ethtool -k eth0 # /etc/sysconfig/network-scripts/ifup eth0 # vi /etc/sysconfig/network-scripts/ifcfg-eth0# /etc/sysconfig/network-scripts/ifdown eth0 # vi /etc/udev/rules.d/50-ethtool.rules Using ifconfig Identifying the QLogic 8100 Adapter Network ID 28. Verify NIC Driver qlge # cd /sys/bus/pci/drivers/qla2xxx # ls -l Ethtool -1 eth0 Offload Support Interrupt SupportNIC Bonding Linux Switch Dependent Bonding Switch Independent BondingBonding Prerequisites Bonding Driver Parameters Parameter Unit Description Default Allowed Values NameEthernet Channel Bonding Driver Linux Bonding Driver Parameters Created FE0254601-00 a Linux Bonding Driver Parameters Loading the Bonding Driver # lsmod grep bonding # modprobe -r bonding Unloading the Bonding DriverChanging Bonding Driver Parameters # modinfo bonding # vi /etc/modprobe.conf # modprobe -v miimon=100 mode=0Alias bond0 bonding Options bonding miimon=100 mode=0 Bonding Configuration # ifenslave bond0 eth0 eth1 Persistent Bonding Configuration # vi /etc/sysconfig/network-scripts/ifcfg-bond0 # service network restart Verify the Bonding ConfigurationMASTER=bond0 SLAVE=yes Disabling a Bonding Network Interface # ifconfig bondX down# ifconfig bond0 down # ifenslave -d bondX ethY Vlan Configuration Vlan Prerequisites Loading the Vlan 802.1q Kernel Module Configuring a VlanUnloading the Vlan 802.1q Kernel Module Etc/sysconfig/network-scripts/ directory # vconfig add eth0 Verify the Vlan configuration # cat /proc/net/bonding/bond0 Disabling a Vlan interface Creating a Vlan on a Bond Interface Wake On LAN 38. PXE Flow Diagram Setting the Client Servers Bios Boot Order 39. Boot Order in BiosPage Driver Parameters Parameter Description Default Range Configuration MethodDriver Parameters Configuring FCoE in a Windows Environment Driver Parameters Driver Parameters Operation Mode ZIO Operation Mode Values Interrupt Delay Timer IDTNPort ID Virtualization QLogic CNA Npiv Solution Npiv Deployment Requirements Creating Virtual Ports Select Port to Create a Virtual Port Verifying the Virtual Ports Verifying Additional Virtual Ports Deleting Virtual Ports Verifying Deletion of Virtual Ports Select Virtual Ports to Delete Virtual Port Features and Limitations  VPD Implementing Adapter-Based Quality of Service Priority and Bandwidth-Based QoS Setting QoS by Bandwidth Boot-from-SAN Requirements Boot from SANHost/Server Requirements Converged Network Adapter Requirements FCoE Switch RequirementsStorage Array Requirements Boot-from-SAN Configuration Boot-from-SAN Topologies Single-Path Configuration Single-Path Topology Multipath Topology Multipath Topology Configuring an Adapter to Boot-from-SAN Selectable Boot Settings Menu Drvcfg -sdriverhandle controllerhandle Driver Configuration Main Menu 10. Edit Boot Settings Menu Configuring FCoE in a Windows Environment Boot from SAN Page FCoE Driver Parameters for Linux FCoE Driver Parameters for Linux Fast!UTIL Interrupt Delay Timer Time interval, in 100ms 255 LIP Bios Making Nonpersistent Changes Using modprobe Configuring Driver Parameters Using modprobe#modprobe -r qla2xxx Making Persistent Changes Using modprobe Adding the Options Line to modprobe.conf Configuring Driver Parameters Using sysfs FCoE Driver Parameters that can be Modified with Sysfs Configuring FCoE Parameters Using QLogic UtilitiesSysfs Location Driver Parameters QConvergeConsole and Fast!UTIL Comparison Configuring FCoE Driver Parameters Using QConvergeConsoleUtility Installation Online or Offline How to Access QConvergeConsole GUI FCoE Driver Parameters QConvergeConsole HBA Parameters Configuring FCoE Driver Parameters Using Fast!UTIL QConvergeConsole Advanced HBA Parameters Adapter Settings Advanced Adapter Settings Fast!UTIL FCoE Driver Parameters Displaying FCoE Driver Parameters Using sysfs Fast!UTIL Advanced Adapter Settings Sysfs FCoE Driver Parameters and File Locations Sysfs Location Parameters Description OstX/statistics Sys/class/scsihost Fwstate Firmware state Identifying the Scsi Host ID #lspci grep QLogic Corp #ls -l /sys/bus/pci/drivers/qla2xxx #cd /sys/bus/pci/drivers/qla2xxx #ls -l 00008500.2/host #cat /sys/class/scsihost/host6/fwversion Online Storage Configuration ReconfigurationDisplaying and Modifying sysfs Entries #echo 1 /sys/class/scsihost/host6/beacon Interrupt Delay Timer ziotimer Adapter FCoE Performance TuningOperation Mode Parameter Queue Depth qla2xmaxqdepth QLogic CNA Npiv Solution #cat /sys/class/scsihost/hostX/state Link Up FPort #echo wwpnwwnn /sys/class/scsihost/hostX/vportcreate #ls -l /sys/class/scsihost/hostX Verifying the Creation of Virtual Ports# ls -l /sys/class/scsihost/host4/device #cat /sys/class/scsihost/hostX/vportstate #echo wwpnwwnn /sys/class/scsihost/hostX/vportdelete Differentiating Virtual Ports from Physical Ports in sysfs #echo 1 /sys/class/scsihost/hostX/vportdisableUnique Physical and Virtual Port sysfs Parameters Boot-from-SAN 11. Comparing Npiv Physical and Virtual Ports Boot-from-SAN Requirements Converged Network Adapter Requirements Boot-from-SAN Configuration Topologies Single-Path Topology 12. Single-Path Topology 13. Multipath Topology Configuring an Adapter to Boot-from-SAN 14. Selectable Boot Settings menu Drvcfg -sdriverhandle controllerhandle 15. Driver Configuration Main Menu 16. Edit Boot Settings Menu Booting from SAN Using a LUN Other Than LUN 17. Select Advanced Boot Loader Options Rhel 5 Install Using the QLogic Linux Utilities File Name Description 10. Dynamic TGT-LUN Discovery Utility Package Files Package ContentsDynamic TGT-LUN Discovery Utility File Description # ./ql-dynamic-tgt-lun-disc.sh command line options Using the Utility11. TGT-LUN Discovery Utility Command Line Options Option Description Abbreviation Task Command Examples 12. TGT-LUN Discovery Utility Tasks and Commands# ./ql-dynamic-tgt-lun-disc.sh --interactive 14. Select Host to Scan Menu 13. Dynamic TGT-LUN Main MenuOption Description HBA Collect Utility 15. HBA Collect Utility Package Files # ./ql-hba-collect.sh 16. FC HBA Snapshot Utility Package Files FC HBA Snapshot Utility# ./ql-hba-snapshot.sh Host number -a/--all options 18. FC HBA Snapshot Utility Command Example 17. FC HBA Snapshot Utility Command Line OptionsTask Command Example 19. FC HBA Change LUN State Utility Package Files FC HBA Change LUN State Utility# ./ql-hba-snapshot.sh --parameters # ./ql-lun-state-online.sh 2 20. FC HBA Change LUN State Utility Command Line Options21. HBA Change LUN State Utility Command Examples # ./ql-lun-state-online.sh --interactive Set Device Command Timeout Utility # ./ql-lun-state-online.sh -interactive # ./ql-set-cmd-timeout.sh Host # 22. Set Device Command Timeout Utility Package Files# ./ql-set-cmd-timeout.sh Host # Target # 23. Set Device Command Timeout Utility Command Options Sys/class/scsihost/hostX 24. Set Device Command Timeout Utility Command Examples 22. Set Device Command Timeout Utility Main Menu 25. Set Device Command Timeout Utility Main Menu Options 23. Select Target for HostX Menu 26. Select Target for HostX Menu Options 27. Modify/Display Timeout Menu Options Offline Utilities Fast!UTIL Starting Fast!UTIL Selecting an Adapter Configuration Settings Adapter Settings Adapter Setting Parameters Parameter Description Selectable Boot Settings Selectable Boot Setting Window Selectable Boot Settings Window Parameters Select Fibre Channel Device Window Restore Default Settings Advanced Adapter SettingsRaw Nvram Data Advanced Settings Window Parameters Scan Fibre Channel Devices Loopback Data Test Fibre Disk UtilitySelect Host Adapter Eficfg Exit Fast!UTIL Installing FlasUTIL FlasUTIL FlasUTIL Command Line Options Using FlasUTILOption Function Installing the Multi-boot Image Efiutil Efiutil Efiutil Adapter Port LEDs Table A-1. Configuration Options for Virtual Ports Link/Ethernet Storage Traffic Hardware State Traffic LED Cisco Nexus 5000 Series Switch Configuration Enable FCoE on the Switch Nexusmv1# show feature Create and Configure the Vlan Configure the Physical Ethernet Interface Switch Port Create and Configure a Virtual Fibre Channel Interface # copy running-config startup-config Verify that the Adapter Is Logged into the Switch# show interface vfc Page Brocade CEE/FCoE Switch/Blade Configuration Admin slotpoweroff 7 admin slotpoweron Enable the Ethernet Switch ServiceAdmin fosconfig -show Admin slotshow -m # configure terminal Create and Configure FCoE VlanConfig# interface vlan Conf-ceemap#priority-group- weight 40 pfc Create and Configure CEE-MAPConfig# cee-map demo Conf-ceemap#priority-group- weight Config# protocol lldp Configure LLDP/DCBX for FCoEConfig# do show cee maps CEE Map demo Config# advertise dcbx-fcoe-app-tlv Conf-if-te-0/19#switchport mode converged Configure CEE PortConfig# interface tengigabitethernet 0/19 Conf-if-te-0/19#vlan classifier activate group 1 vlan Conf-if-te-0/19#do fos fcoe --loginshow Page Page Corporate Headquarters QLogic Corporation