Multipath Topology | Q-Logic 8100 SERIES specs

8–Configuring FCoE in a Linux Environment Boot-from-SAN

Server

CNA Port 1 CNA Port 2

Converged	Converged
Networking	Networking
Switch 1	Switch 2

Controller A

Controller B

Storage Array

LUN 1 (Primary Boot Device)

LUN 3 (Alternate Boot Device)

LUN 2 (Alternate Boot Device)

LUN 4 (Alternate Boot Device)

Figure 8-13. Multipath Topology

8-34	FE0254601-00 A

Image 288

Q-Logic 8100 SERIES manual Multipath Topology

Contents

User’s Guide Document Revision History Table of Contents Installation in a Windows Environment Management Tools Installation in a Linux Environment Installation in a VMware Environment FE0254601-00 a Vii Configuring FCoE in a Windows Environment Configuring FCoE in a Linux Environment User’s Guide Converged Network Adapter Series Adapters Brocade CEE/FCoE Switch/Blade Configuration Offline Utilities List of Figures Xii FE0254601-00 a Xiii Xiv FE0254601-00 a User’s Guide Converged Network Adapter Series Adapters List of Tables FE0254601-00 a Xvii Page Preface What’s in This Guide Intended Audience Related MaterialsDocumentation Conventions  See Installation Checklist on License Agreements Technical Support TrainingContact Information Warranty Laser SafetyLegal Notices Knowledge Database EMI and EMC Requirements CNS 13438 Class a QLE8xxx Product Safety Compliance MIC Class a QLE81xx Preface Legal Notices Xxvi FE0254601-00 a Installation Instructions Verify the Package ContentsInstall the Adapter Hardware Install the Adapter Drivers Figure i Illustration of Sample Motherboard and Slots Install QConvergeConsole Management Tools Additional Resources Quick Start Additional Resources Xxx FE0254601-00 a What is a Converged Network Adapter? QLogic 8100 Series Converged Network AdaptersProduct Part Number What is Enhanced Ethernet? What is Fibre Channel over Ethernet FCoE? QLogic Converged Network Adapter FCoE Network Deployment Series Converged Network Adapters Hardware Components FCoE Deployment Series Adapter Components Function Software Components Hardware Function Component Boot Code Operating System Driver Firmware Management Tools and Utilities Software and Firmware Components Component Operating System Comments QLogic Supported a  Bios Adapter Specifications Physical and Electrical SpecificationSpecification Description FCoE Specifications Feature DescriptionTransceiver Requirements Active Passive SR Optics Optics Not Adapter Sold by Ethernet Specifications Ethernet Specifications Management Specifications Overview QConvergeConsole Web Management GUI QConvergeConsole Management Agents qlremote/netqlremote QConvergeConsole CLI Offline Utilities Management Tools Offline Utilities Server and Switch Requirements System RequirementsOperating Systems Requirements Downloading QLogic Drivers Cabling RequirementsOther Requirements Select an Adapter and a Windows Operating System Installing Hardware Download Drivers for Windows Servers Install the Adapter Verify the Adapter Installation Adapter Hardware Installing Software Drivers Command Output Identifying Unnamed Devices Device Properties Installing and Updating Drivers Using Device Manager Installing the NIC Driver for Windows Server QLogic 8100 Series Adapter Device Entries Typical QLogic 8100 Series Ethernet Adapter Port Entries 11. Starting the Hardware Update Wizard Installing the FCoE Driver for Windows Server 12. Confirming the Ethernet Adapter 13. QLogic 8100 Series Adapter Device Entries 16. Updating an FCoE Driver 18. QLogic 8100 Series Adapter Device Entries-Windows 19. Installing an NIC Driver-Windows 22. Starting the Update Driver Software Wizard 24. QLogic 8100 Series Adapter Device Entries for Windows 25. Installing an FCoE Driver for Windows 28. Starting the Update Driver Software Wizard 30. Prompt to Reboot Downloading the Windows SuperInstaller 31. Select an Adapter and a Windows Operating System 33. Specify Additional Device 34. Insert Driver Disk 36. Install Additional Drivers 37. Windows Installation Type 39. Insert the Driver Disk 41. Select Disk/LUN on which to Install Windows Removing the Driver Verifying Driver Installation 42. Confirming Port Classification and Health 43. Network Adapters and Storage Controllers Firmware Upgrades Obtaining the QLogic Firmware/Boot Code Determining the Installed Firmware Version 46. Download the Multi-boot Image 47. Displaying the Adapter Firmware Version Upgrading the Firmware/Boot Code Using QConvergeConsole GUI or QConvergeConsole CLI 49. QConvergeConsole-Update Entire Image Installing Management Tools Updating Firmware Using QLogic Bios and Uefi Utilities Obtaining QLogic Adapter Management Utilities 50. QConvergeConsole Download Selections Example Installing and Launching the QConvergeConsole 51. Install the QConvergeConsole Introduction 53. Install the QConvergeConsole Pre-Installation Summary 54. Install the QConvergeConsole Installation Status To open QConvergeConsole locally on the server To open QConvergeConsole from a remote computer 58. Entering QConvergeConsole Web Address Example Installing and Launching the QConvergeConsole CLI Standard Windows Interactive CLI InstallationQuiet or Unattended Windows Installation Passive Windows Installation Overwrite Previous Windows Installations QCCCLI.msi /i forceinstall=trueStarting the QConvergeConsole CLI Page Installation in a Linux Environment Operating System Requirements Installation in a Linux Environment Installing Hardware External components Adapter Hardware Verify the Adapter Installation Installing the FCoE Driver qla2xxx Click QLogic Products Click Adapters Select an Adapter and a Linux Operating System Compiling the QLogic Driver #cd /media/RHEL 5.4 x8664 DVD/Server # ./extras/build.sh install Executing the build.sh Script # cd /boot # mkinitrd -f initrd-kernel version.img `uname -r`# shutdown -r now # modprobe -r qla2xxx Installing the FCoE Driver for Rhel 5.3 Boot-from-SAN Select an Adapter and Linux Operating System Download the FC-FCoE DD-Kit Rhel 5.3 Boot Screen Installing the Networking Driver Enter 11. Select an Adapter and a Linux Operating System # cd /media/RHEL 5.4 x8664 DVD/Server # make install # tar -xzvf qlgex.x.x.xx-ddmmyyxxx.x.xx.tgz # cd qlge # modprobe -r qlge # modprobe -v qlge Verifying the Driver Installation # lsmod grep qla2xxx# lsmod grep qlgc # make uninstall Removing Drivers# modinfo -F version qla2xxx 8.03.01.06.05.06-k # modinfo -F version qlgc 14. Select an Adapter and a Linux Operating System 15. Download the Multi-boot Image Displaying the Firmware Version Using the QConvergeConsole 16. Displaying the Adapter Firmware Version Upgrading the Boot Code Firmware Displaying the Firmware Version Using sysfsUpgrading the Boot Code Using the QConvergeConsole GUI #cat /sys/class/scsihost/hostX/fwversion 5.03.02 8d4 18. QConvergeConsole-Update Entire Image Management Tool Installation Using QLogic Bios and Uefi Utilities Obtaining the QLogic Adapter Management Tools 19. Download Linux Adapter Management Tools Installing and Launching QConvergeConsole 22. Install the QConvergeConsole Run in Terminal Selection 23. Install the QConvergeConsole Installer Extracts FIles 25. Install the QConvergeConsole Pre-Installation Summary 26. Install the QConvergeConsole Installation Status Install Complete dialog box -27 opens To open QConvergeConsole from a remote computer 29. Entering QConvergeConsole Web Address Example Installing and Launching the QLogic Linux Tools QLogic Linux Utility Directories and CommandsDirectory Command QLogic Linux Utilities QLogic Linux Utility Directories and Commands Installation in a VMware Environment Installation in a VMware Environment Installing Hardware Installing the FCoE and Networking Drivers Select Adapter Software for VMware by Operating System Selecting the Summary Tab Opening the Temporary Driver Folder # cd /vmfs/volumes/Storage1/esxconsole/temp # esxupdate --bundle=network driver file.zip update# esxupdate --bundle=fcoe driver file.zip update # cd /mnt/cdrom/offline-bundle Verifying Driver Installation Validating Driver and Firmware Versions# ls /proc/scsi # ls /proc/scsi/qla2xxx Ifconfig -a 10. Displaying FCoE Adapter Driver Details 11. Displaying Networking Adapter Driver Details Identifying QLogic Adapters Using vSphere Client # ethtool -i vmnicN Configuring NIC Using the vSphere Client 13. Displaying Storage Adapters Using the vSphere Client 15. Configuring Networking Adapters 17. Selecting the Virtual Switch Configuring the Driver Parameters # esxcfg-boot -b# esxcfg-module -g qla2xxx # esxcfg-module -s options qla2xxx # reboot Driver Parameter Description Esxcfg-module Configurable Driver Parameters Configuring a Hard Drive in a Virtual Machine 19. Exiting Maintenance Mode 21. Virtual Machine Properties Window 22. Add Hardware-Device Type 24. Add Hardware-Select Target LUN 26. Add Hardware-Compatibility Mode 28. Add Hardware-Ready to Complete Configuring a Network Adapter in a Virtual Machine 30. Exiting Maintenance Mode 32. Virtual Machine Properties Window 33. Add Hardware-Select Adapter 35. Add Hardware-Ready to Complete Requirements for Using Npiv Deploying Npiv for VMware ESX/ESXi Assigning WWNs to Virtual Machines 37. Selecting a Managed Host 39. Create New Virtual Machine-Select a Disk 40. Create New Virtual Machine-Select Target LUN 42. Create New Virtual Machine-Compatibility Mode 44. Virtual Machine Properties-Generate New WWNs 45. Confirm Node and Port WWNs Configuring the NIC in a Windows Environment Managing the NIC Function with Windows Property pages Accessing Device Manager Managing the NIC Function with the QConvergeConsole CLI Adapters Properties Dialog Box NIC Driver Parameters Windows Main Interactive Menu NIC Driver Parameters for Windows Advanced tab or NIC Driver Parameters for Windows NIC Driver Parameters for Windows NIC Driver Parameters for Windows Offload Support Receive Side Scaling Receive Side Scaling Concepts Netsh int tcp set global rss = enabled Netsh int tcp show global Enabling RSS-Windows Advanced Properties Disable RSS-Windows Netsh int tcp set global rss = disabled Disable RSS Per Port Header Data Split HDS NIC Teaming 10. Enabling or Disabling HDS Switch Independent Teaming Switch Dependent Teaming Creating and Configuring a Team 11. Host Level Info and Operations Menu 12. Confirm VLAN/Teaming Driver Installation 13. Creating a Team Deleting a Team 15. Deleting a Team Configuring Vlan Tagging Using the Adapter NIC Function Vlan Tagging 16. Host Level Info & Operations Menu 18. Adding a Vlan to a Team 19. Vlan Local Area Connection Entry Removing Vlan ID Assignment PXE Boot Prerequisites for PXE Boot FE0254601-00 a 21. Boot Order in Bios PXE Protocol Operation 22. PXE Operation Configuring the NIC in a Linux Environment Parameter Name Description Default Allowed ConfigurationNIC Driver Parameters Linux NIC Driver Parameters for Linux NIC Driver Parameters for Linux Using modprobe Modifying NIC Driver Parameters Linux # modprobe -v qlge qlgeirqtype =1 qlgempicoredump=0 #vi /etc/modprobe.conf 23. Example modprobe.conf Using sysfs Sysfs Locations and ParametersSysfs Location Modifiable Driver Parameters # cd /sys/module/qlge/parameters Using ethtool # ethtool -K eth0 rx off# ethtool -k eth0 # vi /etc/sysconfig/network-scripts/ifcfg-eth0 # /etc/sysconfig/network-scripts/ifdown eth0# /etc/sysconfig/network-scripts/ifup eth0 # vi /etc/udev/rules.d/50-ethtool.rules Using ifconfig Identifying the QLogic 8100 Adapter Network ID 28. Verify NIC Driver qlge # cd /sys/bus/pci/drivers/qla2xxx # ls -l Ethtool -1 eth0 Interrupt Support Offload SupportNIC Bonding Linux Switch Independent Bonding Switch Dependent BondingBonding Prerequisites Parameter Unit Description Default Allowed Values Name Ethernet Channel Bonding DriverBonding Driver Parameters Linux Bonding Driver Parameters Created FE0254601-00 a Linux Bonding Driver Parameters Loading the Bonding Driver # lsmod grep bonding Unloading the Bonding Driver Changing Bonding Driver Parameters# modprobe -r bonding # modinfo bonding # modprobe -v miimon=100 mode=0 # vi /etc/modprobe.confAlias bond0 bonding Options bonding miimon=100 mode=0 Bonding Configuration # ifenslave bond0 eth0 eth1 Persistent Bonding Configuration # vi /etc/sysconfig/network-scripts/ifcfg-bond0 Verify the Bonding Configuration # service network restartMASTER=bond0 SLAVE=yes # ifconfig bondX down # ifconfig bond0 downDisabling a Bonding Network Interface # ifenslave -d bondX ethY Vlan Configuration Vlan Prerequisites Configuring a Vlan Loading the Vlan 802.1q Kernel ModuleUnloading the Vlan 802.1q Kernel Module Etc/sysconfig/network-scripts/ directory # vconfig add eth0 Verify the Vlan configuration # cat /proc/net/bonding/bond0 Disabling a Vlan interface Creating a Vlan on a Bond Interface Wake On LAN 38. PXE Flow Diagram Setting the Client Servers Bios Boot Order 39. Boot Order in BiosPage Parameter Description Default Range Configuration Method Driver ParametersDriver Parameters Configuring FCoE in a Windows Environment Driver Parameters Driver Parameters Operation Mode ZIO Interrupt Delay Timer IDT Operation Mode ValuesNPort ID Virtualization QLogic CNA Npiv Solution Npiv Deployment Requirements Creating Virtual Ports Select Port to Create a Virtual Port Verifying the Virtual Ports Verifying Additional Virtual Ports Deleting Virtual Ports Verifying Deletion of Virtual Ports Select Virtual Ports to Delete Virtual Port Features and Limitations  VPD Implementing Adapter-Based Quality of Service Priority and Bandwidth-Based QoS Setting QoS by Bandwidth Boot from SAN Boot-from-SAN RequirementsHost/Server Requirements FCoE Switch Requirements Converged Network Adapter RequirementsStorage Array Requirements Boot-from-SAN Configuration Boot-from-SAN Topologies Single-Path Configuration Single-Path Topology Multipath Topology Multipath Topology Configuring an Adapter to Boot-from-SAN Selectable Boot Settings Menu Drvcfg -sdriverhandle controllerhandle Driver Configuration Main Menu 10. Edit Boot Settings Menu Configuring FCoE in a Windows Environment Boot from SAN Page FCoE Driver Parameters for Linux FCoE Driver Parameters for Linux Fast!UTIL Interrupt Delay Timer Time interval, in 100ms 255 LIP Bios Configuring Driver Parameters Using modprobe Making Nonpersistent Changes Using modprobe#modprobe -r qla2xxx Making Persistent Changes Using modprobe Adding the Options Line to modprobe.conf Configuring Driver Parameters Using sysfs Configuring FCoE Parameters Using QLogic Utilities FCoE Driver Parameters that can be Modified with SysfsSysfs Location Driver Parameters Configuring FCoE Driver Parameters Using QConvergeConsole Utility Installation Online or Offline How to AccessQConvergeConsole and Fast!UTIL Comparison QConvergeConsole GUI FCoE Driver Parameters QConvergeConsole HBA Parameters Configuring FCoE Driver Parameters Using Fast!UTIL QConvergeConsole Advanced HBA Parameters Adapter Settings Advanced Adapter Settings Fast!UTIL FCoE Driver Parameters Displaying FCoE Driver Parameters Using sysfs Fast!UTIL Advanced Adapter Settings Sysfs FCoE Driver Parameters and File Locations Sysfs Location Parameters Description OstX/statistics Sys/class/scsihost Fwstate Firmware state Identifying the Scsi Host ID #lspci grep QLogic Corp #ls -l /sys/bus/pci/drivers/qla2xxx #cd /sys/bus/pci/drivers/qla2xxx #ls -l 00008500.2/host Online Storage Configuration Reconfiguration Displaying and Modifying sysfs Entries#cat /sys/class/scsihost/host6/fwversion #echo 1 /sys/class/scsihost/host6/beacon Adapter FCoE Performance Tuning Interrupt Delay Timer ziotimerOperation Mode Parameter Queue Depth qla2xmaxqdepth QLogic CNA Npiv Solution #cat /sys/class/scsihost/hostX/state Link Up FPort #echo wwpnwwnn /sys/class/scsihost/hostX/vportcreate Verifying the Creation of Virtual Ports #ls -l /sys/class/scsihost/hostX# ls -l /sys/class/scsihost/host4/device #cat /sys/class/scsihost/hostX/vportstate #echo wwpnwwnn /sys/class/scsihost/hostX/vportdelete #echo 1 /sys/class/scsihost/hostX/vportdisable Differentiating Virtual Ports from Physical Ports in sysfsUnique Physical and Virtual Port sysfs Parameters Boot-from-SAN 11. Comparing Npiv Physical and Virtual Ports Boot-from-SAN Requirements Converged Network Adapter Requirements Boot-from-SAN Configuration Topologies Single-Path Topology 12. Single-Path Topology 13. Multipath Topology Configuring an Adapter to Boot-from-SAN 14. Selectable Boot Settings menu Drvcfg -sdriverhandle controllerhandle 15. Driver Configuration Main Menu 16. Edit Boot Settings Menu Booting from SAN Using a LUN Other Than LUN 17. Select Advanced Boot Loader Options Rhel 5 Install Using the QLogic Linux Utilities File Name Description Package Contents Dynamic TGT-LUN Discovery Utility10. Dynamic TGT-LUN Discovery Utility Package Files File Description Using the Utility 11. TGT-LUN Discovery Utility Command Line Options# ./ql-dynamic-tgt-lun-disc.sh command line options Option Description Abbreviation 12. TGT-LUN Discovery Utility Tasks and Commands Task Command Examples# ./ql-dynamic-tgt-lun-disc.sh --interactive 13. Dynamic TGT-LUN Main Menu 14. Select Host to Scan MenuOption Description HBA Collect Utility 15. HBA Collect Utility Package Files # ./ql-hba-collect.sh FC HBA Snapshot Utility 16. FC HBA Snapshot Utility Package Files# ./ql-hba-snapshot.sh Host number -a/--all options 17. FC HBA Snapshot Utility Command Line Options 18. FC HBA Snapshot Utility Command ExampleTask Command Example FC HBA Change LUN State Utility 19. FC HBA Change LUN State Utility Package Files# ./ql-hba-snapshot.sh --parameters 20. FC HBA Change LUN State Utility Command Line Options 21. HBA Change LUN State Utility Command Examples# ./ql-lun-state-online.sh 2 # ./ql-lun-state-online.sh --interactive Set Device Command Timeout Utility # ./ql-lun-state-online.sh -interactive 22. Set Device Command Timeout Utility Package Files # ./ql-set-cmd-timeout.sh Host ## ./ql-set-cmd-timeout.sh Host # Target # 23. Set Device Command Timeout Utility Command Options Sys/class/scsihost/hostX 24. Set Device Command Timeout Utility Command Examples 22. Set Device Command Timeout Utility Main Menu 25. Set Device Command Timeout Utility Main Menu Options 23. Select Target for HostX Menu 26. Select Target for HostX Menu Options 27. Modify/Display Timeout Menu Options Offline Utilities Fast!UTIL Starting Fast!UTIL Selecting an Adapter Configuration Settings Adapter Settings Adapter Setting Parameters Parameter Description Selectable Boot Settings Selectable Boot Setting Window Selectable Boot Settings Window Parameters Select Fibre Channel Device Window Advanced Adapter Settings Restore Default SettingsRaw Nvram Data Advanced Settings Window Parameters Scan Fibre Channel Devices Fibre Disk Utility Loopback Data TestSelect Host Adapter Eficfg Exit Fast!UTIL Installing FlasUTIL FlasUTIL Using FlasUTIL FlasUTIL Command Line OptionsOption Function Installing the Multi-boot Image Efiutil Efiutil Efiutil Adapter Port LEDs Table A-1. Configuration Options for Virtual Ports Link/Ethernet Storage Traffic Hardware State Traffic LED Cisco Nexus 5000 Series Switch Configuration Enable FCoE on the Switch Nexusmv1# show feature Create and Configure the Vlan Configure the Physical Ethernet Interface Switch Port Create and Configure a Virtual Fibre Channel Interface Verify that the Adapter Is Logged into the Switch # copy running-config startup-config# show interface vfc Page Brocade CEE/FCoE Switch/Blade Configuration Enable the Ethernet Switch Service Admin fosconfig -showAdmin slotpoweroff 7 admin slotpoweron Admin slotshow -m Create and Configure FCoE Vlan # configure terminalConfig# interface vlan Create and Configure CEE-MAP Config# cee-map demoConf-ceemap#priority-group- weight 40 pfc Conf-ceemap#priority-group- weight Configure LLDP/DCBX for FCoE Config# do show cee maps CEE Map demoConfig# protocol lldp Config# advertise dcbx-fcoe-app-tlv Configure CEE Port Config# interface tengigabitethernet 0/19Conf-if-te-0/19#switchport mode converged Conf-if-te-0/19#vlan classifier activate group 1 vlan Conf-if-te-0/19#do fos fcoe --loginshow Page Page Corporate Headquarters QLogic Corporation