Installing and Setting Up the Driver | Sun Microsystems 10GBE XFP

C H A P T E R 2

Installing and Setting Up the Driver

This chapter explains how to download and install the nxge driver. The nxge gigabit Ethernet driver (nxge(7D)) is a multi-threaded, loadable, clonable, GLD-based STREAMS driver. The nxge driver is managed by the dladm(1M) command line utility, which allows VLANs to be defined on top of nxge instances and for nxge instances to be aggregated. See the dladm(1M) man page for more details on configuring the data-link interfaces and link aggregations.

This chapter contains the following sections:

■“Downloading and Installing the Driver on a Solaris SPARC or x86 Platform” on page 5

■“Downloading and Installing the Driver on a Linux Platform” on page 9

Downloading and Installing the Driver on a Solaris SPARC or x86 Platform

If your system uses the Solaris SPARC or x86 operating system you will need to download and install the nxge device driver for Solaris platforms.

▼To Download the Driver on a Solaris Platform

1.Locate and download the nxge device driver software at the following web site: http://www.sun.com/products/networking/ethernet/index.html

5

Image 23

Sun Microsystems 10GBE XFP manual Installing and Setting Up the Driver, To Download the Driver on a Solaris Platform

Contents

Sun Dual 10GbE XFP PCI Express Card User’s Guide Please Recycle Contents Configuring the nxge Device Driver Parameters Network Configuration Configuring VLANs Configuring the Jumbo Frames FeatureConfiguring Link Aggregation Index SpecificationsDiagnostic Software Tables Page Figures Sun Dual 10GbE XFP PCI Express Card User’s Guide January EMC Declaration of Conformity Xii Sun Dual 10GbE XFP PCI Express Card User’s Guide January How This Document Is Organized Preface Using Unix Commands Typographic Conventions Shell Prompts Third-Party Web Sites Related DocumentationDocumentation, Support, and Training Sun Welcomes Your Comments Page Product Description Product OverviewComponents Hardware and Software Requirements Features Sun Dual 10GbE XFP PCI Express Card User’s Guide January To Download the Driver on a Solaris Platform Installing and Setting Up the Driver For x86 systems Uncompress the gzipped tar fileUnpack the tar file For Sparc systems, change to the following directory # /usr/sbin/pkgadd -d Select the packages you want to install To Remove the Driver from a Solaris Platform Verify that the nxge driver is installed on the systemTo discover the driver packages run the pkginfo command To remove the driver packages run the pkgrm command # ifconfig -a grep eth Downloading and Installing the Driver on a Linux PlatformLogin to your system # modprobe nxge # rpm -e nxge-1.0-1 To Remove the Driver From a Linux Platform# ethtool -i eth4 driver nxge version Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing the Adapter Installing the Adapter To Install the Adapter Installing the Adapter Sun Dual 10GbE XFP PCI Express Card User’s Guide January Install the optical transceivers Installing an Optical Transceiver To Install an Optical Transceiver Installing the Adapter Ok show-nets Verifying the Hardware InstallationTo Verify the Hardware Installation Connect the Ethernet cables Ok .properties Ok cd /pci@7c0/pci@0/pci@8/network@0,1 Ok device-end Rebooting the SystemOk boot -r Configuring the Network Host Files Network Configuration # grep nxge /etc/pathtoinst # ifconfig nxge0 plumb ip-addressup # cat /etc/hosts Export/root/client-name To Set Up a 10-Gigabit Ethernet Port on a Diskless ClientEdit the hosts file in the diskless client’s root directory Network Configuration Find the root directory of the client system # grep client-name /etc/bootparams # shutdown -i0 -g0 -y Proceed with the Solaris Operating System installationOk boot /pci@7c0/pci@0/pci@8/network@0 Shut down and halt the client system # dladm show-dev Refer the boot-device-order image To Boot Over the Network on Solaris x86 and Linux Systems System should reboot after saving the boot configuration Image pxe-mac-addr Press the F12 key to install the OS from the network Sun Dual 10GbE XFP PCI Express Card User’s Guide January Nxge Hardware and Software Overview Configuring the nxge Device Driver Parameters Noninteractive and Interactive Modes Setting nxge Driver Parameters on a Solaris PlatformSetting Parameters Using the ndd Utility To modify a parameter value, use the -setoption To Specify Parameter Values Using the ndd UtilityTo Specify Device Instances for the ndd Utility Man prtconf Setting Parameters Using the nxge.conf File# ndd /dev/nxge1 name to get/set ? Set the parameters for the nxge devices To Set Driver Parameters Using an nxge.conf FileFollowing parameters can be set using Locate the path names and the associated instance numbers Sun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring the nxge Device Driver Parameters Class-opt-ipv4-tcp = 100 class-opt-ipv4-udp = Save the nxge.conf file Tuning for Maximum Performance on a Solaris PlatformReboot the system # reboot -r Set ddimsixalloclimit=1 To Improve Performance on an AMD CPU Based Sun PlatformSet ipipsqueuefanout=1 set ipsqueuesoftring=1 Configuring the nxge Device Driver Parameters To Set Parameters Using the ethtool Utility Setting Parameters on a Linux Platform Configuring the nxge Device Driver Parameters Following are some common parameters that can be changed # ethtool -k eth4 # ethtool -C eth4 rx-usecs # ethtool -c eth4 # /usr/local/bin/nxgeconfig eth4 get classoptipv4udp # /usr/local/bin/nxgeconfig eth4 get Net.core.netdevmaxbacklog = Tuning for Maximum Performance on a Linux Platform# /usr/local/bin/nxgeconfig eth4 set classoptipv4tcp 0xfe0 Net.ipv4.tcpsack = # sysctl -p /etc/sysctlnxge.conf Set up the sysctl utility Jumbo Frames Overview Configuring the Jumbo Frames FeatureChecking Jumbo Frames Configurations # kstat nxge1 grep rdcpackets To Show the Driver Statistics in a Solaris Environment # kstat Nxge38001 Enabling Jumbo Frames in a Solaris Environment Set the maximum MTU for maximum performance To Check Layer 2 ConfigurationBoot -r # ifconfig nxge mtu Enabling Jumbo Frames in a Linux Environment To Check Layer 3 ConfigurationTo Enable Jumbo Frames in a Linux Environment Ensure that the nxge software is installed Set the MTU for maximum performance # ifconfig ethx mtu# ifconfig eth4 To Show the Driver Statistics in a Linux Environment Configuring the Jumbo Frames Feature Sun Dual 10GbE XFP PCI Express Card User’s Guide January Overview of Link Aggregation Configuring Link AggregationConfiguring Link Aggregation in a Solaris Environment To Configure Link Aggregation in a Solaris Environment # dladm show-aggr -s Use the dladm show-aggr-scommand to display statistics# ifconfig aggr33 plumb # ifconfig aggr33 192.168.1.1/24 broadcast + up # dladm show-aggr -L Configuring Link Aggregation in a Linux EnvironmentTo Configure Bonding for Multiple nxge Interfaces Load the bonding driver Configure bond0 interface Sun Dual 10GbE XFP PCI Express Card User’s Guide January Overview of VLANs Configuring VLANs Vlan Configuring VLANs in a Solaris Environment 2Ethernet Tag Header Format To Configure Static VLANs Ensure that the nxge module is loaded Configuring VLANs in a Linux EnvironmentTo Configure VLANs in a Linux Environment # ifconfig -a Insert the Vlan module Configure the nxge Vlan eth2 in this example# /sbin/vconfig add eth2 # ifconfig eth2.5 xxx.xxx.xx.xxx up Connectors Specifications Table A-1XFP Connector Characteristics Performance Specifications Power Requirements Physical Characteristics Sun Dual 10GbE XFP PCI Express Card User’s Guide January SunVTS Diagnostic Software Diagnostic Software Updating SunVTS to Recognize the Adapter To Update SunVTS to Recognize the Adapter To Use the netlbtest Using the SunVTS netlbtest Sun Dual 10GbE XFP PCI Express Card User’s Guide January Index Symbols Sun Dual 10GbE XFP PCI Express Card User’s Guide January