Sun Microsystems 10GBE XFP specification

34 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009

Image 52

Sun Microsystems 10GBE XFP manual Sun Dual 10GbE XFP PCI Express Card User’s Guide January

Contents

Sun Dual 10GbE XFP PCI Express Card User’s Guide Please Recycle Contents Network Configuration Configuring the nxge Device Driver Parameters Configuring Link Aggregation Configuring the Jumbo Frames FeatureConfiguring VLANs Diagnostic Software SpecificationsIndex Tables Page Figures Sun Dual 10GbE XFP PCI Express Card User’s Guide January Declaration of Conformity EMC Xii Sun Dual 10GbE XFP PCI Express Card User’s Guide January Preface How This Document Is Organized Using Unix Commands Shell Prompts Typographic Conventions Documentation, Support, and Training Related DocumentationThird-Party Web Sites Sun Welcomes Your Comments Page Components Product OverviewProduct Description Hardware and Software Requirements Features Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing and Setting Up the Driver To Download the Driver on a Solaris Platform Uncompress the gzipped tar file Unpack the tar fileFor Sparc systems, change to the following directory For x86 systems Select the packages you want to install # /usr/sbin/pkgadd -d Verify that the nxge driver is installed on the system To discover the driver packages run the pkginfo commandTo remove the driver packages run the pkgrm command To Remove the Driver from a Solaris Platform Login to your system Downloading and Installing the Driver on a Linux Platform# ifconfig -a grep eth # modprobe nxge # ethtool -i eth4 driver nxge version To Remove the Driver From a Linux Platform# rpm -e nxge-1.0-1 Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing the Adapter Installing the Adapter To Install the Adapter Installing the Adapter Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing an Optical Transceiver Install the optical transceivers To Install an Optical Transceiver Installing the Adapter Verifying the Hardware Installation To Verify the Hardware InstallationConnect the Ethernet cables Ok show-nets Ok cd /pci@7c0/pci@0/pci@8/network@0,1 Ok .properties Ok boot -r Rebooting the SystemOk device-end Network Configuration Configuring the Network Host Files # ifconfig nxge0 plumb ip-addressup # grep nxge /etc/pathtoinst # cat /etc/hosts Edit the hosts file in the diskless client’s root directory To Set Up a 10-Gigabit Ethernet Port on a Diskless ClientExport/root/client-name Network Configuration # grep client-name /etc/bootparams Find the root directory of the client system Proceed with the Solaris Operating System installation Ok boot /pci@7c0/pci@0/pci@8/network@0Shut down and halt the client system # shutdown -i0 -g0 -y # dladm show-dev To Boot Over the Network on Solaris x86 and Linux Systems Refer the boot-device-order image System should reboot after saving the boot configuration Press the F12 key to install the OS from the network Image pxe-mac-addr Sun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring the nxge Device Driver Parameters Nxge Hardware and Software Overview Setting Parameters Using the ndd Utility Setting nxge Driver Parameters on a Solaris PlatformNoninteractive and Interactive Modes To Specify Device Instances for the ndd Utility To Specify Parameter Values Using the ndd UtilityTo modify a parameter value, use the -setoption # ndd /dev/nxge1 name to get/set ? Setting Parameters Using the nxge.conf FileMan prtconf To Set Driver Parameters Using an nxge.conf File Following parameters can be set usingLocate the path names and the associated instance numbers Set the parameters for the nxge devices Sun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring the nxge Device Driver Parameters Class-opt-ipv4-tcp = 100 class-opt-ipv4-udp = Tuning for Maximum Performance on a Solaris Platform Reboot the system# reboot -r Save the nxge.conf file Set ipipsqueuefanout=1 set ipsqueuesoftring=1 To Improve Performance on an AMD CPU Based Sun PlatformSet ddimsixalloclimit=1 Configuring the nxge Device Driver Parameters Setting Parameters on a Linux Platform To Set Parameters Using the ethtool Utility Configuring the nxge Device Driver Parameters Following are some common parameters that can be changed # ethtool -C eth4 rx-usecs # ethtool -c eth4 # ethtool -k eth4 # /usr/local/bin/nxgeconfig eth4 get # /usr/local/bin/nxgeconfig eth4 get classoptipv4udp Tuning for Maximum Performance on a Linux Platform # /usr/local/bin/nxgeconfig eth4 set classoptipv4tcp 0xfe0Net.ipv4.tcpsack = Net.core.netdevmaxbacklog = Set up the sysctl utility # sysctl -p /etc/sysctlnxge.conf Checking Jumbo Frames Configurations Configuring the Jumbo Frames FeatureJumbo Frames Overview To Show the Driver Statistics in a Solaris Environment # kstat nxge1 grep rdcpackets Enabling Jumbo Frames in a Solaris Environment # kstat Nxge38001 To Check Layer 2 Configuration Boot -r# ifconfig nxge mtu Set the maximum MTU for maximum performance To Check Layer 3 Configuration To Enable Jumbo Frames in a Linux EnvironmentEnsure that the nxge software is installed Enabling Jumbo Frames in a Linux Environment # ifconfig ethx mtu # ifconfig eth4To Show the Driver Statistics in a Linux Environment Set the MTU for maximum performance Configuring the Jumbo Frames Feature Sun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring Link Aggregation in a Solaris Environment Configuring Link AggregationOverview of Link Aggregation To Configure Link Aggregation in a Solaris Environment Use the dladm show-aggr-scommand to display statistics # ifconfig aggr33 plumb# ifconfig aggr33 192.168.1.1/24 broadcast + up # dladm show-aggr -s Configuring Link Aggregation in a Linux Environment To Configure Bonding for Multiple nxge InterfacesLoad the bonding driver # dladm show-aggr -L Configure bond0 interface Sun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring VLANs Overview of VLANs Vlan Configuring VLANs in a Solaris Environment To Configure Static VLANs 2Ethernet Tag Header Format Configuring VLANs in a Linux Environment To Configure VLANs in a Linux Environment# ifconfig -a Ensure that the nxge module is loaded Configure the nxge Vlan eth2 in this example # /sbin/vconfig add eth2# ifconfig eth2.5 xxx.xxx.xx.xxx up Insert the Vlan module Specifications Connectors Performance Specifications Table A-1XFP Connector Characteristics Physical Characteristics Power Requirements Sun Dual 10GbE XFP PCI Express Card User’s Guide January Diagnostic Software SunVTS Diagnostic Software To Update SunVTS to Recognize the Adapter Updating SunVTS to Recognize the Adapter Using the SunVTS netlbtest To Use the netlbtest Sun Dual 10GbE XFP PCI Express Card User’s Guide January Symbols Index Sun Dual 10GbE XFP PCI Express Card User’s Guide January