Sun Microsystems 10GBE XFP manual Class-opt-ipv4-tcp = 100 class-opt-ipv4-udp =

Page 60

b. The following parameters operate on a per port basis and can be set using the /platform/sun4u/kernel/drv/nxge.conf file.

#

#------- How to set parameters for a particular interface --------

#The example below shows how to locate the device path and set a

#parameter for a particular nxge interface. (Using jumbo support as

#an example)

#

#Use the following command to find out the device paths for nxge,

#more /etc/path_to_inst grep nxge

#

#For example, if you see,

#"/pci@7c0/pci@0/pci@8/network@0" 0 "nxge"

#"/pci@7c0/pci@0/pci@8/network@0,1" 1 "nxge"

#"/pci@7c0/pci@0/pci@8/network@0,2" 2 "nxge"

#"/pci@7c0/pci@0/pci@8/network@0,3" 3 "nxge"

#then you can enable jumbo for ports 0 and 1 and disable jumbo for ports 2

#and 3 as follows,

#

#name = "pciex108e,abcd" parent = "/pci@7c0/pci@0/pci@8/" unit-address = "0"

#accept_jumbo = 1;

#name = "pciex108e,abcd" parent = "/pci@7c0/pci@0/pci@8/" unit-address = "0,1"

#accept_jumbo = 1;

#name = "pciex108e,abcd" parent = "/pci@7c0/pci@0/pci@8/" unit-address = "0,2"

#accept_jumbo = 0;

#name = "pciex108e,abcd" parent = "/pci@7c0/pci@0/pci@8/" unit-address = "0,3"

#accept_jumbo = 0;

c.In the following example, the ports of all the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter are being set for load balancing Rx traffic based on IP source address. The default value is F80 indicating Rx load balancing based on IP 5-tuple. Notice the semi-colon at the end of the last parameter.

class-opt-ipv4-tcp = 100; class-opt-ipv4-udp = 100;

42 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009

Image 60
Contents Sun Dual 10GbE XFP PCI Express Card User’s Guide Please Recycle Contents Network Configuration Configuring the nxge Device Driver ParametersConfiguring the Jumbo Frames Feature Configuring Link AggregationConfiguring VLANs Specifications Diagnostic SoftwareIndex Tables Page Figures Sun Dual 10GbE XFP PCI Express Card User’s Guide January Declaration of Conformity EMCXii Sun Dual 10GbE XFP PCI Express Card User’s Guide January Preface How This Document Is OrganizedUsing Unix Commands Shell Prompts Typographic ConventionsRelated Documentation Documentation, Support, and TrainingThird-Party Web Sites Sun Welcomes Your Comments Page Product Overview ComponentsProduct Description Hardware and Software Requirements Features Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing and Setting Up the Driver To Download the Driver on a Solaris PlatformUncompress the gzipped tar file Unpack the tar fileFor Sparc systems, change to the following directory For x86 systemsSelect the packages you want to install # /usr/sbin/pkgadd -dVerify that the nxge driver is installed on the system To discover the driver packages run the pkginfo commandTo remove the driver packages run the pkgrm command To Remove the Driver from a Solaris PlatformDownloading and Installing the Driver on a Linux Platform Login to your system# ifconfig -a grep eth # modprobe nxge To Remove the Driver From a Linux Platform # ethtool -i eth4 driver nxge version# rpm -e nxge-1.0-1 Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing the Adapter Installing the AdapterTo Install the Adapter Installing the Adapter Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing an Optical Transceiver Install the optical transceiversTo Install an Optical Transceiver Installing the Adapter Verifying the Hardware Installation To Verify the Hardware InstallationConnect the Ethernet cables Ok show-netsOk cd /pci@7c0/pci@0/pci@8/network@0,1 Ok .propertiesRebooting the System Ok boot -rOk device-end Network Configuration Configuring the Network Host Files# ifconfig nxge0 plumb ip-addressup # grep nxge /etc/pathtoinst# cat /etc/hosts To Set Up a 10-Gigabit Ethernet Port on a Diskless Client Edit the hosts file in the diskless client’s root directoryExport/root/client-name Network Configuration # grep client-name /etc/bootparams Find the root directory of the client systemProceed with the Solaris Operating System installation Ok boot /pci@7c0/pci@0/pci@8/network@0Shut down and halt the client system # shutdown -i0 -g0 -y# dladm show-dev To Boot Over the Network on Solaris x86 and Linux Systems Refer the boot-device-order imageSystem should reboot after saving the boot configuration Press the F12 key to install the OS from the network Image pxe-mac-addrSun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring the nxge Device Driver Parameters Nxge Hardware and Software OverviewSetting nxge Driver Parameters on a Solaris Platform Setting Parameters Using the ndd UtilityNoninteractive and Interactive Modes To Specify Parameter Values Using the ndd Utility To Specify Device Instances for the ndd UtilityTo modify a parameter value, use the -setoption Setting Parameters Using the nxge.conf File # ndd /dev/nxge1 name to get/set ?Man prtconf To Set Driver Parameters Using an nxge.conf File Following parameters can be set usingLocate the path names and the associated instance numbers Set the parameters for the nxge devicesSun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring the nxge Device Driver Parameters Class-opt-ipv4-tcp = 100 class-opt-ipv4-udp = Tuning for Maximum Performance on a Solaris Platform Reboot the system# reboot -r Save the nxge.conf fileTo Improve Performance on an AMD CPU Based Sun Platform Set ipipsqueuefanout=1 set ipsqueuesoftring=1Set ddimsixalloclimit=1 Configuring the nxge Device Driver Parameters Setting Parameters on a Linux Platform To Set Parameters Using the ethtool UtilityConfiguring the nxge Device Driver Parameters Following are some common parameters that can be changed # ethtool -C eth4 rx-usecs # ethtool -c eth4 # ethtool -k eth4# /usr/local/bin/nxgeconfig eth4 get # /usr/local/bin/nxgeconfig eth4 get classoptipv4udpTuning for Maximum Performance on a Linux Platform # /usr/local/bin/nxgeconfig eth4 set classoptipv4tcp 0xfe0Net.ipv4.tcpsack = Net.core.netdevmaxbacklog =Set up the sysctl utility # sysctl -p /etc/sysctlnxge.confConfiguring the Jumbo Frames Feature Checking Jumbo Frames ConfigurationsJumbo Frames Overview To Show the Driver Statistics in a Solaris Environment # kstat nxge1 grep rdcpacketsEnabling Jumbo Frames in a Solaris Environment # kstat Nxge38001To Check Layer 2 Configuration Boot -r# ifconfig nxge mtu Set the maximum MTU for maximum performanceTo Check Layer 3 Configuration To Enable Jumbo Frames in a Linux EnvironmentEnsure that the nxge software is installed Enabling Jumbo Frames in a Linux Environment# ifconfig ethx mtu # ifconfig eth4To Show the Driver Statistics in a Linux Environment Set the MTU for maximum performanceConfiguring the Jumbo Frames Feature Sun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring Link Aggregation Configuring Link Aggregation in a Solaris EnvironmentOverview of Link Aggregation To Configure Link Aggregation in a Solaris Environment Use the dladm show-aggr-scommand to display statistics # ifconfig aggr33 plumb# ifconfig aggr33 192.168.1.1/24 broadcast + up # dladm show-aggr -sConfiguring Link Aggregation in a Linux Environment To Configure Bonding for Multiple nxge InterfacesLoad the bonding driver # dladm show-aggr -LConfigure bond0 interface Sun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring VLANs Overview of VLANsVlan Configuring VLANs in a Solaris Environment To Configure Static VLANs 2Ethernet Tag Header FormatConfiguring VLANs in a Linux Environment To Configure VLANs in a Linux Environment# ifconfig -a Ensure that the nxge module is loadedConfigure the nxge Vlan eth2 in this example # /sbin/vconfig add eth2# ifconfig eth2.5 xxx.xxx.xx.xxx up Insert the Vlan moduleSpecifications ConnectorsPerformance Specifications Table A-1XFP Connector CharacteristicsPhysical Characteristics Power RequirementsSun Dual 10GbE XFP PCI Express Card User’s Guide January Diagnostic Software SunVTS Diagnostic SoftwareTo Update SunVTS to Recognize the Adapter Updating SunVTS to Recognize the AdapterUsing the SunVTS netlbtest To Use the netlbtestSun Dual 10GbE XFP PCI Express Card User’s Guide January Symbols IndexSun Dual 10GbE XFP PCI Express Card User’s Guide January