Oracle Audio Technologies SunDual 10GbE XFP manual Set ipipsqueuefanout=1 set ipsqueuesoftring=1

Page 52

3.Add the following to a startup script, or use ndd before plumbing the interface:

#ndd -set /dev/ip ip_soft_rings_cnt 8

Utilizing more soft-rings provided by the Solaris TCP/IP stack significantly improves bulk throughput for Rx. The default number of soft-rings is 2, but changing it to 8 improves performance. (You can increase the number to 16 in UltraSparc-T1 based systems).

To Improve Performance on an AMD CPU Based Sun Platform

1.Enable soft-rings and change to a higher value than the default of 2 by adding the following to the /etc/system file:

set ip:ip_squeue_fanout=1 set ip_squeue_soft_ring=1

Bulk throughput for Rx can be significantly improved by utilizing more soft-rings provided by the Solaris TCP/IP stack. Soft-rings are disabled by default in previous and current releases of the Solaris-x86 Operating System.

2.Reboot the system:

#reboot -r

3.Set the MSI to 1 on AMD platforms by adding following to the /etc/system file:

set ddi_msix_alloc_limit=1

4.Reboot the system:

#reboot -r

42 Sun Dual 10GbE XFP PCI Express Card User’s Guide • May 2010

Image 52
Contents Sun Dual 10GbE XFP PCI Express Card Please Recycle Contents Network Configuration Configuring the nxge Device Driver ParametersConfiguring Link Aggregation Configuring the Jumbo Frames FeatureConfiguring VLANs Diagnostic Software SpecificationsIndex Using This Documentation Using Unix CommandsShell Prompts Documentation, Support, and Training Related DocumentationDocumentation Feedback Sun Dual 10GbE XFP PCI Express Card User’s Guide May Components Product OverviewProduct Description Hardware and Software Requirements 1shows the adapterFeatures Declaration of Conformity EMCDate Sun Dual 10GbE XFP PCI Express Card User’s Guide May Installing and Setting Up the Driver To Download the Driver on a Solaris PlatformUncompress the gzipped tar file Unpack the tar fileFor Sparc systems, change to the following directory For x86 systemsSelect the packages you want to install Verify that the nxge driver is installed on the systemTo discover the driver packages run the pkginfo command To remove the driver packages run the pkgrm commandLogin to your system Downloading and Installing the Driver on a Linux Platform# ifconfig -a grep eth # modprobe nxge # ethtool -i eth4 driver nxge version To Remove the Driver From a Linux Platform# rpm -e nxge-1.0-1 Installing the Adapter Installing the AdapterTo Install the Adapter Installing the Adapter Sun Dual 10GbE XFP PCI Express Card User’s Guide May Installing an Optical Transceiver Install the optical transceiversTo Install an Optical Transceiver Installing the Adapter Verifying the Hardware Installation To Verify the Hardware InstallationConnect the Ethernet cables Ok show-netsOk cd /pci@7c0/pci@0/pci@8/network@0,1 Ok .propertiesOk boot -r Rebooting the SystemOk device-end Network Configuration Configuring the Network Host Files# ifconfig nxge0 plumb ip-addressup # grep nxge /etc/pathtoinst# cat /etc/hosts Edit the hosts file in the diskless client’s root directory To Set Up a 10-Gigabit Ethernet Port on a Diskless ClientExport/root/client-name Network Configuration # grep client-name /etc/bootparams Find the root directory of the client systemProceed with the Solaris Operating System installation Ok boot /pci@7c0/pci@0/pci@8/network@0Shut down and halt the client system # shutdown -i0 -g0 -yTo Boot Over the Network on Solaris x86 and Linux Systems # dladm show-devRefer the boot-device-order image Press the F12 key to install the OS from the network Image pxe-mac-addrConfiguring the nxge Device Driver Parameters Nxge Hardware and Software OverviewSetting Parameters Using the ndd Utility Setting nxge Driver Parameters on a Solaris PlatformNoninteractive and Interactive Modes To Specify Device Instances for the ndd Utility To Specify Parameter Values Using the ndd UtilityTo modify a parameter value, use the -setoption # ndd /dev/nxge1 name to get/set ? Setting Parameters Using the nxge.conf FileMan prtconf To Set Driver Parameters Using an nxge.conf File Following parameters can be set usingLocate the path names and the associated instance numbers Set the parameters for the nxge devicesSun Dual 10GbE XFP PCI Express Card User’s Guide May Configuring the nxge Device Driver Parameters Class-opt-ipv4-tcp = 100 class-opt-ipv4-udp = Tuning for Maximum Performance on a Solaris Platform Reboot the system# reboot -r Save the nxge.conf fileSet ipipsqueuefanout=1 set ipsqueuesoftring=1 To Improve Performance on an AMD CPU Based Sun PlatformSet ddimsixalloclimit=1 Configuring the nxge Device Driver Parameters Setting Parameters on a Linux Platform To Set Parameters Using the ethtool UtilityConfiguring the nxge Device Driver Parameters Following are some common parameters that can be changed # ethtool -C eth4 rx-usecs # ethtool -c eth4 # ethtool -k eth4# /usr/local/bin/nxgeconfig eth4 get # /usr/local/bin/nxgeconfig eth4 get classoptipv4udpTuning for Maximum Performance on a Linux Platform # /usr/local/bin/nxgeconfig eth4 set classoptipv4tcp 0xfe0Net.ipv4.tcpsack = Net.core.netdevmaxbacklog =Set up the sysctl utility # sysctl -p /etc/sysctlnxge.confChecking Jumbo Frames Configurations Configuring the Jumbo Frames FeatureJumbo Frames Overview # kstat nxge1 grep rdcpackets To Show the Driver Statistics in a Solaris Environment# kstat Nxge38001 Enabling Jumbo Frames in a Solaris Environment To Check Layer 2 ConfigurationSet the maximum MTU for maximum performance To Check Layer 3 Configuration To Enable Jumbo Frames in a Linux EnvironmentEnsure that the nxge software is installed Enabling Jumbo Frames in a Linux Environment# ifconfig eth4 To Show the Driver Statistics in a Linux EnvironmentSun Dual 10GbE XFP PCI Express Card User’s Guide May Configuring Link Aggregation Overview of Link AggregationConfiguring Link Aggregation in a Solaris Environment To Configure Link Aggregation in a Solaris EnvironmentUse the dladm show-aggr-scommand to display statistics # ifconfig aggr33 plumb# ifconfig aggr33 192.168.1.1/24 broadcast + up # dladm show-aggr -sConfiguring Link Aggregation in a Linux Environment To Configure Bonding for Multiple nxge InterfacesConfigure bond0 interface Load the bonding driverConfiguring VLANs Overview of VLANs1shows an example network that uses VLANs Configuring VLANs in a Solaris Environment To Configure Static VLANs Configuring VLANs in a Linux Environment To Configure VLANs in a Linux Environment# ifconfig -a Ensure that the nxge module is loadedConfigure the nxge Vlan eth2 in this example # /sbin/vconfig add eth2# ifconfig eth2.5 xxx.xxx.xx.xxx up Insert the Vlan moduleSpecifications ConnectorsPerformance Specifications Table A-1XFP Connector CharacteristicsPhysical Characteristics Power RequirementsSun Dual 10GbE XFP PCI Express Card User’s Guide May Diagnostic Software SunVTS Diagnostic SoftwareTo Update SunVTS to Recognize the Adapter Updating SunVTS to Recognize the AdapterUsing the SunVTS netlbtest To Use the netlbtestSun Dual 10GbE XFP PCI Express Card User’s Guide May Symbols IndexSun Dual 10GbE XFP PCI Express Card User’s Guide May