Oracle Audio Technologies SunDual 10GbE XFP Tuning for Maximum Performance on a Linux Platform

Page 59

3.To set a particular variable, use the /usr/local/bin/nxge_config if_name set param_name value:

#/usr/local/bin/nxge_config eth4 set class_opt_ipv4_tcp 0xfe0

Tuning for Maximum Performance on a Linux Platform

The following tunings will improve the performance of the Sun x8 Express Dual 10 Gigabit Ethernet device driver on a system running the Linux operating system.

1.Create the conf file (for example, sysctl_nxge.conf) that will be called by the sysctl utility.

### IPV4 specific settings

#turns TCP timestamp support off, default 1, reduces CPU use net.ipv4.tcp_timestamps = 0

#turn SACK support off, default on systems with a VERY fast bus ->

#memory interface this is the big gainer

net.ipv4.tcp_sack = 0

#sets min/default/max TCP read buffer, default 4096 87380 174760 net.ipv4.tcp_rmem = 10000000 10000000 10000000

#sets min/pressure/max TCP write buffer, default 4096 16384 131072 net.ipv4.tcp_wmem = 10000000 10000000 10000000

#sets min/pressure/max TCP buffer space, default 31744 32256 32768 net.ipv4.tcp_mem = 10000000 10000000 10000000

###CORE settings (mostly for socket and UDP effect)

# maximum receive socket buffer size, default 131071 net.core.rmem_max = 524287

# maximum send socket buffer size, default 131071 net.core.wmem_max = 524287

# default receive socket buffer size, default 65535 net.core.rmem_default = 524287

# default send socket buffer size, default 65535 net.core.wmem_default = 524287

# maximum amount of option memory buffers, default 10240 net.core.optmem_max = 524287

# number of unprocessed input packets before kernel starts dropping

# them, default 300

net.core.netdev_max_backlog = 300000

Chapter 5 Configuring the nxge Device Driver Parameters

49

Image 59
Contents Sun Dual 10GbE XFP PCI Express Card Please Recycle Contents Configuring the nxge Device Driver Parameters Network ConfigurationConfiguring VLANs Configuring the Jumbo Frames FeatureConfiguring Link Aggregation Index SpecificationsDiagnostic Software Using Unix Commands Using This DocumentationShell Prompts Documentation Feedback Related DocumentationDocumentation, Support, and Training Sun Dual 10GbE XFP PCI Express Card User’s Guide May Product Description Product OverviewComponents 1shows the adapter Hardware and Software RequirementsFeatures EMC Declaration of ConformityDate Sun Dual 10GbE XFP PCI Express Card User’s Guide May To Download the Driver on a Solaris Platform Installing and Setting Up the DriverFor x86 systems Uncompress the gzipped tar fileUnpack the tar file For Sparc systems, change to the following directoryTo remove the driver packages run the pkgrm command Select the packages you want to installVerify that the nxge driver is installed on the system To discover the driver packages run the pkginfo command# ifconfig -a grep eth Downloading and Installing the Driver on a Linux PlatformLogin to your system # modprobe nxge # rpm -e nxge-1.0-1 To Remove the Driver From a Linux Platform# ethtool -i eth4 driver nxge version Installing the Adapter Installing the AdapterTo Install the Adapter Installing the Adapter Sun Dual 10GbE XFP PCI Express Card User’s Guide May Install the optical transceivers Installing an Optical TransceiverTo Install an Optical Transceiver Installing the Adapter Ok show-nets Verifying the Hardware InstallationTo Verify the Hardware Installation Connect the Ethernet cablesOk .properties Ok cd /pci@7c0/pci@0/pci@8/network@0,1Ok device-end Rebooting the SystemOk boot -r Configuring the Network Host Files Network Configuration# grep nxge /etc/pathtoinst # ifconfig nxge0 plumb ip-addressup# cat /etc/hosts Export/root/client-name To Set Up a 10-Gigabit Ethernet Port on a Diskless ClientEdit the hosts file in the diskless client’s root directory Network Configuration Find the root directory of the client system # grep client-name /etc/bootparams# shutdown -i0 -g0 -y Proceed with the Solaris Operating System installationOk boot /pci@7c0/pci@0/pci@8/network@0 Shut down and halt the client system# dladm show-dev To Boot Over the Network on Solaris x86 and Linux SystemsRefer the boot-device-order image Image pxe-mac-addr Press the F12 key to install the OS from the networkNxge Hardware and Software Overview Configuring the nxge Device Driver ParametersNoninteractive and Interactive Modes Setting nxge Driver Parameters on a Solaris PlatformSetting Parameters Using the ndd Utility To modify a parameter value, use the -setoption To Specify Parameter Values Using the ndd UtilityTo Specify Device Instances for the ndd Utility Man prtconf Setting Parameters Using the nxge.conf File# ndd /dev/nxge1 name to get/set ? Set the parameters for the nxge devices To Set Driver Parameters Using an nxge.conf FileFollowing parameters can be set using Locate the path names and the associated instance numbersSun Dual 10GbE XFP PCI Express Card User’s Guide May Configuring the nxge Device Driver Parameters Class-opt-ipv4-tcp = 100 class-opt-ipv4-udp = Save the nxge.conf file Tuning for Maximum Performance on a Solaris PlatformReboot the system # reboot -rSet ddimsixalloclimit=1 To Improve Performance on an AMD CPU Based Sun PlatformSet ipipsqueuefanout=1 set ipsqueuesoftring=1 Configuring the nxge Device Driver Parameters To Set Parameters Using the ethtool Utility Setting Parameters on a Linux PlatformConfiguring the nxge Device Driver Parameters Following are some common parameters that can be changed # ethtool -k eth4 # ethtool -C eth4 rx-usecs # ethtool -c eth4# /usr/local/bin/nxgeconfig eth4 get classoptipv4udp # /usr/local/bin/nxgeconfig eth4 getNet.core.netdevmaxbacklog = Tuning for Maximum Performance on a Linux Platform# /usr/local/bin/nxgeconfig eth4 set classoptipv4tcp 0xfe0 Net.ipv4.tcpsack =# sysctl -p /etc/sysctlnxge.conf Set up the sysctl utilityJumbo Frames Overview Configuring the Jumbo Frames FeatureChecking Jumbo Frames Configurations # kstat Nxge38001 To Show the Driver Statistics in a Solaris Environment# kstat nxge1 grep rdcpackets Set the maximum MTU for maximum performance To Check Layer 2 ConfigurationEnabling Jumbo Frames in a Solaris Environment Enabling Jumbo Frames in a Linux Environment To Check Layer 3 ConfigurationTo Enable Jumbo Frames in a Linux Environment Ensure that the nxge software is installedTo Show the Driver Statistics in a Linux Environment # ifconfig eth4Sun Dual 10GbE XFP PCI Express Card User’s Guide May Overview of Link Aggregation Configuring Link AggregationTo Configure Link Aggregation in a Solaris Environment Configuring Link Aggregation in a Solaris Environment# dladm show-aggr -s Use the dladm show-aggr-scommand to display statistics# ifconfig aggr33 plumb # ifconfig aggr33 192.168.1.1/24 broadcast + upLoad the bonding driver Configuring Link Aggregation in a Linux EnvironmentTo Configure Bonding for Multiple nxge Interfaces Configure bond0 interfaceOverview of VLANs Configuring VLANs1shows an example network that uses VLANs Configuring VLANs in a Solaris Environment To Configure Static VLANs Ensure that the nxge module is loaded Configuring VLANs in a Linux EnvironmentTo Configure VLANs in a Linux Environment # ifconfig -aInsert the Vlan module Configure the nxge Vlan eth2 in this example# /sbin/vconfig add eth2 # ifconfig eth2.5 xxx.xxx.xx.xxx upConnectors SpecificationsTable A-1XFP Connector Characteristics Performance SpecificationsPower Requirements Physical CharacteristicsSun Dual 10GbE XFP PCI Express Card User’s Guide May SunVTS Diagnostic Software Diagnostic SoftwareUpdating SunVTS to Recognize the Adapter To Update SunVTS to Recognize the AdapterTo Use the netlbtest Using the SunVTS netlbtestSun Dual 10GbE XFP PCI Express Card User’s Guide May Index SymbolsSun Dual 10GbE XFP PCI Express Card User’s Guide May