Oracle Audio Technologies SunDual 10GbE XFP specs

Configuring Link Aggregation in a

Solaris Environment

This section explains how to configure link aggregation in a Solaris environment.

▼To Configure Link Aggregation in a Solaris Environment

1.Aggregate nxge0 and nxge1 to form an aggregation and a random number 33 as key.

a.Unplumb the interfaces to be aggregated:

#ifconfig down unplumb nxge0

#ifconfig down unplumb nxge1

b.Create a link-aggregation group with key 33 without specifying mode:

#dladm create-aggr -d nxge0 -d nxge1 33

As the command returns, one line appears in /etc/aggregation.conf file and indicates that the default mode is off, as shown in the following example:

# tail -1 /etc/aggregation.conf
33	L4	2	nxge0/0,nxge1/0		auto	off	short
# dladm show-aggr
key: 33 (0x0021)			policy:	L4	address: 0:3:ba:d8:9d:e8 (auto)
	device		address		speed		duplex	link	state
	nxge0		0:3:ba:d8:9d:e8		10000	Mbps	full	up	standby
	nxge1		0:3:ba:d8:9d:e9		10000	Mbps	full	up	standby
# dladm show-link aggr33
aggr33		type: non-vlan		mtu: 1500		aggregation: key 33

58 Sun Dual 10GbE XFP PCI Express Card User’s Guide • May 2010

Image 68

Oracle Audio Technologies SunDual 10GbE XFP manual Configuring Link Aggregation in a Solaris Environment

Contents

Sun Dual 10GbE XFP PCI Express Card Please Recycle Contents Network Configuration Configuring the nxge Device Driver Parameters Configuring VLANs Configuring the Jumbo Frames FeatureConfiguring Link Aggregation Index SpecificationsDiagnostic Software Using This Documentation Using Unix Commands Shell Prompts Documentation Feedback Related DocumentationDocumentation, Support, and Training Sun Dual 10GbE XFP PCI Express Card User’s Guide May Product Description Product OverviewComponents Hardware and Software Requirements 1shows the adapter Features Declaration of Conformity EMC Date Sun Dual 10GbE XFP PCI Express Card User’s Guide May Installing and Setting Up the Driver To Download the Driver on a Solaris Platform Uncompress the gzipped tar file Unpack the tar fileFor Sparc systems, change to the following directory For x86 systems Select the packages you want to install Verify that the nxge driver is installed on the systemTo discover the driver packages run the pkginfo command To remove the driver packages run the pkgrm command # ifconfig -a grep eth Downloading and Installing the Driver on a Linux PlatformLogin to your system # modprobe nxge # rpm -e nxge-1.0-1 To Remove the Driver From a Linux Platform# ethtool -i eth4 driver nxge version Installing the Adapter Installing the Adapter To Install the Adapter Installing the Adapter Sun Dual 10GbE XFP PCI Express Card User’s Guide May Installing an Optical Transceiver Install the optical transceivers To Install an Optical Transceiver Installing the Adapter Verifying the Hardware Installation To Verify the Hardware InstallationConnect the Ethernet cables Ok show-nets Ok cd /pci@7c0/pci@0/pci@8/network@0,1 Ok .properties Ok device-end Rebooting the SystemOk boot -r Network Configuration Configuring the Network Host Files # ifconfig nxge0 plumb ip-addressup # grep nxge /etc/pathtoinst # cat /etc/hosts Export/root/client-name To Set Up a 10-Gigabit Ethernet Port on a Diskless ClientEdit the hosts file in the diskless client’s root directory Network Configuration # grep client-name /etc/bootparams Find the root directory of the client system Proceed with the Solaris Operating System installation Ok boot /pci@7c0/pci@0/pci@8/network@0Shut down and halt the client system # shutdown -i0 -g0 -y To Boot Over the Network on Solaris x86 and Linux Systems # dladm show-dev Refer the boot-device-order image Press the F12 key to install the OS from the network Image pxe-mac-addr Configuring the nxge Device Driver Parameters Nxge Hardware and Software Overview Noninteractive and Interactive Modes Setting nxge Driver Parameters on a Solaris PlatformSetting Parameters Using the ndd Utility To modify a parameter value, use the -setoption To Specify Parameter Values Using the ndd UtilityTo Specify Device Instances for the ndd Utility Man prtconf Setting Parameters Using the nxge.conf File# ndd /dev/nxge1 name to get/set ? To Set Driver Parameters Using an nxge.conf File Following parameters can be set usingLocate the path names and the associated instance numbers Set the parameters for the nxge devices Sun Dual 10GbE XFP PCI Express Card User’s Guide May Configuring the nxge Device Driver Parameters Class-opt-ipv4-tcp = 100 class-opt-ipv4-udp = Tuning for Maximum Performance on a Solaris Platform Reboot the system# reboot -r Save the nxge.conf file Set ddimsixalloclimit=1 To Improve Performance on an AMD CPU Based Sun PlatformSet ipipsqueuefanout=1 set ipsqueuesoftring=1 Configuring the nxge Device Driver Parameters Setting Parameters on a Linux Platform To Set Parameters Using the ethtool Utility Configuring the nxge Device Driver Parameters Following are some common parameters that can be changed # ethtool -C eth4 rx-usecs # ethtool -c eth4 # ethtool -k eth4 # /usr/local/bin/nxgeconfig eth4 get # /usr/local/bin/nxgeconfig eth4 get classoptipv4udp Tuning for Maximum Performance on a Linux Platform # /usr/local/bin/nxgeconfig eth4 set classoptipv4tcp 0xfe0Net.ipv4.tcpsack = Net.core.netdevmaxbacklog = Set up the sysctl utility # sysctl -p /etc/sysctlnxge.conf Jumbo Frames Overview Configuring the Jumbo Frames FeatureChecking Jumbo Frames Configurations # kstat Nxge38001 To Show the Driver Statistics in a Solaris Environment# kstat nxge1 grep rdcpackets Set the maximum MTU for maximum performance To Check Layer 2 ConfigurationEnabling Jumbo Frames in a Solaris Environment To Check Layer 3 Configuration To Enable Jumbo Frames in a Linux EnvironmentEnsure that the nxge software is installed Enabling Jumbo Frames in a Linux Environment # ifconfig eth4 To Show the Driver Statistics in a Linux Environment Sun Dual 10GbE XFP PCI Express Card User’s Guide May Configuring Link Aggregation Overview of Link Aggregation Configuring Link Aggregation in a Solaris Environment To Configure Link Aggregation in a Solaris Environment Use the dladm show-aggr-scommand to display statistics # ifconfig aggr33 plumb# ifconfig aggr33 192.168.1.1/24 broadcast + up # dladm show-aggr -s Configuring Link Aggregation in a Linux Environment To Configure Bonding for Multiple nxge InterfacesConfigure bond0 interface Load the bonding driver Configuring VLANs Overview of VLANs 1shows an example network that uses VLANs Configuring VLANs in a Solaris Environment To Configure Static VLANs Configuring VLANs in a Linux Environment To Configure VLANs in a Linux Environment# ifconfig -a Ensure that the nxge module is loaded Configure the nxge Vlan eth2 in this example # /sbin/vconfig add eth2# ifconfig eth2.5 xxx.xxx.xx.xxx up Insert the Vlan module Specifications Connectors Performance Specifications Table A-1XFP Connector Characteristics Physical Characteristics Power Requirements Sun Dual 10GbE XFP PCI Express Card User’s Guide May Diagnostic Software SunVTS Diagnostic Software To Update SunVTS to Recognize the Adapter Updating SunVTS to Recognize the Adapter Using the SunVTS netlbtest To Use the netlbtest Sun Dual 10GbE XFP PCI Express Card User’s Guide May Symbols Index Sun Dual 10GbE XFP PCI Express Card User’s Guide May