Sun Microsystems 10GBE XFP manual Vlan

Page 86

	Main Server
Accounting	Adapter
Server	Gigabit/Tagged
(VLAN 3)	(All VLANs)

VLAN 1

VLAN 2

VLAN 3

Shared

Media

Segment

Software	Software	Engineering	Accounting	Engineering/
PC 1	PC 2	PC 3	PC 4	Software PC 5
(VLAN 2)	(VLAN 2)	(VLAN 1)	(VLAN 3)	Adapter
				Gigabit/Tagged
				(VLAN 1 & 2)

FIGURE 8-1Example of Servers Supporting Multiple VLANs With Tagging Adapters

The example network has the following features:

The physical LAN network consists of a switch, two servers, and five clients. The LAN is logically organized into three different VLANs, each representing a different IP subnet.

■VLAN 1 is an IP subnet consisting of the Main Server, Client 3, and Client 5. This represents an engineering group.

■VLAN 2 includes the Main Server, Clients 1 and 2 by means of a shared media segment, and Client 5. This is a software development group.

■VLAN 3 includes the Main Server, the Accounting Server and Client 4. This is an accounting group.

68 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009

Image 86

Contents Sun Dual 10GbE XFP PCI Express Card User’s Guide Please Recycle Contents Network Configuration Configuring the nxge Device Driver ParametersConfiguring VLANs Configuring the Jumbo Frames FeatureConfiguring Link Aggregation Index SpecificationsDiagnostic Software Tables Page Figures Sun Dual 10GbE XFP PCI Express Card User’s Guide January Declaration of Conformity EMCXii Sun Dual 10GbE XFP PCI Express Card User’s Guide January Preface How This Document Is OrganizedUsing Unix Commands Shell Prompts Typographic ConventionsThird-Party Web Sites Related DocumentationDocumentation, Support, and Training Sun Welcomes Your Comments Page Product Description Product OverviewComponents Hardware and Software Requirements Features Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing and Setting Up the Driver To Download the Driver on a Solaris PlatformFor Sparc systems, change to the following directory Uncompress the gzipped tar fileUnpack the tar file For x86 systemsSelect the packages you want to install # /usr/sbin/pkgadd -dTo remove the driver packages run the pkgrm command Verify that the nxge driver is installed on the systemTo discover the driver packages run the pkginfo command To Remove the Driver from a Solaris Platform# ifconfig -a grep eth Downloading and Installing the Driver on a Linux PlatformLogin to your system # modprobe nxge # rpm -e nxge-1.0-1 To Remove the Driver From a Linux Platform# ethtool -i eth4 driver nxge version Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing the Adapter Installing the AdapterTo Install the Adapter Installing the Adapter Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing an Optical Transceiver Install the optical transceiversTo Install an Optical Transceiver Installing the Adapter Connect the Ethernet cables Verifying the Hardware InstallationTo Verify the Hardware Installation Ok show-netsOk cd /pci@7c0/pci@0/pci@8/network@0,1 Ok .propertiesOk device-end Rebooting the SystemOk boot -r Network Configuration Configuring the Network Host Files# ifconfig nxge0 plumb ip-addressup # grep nxge /etc/pathtoinst# cat /etc/hosts Export/root/client-name To Set Up a 10-Gigabit Ethernet Port on a Diskless ClientEdit the hosts file in the diskless client’s root directory Network Configuration # grep client-name /etc/bootparams Find the root directory of the client systemShut down and halt the client system Proceed with the Solaris Operating System installationOk boot /pci@7c0/pci@0/pci@8/network@0 # shutdown -i0 -g0 -y# dladm show-dev To Boot Over the Network on Solaris x86 and Linux Systems Refer the boot-device-order imageSystem should reboot after saving the boot configuration Press the F12 key to install the OS from the network Image pxe-mac-addrSun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring the nxge Device Driver Parameters Nxge Hardware and Software OverviewNoninteractive and Interactive Modes Setting nxge Driver Parameters on a Solaris PlatformSetting Parameters Using the ndd Utility To modify a parameter value, use the -setoption To Specify Parameter Values Using the ndd UtilityTo Specify Device Instances for the ndd Utility Man prtconf Setting Parameters Using the nxge.conf File# ndd /dev/nxge1 name to get/set ? Locate the path names and the associated instance numbers To Set Driver Parameters Using an nxge.conf FileFollowing parameters can be set using Set the parameters for the nxge devicesSun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring the nxge Device Driver Parameters Class-opt-ipv4-tcp = 100 class-opt-ipv4-udp = # reboot -r Tuning for Maximum Performance on a Solaris PlatformReboot the system Save the nxge.conf fileSet ddimsixalloclimit=1 To Improve Performance on an AMD CPU Based Sun PlatformSet ipipsqueuefanout=1 set ipsqueuesoftring=1 Configuring the nxge Device Driver Parameters Setting Parameters on a Linux Platform To Set Parameters Using the ethtool UtilityConfiguring the nxge Device Driver Parameters Following are some common parameters that can be changed # ethtool -C eth4 rx-usecs # ethtool -c eth4 # ethtool -k eth4# /usr/local/bin/nxgeconfig eth4 get # /usr/local/bin/nxgeconfig eth4 get classoptipv4udpNet.ipv4.tcpsack = Tuning for Maximum Performance on a Linux Platform# /usr/local/bin/nxgeconfig eth4 set classoptipv4tcp 0xfe0 Net.core.netdevmaxbacklog =Set up the sysctl utility # sysctl -p /etc/sysctlnxge.confJumbo Frames Overview Configuring the Jumbo Frames FeatureChecking Jumbo Frames Configurations To Show the Driver Statistics in a Solaris Environment # kstat nxge1 grep rdcpacketsEnabling Jumbo Frames in a Solaris Environment # kstat Nxge38001# ifconfig nxge mtu To Check Layer 2 ConfigurationBoot -r Set the maximum MTU for maximum performanceEnsure that the nxge software is installed To Check Layer 3 ConfigurationTo Enable Jumbo Frames in a Linux Environment Enabling Jumbo Frames in a Linux EnvironmentTo Show the Driver Statistics in a Linux Environment # ifconfig ethx mtu# ifconfig eth4 Set the MTU for maximum performanceConfiguring the Jumbo Frames Feature Sun Dual 10GbE XFP PCI Express Card User’s Guide January Overview of Link Aggregation Configuring Link AggregationConfiguring Link Aggregation in a Solaris Environment To Configure Link Aggregation in a Solaris Environment # ifconfig aggr33 192.168.1.1/24 broadcast + up Use the dladm show-aggr-scommand to display statistics# ifconfig aggr33 plumb # dladm show-aggr -sLoad the bonding driver Configuring Link Aggregation in a Linux EnvironmentTo Configure Bonding for Multiple nxge Interfaces # dladm show-aggr -LConfigure bond0 interface Sun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring VLANs Overview of VLANsVlan Configuring VLANs in a Solaris Environment To Configure Static VLANs 2Ethernet Tag Header Format# ifconfig -a Configuring VLANs in a Linux EnvironmentTo Configure VLANs in a Linux Environment Ensure that the nxge module is loaded# ifconfig eth2.5 xxx.xxx.xx.xxx up Configure the nxge Vlan eth2 in this example# /sbin/vconfig add eth2 Insert the Vlan moduleSpecifications ConnectorsPerformance Specifications Table A-1XFP Connector CharacteristicsPhysical Characteristics Power RequirementsSun Dual 10GbE XFP PCI Express Card User’s Guide January Diagnostic Software SunVTS Diagnostic SoftwareTo Update SunVTS to Recognize the Adapter Updating SunVTS to Recognize the AdapterUsing the SunVTS netlbtest To Use the netlbtestSun Dual 10GbE XFP PCI Express Card User’s Guide January Symbols IndexSun Dual 10GbE XFP PCI Express Card User’s Guide January