Sun Microsystems 10GBE XFP manual Configuring VLANs in a Solaris Environment

Page 87

The Main Server is a heavily used server that needs to be accessed from all VLANs and IP subnets. The server has a Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter installed. All three IP subnets are accessed by means of the single physical adapter interface. The server is attached to one of the switch’s Gigabit Ethernet ports, which is configured for VLANs 1, 2, and 3. Both the adapter and the connected switch port have tagging turned on. The tagging VLAN capabilities of both devices enable the sever to communicate on all three IP subnets in this network, yet continue to maintain broadcast separation among the three subnets. The following list describes the components of this network:

The Accounting Server is available to VLAN 3 only. It is isolated from all traffic on VLANs 1 and 2. The switch port connected to the server has tagging turned off.

Clients 1 and 2 are attached to a shared media hub that is then connected to the switch. They belong to VLAN 2 only, and are logically in the same IP subnet as the Main Server and Client 5. The switch port connected to this segment has tagging turned off.

Client 3 is a member of VLAN 1, and can communicate only with the Main Server and Client 5. Tagging is not enabled on Client 3’s switch port.

Client 4 is a member of VLAN 3, and can communicate only with the servers. Tagging is not enabled on Client 4’s switch port.

Client 5 is a member of both VLANs 1 and 2, and has a Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter installed. It is connected to switch port 10. Both the adapter and the switch port are configured for VLANs 1 and 2 and have tagging enabled.

VLAN tagging is only required to be enabled on switch ports that create trunk links to other VLAN-aware Ethernet switches, or on ports connected to tag-capable end- stations, such as servers or workstations with VLAN-aware adapters.

Configuring VLANs in a Solaris Environment

VLANs can be created according to various criteria, but each VLAN must be assigned a VLAN tag or VLAN ID (VID). The VID is a 12-bit identifier between 1 and 4094 that identifies a unique VLAN. For each network interface (nxge0 and nxge1), 4094 possible VLAN IDs can be selected. Only 512 unique IDs can be used simultaneously. Because IP subnets are commonly used, it is best to use IP subnets when setting up a VLAN network interface. This means that each VID assigned to a VLAN interface of a physical network interface will belong to different subnets.

Chapter 8 Configuring VLANs 69

Image 87
Contents Sun Dual 10GbE XFP PCI Express Card User’s Guide Please Recycle Contents Configuring the nxge Device Driver Parameters Network ConfigurationConfiguring the Jumbo Frames Feature Configuring Link AggregationConfiguring VLANs Specifications Diagnostic SoftwareIndex Tables Page Figures Sun Dual 10GbE XFP PCI Express Card User’s Guide January EMC Declaration of ConformityXii Sun Dual 10GbE XFP PCI Express Card User’s Guide January How This Document Is Organized PrefaceUsing Unix Commands Typographic Conventions Shell PromptsRelated Documentation Documentation, Support, and TrainingThird-Party Web Sites Sun Welcomes Your Comments Page Product Overview ComponentsProduct Description Hardware and Software Requirements Features Sun Dual 10GbE XFP PCI Express Card User’s Guide January To Download the Driver on a Solaris Platform Installing and Setting Up the DriverFor x86 systems Uncompress the gzipped tar fileUnpack the tar file For Sparc systems, change to the following directory# /usr/sbin/pkgadd -d Select the packages you want to installTo Remove the Driver from a Solaris Platform Verify that the nxge driver is installed on the systemTo discover the driver packages run the pkginfo command To remove the driver packages run the pkgrm commandDownloading and Installing the Driver on a Linux Platform Login to your system# ifconfig -a grep eth # modprobe nxge To Remove the Driver From a Linux Platform # ethtool -i eth4 driver nxge version# rpm -e nxge-1.0-1 Sun Dual 10GbE XFP PCI Express Card User’s Guide January Installing the Adapter Installing the AdapterTo Install the Adapter Installing the Adapter Sun Dual 10GbE XFP PCI Express Card User’s Guide January Install the optical transceivers Installing an Optical TransceiverTo Install an Optical Transceiver Installing the Adapter Ok show-nets Verifying the Hardware InstallationTo Verify the Hardware Installation Connect the Ethernet cablesOk .properties Ok cd /pci@7c0/pci@0/pci@8/network@0,1Rebooting the System Ok boot -rOk device-end Configuring the Network Host Files Network Configuration# grep nxge /etc/pathtoinst # ifconfig nxge0 plumb ip-addressup# cat /etc/hosts To Set Up a 10-Gigabit Ethernet Port on a Diskless Client Edit the hosts file in the diskless client’s root directoryExport/root/client-name Network Configuration Find the root directory of the client system # grep client-name /etc/bootparams# shutdown -i0 -g0 -y Proceed with the Solaris Operating System installationOk boot /pci@7c0/pci@0/pci@8/network@0 Shut down and halt the client system# dladm show-dev Refer the boot-device-order image To Boot Over the Network on Solaris x86 and Linux SystemsSystem should reboot after saving the boot configuration Image pxe-mac-addr Press the F12 key to install the OS from the networkSun Dual 10GbE XFP PCI Express Card User’s Guide January Nxge Hardware and Software Overview Configuring the nxge Device Driver ParametersSetting nxge Driver Parameters on a Solaris Platform Setting Parameters Using the ndd UtilityNoninteractive and Interactive Modes To Specify Parameter Values Using the ndd Utility To Specify Device Instances for the ndd UtilityTo modify a parameter value, use the -setoption Setting Parameters Using the nxge.conf File # ndd /dev/nxge1 name to get/set ?Man prtconf Set the parameters for the nxge devices To Set Driver Parameters Using an nxge.conf FileFollowing parameters can be set using Locate the path names and the associated instance numbersSun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring the nxge Device Driver Parameters Class-opt-ipv4-tcp = 100 class-opt-ipv4-udp = Save the nxge.conf file Tuning for Maximum Performance on a Solaris PlatformReboot the system # reboot -rTo Improve Performance on an AMD CPU Based Sun Platform Set ipipsqueuefanout=1 set ipsqueuesoftring=1Set ddimsixalloclimit=1 Configuring the nxge Device Driver Parameters To Set Parameters Using the ethtool Utility Setting Parameters on a Linux PlatformConfiguring the nxge Device Driver Parameters Following are some common parameters that can be changed # ethtool -k eth4 # ethtool -C eth4 rx-usecs # ethtool -c eth4# /usr/local/bin/nxgeconfig eth4 get classoptipv4udp # /usr/local/bin/nxgeconfig eth4 getNet.core.netdevmaxbacklog = Tuning for Maximum Performance on a Linux Platform# /usr/local/bin/nxgeconfig eth4 set classoptipv4tcp 0xfe0 Net.ipv4.tcpsack =# sysctl -p /etc/sysctlnxge.conf Set up the sysctl utilityConfiguring the Jumbo Frames Feature Checking Jumbo Frames ConfigurationsJumbo Frames Overview # kstat nxge1 grep rdcpackets To Show the Driver Statistics in a Solaris Environment# kstat Nxge38001 Enabling Jumbo Frames in a Solaris EnvironmentSet the maximum MTU for maximum performance To Check Layer 2 ConfigurationBoot -r # ifconfig nxge mtuEnabling Jumbo Frames in a Linux Environment To Check Layer 3 ConfigurationTo Enable Jumbo Frames in a Linux Environment Ensure that the nxge software is installedSet the MTU for maximum performance # ifconfig ethx mtu# ifconfig eth4 To Show the Driver Statistics in a Linux EnvironmentConfiguring the Jumbo Frames Feature Sun Dual 10GbE XFP PCI Express Card User’s Guide January Configuring Link Aggregation Configuring Link Aggregation in a Solaris EnvironmentOverview of Link Aggregation To Configure Link Aggregation in a Solaris Environment # dladm show-aggr -s Use the dladm show-aggr-scommand to display statistics# ifconfig aggr33 plumb # ifconfig aggr33 192.168.1.1/24 broadcast + up# dladm show-aggr -L Configuring Link Aggregation in a Linux EnvironmentTo Configure Bonding for Multiple nxge Interfaces Load the bonding driverConfigure bond0 interface Sun Dual 10GbE XFP PCI Express Card User’s Guide January Overview of VLANs Configuring VLANsVlan Configuring VLANs in a Solaris Environment 2Ethernet Tag Header Format To Configure Static VLANsEnsure that the nxge module is loaded Configuring VLANs in a Linux EnvironmentTo Configure VLANs in a Linux Environment # ifconfig -aInsert the Vlan module Configure the nxge Vlan eth2 in this example# /sbin/vconfig add eth2 # ifconfig eth2.5 xxx.xxx.xx.xxx upConnectors SpecificationsTable A-1XFP Connector Characteristics Performance SpecificationsPower Requirements Physical CharacteristicsSun Dual 10GbE XFP PCI Express Card User’s Guide January SunVTS Diagnostic Software Diagnostic SoftwareUpdating SunVTS to Recognize the Adapter To Update SunVTS to Recognize the AdapterTo Use the netlbtest Using the SunVTS netlbtestSun Dual 10GbE XFP PCI Express Card User’s Guide January Index SymbolsSun Dual 10GbE XFP PCI Express Card User’s Guide January