HP XC System Software 3.2.1 2.5.2 Configuring an InfiniBand Interconnect

Figure 2-6 Gigabit Ethernet Interconnect Connections

Non-Blade Server
			PCI SLOT
MGT	NIC	NIC	PCI SLOT

Non-Blade Server
			PCI SLOT
MGT	NIC	NIC	PCI SLOT

C-Class Blade Enclosure

	Interconnect bay 1
NIC 1
NIC 2	Interconnect bay 2
NIC 3
NIC 4	Interconnect bay 3
MEZZ 1
	Interconnect bay 4
MEZZ 2
MEZZ 3	Interconnect bay 5
iLO2
	Interconnect bay 6
NIC 1
	Interconnect bay 7
NIC 2
MEZZ 1	Interconnect bay 8
MEZZ 2
	ONBOARD
iLO2	ADMINISTRATOR

Admin ProCurve 2800 Series Switch

Console ProCurve 2600 Series Switch

Gigabit Ethernet Interconnect Switch

External Public Network

2.5.2 Configuring an InfiniBand Interconnect

An InfiniBand interconnect requires one or more external InfiniBand switches with at least one managed switch to manage the fabric.

Systems using an InfiniBand interconnect require you to install an InfiniBand mezzanine card into mezzanine bay 2 of each server blade to provide a connection to the InfiniBand interconnect network. The InfiniBand card in mezzanine bay 2 connects to the double-wide InfiniBand switch in interconnect bays 5 and 6 on the enclosure.

The entire interconnect network is formed by connecting the InfiniBand switches in interconnect bays 5 and 6 of each enclosure to one of the InfiniBand interconnect switches.

Non-blade server nodes also require InfiniBand cards and must also be connected to the interconnect network.

Figure 2-7illustrates the connections for an InfiniBand interconnect.

Figure 2-7 InfiniBand Interconnect Connections

Non-Blade Server					Non-Blade Server
				PCI SLOT					PCI SLOT
MGT	NIC		NIC	PCI SLOT	MGT	NIC	NIC		PCI SLOT
				InfiniBand PCI Cards
C-Class Blade Enclosure							Admin ProCurve 2800 Series Switch
NIC 1				Interconnect bay 1
NIC 2	InfiniBand			Interconnect bay 2
NIC 3	Mezzanine
		Cards
NIC 4				Interconnect bay 3			Console ProCurve 2600 Series Switch
MEZZ 1
				Interconnect bay 4
MEZZ 2
MEZZ 3				Interconnect bays
				5 & 6 (double wide)
iLO2							Infiniband Interconnect Switch
NIC 1
				Interconnect bay 7
NIC 2					Double wide
MEZZ 1				Interconnect bay 8
					InfiniBand switch
MEZZ 2					module			External Public Network
				ONBOARD
iLO2				ADMINISTRATOR

40 Cabling Server Blades