359449-001
LC 1000 Series 64 Node Myrinet DL140 Cluster Reference Design
Myrinet (expandable to 128 nodes)
Rack 1 |
|
| Rack 2 |
|
| Rack 3 |
| Rack 4 |
DL140 Compute Node | DL140 Compute Node | DL380 Control Node | DL140 Compute Node | DL140 Compute Node | DL140 Compute Node | DL140 Compute Node | DL140 Compute Node | DL140 Compute Node |
ATA 1 | NIC1 NIC2 Serial ATA 2 | Myr | ATA 1 | NIC1 NIC2 Serial ATA 2 | Myr | SCSI 1 | iLO NIC2 NIC1 Serial SCSI 2 | ATA 1 | NIC1 NIC2 Serial ATA 2 | Myr | ATA 1 | NIC1 NIC2 Serial ATA 2 | Myr | ATA 1 | NIC1 NIC2 Serial ATA 2 | Myr | ATA 1 | NIC1 NIC2 Serial ATA 2 | Myr | ATA 1 | NIC1 NIC2 Serial ATA 2 | Myr | ATA 1 | NIC1 NIC2 Serial ATA 2 | Myr |
Public |
|
|
| |
| SW1 | |||
|
|
| Myricom w/Myrinet | |
|
|
| Line Cards | |
LAN | (Cluster Interconnect | |||
| Switch) | |||
|
|
| ||
|
|
|
|
|
|
|
|
|
|
| SW1 |
|
|
| SW2 |
|
| SW2 |
| SW3 |
| SW1 |
|
|
| SW2 |
| SW1 |
| SW2 | ||||
| ProCurve 2848 |
|
|
| Cyclades |
| ProCurve 2848 |
| Cyclades |
| ProCurve 2848 |
|
|
| Cyclades |
| ProCurve 2848 |
| Cyclades | |||||
10/100/1000 |
|
|
| (OOB Management | 10/100/1000 |
| (OOB Management | 10/100/1000 |
|
|
| (OOB Management | 10/100/1000 |
| (OOB Management | |||||||||
| (IB Management Switch) |
|
|
| Switch) |
| (IB Management Switch) |
| Switch) |
| (IB Management Switch) |
|
|
| Switch) |
| (IB Management Switch) |
| Switch) | |||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4x |
|
|
|
| 4x |
|
|
|
|
|
|
|
|
|
|
| |||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4x |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| Optional Storage Solution |
|
|
|
|
|
|
|
|
|
|
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||
8
42
41
40
39
38
37
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
U
S 40 | Expansion |
S 39 | Expansion |
S 38 | Expansion |
S 37 | Expansion |
S 36 | DL140 |
S 35 | DL140 |
S 34 | DL140 |
S 33 | DL140 |
S 32 | DL140 |
S 31 | DL140 |
S 30 | DL140 |
S 29 | DL140 |
S 28 | DL140 |
S 27 | DL140 |
S 26 | DL140 |
S 25 | DL140 |
S 24 | DL140 |
S 23 | DL140 |
S 22 | DL140 |
S 21 | DL140 |
SW 2 | Cyclades |
SW 1 | ProCurve 2848 |
S 20 | DL140 |
S 19 | DL140 |
S 18 | DL140 |
S 17 | DL140 |
S 16 | DL140 |
S 15 | DL140 |
S 14 | DL140 |
S 13 | DL140 |
S 12 | DL140 |
S 11 | DL140 |
S 10 | DL140 |
S 9 | DL140 |
S 8 | DL140 |
S 7 | DL140 |
S 6 | DL140 |
S 5 | DL140 |
S 4 | DL140 |
S 3 | DL140 |
S 2 | DL140 |
S 1 | DL140 |
Rack 1 (R1)
42 |
| S 29 | DL140 |
41 |
| S 28 | DL140 |
40 |
| S 27 | DL140 |
39 |
| S 26 | DL140 |
38 |
| S 25 | DL140 |
37 |
| S 24 | DL140 |
36 |
| S 23 | DL140 |
35 |
| S 22 | DL140 |
34 |
| S 21 | DL140 |
33 |
| S 20 | DL140 |
32 |
| S 19 | DL140 |
31 |
| S 18 | DL140 |
30 |
| S 17 | DL380 |
29 |
| ||
|
|
| |
28 |
| S 16 | DL140 |
27 |
| S 15 | DL140 |
26 |
| S 14 | DL140 |
25 |
| S 13 | DL140 |
24 |
| S 12 | DL140 |
23 |
| S 11 | DL140 |
22 |
| SW 3 | Cyclades |
21 |
| SW 2 | ProCurve 2848 |
20 |
|
| TFT5600 |
19 |
| S 10 | DL140 |
18 |
| S 9 | DL140 |
17 |
| S 8 | DL140 |
16 |
| S 7 | DL140 |
15 |
| S 6 | DL140 |
14 |
| S 5 | DL140 |
13 |
| S 4 | DL140 |
12 |
| S 3 | DL140 |
11 |
| S 2 | DL140 |
10 |
| S 1 | DL140 |
9 |
|
|
|
8 |
|
|
|
7 |
|
|
|
6Myricom 17 slot
5SW 1 chassis w/Myrinet
4line cards
U |
| Rack 2 (R2) |
42
41
40
39
38
37
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
U
S 40 | Expansion |
S 39 | Expansion |
S 38 | Expansion |
S 37 | Expansion |
S 36 | Expansion |
S 35 | Expansion |
S 34 | Expansion |
S 33 | Expansion |
S 32 | Expansion |
S 31 | Expansion |
S 30 | Expansion |
S 29 | Expansion |
S 28 | Expansion |
S 27 | Expansion |
S 26 | Expansion |
S 25 | Expansion |
S 24 | Expansion |
S 23 | Expansion |
S 22 | Expansion |
S 21 | Expansion |
SW 2 | Expansion |
SW 1 | Expansion |
S 20 | Expansion |
S 19 | Expansion |
S 18 | Expansion |
S 17 | Expansion |
S 16 | Expansion |
S 15 | Expansion |
S 14 | Expansion |
S 13 | Expansion |
S 12 | Expansion |
S 11 | Expansion |
S 10 | Expansion |
S 9 | Expansion |
S 8 | Expansion |
S 7 | Expansion |
S 6 | Expansion |
S 5 | Expansion |
S 4 | Expansion |
S 3 | Expansion |
S 2 | Expansion |
S 1 | Expansion |
Rack 3 (R3)
42 |
|
|
|
41 |
|
|
|
40 |
|
|
|
39 |
|
|
|
38 |
|
|
|
37 |
|
|
|
36 |
|
|
|
35 |
|
|
|
34 |
|
|
|
33 |
|
|
|
32 |
|
|
|
31 |
|
|
|
30 |
|
|
|
29 |
|
|
|
28 |
|
|
|
27 |
|
|
|
26 |
|
|
|
25 |
|
|
|
24 |
|
|
|
23 |
|
|
|
22 |
| SW 2 | Expansion |
21 |
| SW 1 | Expansion |
20 |
| S 20 | Expansion |
19 |
| S 19 | Expansion |
18 |
| S 18 | Expansion |
17 |
| S 17 | Expansion |
16 |
| S 16 | Expansion |
15 |
| S 15 | Expansion |
14 |
| S 14 | Expansion |
13 |
| S 13 | Expansion |
12 |
| S 12 | Expansion |
11 |
| S 11 | Expansion |
10 |
| S 10 | Expansion |
9 |
| S 9 | Expansion |
8 |
| S 8 | Expansion |
7 |
| S 7 | Expansion |
6 |
| S 6 | Expansion |
5 |
| S 5 | Expansion |
4 |
| S 4 | Expansion |
3 |
| S 3 | Expansion |
2 |
| S 2 | Expansion |
1 |
| S 1 | Expansion |
U |
|
| Rack 4 (R4) |
