Linux Cluster for Computational Physics Applications

Maintained by Eric Hazen ( hazen@bu.edu). Updated 16 January 2006

This page is intended to provide documentation of Linux computing clusters being constructed at Boston University for Dr. Anders Sandvik.

The initial cluster prototype consists of 48 nodes arranged on plates with 3 motherboards each. One 380W power supply powers each plate. A single 48-port 100BaseT ethernet switch provides. network connections to all nodes in a rack. Nodes are currently diskless, though a small disk could probably be added if a large PSU were used.

48-node Prototype 2

Completed summer 2005. Instead of a flat plate we use a custom-made aluminum box with punched holes and welded corners made by a local sheet-metal house.

This version uses Intel D865GLCL motherboards, Intel P4 3.0GHz/800MHz CPU, 1GB memory per node and Antec True430 power supplies.

Cost for all computer parts (MoBo, CPU, RAM, PSU) for 48 nodes is about US$23,000.
Other hardware (rack, boxes, power distribution PCBs, wiring harnesses, etc) was about US$4,500.
This works out to US$565 per node (without labour).

Drawings Directory for custom parts New!

Small (88K)
Large (1.3M) Rack with 15 nodes installed. Rack is built of standard slotted steel angle (quite cheap). Small (96K)
Large (1.4M) Another view.
Small (88K)
Large (1.3M) Close-up. Note rear cooling fan for each node (blowing toward camera) plus large cut-out for cables and cooling air exit. Small (100K)
Large (1.4M) Top view showing wiring.
Small (44K)
Large (976K) View of empty box. Hole pattern accomodates standard ATX or Micro-ATX footprint motherboards. Small (84K)
Large (1.3M)

48-node Prototype 1

Each node consists of a Shuttle motherboard with 1GB RAM and a Pentium 4 (Northwood) 3.0GHz processor. Power required is approximately 28A at 117VAC for 48 nodes.

Parts are mounted on flat aluminum plates resting on a utility shelf.

Small (124K)
Large (1.7M) Complete 48-node rack. Note network switch on table, and home-made 240V two-phase power distribution boxes at left. Small (144K)
Large (1.8M) View of several plates.
Small (124K)
Large (1.6M) Close-up showing power distribution PCB.

Preliminary Design

Below are some preliminary drawings of a rack layout for 48 nodes. Mini-ATX format motherboards are assumed.

Presentation by E. Hazen for 2/26/04 meeting
Rack Layout
Layout of one Level
Initial component purchase list

Reference Materials

Linux Clusters at Abo Akademi in Finland
3Com Hub Data Sheet
Asus P4S800-MX Manual
Asus P4S800D-E Deluxe Manual
Asus P4R800-VM Manual
Asus P4P800-VM Manual
From formfactors.org:
- ATX Specification (v2.2)
- ATX Specification (v2.01) with 20-pin power connector
- Micro-ATX motherboard interface specification
- ATX 12V power supply specification 1.3
Air Conditioning Tutorial from Miser Products
Mini-ITX Cluster Project

Power connector (cable, 24-pin) is Molex 39-01-2240 [Digi-Key]).

Photos

First 3 Nodes

Small (88K) Large (1.3M)	Rack with 15 nodes installed. Rack is built of standard slotted steel angle (quite cheap).	Small (96K) Large (1.4M)	Another view.
Small (88K) Large (1.3M)	Close-up. Note rear cooling fan for each node (blowing toward camera) plus large cut-out for cables and cooling air exit.	Small (100K) Large (1.4M)	Top view showing wiring.
Small (44K) Large (976K)	View of empty box. Hole pattern accomodates standard ATX or Micro-ATX footprint motherboards.	Small (84K) Large (1.3M)

	Small (124K) Large (1.7M)	Complete 48-node rack. Note network switch on table, and home-made 240V two-phase power distribution boxes at left.		Small (144K) Large (1.8M)	View of several plates.
	Small (124K) Large (1.6M)	Close-up showing power distribution PCB.