Key numbers about the Stallo cluster: compute nodes, node interconnect, operating system, and storage configuration.
|Peak performance||312 Teraflop/s||332 Gigaflop/s / 448 Gigaflops/s|
304 x HP BL460 gen8 blade servers
328 x HP SL230 gen8 servers
144 x HP Apollo 8000 gen8 servers
1 x HP BL460 gen8 blade servers
1 x. HP SL230 gen8 servers
1 x. HP apollo 8000 gen8 servers
# CPU’s / # Cores
608 / 4864
656 / 6560
288 / 5760
2 / 16
2 / 20
2 / 20
608 x 2.60 GHz Intel Xeon E5 2670
656 x 2.80 GHz Intel Xeon E5 2680
288 x 2.80 GHz Intel Xeon E5 2680
2 x 2.60 GHz Intel Xeon E5 2670
2 x 2.80 Ghz Intel Xeon E5 2680
2 x 2.80 GHz Intel Xeon E5 2680
|Total memory||26.2 TB||32 GB (32 nodes with 128 GB)|
|Internal storage||155.2 TB||500 GB (32 nodes with 600GB raid)|
|Centralized storage||2000 TB||2000 TB|
|Interconnect||Gigabit Ethernet + Infiniband 1||Gigabit Ethernet + Infiniband 1|
1) All nodes in the cluster are connected with Gigabit Ethernet and QDR Infiniband.
Stallo - a Linux cluster¶
This is just a quick and brief introduction to the general features of Linux Clusters.
A Linux Cluster - one machine, consisting of many machines¶
On one hand you can look at large Linux Clusters as rather large and powerful supercomputers, but on the other hand you can look at them as just a large bunch of servers and some storage system(s) connected with each other through a (high speed) network. Both of these views are fully correct, and it’s therefore important to be aware of the strengths and the limitations of such a system.
Clusters vs. SMP’s¶
Until July 2004, most of the supercomputers available to Norwegian HPC users were more or less large Symmetric Multi Processing (SMP’s) systems; like the HP Superdome’s at UiO and UiT, the IBM Regatta at UiB and the SGI Origion and IBM p575 systems at NTNU.
On SMP systems most of the resources (CPU, memory, home disks, work disks, etc) are more or less uniformly accessible for any job running on the system. This is a rather simple picture to understand, it’s nearly as your desktop machine – just more of everything: More users, more CPU’s, more memory, more disks etc.
On a Linux Cluster the picture is quite different. The system consists of several independent compute nodes (servers) connected with each other through some (high speed) network and maybe hooked up on some storage system. So the HW resources (like CPU, memory, disk, etc) in a cluster are in general distributed and only locally accessible at each server.
Linux operation system (Rocks): http://www.rocksclusters.org/¶
Since 2003, the HPC-group at has been one of five international development sites for the Linux operation system Rocks. Together with people in Singapore, Thailand, Korea and USA, we have developed a tool that has won international recognition, such as the price for “Most important software innovation ” both in 2004 and 2005 in HPCWire. Now Rocks is a de-facto standard for cluster-management in Norwegian supercomputing.
Stallo - Norse mythology¶
In the folklore of the Sami, a Stallo (also Stallu or Stalo) is a sami wizard. “The Sami traditions up North differ a bit from other parts of Norwegian traditions. You will find troll and draug and some other creatures as well, but the Stallo is purely Sami. He can change into all kinds of beings,; animals, human beings, plants, insects, bird – anything. He can also “turn” the landscape so you miss your direction or change it so you don’t recognise familiar surroundings. Stallo is very rich and smart, he owns silver and reindeers galore, but he always wants more. To get what he wants he tries to trick the Samis into traps, and the most popular Sami stories tell how people manage to fool Stallo.” NB! Don’t mix Stallo with the noaide! He is a real wizard whom people still believe in.