SwissTx : A Commodity MPI computing solution

1
Swiss-Tx A Commodity MPI computing solution
Swiss-Tx
Ralf Gruber, EPFL-SIC/CAPA/Swiss-Tx, Lausanne
Mars 1999
2
The Swiss-Tx machines
Swiss-Tx
Machine
Archive
Connection
TBytes
system
Swiss-T0
EasyNet bus FE bus
Swiss-T0 (Dual)
EasyNet bus FE switch
Baby T1
Crossbar 12x12 FE switch
Swiss-T1
Crossbar 12x12 FE switch
-
9000
252
1008
504
? ?
Not decided
Crossbar 12x12 FE switch
Swiss-T2
Baby T1 is an upgrade of T0(Dual)
Archive ported from T0 to T1
September 1998
3
Swiss-Tx
Swiss-T1
March 2000
4
Swiss-Tx
Swiss-T1 Architecture
March 2000
5
Swiss-T1
Swiss-Tx
Components 32 computational DS20E 2 frontend
DS20E 1 development DS20E 300 GB Raid 600 GB
distributed disks 1 TB DLT library Fast/Gigabit
Ethernet Tru64/TruCluster Unix LSF,
GRD/Codine Totalview, Paradyn MPICH, PVM
T-Net network technology ( 81)12x12 crossbar 1.2
GB/s 32 bit PCI adapter 75 MB/s (64 bit PCI
adapter 180 MB/s) Flexible, non-blocking Reliable
Optimal routing FCI (one-sided) 5 ms MPI 18
ms Monitoring system Remote management Up to 3
Tflop/s (g lt 100)
6
Baby T1 Architecture
Swiss-Tx
March 2000
7
Fat-tree/Crossbars 16x16
Swiss-Tx
N8, P8, NP64 PUs, X12, BBW32, L64
March 2000
8
Circulant graphs/Crossbars 12x12
Swiss-Tx
K2 (1/3) N8, P8, X8 BBW8, L16
K3 (1/3/5) N11, P6, X11 BBW18, L33
K4 (1/3/5/7) N16, P4, X16 BBW32, L64
March 2000
9
Fat-tree/Circulant graphs
Swiss-Tx
March 2000
10
Swiss-T2 K-Ring architecture
Swiss-Tx
March 2000
11
Swiss-T1 Alternative network
Swiss-Tx
March 2000
12
Swiss-T1 Software in a Box
Swiss-Tx
Digital Unix Compaq Operating system in each
box F77/F90 Compaq Fortran compilers HPF Compaq
High performance Fortran C/C Compaq C and
C compilers DXML Compaq Digital math library
in each box Posix threads Compaq Threading in a
box OpenMP Compaq Multiprocessor usage in a box
through directives KAP-F KAI To parallelise a
Fortran code in a multiprocessor
box KAP-C KAI To parallelise a C program in a
multiprocessor box
15 juin 1998
13
Swiss-T1 Software between Boxes
Swiss-Tx
LSF Platform Inc.Load Sharing Facility for
resource management Totalview Dolphin Parallel
debugger Paradyn Madison/CSCS Profiler to help
parallelising programs MPI-1/FCI SCS AG Message
passing interface between boxes running over
TNET MPICH Argonne Message passing interface
running over Fast Ethernet PVM UTK Parallel
virtual machine running over Fast
Ethernet BLACS UTK Basic linear algebra
subroutines ScaLAPACK UTK Linear algebra matrix
solvers MPI I/O SCS/LSP Message passing
interface for I/O MONITOR EPFL Monitoring of
system parameters NAG NAG Math library
package Ensight Ensight 4D visualisation MEMCOM S
MR SA Data management system for distributed
architectures
15 juin 1998
14
Create SwissTx Company
Swiss-Tx
Commercialise T-Net Commercialise machines for
Compute Centres Commercialise dedicated
machines Transfer knowhow in parallel application
technology