Hardware
 |
 |
|
Five of the eight racks in the first row of Lindgren |
The eight racks in the second row of Lindgren |
Configuration
Lindgren is a Cray XE6 system, based on AMD Opteron 12-core “Magny-Cours” (2.1 GHz) processors and Cray Gemini interconnect technology. It consists of 1516 compute nodes and 10 service nodes. The service nodes are used for things such as the login environment and internal services.
| Number of cabinets (racks) |
16 |
| Number of compute nodes | 1516 (96 nodes per cabinet) |
| Number of compute cores | 36384 (24 cores per node) |
| Peak performance (TOP 500) | 305.6 teraFLOPS |
| Sustained performance (LINPACK) |
237 teraFLOPS |
| High speed network | Cray Gemini (3-D Torus topology) |
| Total compute memory | 47.38 TB (32 GB DDR3 per node) |
| Disk space | 450 TB (site wide usage) |
| Compute environment | Cray Linux (CLE3) with two modes (ESM and CCM)* |
| File system | Lustre Parallel File System |
Each node has 24 cores divided between 2 sockets, with 12 cores each. Each of the 16 cabinets has 96 nodes or 2304 cores.
- L1 cache: 64KB data cache
- L2 cache: 512KB per core
- L3 cache: 12MB per processor
(*) The Cray Linux (CL3) on compute nodes will operate in two modes:
- ESM - Extreme Scalability Mode: ESM ensures no compromise scalability, Low-Noise Kernel for scalability, Native Communication and Optimized MPI, application-specific performance tuning and scaling.
- CCM - Cluster Compatibility Mode: CCM ensures no compromise compatibility, fully standard x86/Linux, Standardized Communication Layer, out-of-the-box ISV Installation, ISV applications simply install and run.
Interconnect
Lindgren has a Cray Gemini interconnect. The topology of the Lindgren network is described in this file.
