Storage and Milan Partition Delivered

Storage and Milan Partition Delivered

Published: 12 Aug 2024 by NEMO Team

The Weka Storage and the Milan partition of the new NEMO2 cluster have been delivered in the last weeks. In the next weeks, the companies will run tests and benchmarks and set up a final configuration for the systems. After that, we plan to start a first phase of NEMO2 with limited functionality, which we will increase over time.

Unfortunately, we had to shut down a large portion of the old NEMO cluster since the Milan partition needed to be installed into the same rack space. We will continue to operate the remaining approximately 300 nodes and the old BeeGFS until the official launch of NEMO2.

The first partition consists of:

  • 137 Milan nodes, each node has
    • 2x 64 Core AMD EPYC 7763 2.45GHz processors (128 cores per node)
    • 512GiB DDR4 RAM
    • 100 Gbit/s Omni-Path Interconnect
    • 100 Gbis/s Ethernet
    • 1.92TB local NvMe Disk
  • 1 Petabyte Weka Parallel Storage
    • Benchmark extrapolation: 80GB/s write, >200GB/s read (limited to 800Gbit/s Uplink)
    • Connected through 8x 100GbE Uplink
    • Each node connected via 100GbE

In the next month this partition will be extended by the Genoa and GPU/APU/KI partitions:

  • 96x Genoa nodes
  • 4x AMD APU nodes
  • 8x Nvidia L40S nodes (4x L40S each node)
  • further KI nodes will follow first half 2025
NEMO2

Latest Posts

NEMO2 Production Mode

NEMO2 has officially launched, transitioning from a testing phase to full production with expanded hardware, including AMD Instinct MI300A and Nvidia L40A nodes. NEMO1 is being phased out, with limited resources available until May 31st. Users are encouraged to transition to NEMO2 and consult the wiki for details.

Read more

Published: 14 May 2025

NEMO2 Conda

NEMO2 uses Miniforge for conda environments, offering a streamlined setup with conda-forge as the default repository. The Miniforge module auto-initializes conda, simplifying environment activation without modifying shell profiles.

Read more

Published: 14 May 2025

Genoa Nodes Delivered

The AMD Genoa, Machine Learning and AI partitions for NEMO2 were delivered on December 4th. The acceptance of the storage has been delayed, so that NEMO2 could not yet start this year. However, calculations with the Milan nodes in NEMO1 are still possible.

Read more