Skip to main content

MareNostrum 4

System Overview​

MareNostrum4 is a supercomputer based on Intel Xeon Platinum processors from the Skylake generation. It is a Lenovo system composed of SD530 Compute Racks, an Intel Omni-Path high performance network interconnect and running SuSE Linux Enterprise Server as operating system. Its current Linpack Rmax Performance is 6.2272 Petaflops.

This general-purpose block consists of 48 racks housing 3456 nodes with a grand total of 165,888 processor cores and 390 Terabytes of main memory. Compute nodes are equipped with:

  • 2 sockets Intel Xeon Platinum 8160 CPU with 24 cores each @ 2.10GHz for a total of 48 cores per node
  • L1d 32K; L1i cache 32K; L2 cache 1024K; L3 cache 33792K
  • 96 GB of main memory 1.880 GB/core, 12x 8GB 2667Mhz DIMM (216 high memory nodes, 10368 cores with 7.928 GB/core)
  • 100 Gbit/s Intel Omni-Path HFI Silicon 100 Series PCI-E adapter
  • 10 Gbit Ethernet
  • 200 GB local SSD available as temporary storage during jobs ($TMPDIR=/scratch/tmp/[jobid])

The processors support well-known vectorization instructions such as SSE, AVX up to AVX-512.

Remember that the BIOS and kernel reserves memory, so the actual total usable RAM that commands like "free" or "lstopo" report will be slighlty lower than 96GB (~94GB).

Login Nodes​

You can connect to MareNostrum using three public login nodes. Please note that only incoming connections are allowed in the whole cluster. The logins are:

mn1.bsc.es
mn2.bsc.es
mn3.bsc.es