IBM-BSC - Power9 at BSC

  • With the racks of IBM, BSC became the first supercomputing center in Europe to offer access to the same technologies of the brand new Summit, the most powerful supercomputer in the world.
  • The 3 racks have a peak performance of 1,48 Petaflops, a 50% more than MareNostrum3 supercomputer, which was uninstalled just one year ago.
  • POWER9 cluster emerged as the most "green" machine in Europe, according to the Green500 ranking in June 2018.

MareNostrum 4 supercomputer incorporated into production three racks of last IBM POWER technologies with a peak performance of 1.5 petaflops. With this incorporation, the Barcelona Supercomputing Center (BSC) aims to explore the high expectative of this technology to accelerate Artificial Intelligence–based research.

With the new POWER9 – Volta GPU racks, Barcelona Supercomputing Center (BSC) became the first supercomputing center in Europe to offer access to the same technologies of the Summit supercomputer, with which the US snatched from China the throne of the most powerful supercomputer in the world according to the Top500 ranking in November 2018.

Mateo Valero, director at Barcelona Supercomputing Center states to have “expectations that IBM POWER Systems will help BSC accelerate MareNostrum’s ability to advance research in personalized medicine, deep learning, and AI applications”.

MareNostrum

The 3 racks, formed of 54 IBM Power Systems AC922 servers, have a peak performance of 1,48 Petaflops, a 50% more than MareNostrum 3 supercomputer, which was uninstalled just one and a half year ago and had a performance of 1,1 Petaflops. On Linpack benchmark the cluster obtains 1,01 Pflops, using 85,8 Kw, for 11,77 Gflops/watt, and on HPCG benchmark is 28 Tflops using 27,48 kw, for 0,59 GFlops/watt.

MareNostrum 4 is an heterogeneous supercomputer entirely aimed at generating scientific knowledge and innovation. It is formed by a main block for current research workloads and three blocks of emerging technologies that are being added and updated as they become available. The main block, formed of Intel Xeon Platinum chips with a performance of 11,15 Petaflops, begun operation in July 2017. POWER9 racks are the first block of emerging technologies that has been installed. IBM delivered them on the 29 of December and they started operation in May 2018.

The aim of gradually incorporating emerging technologies like POWER9 into MareNostrum 4 is to allow BSC to experiment with what are expected to be the most advanced technological developments over the next few years. The goal of the center is evaluate which applications will get a better cost / performance ratio in each architecture and its suitability for future iterations of MareNostrum.

“By selecting IBM POWER9, Barcelona Supercomputing Center has positioned its MareNostrum Supercomputer to accelerate the most demanding data-intensive workloads like deep learning and personalized medicine research,” said David Turek, IBM VP of Exascale Systems. “IBM POWER9 Systems were designed from the ground up for big data and advanced analytics that fuel AI and high performance computing applications, making it an ideal platform to advance BSC’s research.”

Technical information

The 3 new racks of MareNostrum 4 are formed of 54 nodes of IBM POWER9 processors. Each node has 2 Witherspoons processors (with 20 cores of 3,1 GHz each), 4 Volta NVIDIA GPUS (with 16 GiB each), and 6,4 TB of NVMe (Non-Volatile Memory).

The three new racks have 30,7 Terabytes of main memory, 207 Terabytes of SSD storage, 345,6 TB of NVMe, and the different nodes are connected to each other with a high speed Mellanox EDR network, and interconnected to BSC file systems allowing MareNostrum to handle large, complex data sets and models.

Built from the ground-up for the most demanding workloads like deep learning and AI, IBM’s new POWER9 processor includes the latest IO subsystem technology to accelerate the most data-intensive workloads.

MareNostrum 4 has been built by IBM with key industry partners. When completed, will have a performance capacity of 13,7 Petaflops.

The BSC POWER9 cluster is Europe’s “greenest” supercomputer

The Barcelona Supercomputing Center’s POWER9 cluster emerged as the most "green" machine in Europe, according to the Green500 ranking in June 2018, which scores the world's fastest supercomputers for its energy efficiency.

In that edition of the Green500 ranking, MareNostrum 4 POWER9 cluster revealed itself capable of executing 11.865 x 109 floating point operations per watt of consumed energy (11,865 Gigaflops / Watt). This energy efficiency placed it at number 9 on the Green500, after six Japanese supercomputers and two North American computers.

  • Caption: Dave Turek, IBM VP of Exascale Systems and Mateo Valero, BSC Director