Introducing the Spack Rolling Binary Cache hosted on AWS

57

Today we’re excited to announce the availability of a new public Spack binary cache hosted on AWS. Spack users now have access to a public build cache hosted on Amazon Simple Storage Service (Amazon S3).

Using this binary cache results in up to 20x faster install times for common spack packages. The work was the result of a collaboration between AWS, E4S, Kitware, and Lawrence Livermore National Laboratory (LLNL), and is powered by Spack’s open source project team, who have done amazing work in support of the HPC community.

background

We often comment that HPC software is almost defined by its complexity. A lot of the time we’re talking about the really huge dependency trees like the one in Figure 1.

Figure 1: Spack build dependency diagram for WRF with GCC and Open MPI on AWS

Keeping track of an application’s build dependencies, its installation and maintenance is not a trivial task. Their assembly is also a complex process full of nuanced…



Source link

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.