# EESSI/AWS sync meetings - link to AWS project doc: https://docs.google.com/document/d/1CHG9fCh2LkfJ-EI8J-_Wr5NpHL5iwm8Wu6syfK9h7-c ## Next meeting - Every 2 months on 2nd Thursday, 13:00 GMT/BST a.k.a. 14:00 CE(S)T - Thu 14 Mar 2024 - Thu 9 May 2024 => move to June? --- ## Notes 28 Aug 2025 (11:00 UTC) attending: - Brendan (AWS) - Alan (CECAM/EESSI) - Kenneth (HPC-UGent/EESSI) - Bob (RUG/EESSI) ### Notes - adoption of EESSI - 40+ systems (see https://www.eessi.io/docs/systems) - some looking into using EESSI as a base software stack - like MUSICA @ Austria - mandate for EuroHPC systems via EuroHPC Federation Platform - status on sponsored AWS credits - ~28k left (with end date of 31 Oct'25) - => extended to 31 Dec'25 - current burn rate ~7k - schedule meeting with Brendan mid Nov'25 - reInvent week (1-5 Dec) will be quiet for Brendan - one-page summary, just text => in next 2 weeks - what is EESSI - spread (adoption in EFP) - award: https://www.eessi.io/docs/blog/2024/11/18/hpcwire-readers-choice-awards-2024-for-eessi/ - progress made curtosy of the AWS credits - future plans - GPU support matrix - https://www.eessi.io/docs/software_layer/gpu_targets - single-GPU instance now possible in AWS? - presence at Supercomputing'25 - EESSI BoF proposal was rejected - could consider tutorial submission on CI/CD in HPC context - EFP related activity at EuroHPC booth at SC'26? - MPI injection w/ EFA - EESSI recipe for ParallelCluster - EESSI in Parallel Computing Service (PCS) - UI in AWS Console to create clusters - Slurm operated/updated by AWS - after confirmation for major Slurm updates - post-install script to add EESSI (Packer script) - https://github.com/aws-samples/aws-hpc-recipes/tree/main/recipes/pcs - https://github.com/aws-samples/aws-hpc-recipes/blob/main/recipes/env/eessi/assets/postinstall.sh - Squid caching aspect => on PCS login node - could be via auto-discovery thing in CernVM-FS - (additional) AWS-specific mirrors - run by EESSI through sponsored credits - CDN services may also be useful here - status of MPI libraries in those images? - docs refer to EFA docs - Matt Vaugn tutorial videos - like https://www.youtube.com/watch?v=3ysMkZrDlGI - AWS blog post on EESSI in PCS - ingested by ChatGPT/Claude & co - aim for "active voice" format - see HPC blog channel - send draft to Brendan - keep scripts in Git repo, easier to maintain - SC/reInvent attract a lot of attention ## Notes 24 Oct 2024 (11:00 UTC) attending: - Brendan (AWS) - Pedro (HPCNow!) - Alan (CECAM/EESSI) - Kenneth (HPC-UGent/EESSI) - PR open to AWS Recipes to make EESSI available - see https://github.com/aws-samples/aws-hpc-recipes/pull/40 - post-install script for ParallelCluster - Alan spent some time on looking into performance comparison with Spack, but took a long time - new AWS service: PCS (sort of a managed ParallelCluster service) - waiting on CloudFormation support to fully automate it, 1-click launch of a cluster - support architectures - Graviton 4 is quite close to NVIDIA Grace - significant speedup with Graviton 4 - credits - Brendan will top up sponsored credits for next year - SC24 - no customer talks at AWS booth - Tech Short with update on EESSI - scheduled for Thu 28 Nov - HPSF --- ## Notes previous meetings - 24 Oct 2024: https://github.com/EESSI/meetings/wiki/AWS-meeting-2024-10-24 - 14 Mar 2024: https://github.com/EESSI/meetings/wiki/AWS-meeting-2024-03-14 - 12 Oct 2023: https://github.com/EESSI/meetings/wiki/AWS-meeting-2023-10-12 - 14 Sept 2023: no notes were taken :( - 10 Aug 2023: https://github.com/EESSI/meetings/wiki/AWS-meeting-2023-08-10 - July 2023: (skipped) - 8 June 2023: https://github.com/EESSI/meetings/wiki/AWS-meeting-2023-06-08 - 11 May 2023: https://github.com/EESSI/meetings/wiki/AWS-meeting-2023-05-11 - 13 April 2023: https://github.com/EESSI/meetings/wiki/AWS-meeting-2023-04-13 - 9 Mar 2023: https://github.com/EESSI/meetings/wiki/AWS-meeting-2023-03-09 - 11 Jan 2023: https://github.com/EESSI/meetings/wiki/AWS-meeting-2023-01-11