ExCALIBUR "Turbulence at the exascale" dashboard

# ExCALIBUR "Turbulence at the exascale" dashboard :::info **NEWS OCTOBER 2022** ::: **-AMD Training Daresbury** The Scientific Computing Department at Daresbury Lab and CoSeC organised a half day training event together with AMD on October 5th 2022. The event is centred around AMD vision and technologies for the next generation of HPC systems. Agenda 12:45:13:00 Set up and connection for people on-line. 13:00:14:00 AMD Introduction and strategy -> 30 min for CPUs roadmap and 30 min for GPUs 14:00-15:00 AMD CPU Technology and training 15:00-15:15 Coffee Break 15:15-17:15 AMD GPU Technology and training 17:15-17:30 Wrap-up --- :::info **NEWS SEPTEMBER 2022** ::: **-First in-person workshop for the project** The first in-person meeting for the turbulence at the exascale project was organised at Imperial College London at the end of September, with 20 participants. It was really nice to finally meet the newly appointed PDRAs who will work on the project. Slides for all presentations available [here](http://weebly-file/5/8/7/2/58724623/first_workshop_slides.zip). **Programme** 10.00-10.30: Coffee & Cakes 10.30-10.45: Introduction and Welcome (Sylvain Laizet) Session 1: 10.50-11.10: Toby Flynn “A Scalable Many-core Tridiagonal Solver for OPS” 11.10-11.30: Jianping Meng “Towards automatic code generation for high-order compact schemes” 11.30-11.50: Neil Sandham “OpenSBLI code generation for high speed flows with thermochemical non-equilibrium” 11.50-12.10: Semih Akkurt "Update on the implementation of OpenMP in Xcompact3d" 12.10-12.45: [informal] panel session with Gihan Mudalige, Neil Sandham, Toby Flynn & Jianping Meng “lessons learnt from using DSL” 12.45-13.45: Lunch Session2: 13.45-14.05: Ali Girayhan Ozbay: Fluid flow reconstruction using neural networks 14.05-14.25: Vishnu Mohan: Introduction to SENGA+ and its capabilities 14.25-14.45: Sam Owens: uDALES: applications overview and development plan, including integration with 2DECOMP&FFT 14.45-15.05: Paul Bartholomew: Addressing the I/O bottleneck in Xcompact3d 15.05-15.25 Filippo Spiga: introduction to GRACE/HOPPER 15.25-16.00: General discussion and close **-Lagrangian particle tracking** A fully working version of the Lagrangian particle tracking within a channel flow is now available and verified in Xcompact3d. Work is on-going on the validation and potential new applications. https://github.com/rfj82982/Incompact3d/tree/dev-stfc-particle --- :::info **NEWS AUGUST 2022** ::: **-New 2DECOMP&FFT Github** A new release of the 2decomp&FFT library has been released which support NVIDIA GPUs offloading as well as a back end for CUDA FFT to perform FFT Fast Fourier Transform on the GPU (https://github.com/xcompact3d/2decomp-fft). The decoupling of 2decomp&FFT from the main branch of the Xcompact3d will help in increasing the impact since the library is used by several codes to perform 2D decomposition. For example the code CaNS is already using the new release of the library linking directly to the newly created repository (https://github.com/CaNS-World/CaNS/tree/main/dependencies). --- :::info **NEWS JULY 2022** ::: **-Launch of a mailing list for the project** Please contact s.laizet @ imperial.ac.uk if you want to join the mailing list. **-Updated x3div app** A full Navier-Stokes solver has been added to the X3div mini-app and ported to GPU (https://github.com/rfj82982/x3div/tree/Fix_HC_TGV). Performances review is now in progress to increase the speed-up in the GPU porting. --- :::info **NEWS JUNE 2022** ::: **-ParaCFD conference** All the member of the CCP-Turbulence were at the centre of the organisation of the [ParCFD2022](https://parcfd2022.org/) event in Italy from 25 to 27 May 2022 with around 130 participants form Europe, North America, and Asia. Seven keynote lectures were given including the one from Dr Rupak Biswas from NASA about NASA’s vision for quantum computing. 108 contributions covering several aspects of CFD and HPC were presented. --- :::info **NEWS MAY 2022** ::: **-ISC2022 student competition** The ISC Student Cluster Competition 2022, co-organized by the HPC-AI Advisory Council and ISC Group, took place during the ISC High Performance Conference. Xcompact3d was been selected as one of the three applications which was used for the competition. The student teams did a great job with the code and investigated the potential of non-blocking communications on NVIDIA DPUs. The award ceremony can be seen here. ISC22 SCC Winners Online Winners First Place Winner: Team Diablo, Tsinghua University, China Second Place Winner: Team SYSU-SCC, Sun Yat-Sen University, China Third Place Winner: Team SUST, Southern University of Science and Technology, China Onsite Winners First Place Winner: Team Heidelbears, Heidelberg University, Germany Second Place Winner: Team RACKlette, ETH Zurich University, Switzerland Highest LINPACK Winner: Team Heidelbears, Heidelberg University, Germany Fan Favorite Winner: Team NotOnlyFlops, Universitat Politecnica de Catalunya (UPC) --- :::info **NEWS APRIL 2022** ::: **-Hackathon Xcompact3d June 2022** A new in-person hackathon for Xcompact3d will be organised on 27th/28th June 2022 at Imperial College London. **-Publication:** Özbay, A. G., & Laizet, S. (2022). [Deep learning fluid flow reconstruction around arbitrary two-dimensional objects from sparse sensors using conformal mappings](https://aip.scitation.org/doi/full/10.1063/5.0087488). AIP Advances, 12(4), 045126. **-Recruitment** Most of the PDRA for this project are not in place (or are about to start in the next few weeks). --- :::info **NEWS MARCH 2022** ::: **-N8 CIR Retreat** The N8 Centre of Excellence in Computationally Intensive Research (N8 CIR) has been given some funds by EPSRC to bring together some soft/professional skills training for digital research infrastructure professionals. The programme will take the form of a five-day retreat, similar to the virtual residencies that have been held at the University of Oklahoma since 2015. The goal is to develop the soft-skills specifically associated with operating at the interface between researchers and technology. More information about the event: https://n8cir.org.uk/news/dri-retreat/ **-Industry-academia interface (IAI) day on the use of high-performance computing for CFD** The focus of this IAI day is to better understand the use of high-performance computing in various flow solvers targeting fluid flows of industrial relevance, and to discuss the challenges and opportunities that will come with exascale computing. The event will be held online via Zoom on Wednesday 4th May 2022 from 1pm to 5pm UK time (for registration please contact Sylvain Laizet from Imperial College London). **Agenda:** 13.00-13.10 Welcome and Opening Remarks (Sylvain Laizet) 13.10-13.40 Charles Moulinec (SFTC) & Yvan Fournier (EDF): Using and updating an industrial CFD code for and through research 13.40-14.10 Fred Mendonca (ESI Group): Some insights into deployment of the prolific opensource CFD, OpenFOAM, towards exascale computing 14.10-14.40 Mark Allan (ZENOTECH): High Fidelity Computational Fluid Dynamics and Aero-Acoustics with zCFD 14.40-15.00 Break 15.00-15.30 Moritz Kreutzer (Siemens Software): The Simcenter STAR-CCM+ HPC ecosystem 15.30-16.00 Dipankar Choudhury (ANSYS): Delightful Digital Exploration With CFD, Made Possible by Accelerator Node Computing 16.00-16.45 Facilitated discussion and Q&A with participants 16.45 Close **-UK Turbulence Consortium annual meeting 2022** The first in-person annual meeting for the UKTC was held at the end of March at Imperial College London. The event was well attended with over 90 participants. It was a nice opportunity for our community to catch up with each other. --- :::info **NEWS FEBRUARY 2022** ::: **- Recruitment** 7 Research Software Engineers are going to be recruited for this project (3 at Imperial College London, 1 in Southampton, 1 in Newcastle, 1 in Warwick, 1 in Daresbury). The positions are currently being advertised for a start as soon as possible (March-April 2022). **-Hackathon Xcompact3d Feb 2022** The Xcompact3d team of developers participated in another hackathon jointly organised by GPU Hackathons. The hackathon was an opportunity to improve the performance of x3div on GPUs. **-UK Turbulence Consortium annual meeting 2022** It is our great pleasure to announce that the next UK Turbulence Consortium annual meeting will be held at Imperial College London on 28th/29th March 2022 (we are aiming to have an in-person event). The three invited speakers are: Gihan Mudalige (Warwick) for a talk about Domain Specific Languages Benedict Rogers (Manchester) for a talk about Smoothed Particle Hydrodynamics Viv Kendon (Strathclyde) for a talk about Quantum Computing Full programme [here](http://weebly-file/5/8/7/2/58724623/2022_uktc_programme.pdf) New 4: ExCALIBUR Special Issue There is an ExCALIBUR special issue in Computing in Science & Engineering, with a contribution around the OPS library, see https://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=9734766. --- :::info **NEWS JANUARY 2022** ::: **- Recruitment** 7 Research Software Engineers are going to be recruited for this project (3 at Imperial College London, 1 in Southampton, 1 in Newcastle, 1 in Warwick, 1 in Daresbury). The positions are currently being advertised for a start as soon as possible (March-April 2022). **-Hackathon Xcompact3d Jan 2022** The Xcompact3d team of developers participated in a hackathon jointly organised by SFTC Daresbury and Nvidia. The hackathon was an opportunity to test a mini-app called x3div to investigate the potential of the Fortran command "do concurrent" for replacing directives for accelerated computing. Investigations are still on-going but it was possible to run a "do concurrent" version of x3div on Nvidia GPUs. The next steps will focus on improving the performance of x3div on GPUs as well as testing it with Intel/GNU Fortran compilers on multiple CPUs. **-LIFD John Fox Annual Lecture** Dr Sylvain Laizet will be delivering the keynote talk at the LIFD John Fox Annual Lecture in Leeds. The event will focus on active flow control solutions for wall-bounded flows, free-shear flows and wind turbines. The LIFD John Fox Annual Lecture is kindly supported by Dr R V Ahilan (ABL Group) and is organised by the Leeds Institute for Fluid Dynamics. --- :::info **NEWS DECEMBER 2021** ::: **-Virtuak Kick-off meeting** The kick-off meeting for the project was held virtually on Monday 13th December 2021 with nearly 50 participants, with representatives from Intel, Nvidia & 3 cross-cutting ExCALIBUR projects. The meeting started with an overview of the project with its objectives and presentation of our four flow solvers Xcompact3d, OpenSBLI, uDALES and SENGA+. Then the Domain Specific Language (DLS) framework OPS and the 2DECOMP&FFT library were introduced to the participant. Following this presentations, the three cross-cutting projects involved in "turbulence at the exascale" were briefly introduced by their knowledge exchange coordinator (one project is about UQ, on project is about DLS and one project is about coupling methods). The meeting was ended by a general discussion. **-Recruitment** 7 Research Software Engineers are going to be recruited for this project (3 at Imperial College London, 1 in Southampton, 1 in Newcastle, 1 in Warwick, 1 in Daresbury). The positions should be advertised in January 2022 for a start as soon as possible (March-April 2022). Most of the positions will be for 30 months. **-Performance analysis and benchmarking on the full ARCHER2 system** On-going testing on ARCHER2 for Xcompact3d, OpenSBLI, uDALES and SENGA+ with up to 1,024 nodes (131,072 CPU cores). First investigations are showing that the system has some issues about 1,024 nodes and the ARCHER2 team is investigating the problem. **-Podcast** A couple of more episodes of the podcast "turbulence at the exascale" were recorded in December --> [all episodes](https://www.ukturbulence.co.uk/podcast.html) **-ISC2022 student competition** The ISC Student Cluster Competition 2022, co-organized by the HPC-AI Advisory Council and ISC Group, will take place during the ISC High Performance Conference (June 2022). Xcompact3d has been selected as one of the three applications which will be used for the competition. ---