# Rāpoi Morning Tea - 2022/05/26 * Quick notes * Updated Docs * New Module System * BeeGFS * 🌟New Hardware🌟 --- # Quick notes * 1.5 million jobs run * 310 users in the system * HPC drop ins on Wednesdays --- ## Updated Docs [Raapoi Docs](https://vuw-research-computing.github.io/raapoi-docs/hpclayout/) ---- ## Updated docs * Hardware layout * Partition info * New module system * Examples * Git repo coming * User Submitted Docs * Your school/group notes here? * It's all markdown on [github](https://github.com/vuw-research-computing/raapoi-docs/blob/master/docs/partitions.md?plain=1), contributions welcome! --- ## New Module System * Stands alongside existing modules * Software restricted to toolchain "silos" * Searching for and loading software, is a little different. * A bit more annoying!<!-- .element: class="fragment" data-fragment-index="1" --> * Fewer tricky to diagnose problems!<!-- .element: class="fragment" data-fragment-index="2" --> ---- ## New Module System ```mermaid graph TD; LMOD["Module System"] --toolchain --- foss2020b["foss2020b <br> GCC/10.2.0 OpenMPI/4.0.5"] LMOD --toolchain --- foss2021a["foss2021a <br> GCC/10.3.0 OpenMPI/4.1.1"] foss2020b --- id3["ORCA/4.2.1"] foss2020b --- id4["Singularity/3.7.3"] foss2021a --- id5["Biopython/1.79"] foss2021a --- id6["Haploflow/1.0"] ``` ---- ### Loading Example Example loading `BioPython/1.7.9` ```bash # loading the modules module load foss/2021a # Needed for biopython to be loadable module load BioPython/1.7.9 ``` ---- #### Searching Example ```shell module spider netCDF ``` ---- #### Searching Example ```bash ------------- netCDF: ------------- Description: NetCDF (network Common Data Form) is a set of software libraries and machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. Versions: netCDF/4.7.1 netCDF/4.7.4 netCDF/4.8.0 -------------- For detailed information about a specific "netCDF" module (including how to load the modules) use the modules full name. For example: $ module spider netCDF/4.7.1 -------------- ``` ---- #### Searching Example ```bash module spider netCDF/4.7.1 ``` ---- #### Searching Example ```bash ---------- netCDF: netCDF/4.7.1 ---------- Description: NetCDF (network Common Data Form) is a set of software libraries and machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. You will need to load all module(s) on any one of the lines below before the "netCDF/4.7.1" module is available to load. GCC/8.3.0 OpenMPI/3.1.4 Help: Description =========== NetCDF (network Common Data Form) is a set of software libraries and machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. More information ================ - Homepage: https://www.unidata.ucar.edu/software/netcdf/ ``` ---- Toolchains currently on Rāpoi as of May 2022. Toolchain | Compiler | MPI :---------:|:----------:|:-------------: foss/2018b | GCC/7.3.0 | OpenMPI/3.1.1 foss/2019b | GCC/8.3.0 | OpenMPI/3.1.4 foss/2020a | GCC/9.3.0 | OpenMPI/4.0.3 foss/2020b | GCC/10.2.0 | OpenMPI/4.0.5 foss/2021a | GCC/10.3.0 | OpenMPI/4.1.1 --- ## BeeGFS * ~100TB of storage * No Quota * All SSD * Good I/O performance * Especially good for big parallel jobs * Deleted periodically * Next purge on 15th of August * Not backed up. * ```/beegfs-volatile/<username>``` ---- ## BeeGFS  ---- ## BeeGFS ```mermaid graph TD A(Home and Research Storage) -->|faster| B B[Scratch] -->|faster| C C[BeeGFS] -->|fastest| D D[local tmp on nodes] ``` --- ## New Hardware ###### *Kindly Funded by Digital Solutions* * New storage node - ~500TB * Faster Metadata * 4 new high memory nodes * 1TB ram * 128 cpus - (2 x AMD 7702 Rome) * Fast NVMe ```/tmp``` - to match the standard in the AMD parallel nodes ---- ## New Hardware ###### *Kindly Funded by Digital Solutions* * 1 new GPU node * 2 A100's * Same as the existing nodes * 1 new Compute Chassis * 4 new AMD parallel nodes matching existing AMD parallel nodes ---- ## New Hardware ###### *Kindly Funded by Digital Solutions* * We hope to get these in without a big outage.