# AiiDA Team Meeting 2022-03-09

###### tags: `team meetings`
###### time: 10am CET

[TOC]

### Present

* Giovanni
* Sebastiaan
* Marnik
* Chris
* Francisco
* Jason

### Catch-up round

*Max. 3 minutes each*

Giovanni:
* News for NumFOCUS?
* Tested migrations, couldn't test submitting yet
* (At the end) Agree on timeline for release (include also dates for "side-products" such as plugins, Quantum Mobile, tutorials, ...)

Sebastiaan:
* Releases:
* Released `aiida-core` `v1.6.6` and `v1.6.7` with some bug backports and updating of dependencies and CI workflow.
* Testing of `develop`
* Imported 14k CIF files as `CifData` and ran the `CifCleanWorkChain`. When running 300 processes in parallel, ran into [issue #4876](https://github.com/aiidateam/aiida-core/issues/4876) which causes the workchain to except due to a recursion error in the query builder. This was also present already in `v1.6.x`. We should prioritize trying to fix this, as it is basically hampering the high-throughput functionality of AiiDA.
* When running with just 30 concurrent processes, the exception did not occur once in all 14k workchains. Seems to be related to high-load of the workers then, but I have no clue what the origin could be yet. Still need to test whether the number of workers plays a role.
* Merged PRs:
* `Manager.load_profile`: do not load default profile if other already loaded (This was causing `-p` option to be ignored in certain CLI commands) [[#5383]](https://github.com/aiidateam/aiida-core/pull/5383)
* CLI: reinstate the tab-completion of parameter values (this was accidentally removed when moving to `click==8.0`) [[#5386]](https://github.com/aiidateam/aiida-core/pull/5386)
* `Profile`: formalize what constitutes a test profile (no longer based on profile name starting with `test_` but actually determined by a dedicated attribute) [[#5392]](https://github.com/aiidateam/aiida-core/pull/5392)
* Correct version number for RabbitMQ warning (Only versions of 3.8.15 and higher are no longer compatible with default server configuration) [[#5413]](https://github.com/aiidateam/aiida-core/pull/5413)
* ProfileManager: always clear storage in `clear_profile` (this was not always being called, causing tests to fail if database was not cleaned after previous session) [[#5412]](https://github.com/aiidateam/aiida-core/pull/5412)
* Open PRs:
* Dependencies: remove `simplejson` (approved by Chris, wanted to confirm with others) [[#5391]](https://github.com/aiidateam/aiida-core/pull/5391)
* `QueryBuilder`: add flat keyword to `first` method (Straight forward backwards-compatible addition, already exists for `all` method) [[#5410]](https://github.com/aiidateam/aiida-core/pull/5410)
* `GroupParamType`: store group if created [[#5411]](https://github.com/aiidateam/aiida-core/pull/5411)
* `Config`: add the hidden `warnings.rabbitmq_version` option (Chris suggested not to add added complexity of "hidden" options and just make it a normal option. Giovanni had originall suggested to make it hidden) [[#5415]](https://github.com/aiidateam/aiida-core/pull/5415)

Francisco:
* Merged the last PR for the profile locking mechanism functionality [#5331](https://github.com/aiidateam/aiida-core/pull/5331)

Jason:
* Testing of `develop` with some new under-developing plugin. Find some small issues.
* The autocomplete of `verdi run` still not working
* `%aiida` magic not working in jupyter notebook
* code setup, [the input plugin prompt does not show the list of plugin #5406](https://github.com/aiidateam/aiida-core/issues/5406)
* As for maxium recursion issue, I test with `SQLalchemy` in `v1.6.5`, not see the error message but always some calculations stuch and not response.
* Testing new aiida-core with aiida-optimade.

Chris:
- Storage stuff
- ♻️ REFACTOR: Move archive backend to aiida/storage
- ♻️ REFACTOR: Storage info flag `statistics` -> `detailed`
- 🐛 FIX: Ensure removal of "dangling" entity rows
- Everyone: archive migration testing: https://github.com/aiidateam/aiida-core/discussions/5407
- Documentation stuff (for v2 release)
- 📚⬆️ UPDATE: sphinx v4 (+ sphinx extensions)
- 📚 DOCS: Replace sphinx-panels with sphinx-design
- shiny new landing page
- 📚 DOCS: Include changelog in docs
- 📚 DOCS: Execute graph tutorial as Jupyter Notebook
- 📚 DOCS: Add storage architecture section

Marnik:
* Testing migrations done: all completed successfully!🥳
* Been developing/testing with `aiida-core` `develop` in `aiida-quantumespresso` plugin, no significant issues found so far.
* Don't have a proper AST-based solution for `aiida-upgrade` yet, just used my original regex-based solution in [this branch](https://github.com/mbercx/aiida-core/tree/new/5335/plugin-migrator) so far. Maybe that'll do as a first version? Note: [#5335](https://github.com/aiidateam/aiida-core/issues/5335) is where I'm trying to keep track of changes the migration tool should make.

### Specific Agenda Items
* Timeline for release (set it, where to write it) + email for developers
* Tutorial date? -> Tentative date, first week of October 2022