# Swarm/VirES poster notes

---

Contact **[e-mail]**
<!-- - [:watch: Schedule a meeting with me](https://doodle.com/mm/426705083/smithara)
(one-to-one training/discussion, request for a new tool etc.) -->
<!-- replace with calendly? -->

[Poster PDF download](https://docs.google.com/drawings/d/19LEbBwkuSpVAABKUn0r4KYcZxn-tSv1wri7dkQRv3UY/export/pdf)

---

## Project links

- VirES GUI: https://vires.services/
- VRE: https://vre.vires.services/
- Notebooks: https://notebooks.vires.services/
- Misc projects:
- fac-exploration.swarmdisc.org
- quicklooks.swarmdisc.org
- panel.swarmdisc.org
- Sounds from Swarm: see swarmdisc.org/outreach
- geomag-datacubes-dev.netlify.app

---

## SwarmPAL

- Openly developed at https://github.com/Swarm-DISC/SwarmPAL
- Slides: https://docs.google.com/presentation/d/1XCTXCZ9bXeykI-JdagN4PAZWs6DEs39lbQiF-3bfFIY/edit?usp=sharing
- Developer guide: https://hackmd.io/@swarm/dev
- Meetings: hackmd.io/@swarm/meetings

---

<!-- - Newsletter TBA -->
<!-- - [:incoming_envelope: Sign up to Magnetic Earth newsletter & meetings](https://hackmd.io/@mag-earth/community) -->

- Tutorials/guides:
- Python: check links at https://notebooks.vires.services/notebooks/01a__intro-jupyter-python
- PyHC School presentation about VirES:
- https://youtu.be/G_UuTP7OMZg?list=PLDKhoNyHGTFZ345-lI-EeC4CAQhNUfUS0&t=13870
- (see surrounding times in that video for HAPI)
- resources at https://github.com/heliophysicsPy/summer-school
---

<!-- - Prototype dashboards: panel.magneticearth.org -->
<!-- - Presentation slides: bit.ly/VRE21-slides -->
<!-- - 2021 [Poster PDF download](https://docs.google.com/drawings/d/1SIWeR0WopakFt7lQx6RzH-y0RhHQhu2rWE9c0I4JRQQ/export/pdf) -->
<!-- - 2022 ESA LPS [Poster PDF download](https://docs.google.com/drawings/d/17TGW1JohYngF_NkieZbkazr66FlIgIjlhSa4qPZGXe8/export/pdf) -->

---

### Feedback

- Data request and download through viresclient is a bottleneck
- Some kind of caching would help. This follows usage patterns with e.g. pysat or pyspedas. afaik the best caching system might be in [speasy](https://github.com/SciQLop/speasy). hapiclient also has a cache system (let's look at copying that first)
- those tools fetch just the original data (no models, filtering etc)
- how to handle viresclient cache?
- use the hash of the request parameters as the cache key? how to detect whether to refresh the cache (because the data and model versions update)? adjust the current tempfile handling by not deleting them when `usecache=True` and use the filename as the cache key?
- could also cache the most used model (e.g. CHAOS full) on the server - we might use publish this as a HAPI dataset
- [datacube approach](geomag-datacubes-dev.netlify.app/) also tackles this bottleneck (for geomagnetic measurements)
- this will leverage the cloud architecture

---

### Contribute ideas

1. [Swarm Notebooks](https://notebooks.vires.services): *Cookbook of reproducible recipes*
- Requirements: self-contained notebook, run in <10 mins, using Python libraries
- :point_right: Your suggestions?
2. [Dashboards](http://panel.magneticearth.org/): *Single-purpose apps*
- Requirements: see [Panel reference gallery](https://panel.holoviz.org/gallery/index.html) for ideas
- :point_right: Your suggestions?
3. [Quicklooks](https://quicklooks.swarmdisc.org)
4. Datasets available through VirES (must go through authorisation by ESA and the provider )
- :point_right: Your suggestions?
5. Extensions to VirES GUI (must consider current interface)
- :point_right: Your suggestions?
6. Interlinking with other tools (e.g. AuroraX)
- What tools do you use?
- :point_right: Your suggestions?
7. :point_right: something else?

---

### Available data


New (2022-05-23):
- EFI TIE
- EFI TCT02/16

New (2022-10-22):
- EFI IDM
- GOCE MAG

---

### Notes