The goal of this project is to set up simple ways to monitor and support free geodata publication.
We originally thought about an application that enables pulling data offline. Doing so automatically and completely was deemed unrealistic in the short term, however we explored ways of presenting metadata statistically and graphically inspired by [Gapminder Foundation](https://en.wikipedia.org/wiki/Gapminder_Foundation) and specifically their [Open Numbers](https://github.com/open-numbers) initiative, Open Knowledge Australia's [Morph.io](https://morph.io) platform, and the [Figure.nz](https://figure.nz/) project in New Zealand. We collected ideas about helping people to better differentiate, track, and sustain open government geodata, by simplifying data monitoring and collection as a community effort.
## Release timeline
The prototype (shown at the top of the [project page](https://dribdat.cividi.space/project/9)) that resulted in our collaboration with Swisstopo this week is an [interactive timeline](https://cdn.knightlab.com/libs/timeline3/latest/embed/index.html?source=13Y5q0jAySu28fgJfr8pxYXInvx6z02jM1qKo9f8DqfM&font=Default&lang=en&initial_zoom=2&height=1050) of dataset publications since 2013, based on [TimelinerJS](https://timeline.knightlab.com/) - an open source web tool popular in the Open Knowledge community - with the data so far scraped from the GeoAdmin [release notes](http://api.geo.admin.ch/releasenotes/index.html) ([example](http://api.geo.admin.ch/releasenotes/index.html#release-20201209-wednesday-december-9th-2020), [source](https://docs.google.com/spreadsheets/d/13Y5q0jAySu28fgJfr8pxYXInvx6z02jM1qKo9f8DqfM/edit?usp=sharing
)) using LibreOffice. Image are obtained with the screenshot service at the URL `https://map.geo.admin.ch/?layers=<layername>&bgLayer=voidLayer`
## Crowdsourced timeline
There is also now a separate [timeline](https://cdn.knightlab.com/libs/timeline3/latest/embed/index.html?source=1H4vZSeBlZA1emeysYJyvN-xJMw-HA_BGbVuIxmigf1Q&font=Default&lang=de&hash_bookmark=true&initial_zoom=2&height=650) ([source](https://docs.google.com/spreadsheets/d/1H4vZSeBlZA1emeysYJyvN-xJMw-HA_BGbVuIxmigf1Q/edit#gid=0)) and corresponding [form](https://forms.gle/xGru4MSGCBpuBCVu8) for collecting relevant community events and publications. If you would like to add to it, click here:
<a href="https://forms.gle/xGru4MSGCBpuBCVu8" target="_blank" class="btn btn-lg btn-success">Contribute event</a>
## Community monitoring
We tested an instance of a web uptime monitoring tool, [Falco](https://getfal.co/) (using [Ansible role](https://github.com/moreiramarti/falco_ansible_role) and an [Ungleich](https://ungleich.ch/) VPS) with which we can set up "pings" at regular interviews to key services - but found it to be rather limited in use. Basic uptime monitoring of the APIs (which have extremely high availability) is already done at https://api3.geo.admin.ch/api/status.html (screenshot above)
Since we would want to be able to program notifications when data gets updated or new releases are available, an instance of the open source [Huginn](https://github.com/huginn/huginn) platform was installed, and we looked for ways to make it useful for monitoring [site changes](https://edlinus.cn/archives/monitor-changes-in-a-website-and-push-notification-to-slack-via-huginn-and-slack-api.html) and [pushing alerts](https://edlinus.cn/archives/monitor-changes-in-a-website-and-push-notification-to-slack-via-huginn-and-slack-api.html).
<a href="https://github.com/huginn/huginn#what-is-huginn" target="_blank"><img src="https://camo.githubusercontent.com/198521c8a76f1a87b04042e7ed5ce864caf8b033ef3a655ca48cd1114291f7e4/68747470733a2f2f7261772e6769746875622e636f6d2f687567696e6e2f687567696e6e2f6d61737465722f6d656469612f687567696e6e2d6c6f676f2e706e67" height="200"></a>
The following tools were also considered:
- https://github.com/naztronaut/RaspberryPi-Website-Uptime-Monitor (solder alert! 🧑🔧)
Long term goals could include:
- Independently collect and federate historical data to run metrics on [design](https://www.researchgate.net/publication/330727436_Problems_of_designing_geoportal_interfaces) and [usability](https://www.researchgate.net/publication/328975369_Building_a_Framework_of_Usability_Patterns_for_Web_Applications_in_Spatial_Data_Infrastructures) issues, as well as [uptime monitoring](https://github.com/topics/uptime-monitor) and more technical reviews.
- Compare with and across regional, cantonal or city portals in form of a [crowdsourced census](https://census.okfn.org/en/latest/local/#current-censuses)
- Providing effective alternative discovery services, supporting efforts to republish geospatial data using [CKAN](https://ckan.org/portfolio/geospatial/), [GeoBlacklight](https://geoblacklight.org/projects.html), etc.
- Connect with international efforts, e.g. [FRDR Geodisy](https://www.frdr-dfdr.ca/repo/), [Radiant Earth](https://www.radiant.earth/community/), [S-ENDA](https://s-enda-documentation.readthedocs.io/en/latest/architecture.html)
Further ideas are discussed in the forum:
- [#2 Easily mirroring the data](https://github.com/cividi/geohackmin/discussions/2)
- [#6 Hitchhiker's Guide](https://github.com/cividi/geohackmin/discussions/6)
- [#50 Self-hosting open data](https://github.com/cividi/geohackmin/discussions/50)