# Prometheus HA 1
###### tags: `PIXNET`

Use Thanos on promethus HA
https://thanos.io
https://github.com/thanos-io/thanos

## Tutorial
https://thanos.io/getting-started.md/
https://opencredo.com/blogs/ha-prometheus-the-thanos-evolution/
https://fosdem.org/2019/schedule/event/thanos_transforming_prometheus_to_a_global_scale_in_a_seven_simple_steps/attachments/slides/3178/export/events/attachments/thanos_transforming_prometheus_to_a_global_scale_in_a_seven_simple_steps/slides/3178/Thanos___Transforming_Prometheus_to_a_Global_Scale_in_a_Seven_Simple_Steps_(FOSDEM).pdf

## Experiment
### Install
* GCP (Debian 9.9)
* Docker
* Docker Compose
* zfs to manage prometheus data

### Stage
* [x] Stage1: docker-compose node-exporter + prometheus + grafana
* [x] Stage2: Thanos SideCar + query
* [x] Stage3: Test mulitple prometheus
* [ ] Stage4: Test storage
* [ ] Stage5: Rewrite and test on kubernete

dockerfile https://hub.docker.com/r/improbable/thanos
related https://grpc.io/docs/guides/concepts

Be aware that databases in two prometheus are NOT sync together when using Thanos.

## Detail
### Stage1
### Stage2
### Stage3 and result
https://gist.github.com/linnil1/25e480055b99220540dac870a9a11204