# <i>Liquid Investigations + Nomad</i> Pre-Post-Mortem

Nomad version: *0.10.2*

Why migrate to Kubernetes?

## Features?

- namespacing is an enterprise feature
- can't run two instances of anything without making it all ugly (prefixing, dynamically setting up static ports, etc)
- anything remotely smart/automated is an enterprise feature

- https://github.com/hashicorp/nomad/issues/606
- 1 node + 100+ containers -- need oversubscription

- https://github.com/hashicorp/nomad/issues/545 or
https://github.com/hashicorp/nomad/issues/1061
- we need to keep re-implementing logic related to waiting for health checks

- https://github.com/hashicorp/nomad/issues/6366
- need external templating service, because nomad can only rewrite some of the fields using vars
- [nomad templates](https://github.com/liquidinvestigations/node/blob/3cc273a57e9da4403630f46a87beffaa9b9918fa/templates/nextcloud-migrate.nomad#L24) + [consul templates](https://github.com/liquidinvestigations/node/blob/3cc273a57e9da4403630f46a87beffaa9b9918fa/templates/nextcloud-migrate.nomad#L60) + [Jinja templates](https://github.com/liquidinvestigations/node/blob/3cc273a57e9da4403630f46a87beffaa9b9918fa/templates/nextcloud-migrate.nomad#L84) -- confusing

- https://github.com/hashicorp/nomad/issues/1782
- we sometimes encounter batch jobs that should've ended a long time ago, but they never did...

- https://github.com/hashicorp/nomad/issues/6536 or
https://github.com/hashicorp/nomad/issues/5378
- you need to restart the client to add/remove host volumes
- in the meantime they re-implemented the kubernetes storage API
- but i'm sure it's buggy, since it's a fresh integration (oct 2020)

## Bugs.

Nomad is pre-release software v0.XX and there's a blocking bug every release:
- https://github.com/hashicorp/nomad/issues/6646
- https://github.com/hashicorp/nomad/issues/5819 and many similar
- https://github.com/hashicorp/nomad/issues/6159
- https://github.com/hashicorp/nomad/pull/6325
- before that we used to run "docker system prune" and it would enter this infinite loop with nomad, one adding containers, one removing them, both at the same time
- You never know what the next update is gonna bring you in terms of random bugs, panics, broken features, etc
- We wouldn't care this much about random breakage if we didn't try and use its entire feature set...