# RCA
## [Production Outage] - [2/11/2022]

### What happened?
Production site went down for about 4 hours due to a deployment pipeline bug (deployment token invalid). From **(5AM - 9AM) Seattle time**, (2PM - 6PM) Gaza time.

### Who was impacted
Was there data loss? **No**
Was there a security breach? **No**

### What was the immediate fix?
Update the deployment token of the production pipeline.

### What is the permanent fix?
Document the process of changing the deployment pipeline to make the dev team aware of such pitfalls.

### What do we do to prevent this from occurring in the future?
* Have clear documentation of the process.
* Add it to a knowledge base accessible by the dev team. Jira's confluence feature would help with that.
* Refer members to the documentation as needed.