---
# System prepended metadata

title: 'GA2: Regularization'

---

# GA2: Regularization


![](https://i.imgur.com/FRO2sOw.png)


![](https://i.imgur.com/yUTHVLh.png)


Learning rate should go down again when regularizing?
Validation accuracy is lower in any case


![](https://i.imgur.com/flkpoyw.png)


![](https://i.imgur.com/MLRb4Xp.png)

Same


Make network less complex: Remove last 2 Conv layers

![](https://i.imgur.com/B0nSTsB.png)

Stuck at 0.63 val, but now maybe Regularization will help?

Introduce dropout in Dense layers

![](https://i.imgur.com/b7DCvqS.png)


Curves become unstable as fuck

![](https://i.imgur.com/0uhXsvw.png)


This is with decreased learning rate