# GA2: Regularization ![](https://i.imgur.com/FRO2sOw.png) ![](https://i.imgur.com/yUTHVLh.png) Learning rate should go down again when regularizing? Validation accuracy is lower in any case ![](https://i.imgur.com/flkpoyw.png) ![](https://i.imgur.com/MLRb4Xp.png) Same Make network less complex: Remove last 2 Conv layers ![](https://i.imgur.com/B0nSTsB.png) Stuck at 0.63 val, but now maybe Regularization will help? Introduce dropout in Dense layers ![](https://i.imgur.com/b7DCvqS.png) Curves become unstable as fuck ![](https://i.imgur.com/0uhXsvw.png) This is with decreased learning rate