## Efficient uncertainty estimations --- ### Sample Efficient Uncertainty Estimation for Deep Learning Safety (Mallick et al.) Problem (in the paper): overconfidence with small datasets --- ### Problem example ![](https://i.imgur.com/OpzTgpD.png =500x) --- ### NCA Neighborhood component analysis ![](https://i.imgur.com/tcsWq9C.png =140x) ![](https://i.imgur.com/h7UOlBO.png =700x) ![](https://i.imgur.com/lXBfluw.png =250x) --- ### PNCA Probabilistic Neighborhood Component Analysis ![](https://i.imgur.com/gzkGLBH.png) --- ### Results ![](https://i.imgur.com/LrNpW8P.png =800x) ![](https://i.imgur.com/gBiCN36.png =800x) --- ### Notes - GP? - Accuracy is poor, not really relevant - Presentation is good --- ### Simple and Scalable Epistemic Uncertainty Estimation Using a Single Deep Deterministic Neural Network (van Amersfoort et al.) ![](https://i.imgur.com/JIodosw.png) --- ### Uncertainties types - epistemic (bad model), AL/RL - aleatoric (inherent in the data), Safety-first --- ### RBF networks ![](https://i.imgur.com/juyzn9X.png) ![](https://i.imgur.com/7SSg320.png) --- ### Regularization by gradient penalties (Gulrajani et al. (2017)) ![](https://i.imgur.com/VXPyHC0.png) ![](https://i.imgur.com/cNGK3kg.png) --- ### Results ![](https://i.imgur.com/YZ22LjU.png =400x) ![](https://i.imgur.com/wftLLK5.png =400x) --- ### Notes - Need a parameter - Entropy for ensembles? - OOD is a choice
{"metaMigratedAt":"2023-06-15T09:56:18.183Z","metaMigratedFrom":"YAML","title":"Efficient uncertainty estiamation","breaks":true,"slideOptions":"{\"theme\":\"beige\",\"transition\":\"fade\"}","contributors":"[{\"id\":\"173eb66f-920d-45e9-8ef5-4b365abfa9d8\",\"add\":2220,\"del\":557}]"}
    265 views