# Squad ROC |model | lm | base acc | best acc | | -------- | -------- | -------- | ------| | Electra | 0 | 0.915 | 0.915 | | Electra | 3 | 0.847 | 0.852| | roberta | 0 | 0.852 | 0.853 | ## Graphs ### Electra, lm=0 ![](https://i.imgur.com/fcSvQAA.png) ![](https://i.imgur.com/UvZiyIP.png) **"exists answer" score - "no answer" score:** ![](https://i.imgur.com/22dEDEt.png) ![](https://i.imgur.com/s9OU5yd.png) ### Electra, lm=3 ![](https://i.imgur.com/zRcyFTB.png) ![](https://i.imgur.com/mxh0wpN.png) **"exists answer" score - "no answer" score:** ![](https://i.imgur.com/DoPmWJ3.png) ![](https://i.imgur.com/8bSbFkn.png) ### Roberta, lm=0 ![](https://i.imgur.com/B8Fk6PB.png) ![](https://i.imgur.com/UBKX2OP.png) **"exists answer" score - "no answer" score:** ![](https://i.imgur.com/JNRBQQ1.png) ![](https://i.imgur.com/7tjZuEH.png) ### Roberta, lm=3