---
# System prepended metadata

title: Squad ROC

---



# Squad ROC


|model     | lm | base acc | best acc |
| -------- | -------- | -------- | ------|
| Electra     | 0     | 0.915     | 0.915 |
| Electra | 3 | 0.847 | 0.852|
| roberta | 0 | 0.852 | 0.853 |




## Graphs

### Electra, lm=0

![](https://i.imgur.com/fcSvQAA.png)

![](https://i.imgur.com/UvZiyIP.png)

**"exists answer" score - "no answer" score:**

![](https://i.imgur.com/22dEDEt.png)

![](https://i.imgur.com/s9OU5yd.png)



### Electra, lm=3

![](https://i.imgur.com/zRcyFTB.png)


![](https://i.imgur.com/mxh0wpN.png)

**"exists answer" score - "no answer" score:**

![](https://i.imgur.com/DoPmWJ3.png)

![](https://i.imgur.com/8bSbFkn.png)




### Roberta, lm=0

![](https://i.imgur.com/B8Fk6PB.png)

![](https://i.imgur.com/UBKX2OP.png)


**"exists answer" score - "no answer" score:**
![](https://i.imgur.com/JNRBQQ1.png)


![](https://i.imgur.com/7tjZuEH.png)


### Roberta, lm=3



