---
# System prepended metadata

title: BinThoven

---

# BinThoven

## 0. Dataset (CAPYBARA)

![image](https://hackmd.io/_uploads/H1liM1VVp.png)

![image](https://hackmd.io/_uploads/ByNzESsw6.png)

![image](https://hackmd.io/_uploads/r1T5NHoPp.png)

![image](https://hackmd.io/_uploads/SJE2ESsDa.png)

* GShard (ICLR'21)

* 

## 1. LoRA

![image](https://hackmd.io/_uploads/ByaZdCQNT.png)

## 2. AST

![image](https://hackmd.io/_uploads/Sklg_C7Ea.png)

![image](https://hackmd.io/_uploads/HyaK814NT.png)

![image](https://hackmd.io/_uploads/By5PLyE4T.png)

![image](https://hackmd.io/_uploads/Hy0npkEE6.png)

![image](https://hackmd.io/_uploads/r1V0ikEN6.png)


## 3. Training

![image](https://hackmd.io/_uploads/H1i2t0Q46.png)

![image](https://hackmd.io/_uploads/Hk8ROR746.png)

## AMP -> Summarizer?

