# BinThoven ## 0. Dataset (CAPYBARA) ![image](https://hackmd.io/_uploads/H1liM1VVp.png) ![image](https://hackmd.io/_uploads/ByNzESsw6.png) ![image](https://hackmd.io/_uploads/r1T5NHoPp.png) ![image](https://hackmd.io/_uploads/SJE2ESsDa.png) * GShard (ICLR'21) * ## 1. LoRA ![image](https://hackmd.io/_uploads/ByaZdCQNT.png) ## 2. AST ![image](https://hackmd.io/_uploads/Sklg_C7Ea.png) ![image](https://hackmd.io/_uploads/HyaK814NT.png) ![image](https://hackmd.io/_uploads/By5PLyE4T.png) ![image](https://hackmd.io/_uploads/Hy0npkEE6.png) ![image](https://hackmd.io/_uploads/r1V0ikEN6.png) ## 3. Training ![image](https://hackmd.io/_uploads/H1i2t0Q46.png) ![image](https://hackmd.io/_uploads/Hk8ROR746.png) ## AMP -> Summarizer?