---
# System prepended metadata

title: kanban

---

### DOING
- **軟體：謝棻伃、林榮翼** 
    - [x] 軟體端轉c++
    - [x] 確認input output weight的正確性
    - [x] kv cache架構
    - [x] kv cache值
- **硬體：宋少棠、許芳語、唐翊雯**
    - [x] HLS、kernel IO的ppt
    - [x] 讀HLS lab3的code
    - [x] 測試flow (lab3)
### TODO 
- **整體時程**
- 9/30 整個model inference要能得到正確答案
- 
- **軟體：謝棻伃、林榮翼** 
    - [ ] 軟體端轉c++
    - [ ] 確認input output weight的正確性
- **硬體：宋少棠、許芳語**
    - [ ] 9/2 串好整個model(結果要正確)
    - [ ] 8/19
        - [ ] 8/14
            - [ ] attn 
            - [ ] MLP
        - [ ] ln + attn + add
        - [ ] ln + mlp + add
        - [ ] layer block
    - [ ] 8/26
        - [ ] 12層 layer block
        - [ ] layer block 之前
            - [ ] tokenization
            - [ ] wpe
            - [ ] wte
        - [ ] layer block 之後
            - [ ] decode
            - [ ] sample
            - [ ] add after
        - [ ] auto-regressive
    - [ ] 怎麼收int4
    - [ ] 怎麼用fp16
    - [ ] model bottleneck
### DONE
- **train：謝棻伃** 
    - [x] find training code
    - [x] train起來
    - [x] find task -> text generation or fill mask
    - [x] 跑text generation and fill mask 不同的dataset
    - [x] 選finetune的dataset
    - [x] 比較我們跑的結果和網路上的
    - [x] train到好
    - [x] 準備train的工研院ppt
    - [x] inference
- **model : 唐翊雯、林榮翼**
    - [x] model summary
    - [x] model architecture
    - [x] trace code
    - [x] 整理 model 的 flow
    - [x] 製作簡報
    - [x] 研究常見的 quantization method
    - [x] quantization method 比較
    - [x] 估kv-cache
    - [x] AWQ ppt
    - [x] 選取適當的 quantization method
    - [x] non linear 的quantization處理方式
    - [x] gptq ppl issue
    - [x] fine-tune model architecture (包含kv-cache)
    - [x] with/without kv-cache的比較

- **硬體：宋少棠、許芳語**
    - [x] 問學長姐或鄧學長U50有沒有document或是manual
    - [x] 上網找U50有沒有document或是manual
    - [x] vitis document
    - [x] 安裝環境
    - [x] HLS、kernel IO的ppt
    - [x] 讀HLS lab3的code
    - [x] 測試flow (lab3)
    - [x] 合看看fp16的運算     
    - [x] HLS flow
    - [x] 做一個example跑看看(乘法器之類的)
- **軟體：謝棻伃、林榮翼**
    - [x] dump weight  
    - [x] model inference architecture (include dimension)
    - [x] input and output of each layer