# Storage Accelerator ###### tags: `Accelerator` ### Contents * [Meeting Minutes](###Meeting-Minutes) * [Monthly Report](###Monthly-Report) * [Biweekly Report](###Biweekly-Report) * [Weekly Report](###Weekly-Report) * [Experiment](###Experiment) * [Reference Paper & Notes](###Reference-Paper-and-Notes) * [Experiment Platform](###Experiment-Platform) * [Resource](###Resource) --- Meeting with Phison ### Meeting Minutes * [2022/05/09](/l3sTwCBEQlK3lEB6DqZzBA) * [2022/06/06](https://hackmd.io/@in-storage-accel/SyvUvEiuq) * [2022/07/04](/z-za9qQnTi2To9PBx9Ycqw) * [2022/08/01](/giNJvINBS5CuXdbF14I8gw) ### Monthly Report * [2022/05](https://docs.google.com/presentation/d/1-eJ8ReSudKVZBeHs5Uq_j268qcAVLyuqTZwR3rcOd2Q/edit?usp=sharing) * [2022/06](https://docs.google.com/presentation/d/1T8lnhyWHLwPOSdqDE0lX495dVnogrKFZ4MHuQMwpxBs/edit?usp=sharing) * [2022/07](https://docs.google.com/presentation/d/1ImDp8tyluogPskWZFZjRS9gYTVjAsqVeJfTuWxu7VBg/edit?usp=sharing) * [2022/08](https://docs.google.com/presentation/d/1PIniextFGSR21DDNwJzgUXJZkZ21K53X-RL_QxWVrko/edit?usp=sharing) * [2022/09](https://docs.google.com/presentation/d/1OIkOFNbQ21WIUL74pliFLqdmrMo9kKbKh_hr_CWSrBw/edit#slide=id.gfe7bf2e833_1_1) * [2022/10](https://docs.google.com/presentation/d/1Eu1bdaDpKi_zEkGogktilmBkuZC2FWXtMllrjKlBT7A/edit#slide=id.p) * [2022/11](https://docs.google.com/presentation/d/1VA4rpEDDV8LGJF7nLXIETu6-LUIoIlNnnBHKqLSlEhs/edit?usp=sharing) * [2022/12](https://docs.google.com/presentation/d/1P9lGn8ys-OyuiE9Jw_YTSMrH5vOrZj3Q-o_Wp9kAAPw/edit?usp=sharing) * [2023/01](https://docs.google.com/presentation/d/1GZq-ZD-VuZaEl5PLWd9s-XJzaaRI_hkCTEko0N82HOY/edit?usp=sharing) * [2023/02](https://docs.google.com/presentation/d/1g_o_T24tiC_dPkDvhH4FvoDYRaEtwj5iurvhI0hjcxI/edit?usp=share_link) * [2023/03](https://docs.google.com/presentation/d/1GgtWV1qxD9JRyobpiGL7cA1CpcBEP1NlnYbWom3yxks/edit?usp=share_link) * [2023/04](https://docs.google.com/presentation/d/1IcoyF11AeXcql1AtVVpVb858TwBYtG_Ig9wVbo74MTo/edit?usp=share_link) * [2023/05](https://docs.google.com/presentation/d/1i3P69bElYBmquUhO1WijCGsXVe2-4AtbAnL9Z9in9hU/edit?usp=share_link) * [2023/06](https://docs.google.com/presentation/d/1Hmf9GfJuG5xwuYq6mBWNlEdUlf8K70V_PNVAZ4EAlf0/edit?usp=drive_link) * [2023/07](https://docs.google.com/presentation/d/13e5TKb4N15NOsluyA-20QpUmlTXwU7bsQoZ27h-zKeQ/edit?usp=drive_link) ### Biweekly Report * [2023/09/18](https://docs.google.com/presentation/d/1GQfI6tqVh3RbcmYXlrWKPCC8dkecQqcjkkCITuXd-08/edit?usp=drive_link) * [2023/10/02](https://docs.google.com/presentation/d/13KuFMHxu8-wzDF3Pu87D2CMxf6-F8cSf9ii5B5sk9kc/edit?usp=drive_link) * [2023/10/16](https://docs.google.com/presentation/d/1Pu3eRMC9OPxPqjiMxiC1-b6UBRClvmDm8cNx4LHtcXw/edit#slide=id.g28b59b9c231_0_0) * [2023/10/30](https://docs.google.com/presentation/d/14jrndZY2dNAjqmFjYXmJn-dle9jOeZ0PQKzIt-oL8DA/edit#slide=id.g24fff018679_0_771) --- ### Weekly Report * [2022/07/19](/4FaB5RCNSGOWvPzNX6FfDQ) * [PPT](https://docs.google.com/presentation/d/1K0Zoy2l7DxTXAbMD56I5_Uwh45JtBjNTzGkRYaCitU0/edit?usp=sharing) * [2022/08/15](/CpZjf45LQdWp2Cayu0Q-pw) * [2022/09/12](/mvL_jhoiQk6P8k2SVlKi8w) * [2022/10](https://hackmd.io/WcblM3wJRR-e142SOZS68Q#10/10) * [2022/11](https://hackmd.io/ia9s5s3KQsStBqjW1ZsDLg) * [2022/12](https://hackmd.io/RajVX77kR1OdICDiLcD0Jg) * [2023/01 ~ 2023/05](https://hackmd.io/he5LhMnpQIKKEeLNiu9j3g?both) --- --------------------[Deprecated]----------------------- ### Experiment #### [Roofline](https://hackmd.io/@ktlin/Hyf6IeQ49) #### [DLRM breakdown](/Ww_g11yITmqICTaNLr7QNA) #### [DLRM saving/re-order experiment](https://hackmd.io/@Lucas-TzuChieh-Kuo/rJPWVj1C5) ### Reference Paper and Notes #### [Reference Paper](https://hackmd.io/@accelerator/HknSYKvU9) #### Notes * Recommendation System * [DLRM(Facebook)](https://hackmd.io/@accelerator/BJX_-wqk5) * [DIN/DIEN(Alibaba)](https://hackmd.io/@accelerator/HyhSEgsXq) * [WnD(Google)](https://hackmd.io/@accelerator/Bk-9O3qX5) * [Comparison between Recommendation Systems](/2y7x_EaNR7G3lfr2s63IeQ) ### Experiment Platform * [Open channels SSD](https://hackmd.io/@UzwkpqmTSKS3rukkbAQPBw/Sk1B2W4V5) * [Virtual OCSSD Platform](https://hackmd.io/dN9Su6aFQA6zJL43muRPcg?both) * [Lightnvm def.](https://hackmd.io/@UzwkpqmTSKS3rukkbAQPBw/BJIxbrMIc) * [FEMU](https://github.com/ucare-uchicago/FEMU) * [Introduction](https://hackmd.io/@accelerator/H1KuiFvLq) * [Installation](https://hackmd.io/@UzwkpqmTSKS3rukkbAQPBw/BJgAcpPIq) * [Traced-code](https://gitmind.com/app/doc/90610991475) ### Resource * DLRM: [GitHub](https://github.com/facebookresearch/dlrm) * DeepRecSys: [GitHub](https://github.com/harvard-acc/DeepRecSys) * FEMU: [GitHub](https://github.com/ucare-uchicago/FEMU) --- ### 1. Experiment Model #### Recommendation System * [<i class="fa fa-file" aria-hidden="true"></i>](https://hackmd.io/@accelerator/BJX_-wqk5) DLRM(Facebook): [Breakdown](https://hackmd.io/@UzwkpqmTSKS3rukkbAQPBw/H1tZuXkXc) * [<i class="fa fa-file" aria-hidden="true"></i>](https://hackmd.io/@accelerator/HyhSEgsXq) DIN/DIEN(Alibaba) * [<i class="fa fa-file" aria-hidden="true"></i>](https://hackmd.io/@accelerator/Bk-9O3qX5) WnD(Google) * [<i class="fa fa-file" aria-hidden="true"></i>](https://hackmd.io/@accelerator/S1a72kJXq) Comparison between RSs ### 2. Experiment Platform * [Open channels SSD](https://hackmd.io/@UzwkpqmTSKS3rukkbAQPBw/Sk1B2W4V5) * [Virtual OCSSD Platform](https://hackmd.io/dN9Su6aFQA6zJL43muRPcg?both) * [Lightnvm def.](https://hackmd.io/@UzwkpqmTSKS3rukkbAQPBw/BJIxbrMIc) * [Roofline](https://hackmd.io/@ktlin/Hyf6IeQ49) * [FEMU](https://github.com/ucare-uchicago/FEMU) * [Introduction](https://hackmd.io/@accelerator/H1KuiFvLq) * [Installation](https://hackmd.io/@UzwkpqmTSKS3rukkbAQPBw/BJgAcpPIq) * [Traced-code](https://gitmind.com/app/doc/90610991475) ### 3. Source Code * DLRM: [GitHub](https://github.com/facebookresearch/dlrm) * DeepRecSys: [GitHub](https://github.com/harvard-acc/DeepRecSys) * FEMU: [GitHub](https://github.com/ucare-uchicago/FEMU) ### 4. Next Week Progress * burnie * tools * [fio](https://hackmd.io/@UzwkpqmTSKS3rukkbAQPBw/H1CF46_wq) * [libnvme](https://www.usenix.org/sites/default/files/conference/protected-files/vault20_slides_busch.pdf) * [pynvme](https://pynvme.readthedocs.io/en/latest/intro.html#) * [bcc](https://github.com/iovisor/bcc) * use real data from 1 table to 8 table * test time without read time * weiqi * milestone1: to know how to write table into NAND * done: have known flow from ***NVME_CMD_WRITE*** to ***Tail Queues*** * next: what commands be executed at ~~[NVMe Driver](https://hackmd.io/@accelerator/Byb41Sowq)~~ or Guest OS layer? * behavior: ***dd*** command, [example](https://blog.gtwang.org/linux/dd-command-examples/) * monitor: * milestone2: to know how to lookup table from NAND ### 5. Reference Paper * [link](https://hackmd.io/@accelerator/HknSYKvU9) ### 6. Phison Meeting Minutes * [2022/05/09](/l3sTwCBEQlK3lEB6DqZzBA) * [2022/06/06](https://hackmd.io/@in-storage-accel/SyvUvEiuq)