DeepDance a.k.a 揚揚女團生產器 - 寒假規劃
===
:::info
組長:余振揚
信箱:NM6121030@gs.ncku.edu.tw
Line:https://line.me/ti/p/1ULJgdvxqv
組員們😎
| 姓名 | DC名稱 | GitHub |
| -------- | ------------- | -------- |
| 余振揚 | 小魚 | [LittleFish-Coder](https://github.com/LittleFish-Coder) |
| 顏鈺蓁 | yuchen170 | [yuchen170](https://github.com/yuchen170) |
| 江宇浩 | HunkNow | |
| 施尚均 | Finn | |
| 吳出右 | 筍包 |[swenbao](https://github.com/swenbao)|
| 黃大晟 | Cheng | |
| 林子齊 | happyduckduck | |
| 梁菁芸 | Whale | |
:::
> <img src="https://github.com/LittleFish-Coder/basketball-sports-ai/raw/master/src/newjeans.gif" alt="newjeans"/>
# Pipeline (專案規劃)
- 先完成DeepFake(換臉) <font color="red">(寒假作業!)</font> [作業繳交區](/H1uAugEta)
- 短期參考這個Everybody Dance Now,實作出來 <font color="blue">先實作這項</font>
- Paper: https://arxiv.org/abs/1808.07371
- Blog: https://www.theverge.com/2018/8/26/17778792/deepfakes-video-dancing-ai-synthesis
- GitHub:https://github.com/carolineec/EverybodyDanceNow
- 最新paper - Animate Anyone:
- Paper: https://arxiv.org/pdf/2311.17117.pdf
- Blog: https://humanaigc.github.io/animate-anyone/
:::success
**必讀專區**
- 李宏毅老師必看影片
- GAN (機器學習2021): [GAN-1](https://youtu.be/4OWp0wDu6Xw) , [GAN-2](https://youtu.be/jNY1WBb8l4U), [GAN-3](https://youtu.be/MP0BnVH2yOo), [GAN-4](https://youtu.be/wulqhgnDr7E)
- AutoEncoder (機器學習2021): [AE-1](https://youtu.be/3oHlf8-J3Nc), [AE-2](https://youtu.be/JZvEzb5PV3U)
- DiffusionModel (機器學習2023): [速覽生成模型](https://youtu.be/z83Edfvgd9g), [Diffusion Model](https://youtu.be/azBugJzmz-o), [Stable Diffusion](https://youtu.be/JbfcAaBT66U)
- DeepFaceLab
- paper: https://arxiv.org/abs/2005.05535
- GitHub: https://github.com/iperov/DeepFaceLab
- GAN
- paper: https://arxiv.org/abs/1406.2661
- 中文筆記: https://blog.csdn.net/qq_44766883/article/details/112614827
- Diffusion Model
- paper: https://arxiv.org/abs/2006.11239
- 中文筆記: https://medium.com/image-processing-and-ml-note/diffusion-models-b4609ff05ae6
:::
## 需要用到的工具:
- [Hugging Face](https://huggingface.co) (可能會使用到Diffusion Model)
- [Pytorch Lightning](https://lightning.ai) (Pytorch的模組化框架)
## 自學教材:
- PyTorch:兩個選一個看就好
- [Complete Beginner](https://youtube.com/playlist?list=PLqnslRFeH2UrcDBWF5mfPGpqQDSta6VK4&si=Wd_i_28-gLd3b_bR)
- [Basic To Deeper](https://youtube.com/playlist?list=PLhhyoLH6IjfxeoooqP9rhU3HJIAVAJ3Vz&si=1iOKdFhxZiEtHbrA)
- [Pytorch Lightning](https://youtube.com/playlist?list=PLhhyoLH6IjfyL740PTuXef4TstxAK6nGP&si=0T8rJjZcofhzTn8L)
# LeetCode Challenge
- 規劃:
- 週一~週四:2題Easy
- 週五:1題Medium
- 如果你有跟著我們狂做,寒假結束你就可以完成36題😎
- 題目:
| 日期 | 題目一 | 題目二 |
| -------- | ------ | ------ |
| 1/8(一) | [2235. Add Two Integers](https://leetcode.com/problems/add-two-integers/description/) | [2651. Calculate Delayed Arrival Time](https://leetcode.com/problems/calculate-delayed-arrival-time/description/) |
| 1/9(二) | [2413. Smallest Even Multiple](https://leetcode.com/problems/smallest-even-multiple/description/) | [2652. Sum Multiples](https://leetcode.com/problems/sum-multiples/description/) |
| 1/10(三) | [1342. Number of Steps to Reduce a Number to Zero](https://leetcode.com/problems/number-of-steps-to-reduce-a-number-to-zero/description/) | [1688. Count of Matches in Tournament](https://leetcode.com/problems/count-of-matches-in-tournament/description/) |
| 1/11(四) | [412. Fizz Buzz](https://leetcode.com/problems/fizz-buzz/description/) | [441. Arranging Coins](https://leetcode.com/problems/arranging-coins/description/) |
| 1/12(五) | [2125. Number of Laser Beams in a Bank](https://leetcode.com/problems/number-of-laser-beams-in-a-bank/description/) | :D |
| 1/13-14 | 休息 | 休息 |
| 1/15(一) | [231. Power of Two](https://leetcode.com/problems/power-of-two/description/) | [69. Sqrt(x)](https://leetcode.com/problems/sqrtx/description/) |
| 1/16(二) | [292. Nim Game](https://leetcode.com/problems/nim-game/description/) | [2469. Convert the Temperature](https://leetcode.com/problems/convert-the-temperature/description/) |
| 1/17(三) | [1929. Concatenation of Array](https://leetcode.com/problems/concatenation-of-array/description/) | [35. Search Insert Position](https://leetcode.com/problems/search-insert-position/description/) |
| 1/18(四) | [2535. Difference Between Element Sum and Digit Sum of an Array](https://leetcode.com/problems/difference-between-element-sum-and-digit-sum-of-an-array/description/) | [1281. Subtract the Product and Sum of Digits of an Integer](https://leetcode.com/problems/subtract-the-product-and-sum-of-digits-of-an-integer/description/) |
| 1/19(五) | [49. Group Anagrams](https://leetcode.com/problems/group-anagrams/description/) | |
| 1/20-21 | 休息 | 休息 |
<!-- | 1/22(一) | | |
| 1/23(二) | | |
| 1/24(三) | | |
| 1/25(四) | | |
| 1/26(五) | | |
| 1/27-28 | 休息 | 休息 |
| 1/29(一) | | |
| 1/30(二) | | |
| 1/31(三) | | |
| 2/1(四) | | |
| 2/2(五) | | |
| 2/3-4 | 休息 | 休息 | -->
<!-- # Machine Learning (優先完成)
:::warning
希望同學可以在1/31以前完成所有課程!
這堂課超級數學,如果你啃不下去,快速帶過就好,不要糾結太多。
機器學習基石(下)比較困難,如果聽不下去可以放棄 → just like me :D
:::
機器學習是基於<font color="red">傳統統計的方式</font>去做回歸預測或簡單分類。請優先完成Machine Learning,雖然我們之後要用到的技術是Deep Learning,但為了各位之後對資料的敏銳度,所以勢必要懂一些傳統的統計方法,無論如何這門課絕對對你之後的工程數學或是機率統計都會很有幫助。
- 講師:國立台灣大學-林軒田教授
- 課程:該課程在coursera上可以免費註冊,且有詳細單元切割,適合做進度規劃追蹤。
- [機器學習基石上 (Machine Learning Foundations)---Mathematical Foundations](https://www.coursera.org/learn/ntumlone-mathematicalfoundations)
(至少完成這個><)
- [機器學習基石下 (Machine Learning Foundations)---Algorithmic Foundations](https://www.coursera.org/learn/ntumlone-algorithmicfoundations)
(聽不下去就先pass)
- P.S. 如果你不想用coursera的話,這是他的youtube連結
[Machine Learning Foundations (機器學習基石)](https://youtube.com/playlist?list=PLXVfgk9fNX2I7tB6oIINGBmW50rrmFTqf&si=uNkBVsPNBZ6T5YMq) -->
# Deep Learning (2020 -> 2023 -> 2021)
- 講師:國立台灣大學-李宏毅教授
- 機器學習 2020(General Concept):
- 內容:前10部影片會提到Machine Learning的基本知識,之後會進到Deep Learning,並帶到基礎的Classification, CNN及深度學習的其他廣泛任務常識。
- 播放清單:https://youtube.com/playlist?list=PLJV_el3uVTsPy9oCRY30oBPNLCo89yu49&si=aEtkTWurKlv-LrN3
- 機器學習2020官方網站(內含教材):https://speech.ee.ntu.edu.tw/~hylee/ml/2020-spring.php
- 機器學習 2021(Transformer):
- 內容:將會提到深度學習上會使用的模型以及任務,例如:RNN, Transformer等。
- 播放清單:https://youtube.com/playlist?list=PLJV_el3uVTsMhtt7_Y6sgTHGHp1Vb2P2J
- 機器學習2021官方網站(內含教材):https://speech.ee.ntu.edu.tw/~hylee/ml/2021-spring.php
- 機器學習 2023(生成式AI):<font color="red">爆推!把它當連續劇看</font>
- 內容:會提到生成式AI最屌的Diffusion Model,我也還沒看,一起看吧!
- 播放清單:https://youtube.com/playlist?list=PLJV_el3uVTsOePyfmkfivYZ7Rqr2nMk3W&si=j5sKrSaWlN_PdhyA
- 機器學習2023官方網站(內含教材):https://speech.ee.ntu.edu.tw/~hylee/ml/2023-spring.php
# Frontend & Backend Development (Optional)
如果你對製作網站以及架設伺服器有興趣的話,請參考[網頁開發全攻略](/A0l0cM_sRz2zDJWsUkMyrg)。
# Workshop (還在想QAQ)
- Copilot with VScode
- Conda
- [HuggingFace - Diffuser](/H8YXJGgpQQOiPPC9DHy2IQ)
- Pytorch-Lightning
# Paper
## DeepFake Dataset
- FaceForensics++: Learning to Detect Manipulated Facial Images
- Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics
- The DeepFake Detection Challenge (DFDC) Dataset
## DeepFake Generation
- GAN
- Diffusion
## DeepFake Detection
# Meeting
## 1/16
派作業: DeepFake換臉
## 1/24
觀摩進度,報告paper
## 1/30
HuggingFace Diffuser