# 4. HUNG-YI LEE 2022 ML - Self-Attention
###### tags: `Machine Learning`
## Self-Attention
word-embedding
參考[2021 BERT更新版筆記](https://drive.google.com/file/d/1yeVssXHlwFif_3Fyo2jRyf13kJEmYhTI/view?usp=drivesdk)

## 傳統RNN
[RNN (part 1)](https://youtu.be/xCGidAeyS4M)
[RNN (part 2)](https://youtu.be/rTqmWlnwz_0)