---
# System prepended metadata

title: Intro to Large Language Models
tags: [章節筆記]

---

# Intro to Large Language Models

<iframe width="560" height="315" src="https://www.youtube.com/embed/zjkBMFhNj_g?si=OI_pdbHIdpKqCdzy" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>



1st stage: pre-trained stage is training on trains on a ton of internet and it's about knowledge 

2nd stage: fine tuning stage is call alignment it's about like chainging the formatting from internet documents to question and answer documents in kind of like a helpful assistant 

![image](https://hackmd.io/_uploads/HJ8HxtHPp.png)
