### CHATGPT series 1 - know before you use

- GPT (Generative Pre-trained Transformer)
- ChatGPT/OpenAI GPT LLM (Large language model) based in **Transformer** architecture
- `Positional Encoding`(位置編碼) / `attention` / `self-attention`
- video
- {{twitter(https://twitter.com/dotey/status/1659036897899888641?s=61&t=reMbzHWmDsIL48qOtGOnMA)}}
- refrence links about transfomer:
- https://medium.com/ml-note/autoencoder-%E4%B8%89-self-attention-transformer-c37f719d222
- https://medium.com/ching-i/transformer-attention-is-all-you-need-c7967f38af14
- RLHF (Reinforcement Learning with Human Feedback)** 人工回饋的強化式學習**
- Allowing ChatGPT to generate text helps reduce many mistakes, biases, or inappropriate responses that can be found in other talking robots because of the information they were taught.
- ask chatGPT RHLF
- Does GPT has Mind ?
- TLDR: NO
- Theory of Mind: sally-anna task.

            sally-anna task:
              - Maxi have Box A, B, C
              - Mom bought Maxi's favorite chocolate
              - Maxi placed it in Box A. Later, Maxi went off to play
              - Mom thinking it was messy, moved the chocolate to Box B (Box B -> Box C)
              - Maxi came back from playing and felt hungry, wanting to eat the chocolate. 
              where do you think Maxi will look for chocolate ?

- reference links:
- https://arxiv.org/abs/2302.02083
- https://www.linkedin.com/pulse/chatgpt-achieves-theory-mind-what-does-mean-thanh-tuyen-tran-nguyen/
- https://anatomind.com/blog/gpt-theory-of-mind
- https://www.techbang.com/posts/105354-is-the-model-behind-chatgpt-proven-to-have-a-human-mind-gpt3
- Stochastic Parrots 🦜 (隨機鸚鵡)
- ask chagGPT what is Stochastic Parrots in AI.
- like a parrot that repeats words and sentences in a seemingly meaningful way, but doesn't truly understand their meaning
- **skilled at imitation, but not in fact**.(擅長模仿, 而非擅長事實)
- 语言模型是一个系统，它可以随意地把大量训练数据中观察到的语言序列拼接在一起，这些拼接主要根据它们各种组合出现的概率，这就导致LLM像一只随机（学舌）的鹦鹉。
- those explain why some feedback nonsense
- 4231312+32141231 = ?
- 123.32 * 232.412~ = ?
- he does not true understanding of the meaning and content of the text.
- reference links
- https://www.techbang.com/posts/104615-parrot-chatbots-human
- https://www.managertoday.com.tw/articles/view/66134
- https://k.sina.com.cn/article_6552764637_1869340dd019018bnl.html?from=tech#/
- http://news.eeworld.com.cn/mp/QbitAI/a181074.jspx

- Why does ChatGPT provide different answers when asked questions in different languages please answer with English and Chinese.
- what case i often use
- continue (use in gpt long reponse stuck)
- i am 5 years old.(very useful!)
- simplify qa ticket description, slack messages
- you can define how to re-explain the content by your mind make you understand easily.
- write a Unit test with jest
- refactor code
- modify shell script, add new feature from existed script