---
# System prepended metadata

title: Untitled

---

### CHATGPT series 1 - know before you use

- GPT (Generative Pre-trained Transformer)
	- ChatGPT/OpenAI GPT LLM (Large language model) based in **Transformer** architecture
		- `Positional Encoding`(位置編碼) / `attention` / `self-attention`
		- video
			- {{twitter(https://twitter.com/dotey/status/1659036897899888641?s=61&t=reMbzHWmDsIL48qOtGOnMA)}}
		- refrence links about transfomer:
		    - https://medium.com/ml-note/autoencoder-%E4%B8%89-self-attention-transformer-c37f719d222
		    - https://medium.com/ching-i/transformer-attention-is-all-you-need-c7967f38af14
	- RLHF (Reinforcement Learning with Human Feedback)** 人工回饋的強化式學習**
		- Allowing ChatGPT to generate text helps reduce many mistakes, biases, or inappropriate responses that can be found in other talking robots because of the information they were taught.
		- ask chatGPT RHLF
	- Does GPT has Mind ?
		- TLDR: NO
		- Theory of Mind: sally-anna task.

          ```
            sally-anna task:
              - Maxi have Box A, B, C
              - Mom bought Maxi's favorite chocolate
              - Maxi placed it in Box A. Later, Maxi went off to play
              - Mom thinking it was messy, moved the chocolate to Box B (Box B -> Box C)
              - Maxi came back from playing and felt hungry, wanting to eat the chocolate. 
              where do you think Maxi will look for chocolate ?
          ```
			- reference links:
                - https://arxiv.org/abs/2302.02083
                - https://www.linkedin.com/pulse/chatgpt-achieves-theory-mind-what-does-mean-thanh-tuyen-tran-nguyen/
                - https://anatomind.com/blog/gpt-theory-of-mind
                    - https://www.techbang.com/posts/105354-is-the-model-behind-chatgpt-proven-to-have-a-human-mind-gpt3
		- Stochastic Parrots 🦜 (隨機鸚鵡)
            - ask chagGPT what is Stochastic Parrots in AI. 
			- like a parrot that repeats words and sentences in a seemingly meaningful way, but doesn't truly understand their meaning
			- **skilled at imitation, but not in fact**.(擅長模仿, 而非擅長事實)
			- 语言模型是一个系统，它可以随意地把大量训练数据中观察到的语言序列拼接在一起，这些拼接主要根据它们各种组合出现的概率，这就导致LLM像一只随机（学舌）的鹦鹉。
            - those explain why some feedback nonsense
				- 4231312+32141231 = ?
				- 123.32 * 232.412~ = ?
				- he does not true understanding of the meaning and content of the text.
                - reference links
                    - https://www.techbang.com/posts/104615-parrot-chatbots-human
                    - https://www.managertoday.com.tw/articles/view/66134
                    - https://k.sina.com.cn/article_6552764637_1869340dd019018bnl.html?from=tech#/
                    - http://news.eeworld.com.cn/mp/QbitAI/a181074.jspx
				   
	- Why does ChatGPT provide different answers when asked questions in different languages please answer with English and Chinese.
    - what case i often use
        - continue (use in gpt long reponse stuck)
        - i am 5 years old.(very useful!)
        - simplify qa ticket description, slack messages
            - you can define how to re-explain the content by your mind make you understand easily.
        - write a Unit test with jest
        - refactor code
        - modify shell script, add new feature from existed script
