LLM: Large Language Models
Inteligencia Artificial Generativa
Vector: A series of weights assigned to words, to form a topology (webvectors)
Embeddings: the numbers that compose the vectors. Each model has their own way.
Token: How LLM breaks down sentences, to create vectors. Each model has their own way. Overall 70 words = 100 tokens
Vector Database: A database that facilitates calculation of distance between vectors
Transformer: It transforms a set of word embeddings to another set of embeddings
Embeddings
Corpus: The entire set of language data to be analyzed and weighted
Training phase
Parameter: the number of artificial neurons that run thru corpus on training phase looking for patterns (Bird, 240M. ChatGPT3: 175B, chatGPT4: 1T, non-officially)
RAG or Retrieval-Augmented Generation: A technique for enhancing the accuracy and reliability of generative AI models with facts fetched from external sources
Models
Probabilistic language models: assigns a probability to every sentence in English in such a way that more likely sentences (in some sense) get higher probability
Fine-tunning: A model with weights adjusted by an annotated dataset so it works for more specific cases
Quantized (or distilled) LLM: A slimmed down LLM model for slower machines
Prompt
LLM Usages: human-to-human or human-to-machine communication; audio-to-text; video-to-text; text-to-text (prose-to-code included)
or
or
By clicking below, you agree to our terms of service.
New to HackMD? Sign up
Syntax | Example | Reference | |
---|---|---|---|
# Header | Header | 基本排版 | |
- Unordered List |
|
||
1. Ordered List |
|
||
- [ ] Todo List |
|
||
> Blockquote | Blockquote |
||
**Bold font** | Bold font | ||
*Italics font* | Italics font | ||
~~Strikethrough~~ | |||
19^th^ | 19th | ||
H~2~O | H2O | ||
++Inserted text++ | Inserted text | ||
==Marked text== | Marked text | ||
[link text](https:// "title") | Link | ||
 | Image | ||
`Code` | Code |
在筆記中貼入程式碼 | |
```javascript var i = 0; ``` |
|
||
:smile: | ![]() |
Emoji list | |
{%youtube youtube_id %} | Externals | ||
$L^aT_eX$ | LaTeX | ||
:::info This is a alert area. ::: |
This is a alert area. |
On a scale of 0-10, how likely is it that you would recommend HackMD to your friends, family or business associates?
Please give us some advice and help us improve HackMD.
Do you want to remove this version name and description?
Syncing