Julia deep-dive

An ongoing cyborg.support study session

• install julia programming language
• very brief intro to Julia language
• quick motivating exercise in autodifferention (running gradient descent on a simple, plain function)
• then we can start working through the tutorial together

Resources (AI resources)

• Flux Julia library

References

• The Emperor's New Mind (book)

Building a Transformer in Julia

questions

​​​​> What is a transformer? 
​​​​    A matrix calculation to optimize calculating vector weights so that we dont have to go sequentially we can do paralle. 
​​​​    
​​​​> What is the input to an embedding? 
​​​​    Is it a word, or a corpus (I guess both)