# Julia deep-dive > An ongoing [cyborg.support](https://hackmd.io/@commonsgarden/cyborg-support) study session - [x] install [julia programming language](https://julialang.org/downloads/) - [x] very brief intro to Julia language - [x] quick motivating exercise in autodifferention (running gradient descent on a simple, plain function) - [x] then we can start working through the tutorial together ## Resources (AI resources) - [Flux](https://fluxml.ai/Flux.jl/stable/) Julia library ## References - [The Emperor's New Mind](https://www.amazon.com/Emperors-New-Mind-Concerning-Computers/dp/0192861980) (book) ## Building a Transformer in Julia ### questions > What is a transformer? A matrix calculation to optimize calculating vector weights so that we dont have to go sequentially we can do paralle. > What is the input to an embedding? Is it a word, or a corpus (I guess both)