The state for the GPT assistant model
So, finished the decoder-only Transformer implementation aula do Karpathy e inicie a próxima do curso. The state.
Interesting that Karpathy states that pre-training is where the 99% of the computation for training a GPT happens. So, the idea is to advance, like, what is the state now? And to be following the frontier, man.
Really great learning.