The tokenization and the Transformer architecture
So, observei que o curso está progredindo e apenas com pequenos trechos assistidos, there is no meaningful information and this difficults to understand what is proceeding in terms of the technique, like, small details that are relevant for comprehension. To really focus, man. The research perspective to first consider that conclusion for the Karpathy curso.
Da literature review, um paper estudando Transformer com attention-only layers. Interesting.
Really great learning.