What resonates em relação ao ARENA learning
So, pensei aqui em focar e escrever o que mais resonates do que estudei do ARENA. Simple like that e ajuda a ter foco. Context is that the study is on the Intro to Mechanistic Interpretability. Second subchapter do chapter 1 do ARENA. The study was great.
The study that resonates was the implementation for comparison do pattern. Aprendi que o pattern seria o que se obtain depois do softmax. Tem o residual stream, calcula-se os scores e depois que considera o softmax seria o pattern. Like, tem alguns números que mech interp tem interesse and this was great to learn. But the implementation resonates because it was great to obtain the results and compare with assert do PyTorch. Interesting to consider q and k and process as the architecture consider, layer 0, and obtain the results. It was step by step with the ajuda do Claude Opus 5.5. Really interesting to learn. Regarding the manipulation, it was learned the detailed implementation and the concise ones with einsum do PyTorch e do einops for the tensors operations. Interesting.
Really great learning.