Breno

Representation learning

So, really interesting a paper that I found in the literature review. Sobre o curso do Karpathy, really slow progress. Karpathy implemented a function for obtaining the pairs and the counts so that it can proceed with the byte pair encoding algorithm strategy.

So, sobre o paper, like, the one that I considered it was The Concept of Representation in ML, Beyond Plato and Aristotle. Really interesting, li o início and there is this hyphotesis that the models converge to a similar representation.

Really great learning.