Bluesky Thread

TRM reproduction report

October 23, 2025 View original thread

TRM reproduction report

okay, i’m starting to believe TRM is legit. The 5M does seem to hold up on almost all of its claims

crazy.

repro report: github.com/alphaXiv/Tin...

code: github.com/alphaXiv/Tin...

(weights in readme)

34 2

the gh readme has some cool background

This work came to be after I learned about the recent innovative Hierarchical Reasoning Model (HRM). I was amazed that an approach using small models could do so well on hard tasks like the ARC-AGI competition (reaching 40% accuracy when normally only Large Language Models could compete). But I kept thinking that it is too complicated, relying too much on biological arguments about the human brain, and that this recursive reasoning process could be greatly simplified and improved. Tiny Recursion Model (TRM) simplifies recursive reasoning to its core essence, which ultimately has nothing to do with the human brain, does not require any mathematical (fixed-point) theorem, nor any hierarchy.

8

More like this

SmolLM3: a highly detailed look into modern model training

Qwen Tongyi Deep Research

if you want to try a diffusion LLM, inception labs just released one. it goes...