is it good or bad that we’re not obsessing about the Dwarkesh Sutton intervie...
View original threadis it good or bad that we’re not obsessing about the Dwarkesh Sutton interview here?
21
1 hour later
if you take all the positive statements and ignore the negatives, arguments and conflicting parts, i think this gives a very clear and productive view of LLMs
but that’s a lot of revision
but that’s a lot of revision
1
e.g. Sutton is very anti supervised learning, except
1. RL is kinda just supervised learning
2. LLM pretraining isn’t really supervised learning
so kinda just have to throw those comments out entirely
1. RL is kinda just supervised learning
2. LLM pretraining isn’t really supervised learning
so kinda just have to throw those comments out entirely
3
Sutton is a bit frustrating on this because it seems that he takes both sides, and for some reason Dwarkesh reliably follows him to the opposite side each time he switches
3