🚨 Alert: Very Readable Paper 🚨
The “do LLMs think?” question always bugged me because I have no idea what that means. This paper focuses narrowly on, “do LLMs learn **how to do** things”.
Unlike most ML/AI paper, it’s easy to read and understand WHY
arxiv.org/abs/2411.12580
Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models
The capabilities and limitations of Large Language Models have been sketched out in great detail in recent years, providing an intriguing yet conflicting picture. On the one hand, LLMs demonstrate a g...