Andrej Karpathy 10/1/2025

Animals vs Ghosts

Read Original

The article analyzes a podcast discussion with AI researcher Rich Sutton, author of "The Bitter Lesson." It explores Sutton's critique that large language models (LLMs) are not truly aligned with his principles due to their reliance on finite, human-generated data. Sutton advocates for a "classicist" approach inspired by animal learning, focusing on reinforcement learning, intrinsic motivation, and continuous learning from interaction, rather than massive pre-training.

Animals vs Ghosts

Comments

No comments yet

Be the first to share your thoughts!

Browser Extension

Get instant access to AllDevBlogs from your browser

Top of the Week