Simon Willison • 1/31/2026

Quoting Andrej Karpathy

Read Original

The article quotes Andrej Karpathy comparing the 2019 training of GPT-2 (costing ~$43K over 7 days) to a modern, more efficient training run achieving a higher benchmark score in just 3.04 hours for ~$73. This demonstrates a 600x cost reduction over 7 years, equating to training costs falling by approximately 2.5x annually in AI/ML.

0 comments
#Machine Learning #hardware scaling #Gpt 2
Quoting Andrej Karpathy

Comments

No comments yet

Be the first to share your thoughts!

Browser Extension

Get instant access to AllDevBlogs from your browser

Top of the Week

1
React, useEffect, and Stale Closures: How to Avoid Them with Dependencies and useRef
Jivbcoop • 4 votes
2
Using Browser Apis In React Practical Guide
Jivbcoop • 2 votes
3
Better react-hook-form Smart Form Components
Maarten Hus • 2 votes
4
Top picks — 2026 January
Paweł Grzybek • 1 votes
5
In Praise of –dry-run
Henrik Warne • 1 votes
6
Deep Learning is Powerful Because It Makes Hard Things Easy - Reflections 10 Years On
Ferenc Huszár • 1 votes
7
Vibe coding your first iOS app
William Denniss • 1 votes
8
AGI, ASI, A*I – Do we have all we need to get there?
John D. Cook • 1 votes
9
Quoting Thariq Shihipar
Simon Willison • 1 votes
10
Dew Drop – January 15, 2026 (#4583)
Alvin Ashcraft • 1 votes