LLMs From Scratch Reaches 100,000 GitHub Stars
Read OriginalThe author celebrates the LLMs-from-scratch repository reaching 100,000 GitHub stars, thanking contributors and outlining future additions like new attention variants and architectures. The repo offers complete from-scratch implementations of tokenization, attention, pretraining, classification, and instruction fine-tuning, plus implementations of Llama, Qwen, Gemma, and Olmo, and alternatives like GQA, MLA, and mixture-of-experts. The author also mentions a larger applied LLM project and an upcoming Substack mega-article.
Comments
No comments yet
Be the first to share your thoughts!
Browser Extension
Get instant access to AllDevBlogs from your browser
Top of the Week
1
Limit token usage in Microsoft Agent Framework
Jesse Liberty
•
1 votes
2
How to Roll Back AI Agents: Incident Response, Circuit Breakers, and Recovery Patterns
Paul Bryant
•
1 votes
3
Avoiding Reasoning Model Failures with Microsoft Foundry
Luke Murray
•
1 votes
4
When Your AI Agent Lies: Silent LLM Fallbacks
Luke Murray
•
1 votes
5
Adding a custom MCP server to Claude and ChatGPT
Simon Willison
•
1 votes
6
Testing AI prompts and comparing models with promptfoo
Tim Deschryver
•
1 votes
7
Superlogical
Mitchell Hashimoto
•
1 votes