An in-depth analysis of scaling laws in deep learning, exploring the power-law relationship between model size, data, compute, and loss.
A reflection on a decade-old blog post about deep learning, examining past predictions on architecture, scaling, and the field's evolution.
A discussion of AI researcher Rich Sutton's critique of LLMs and his vision for AI inspired by animal learning, contrasting with current approaches.
Argues that the 'age of data' for AI is not ending but evolving into an era of 'superhuman data' with higher quality and knowledge density.
Summary of Microsoft Build 2024 keynote on AI transformation, from information access to actionable expertise, featuring Microsoft Copilot.
