Gradient Descent articles

11/16/2025 • EN

Quoting Andrej Karpathy

Explores Andrej Karpathy's concept of Software 2.0, where AI writes programs through objectives and gradient descent, focusing on task verifiability.

ai programming Gradient Descent Neural Networks Reinforcement Learning Software 20

Simon Willison

12/4/2017 • EN

Logistic Regression with Gradient Descent in JavaScript

A guide to implementing logistic regression with gradient descent in JavaScript to solve classification problems.

classification Gradient Descent JavaScript Logistic Regression Machine Learning

Robin Wieruch

11/23/2017 • EN

Multivariate Linear Regression, Gradient Descent in JavaScript

A guide to implementing multivariate linear regression with gradient descent in JavaScript, including feature scaling.

Gradient Descent JavaScript Machine Learning Multivariate Linear Regression Vectorization

Robin Wieruch

11/21/2017 • EN

Gradient Descent with Vectorization in JavaScript

A guide to implementing vectorized gradient descent in JavaScript for machine learning, improving efficiency over unvectorized approaches.

Gradient Descent JavaScript Linear Regression Machine Learning Vectorization

Robin Wieruch

11/16/2017 • EN

Improving Gradient Descent in JavaScript

Explores methods to optimize the gradient descent algorithm in JavaScript, focusing on selecting the right learning rate for convergence.

Gradient Descent JavaScript Learning Rate Machine Learning optimization

Robin Wieruch

10/30/2017 • EN

Polynomial Regression and Model Selection

Explains polynomial regression as a solution to under-fitting in machine learning when data has a nonlinear correlation.

Gradient Descent Machine Learning Model Selection Polynomial Regression Underfitting

Robin Wieruch

10/19/2017 • EN

Linear Regression with Gradient Descent in JavaScript

A guide to implementing linear regression with gradient descent in JavaScript, using a housing price prediction example.

Gradient Descent JavaScript Linear Regression Machine Learning

Robin Wieruch

3/24/2015 • EN

Single-Layer Neural Networks and Gradient Descent

An introduction to single-layer neural networks, covering the Perceptron and Adaline models, with Python implementations and gradient descent.

Gradient Descent Machine Learning Neural Networks Perceptron Python

Sebastian Raschka

Gradient Descent Articles

Quoting Andrej Karpathy

Logistic Regression with Gradient Descent in JavaScript

Multivariate Linear Regression, Gradient Descent in JavaScript

Gradient Descent with Vectorization in JavaScript

Improving Gradient Descent in JavaScript

Polynomial Regression and Model Selection

Linear Regression with Gradient Descent in JavaScript

Single-Layer Neural Networks and Gradient Descent

Select Language