Local LLM articles

11/29/2025 • EN

Handing over to the AI for a day [blog]

A developer's personal experiment with AI-driven software development using local LLMs, detailing setup, challenges, and initial impressions.

ai development Claude Code llm Local LLM TypeScript

Remy Sharp

3/25/2025 • EN

How to setup secure access to your local LLM UI

A technical guide on setting up secure HTTPS access to a local LLM web interface using Tailscale and a Go proxy.

docker golang HTTPS Proxy Local LLM Tailscale

Laurent Demailly

2/5/2025 • EN

AI project: Clickbait Fixer, the Chrome Extension that detects and fixes clickbait links in any website with AI locally

A Chrome extension that uses local AI to detect clickbait headlines, score websites, and suggest alternative titles, built for the Google Chrome Built-in AI Challenge.

ai Chrome Extension Clickbait Detection Local LLM Prompt API

Javier Campos

5/1/2024 • EN

#SemanticKernel: Local LLMs Unleashed on #RaspberryPi 5

Guide to running local LLMs like Llama3 and Phi-3 on a Raspberry Pi 5 using Ollama for private, cost-effective AI.

Local LLM Ollama Quantization raspberry pi Semantic Kernel

Bruno Capuano

12/14/2023 • EN

Running Mistral 7B Instruct on a Macbook

A technical guide on how to run the Mistral 7B Instruct large language model locally on a Macbook using llama.cpp and HuggingFace.

Llamacpp Local LLM Maco Mistral 7b Model Quantization

Matt Mazur

12/13/2023 • EN

Running Mistral 8x7Bs Mixture of Experts on a Macbook

A technical guide on running the Mistral 8x7B Mixture of Experts AI model locally on a MacBook, including setup steps and performance notes.

Llamacpp Local LLM Macbook M2 Mistral AI Mixture Of Experts