Simon Willison 7/30/2026

llm-chat-completions-server 0.1a0

Read Original

This article announces the release of llm-chat-completions-server 0.1a0, a plugin for the LLM tool that provides an OpenAI Chat Completions compatible API endpoint. It leverages the new content-addressable logs in LLM 0.32rc1 to efficiently handle multi-turn conversations by de-duplicating message parts using hashes. The plugin allows users to expose their installed LLM models via a local server, as demonstrated with a curl example. The post includes installation and usage instructions, and notes that the code was written by GPT-5.6. This is relevant to developers using LLM and interested in OpenAI-compatible APIs.

llm-chat-completions-server 0.1a0

Comments

No comments yet

Be the first to share your thoughts!

Browser Extension

Get instant access to AllDevBlogs from your browser