Running LiteLLM on AKS with azd and Bicep

This article details how to deploy LiteLLM, an open-source proxy for managing LLM provider access, on Azure Kubernetes Service (AKS) using the Azure Developer CLI (azd) and Bicep infrastructure as code. It covers the complete setup including private networking, Redis caching, PostgreSQL for spend tracking, and NGINX ingress with automatic TLS. The deployment uses a greenfield environment with AKS, Azure Container Registry, PostgreSQL, Redis, Key Vault, and Azure OpenAI, all configured with private endpoints and Azure CNI Overlay. The article provides a walkthrough of the infrastructure components, network design with three subnets, and outbound connectivity via NAT Gateway, making it a practical resource for IT professionals interested in self-hosted LLM gateways and cloud-native deployments.