Amazon EKS with Open WebUI and AWS Bedrock managed by OpenTofu
Read OriginalThis article provides a detailed guide for deploying an Amazon EKS cluster hosting Open WebUI with AWS Bedrock as the LLM provider, all managed by OpenTofu. It covers single-AZ worker nodes, spot instances via Karpenter, Bottlerocket OS, NLB, KMS encryption, CloudWatch logging, network policies, and EKS Pod Identities. The setup includes Envoy Gateway with OIDC/JWT authentication, LiteLLM for an OpenAI-compatible API over Bedrock, and Open WebUI as the front-end. Infrastructure is provisioned using terraform-aws-modules and Helm releases, with a focus on cost efficiency and security.
0 comments
Comments
No comments yet
Be the first to share your thoughts!
Browser Extension
Get instant access to AllDevBlogs from your browser
Top of the Week
No top articles yet