---
format: "aidr-story-markdown/v1"
id: "43871841ab877df2a3b5574912749d96f2b8dfeffafa083fdfec62e39924ba51"
canonical_url: "https://aidr.today/43871841?lang=en"
title: "Building a self-service LLM gateway with Amazon Bedrock and LiteLLM"
lang: "en"
requested_lang: "en"
available_langs: ["en","vi"]
translation_fallback: null
fallback_fields: []
published_at: "2026-11-12T18:41:12.000Z"
category: "Tools"
topics: ["amazon","llm","devtools"]
source_urls: ["https://aws.amazon.com/blogs/machine-learning/building-a-self-service-llm-gateway-with-amazon-bedrock-and-litellm/"]
summary: "A guide explains how to build a self-service LLM gateway using LiteLLM on AWS Fargate, placing Amazon Bedrock foundation models behind an OpenAI-compatible API with per-user cost controls, quota isolation, and observability."
---

# Building a self\-service LLM gateway with Amazon Bedrock and LiteLLM

> [Open the canonical story](<https://aidr.today/43871841?lang=en>)

**Published:** 2026-11-12T18:41:12.000Z
**Category:** Tools
**Topics:** amazon, llm, devtools

## Summary

A guide explains how to build a self\-service LLM gateway using LiteLLM on AWS Fargate, placing Amazon Bedrock foundation models behind an OpenAI\-compatible API with per\-user cost controls, quota isolation, and observability\.

## Sources

- [Story source](<https://aws.amazon.com/blogs/machine-learning/building-a-self-service-llm-gateway-with-amazon-bedrock-and-litellm/>)