deltawi/deltallm
View on GitHub ↗Route, manage, and analyze your LLM requests across multiple providers with a unified API interface
19 ★2 forksPythonUpdated 1mo ago
What you need to know
Self-hosted LLM gateway exposing an OpenAI-compatible endpoint with model routing, budgets, guardrails, and MCP tools.
Install
docker compose up or run the binary
Usage
- •Point any OpenAI-compatible client at localhost:4002/v1 and manage routes, budgets, and guardrails
Key features
- ✓OpenAI-compatible endpoint at localhost:4002/v1
- ✓Model routing and fallbacks
- ✓Budget management
- ✓Guardrails
- ✓MCP tool integration
Best for
Self-hosted LLM gateway with governance
Platforms: DockerClients: OpenAI-compatible clients
Reviewed 2026-08-11
Topics
ai-gatewayai-infrastructureapi-gatewaykubernetesllm-gatewayllm-proxyllm-routingmcpmodel-context-protocolmulti-llmopenai-compatibleself-hosted
- Stars
- 19★
- Forks
- 2
- Language
- Python
- License
- MIT
- Created
- 2026-02-04
- Last push
- 2026-08-16