Mattbusel/tokio-prompt-orchestrator
View on GitHub ↗Multi-core, Tokio-native orchestration for LLM pipelines.
57 ★5 forksRustUpdated 5mo ago
What you need to know
An MCP server that orchestrates and routes prompts, letting you manage multiple prompt templates and dispatch them to different handlers/models through a single interface.
Install
Run the MCP server binary and register it with your MCP client.
Usage
- •Define prompt templates and route requests to the appropriate handler via tools.
Key features
- ✓prompt orchestration
- ✓routing
- ✓template management
Best for
Developers who want centralized prompt management across assistants.
Platforms: macOS · Linux · Windows
Reviewed 2026-08-11
Topics
agentasyncbackpressurecircuit-breakerdeduplicationllmllm-inferencemcpmodel-context-protocolmulti-agentorchestrationproductionrate-limitingrusttokio
- Stars
- 57★
- Forks
- 5
- Language
- Rust
- License
- MIT
- Created
- 2025-10-07
- Last push
- 2026-03-23