kinpatchii/batchi
View on GitHub ↗🚀 Enable efficient deep learning serving with dynamic batching that optimizes batch size and reduces latency while isolating invalid requests.
3 ★0 forksGoUpdated 18d ago
Topics
ai-agentsalgorithmautomationawsbatchbatchingcli-flagsdagdeveloper-toolsdigraphdirected-acyclic-graphdynamic-batchgraphllm-toolsmcpmodel-context-protocolswifttoposort
- Stars
- 3★
- Forks
- 0
- Language
- Go
- License
- Apache-2.0
- Created
- 2025-10-16
- Last push
- 2026-08-18