0xzr/freellmpool

View on GitHub ↗

Free LLM API pool: 24 LLM providers cataloged, 222 routes, 407 cataloged chat models, keyless start when available.

77 ★11 forksPythonUpdated 21d ago

What you need to know

Pools the free tiers of 24 LLM providers behind a single OpenAI-compatible endpoint, available as a CLI, Python library, or local proxy.

Install

pip install freellmpool
Or run via uvx

Usage

  • Start the local proxy or import as a Python library
  • Point any OpenAI-compatible client at the pooled endpoint

Key features

  • Unified access to 24 free-tier LLM providers
  • OpenAI-compatible API
  • CLI, Python library, and local proxy modes

Best for

Developers who want free LLM access without managing many provider keys.

Caveats

  • Depends on provider free-tier availability and limits

Reviewed 2026-08-11

Topics

anthropicclaudecodexcursorfailoverfree-llmfree-llm-apigeminigroqllm-gatewayllm-routermcpmcp-servermodel-context-protocolopenaiopenai-proxyopencodeopenrouterpythonrate-limiting
Stars
77★
Forks
11
Language
Python
License
MIT
Created
2026-06-03
Last push
2026-08-14