diegosouzapw/OmniRoute
๐ https://github.com/diegosouzapw/OmniRoute โ๐ OmniRoute โ The Free AI Gateway ๐ฐ ~1.62B Free Tokens / Month Stacking free tiers by hand is painful โ dozens of SDKs, dozens of rate limits, and no idea how much you actually have. OmniRoute catalogs 489 free-tier entries across 35 recurring pool keys and computes the token headline from the 17 pools with a published positive monthly budget plus five per-model Groq caps , deduplicated by shared pool. Quotas that only open after a regional identity check (today: ModelScope) are shown apart, +~6M behind regional identity verification, and never summed into the headline. The result stays visible on the dashboard ( /dashboard/free-tiers ). Animated summary of the live /dashboard/free-tiers page. Full methodology (pool dedupe, credit tiers, provider terms): docs/reference/FREE_TIERS.md . These figures are re-audited every two weeks against the live catalog and move both ways โ a provider ends a free tier and the number drops; a new one lands and it climbs. We publish what the catalog actually computes, never a rounded-up best case. โญ Star the repo if OMNIROUTE helped you save money and make your work easier. ๐ฌ Join the community ๐ Follow the maintainer โ get new providers, releases & tips first: Questions, provider tips, roadmap & support โ Discord ยท Telegram ยท WhatsApp ๐ Global / ๐ง๐ท Brasil / Portal ๐ The Gateway Keeps Growing v3.8.49 v3.8.50 v3.8.51+ ๐ Providers 290 357 more queued ๐ง Unique chat model IDs 1185 1312 โ ๐ผ๏ธ Modality Bridge โ ๐ vision + audio + video โ ๐ก Radar free catalog โ ๐ opt-in โ โ๏ธ Quota-aware scheduling โ ๐ Quota-Share โ ๐ Quota telemetry โ ๐ live โ โ Roadmap โ riding the rail to v3.9.0 LTS ๐งฉ Available ๐ Start ๐ Quick Start ๐ฆ Install ๐ Zero-config ๐ก Learn ๐ฅ The Promise ๐ค Why OmniRoute ๐ What Sets Apart โ๏ธ Features ๐ฏ Combos ๐ Providers ๐ CLI & MCP ๐๏ธ Compression ๐ฅ๏ธ Where It Runs ๐ Private ๐ See it ๐ฌ In Action โจ What's New ๐ค Compatible CLIs ๐ Support ๐ Support / Donate ๐ฌ Community ๐ Sponsors ๐ฆ Project ๐ ๏ธ Tech Stack ๐ Docs ๐ฅ Contributors ๐ In 67 languages ๐ Works the second you install it โ no keys, no config # Fresh install, zero credentials โ `auto` already works: curl http://localhost:20128/v1/chat/completions \ -H " Content-Type: application/json " \ -d ' {"model":"auto","messages":[{"role":"user","content":"Hello!"}]} ' Prefer a specific free backend? Call oc/โฆ (OpenCode Free) directly. Then graduate to auto and let OmniRoute pick. ๐ฆ Copy-paste quickstart scripts for Python, Node.js, PHP, and cURL โ examples/quickstart/ ๐ฅ The Promise ๐ค Why OmniRoute? ๐ค Supported by our Open Source Friends Want to join as an Open Source Friend? These are the companies that back open source and help keep OmniRoute moving โ and we say publicly where every token they give us goes. Reach out: diegosouza.pw@outlook.com Kimi Moonshot AI Thanks to Kimi (Moonshot AI) , our founding Open Source Friend, for backing this project! Kimi is the AI lab behind the open-weight K2 and K3 model families โ Kimi K3 delivers a 1M-token context window, native vision and frontier-level coding at a fraction of closed-model prices, and works out of the box with Claude Code, Codex and every coding tool OmniRoute serves. What Kimi's support powers: Kimi's API credits power OmniRoute's AI-validated release pipeline โ the merge validation powered by Kimi K3 stage that reviews every pull request before it ships โ plus day-to-day feature development. First-class Kimi support ships on both rails: the direct Kimi API ( kimi-k3 ) and the Kimi Code coding plan (OAuth and API key). OmniRoute is also the first Brazilian open-source project in Kimi's support program. Get a Kimi API key with 15% extra credits โ Cheaper Inference cheaperinference.com Thanks to Cheaper Inference , an OmniRoute Open Source Friend, for backing this project! Cheaper Inference is a cost-ranked gateway that resells 42 frontier models โ Claude, GPT-5.x, Gemini, Kimi K3, GLM, DeepSeek, Grok and MiniMax โ behind one OpenAI-compatible endpoint, routing each request to the cheapest eligible provider without ever charging above the model maker's list price. First-class support in OmniRoute: Chat Completions, the native /v1/responses endpoint, vision, tool calling and 3 image models ( grok-imagine , nano-banana-pro , nano-banana-2 , reachable as cheaperinference/<model> ). Get an API key โ Links tagged aff=omniroute are partner links. They fund the project at no extra cost to you. ๐๏ธ Affiliates Promo โ free signup coupons from providers we don't sponsor (click to expand) This section is for referral/coupon codes only. Sponsored partnerships live in ๐ค Supported by our Open Source Friends above. OmniRoute has no sponsorship or partnership with the providers listed here โ these are public coupons anyone can use. AgentRouter agentrouter.org AgentRouter โ affiliate signup ยท $100 free credits on signup (free server, expect higher latency โ best for testing, not production). First-class support in OmniRoute since v3.8.50 : Chat Completions, the Anthropic-compatible wire format and the OpenAI-compatible path. Available models include claude-opus-4-8 , claude-opus-5 , gpt-5.6-sol and more. Grab your $100 โ โ ๏ธ Affiliate link โ OmniRoute has no sponsorship or partnership with this provider. Know another provider with a generous free signup coupon that benefits OmniRoute users? Open an issue and we'll add it here. ๐ฏ Combos โ The Flagship A combo is a chain of models OmniRoute routes across automatically . If quota runs out, a provider fails, or costs spike, the combo can move to the next eligible healthy model. ๐ก๏ธ โก Zero-config โ just use auto No combo to create. Set your model to auto (or a variant) and OmniRoute builds a virtual combo from your connected providers, scored live: Model ID What it optimizes for auto ๐ฏ Balanced default (LKGP โ sticks to your last good provider) auto/coding ๐งโ๐ป Quality-first weights for code generation auto/fast โก Lowest latency first auto/cheap ๐ฐ Cheapest per token first auto/offline ๐ Most quota / rate-limit headroom first auto/smart ๐ญ Quality-first + 10% exploration to discover better models auto/lkgp ๐ Explicit last-known-good-provider stickiness auto/chaos ๐งช Parallel fan-out to a panel of models (one per provider, 5 by default), returns one answer; one upstream call per panel model, not fault injection ๐ Or build your own โ 19 routing strategies All 19 strategies โ mix & match per combo step: # Strategy What it does 1 priority First-target ordered list โ drain each before the next ๐ฅ 2 fill-first Fill each target's quota fully before moving on 3 weighted Weighted random by per-target weight 4 round-robin Cycle through targets in order 5 p2c Power-of-two-choices random load balancing 6 least-used Pick the target with the lowest current load 7 random Uniform random pick (deduplicated) 8 strict-random Random without de-duplicating repeats ๐ฒ 9 cost-optimized Minimize $ per request from live catalog pricing ๐ธ 10 headroom Pick the target with the most remaining quota 11 reset-window Prefer the target whose quota window resets soonest 12 reset-aware Rank by quota reset time โ short windows first ๐ 13 context-relay Hand off context across targets for long conversations ๐ง 14 context-optimized Pick the best fit for the current context size 15 cache-optimized Pin each reusable prompt prefix to the same account โ maximize prompt-cache hits ๐ฏ 16 lkgp Last-Known-Good Path โ pins to the last successful provider, then falls back to rules 17 auto 16-factor live scoring across every connection ๐ค 18 fusion Fan out to a panel of models + a judge synthesizes one answer ๐งฌ 19 pipeline Chain steps โ each target's output feeds the next one ๐ The Auto-Combo engine scores every candidate on 16 factors (health, quota, cost, latency, task fit, quality, session availabilityโฆ) โ see docs/routing/AUTO-COMBO.md .
ๅ งๅฎน็บๆถ้็ถๆฅๆๅ็ repo ๆ่ฟฐๅๆ๏ผๅฎๆด่ณ่จ่ซ่ฆ GitHub ๅ้ ใ