โญ +332 today TypeScript

diegosouzapw/OmniRoute

๐Ÿ”— https://github.com/diegosouzapw/OmniRoute โ†—

๐Ÿš€ OmniRoute โ€” The Free AI Gateway ๐Ÿ’ฐ ~1.62B Free Tokens / Month Stacking free tiers by hand is painful โ€” dozens of SDKs, dozens of rate limits, and no idea how much you actually have. OmniRoute catalogs 489 free-tier entries across 35 recurring pool keys and computes the token headline from the 17 pools with a published positive monthly budget plus five per-model Groq caps , deduplicated by shared pool. Quotas that only open after a regional identity check (today: ModelScope) are shown apart, +~6M behind regional identity verification, and never summed into the headline. The result stays visible on the dashboard ( /dashboard/free-tiers ). Animated summary of the live /dashboard/free-tiers page. Full methodology (pool dedupe, credit tiers, provider terms): docs/reference/FREE_TIERS.md . These figures are re-audited every two weeks against the live catalog and move both ways โ€” a provider ends a free tier and the number drops; a new one lands and it climbs. We publish what the catalog actually computes, never a rounded-up best case. โญ Star the repo if OMNIROUTE helped you save money and make your work easier. ๐Ÿ’ฌ Join the community ๐Ÿ‘‹ Follow the maintainer โ€” get new providers, releases & tips first: Questions, provider tips, roadmap & support โ†’ Discord ยท Telegram ยท WhatsApp ๐ŸŒ Global / ๐Ÿ‡ง๐Ÿ‡ท Brasil / Portal ๐Ÿ“ˆ The Gateway Keeps Growing v3.8.49 v3.8.50 v3.8.51+ ๐ŸŒ Providers 290 357 more queued ๐Ÿง  Unique chat model IDs 1185 1312 โ€” ๐Ÿ–ผ๏ธ Modality Bridge โ€” ๐Ÿ†• vision + audio + video โ€” ๐Ÿ“ก Radar free catalog โ€” ๐Ÿ†• opt-in โ€” โš–๏ธ Quota-aware scheduling โ€” ๐Ÿ†• Quota-Share โ€” ๐Ÿ“Š Quota telemetry โ€” ๐Ÿ†• live โ€” โ†’ Roadmap โ€” riding the rail to v3.9.0 LTS ๐Ÿงฉ Available ๐Ÿš€ Start ๐Ÿš€ Quick Start ๐Ÿ“ฆ Install ๐Ÿ†“ Zero-config ๐Ÿ’ก Learn ๐Ÿ’ฅ The Promise ๐Ÿค” Why OmniRoute ๐Ÿ† What Sets Apart โš™๏ธ Features ๐ŸŽฏ Combos ๐ŸŒ Providers ๐Ÿ”Œ CLI & MCP ๐Ÿ—œ๏ธ Compression ๐Ÿ–ฅ๏ธ Where It Runs ๐Ÿ”’ Private ๐Ÿ‘€ See it ๐ŸŽฌ In Action โœจ What's New ๐Ÿค– Compatible CLIs ๐Ÿ’š Support ๐Ÿ’š Support / Donate ๐Ÿ’ฌ Community ๐Ÿ’– Sponsors ๐Ÿ“ฆ Project ๐Ÿ› ๏ธ Tech Stack ๐Ÿ“– Docs ๐Ÿ‘ฅ Contributors ๐ŸŒ In 67 languages ๐Ÿ†“ Works the second you install it โ€” no keys, no config # Fresh install, zero credentials โ€” `auto` already works: curl http://localhost:20128/v1/chat/completions \ -H " Content-Type: application/json " \ -d ' {"model":"auto","messages":[{"role":"user","content":"Hello!"}]} ' Prefer a specific free backend? Call oc/โ€ฆ (OpenCode Free) directly. Then graduate to auto and let OmniRoute pick. ๐Ÿ“ฆ Copy-paste quickstart scripts for Python, Node.js, PHP, and cURL โ†’ examples/quickstart/ ๐Ÿ’ฅ The Promise ๐Ÿค” Why OmniRoute? ๐Ÿค Supported by our Open Source Friends Want to join as an Open Source Friend? These are the companies that back open source and help keep OmniRoute moving โ€” and we say publicly where every token they give us goes. Reach out: diegosouza.pw@outlook.com Kimi Moonshot AI Thanks to Kimi (Moonshot AI) , our founding Open Source Friend, for backing this project! Kimi is the AI lab behind the open-weight K2 and K3 model families โ€” Kimi K3 delivers a 1M-token context window, native vision and frontier-level coding at a fraction of closed-model prices, and works out of the box with Claude Code, Codex and every coding tool OmniRoute serves. What Kimi's support powers: Kimi's API credits power OmniRoute's AI-validated release pipeline โ€” the merge validation powered by Kimi K3 stage that reviews every pull request before it ships โ€” plus day-to-day feature development. First-class Kimi support ships on both rails: the direct Kimi API ( kimi-k3 ) and the Kimi Code coding plan (OAuth and API key). OmniRoute is also the first Brazilian open-source project in Kimi's support program. Get a Kimi API key with 15% extra credits โ†’ Cheaper Inference cheaperinference.com Thanks to Cheaper Inference , an OmniRoute Open Source Friend, for backing this project! Cheaper Inference is a cost-ranked gateway that resells 42 frontier models โ€” Claude, GPT-5.x, Gemini, Kimi K3, GLM, DeepSeek, Grok and MiniMax โ€” behind one OpenAI-compatible endpoint, routing each request to the cheapest eligible provider without ever charging above the model maker's list price. First-class support in OmniRoute: Chat Completions, the native /v1/responses endpoint, vision, tool calling and 3 image models ( grok-imagine , nano-banana-pro , nano-banana-2 , reachable as cheaperinference/<model> ). Get an API key โ†’ Links tagged aff=omniroute are partner links. They fund the project at no extra cost to you. ๐ŸŽŸ๏ธ Affiliates Promo โ€” free signup coupons from providers we don't sponsor (click to expand) This section is for referral/coupon codes only. Sponsored partnerships live in ๐Ÿค Supported by our Open Source Friends above. OmniRoute has no sponsorship or partnership with the providers listed here โ€” these are public coupons anyone can use. AgentRouter agentrouter.org AgentRouter โ€” affiliate signup ยท $100 free credits on signup (free server, expect higher latency โ€” best for testing, not production). First-class support in OmniRoute since v3.8.50 : Chat Completions, the Anthropic-compatible wire format and the OpenAI-compatible path. Available models include claude-opus-4-8 , claude-opus-5 , gpt-5.6-sol and more. Grab your $100 โ†’ โš ๏ธ Affiliate link โ€” OmniRoute has no sponsorship or partnership with this provider. Know another provider with a generous free signup coupon that benefits OmniRoute users? Open an issue and we'll add it here. ๐ŸŽฏ Combos โ€” The Flagship A combo is a chain of models OmniRoute routes across automatically . If quota runs out, a provider fails, or costs spike, the combo can move to the next eligible healthy model. ๐Ÿ›ก๏ธ โšก Zero-config โ€” just use auto No combo to create. Set your model to auto (or a variant) and OmniRoute builds a virtual combo from your connected providers, scored live: Model ID What it optimizes for auto ๐ŸŽฏ Balanced default (LKGP โ€” sticks to your last good provider) auto/coding ๐Ÿง‘โ€๐Ÿ’ป Quality-first weights for code generation auto/fast โšก Lowest latency first auto/cheap ๐Ÿ’ฐ Cheapest per token first auto/offline ๐Ÿ”‹ Most quota / rate-limit headroom first auto/smart ๐Ÿ”ญ Quality-first + 10% exploration to discover better models auto/lkgp ๐Ÿ“Œ Explicit last-known-good-provider stickiness auto/chaos ๐Ÿงช Parallel fan-out to a panel of models (one per provider, 5 by default), returns one answer; one upstream call per panel model, not fault injection ๐Ÿ”€ Or build your own โ€” 19 routing strategies All 19 strategies โ€” mix & match per combo step: # Strategy What it does 1 priority First-target ordered list โ€” drain each before the next ๐Ÿฅ‡ 2 fill-first Fill each target's quota fully before moving on 3 weighted Weighted random by per-target weight 4 round-robin Cycle through targets in order 5 p2c Power-of-two-choices random load balancing 6 least-used Pick the target with the lowest current load 7 random Uniform random pick (deduplicated) 8 strict-random Random without de-duplicating repeats ๐ŸŽฒ 9 cost-optimized Minimize $ per request from live catalog pricing ๐Ÿ’ธ 10 headroom Pick the target with the most remaining quota 11 reset-window Prefer the target whose quota window resets soonest 12 reset-aware Rank by quota reset time โ€” short windows first ๐Ÿ“Š 13 context-relay Hand off context across targets for long conversations ๐Ÿง  14 context-optimized Pick the best fit for the current context size 15 cache-optimized Pin each reusable prompt prefix to the same account โ€” maximize prompt-cache hits ๐ŸŽฏ 16 lkgp Last-Known-Good Path โ€” pins to the last successful provider, then falls back to rules 17 auto 16-factor live scoring across every connection ๐Ÿค– 18 fusion Fan out to a panel of models + a judge synthesizes one answer ๐Ÿงฌ 19 pipeline Chain steps โ€” each target's output feeds the next one ๐Ÿ”— The Auto-Combo engine scores every candidate on 16 factors (health, quota, cost, latency, task fit, quality, session availabilityโ€ฆ) โ€” see docs/routing/AUTO-COMBO.md .

ๅ…งๅฎน็‚บๆ”ถ้›†็•ถๆ—ฅๆŠ“ๅ–็š„ repo ๆ่ฟฐๅŽŸๆ–‡๏ผŒๅฎŒๆ•ด่ณ‡่จŠ่ซ‹่ฆ‹ GitHub ๅŽŸ้ ใ€‚