magpie
Point every coding agent and chat client at one self-hosted gateway, then choose which model answers from a single browser console. Add providers by preset or custom OpenAI-compatible URL, or sign in with the subscriptions you already pay for. Routing groups bundle several models into one name and move to the next member when a quota runs out, so the calling agent never sees the error. Create a gateway key per client, cap each with daily token or cost budgets, restrict its models, and watch usage counted separately. The Usage pages chart tokens, cost, request counts, cache hit rate, and a yearly heatmap, split by model, provider, or agent, with CSV export. A Routing view replays how each request was routed, with timing for masking, connecting, and the vendor. Masking swaps passwords, API keys, and tokens for placeholders before a prompt leaves your server and restores them in the answer. The browser page is protected by a key you set at launch. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
Agent Gateway
Backed by the Linux Foundation with contributions from AWS, Cisco, IBM, Microsoft, Red Hat, and Shell, Agentgateway is the first data plane built from the ground up for AI agent workloads — providing a unified Rust-based proxy that handles conventional HTTP and gRPC traffic alongside MCP tool servers, A2A agent communication, and LLM inference endpoints through a single deployment. The LLM gateway routes requests to OpenAI, Anthropic, Gemini, AWS Bedrock, and other providers through an OpenAI-compatible unified API with per-tenant budget controls, spend tracking, prompt enrichment, load balancing across multiple model endpoints, and automatic failover when providers experience outages. The MCP gateway federates multiple tool servers behind one endpoint, supporting stdio, HTTP/SSE, and Streamable HTTP transports with built-in OAuth authentication compliant with the MCP auth specification, integrating Auth0 and Keycloak out of the box. OpenAPI integration exposes existing REST APIs as MCP-native tools without code changes, enabling legacy services to participate in agent workflows. Policy-based RBAC controls which agents access which tools, while OpenTelemetry integration provides distributed tracing across agent communication chains. Deploy as a standalone binary with flat YAML configuration or on Kubernetes using the built-in controller with Gateway API support for declarative infrastructure-as-code management. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.
CLIProxyAPI Dashboard
CLIProxyAPI Dashboard puts a web console in front of CLIProxyAPI so you manage AI providers, keys, quotas, and containers through forms instead of YAML files. Connect Claude Code, Codex, xAI, Antigravity, Kimi, and Devin accounts with OAuth, then add Gemini CLI, GitHub Copilot, Kiro, and Cursor through plugins you install and configure from the settings store. Any OpenAI-compatible endpoint can join as a custom provider with model mappings, and admins can mark a provider as shared so the whole team uses it. You create, revoke, and track API keys with per-user ownership, manage dashboard users and admin rights, and stream live logs beside container health. Quota views track rate limits per provider and per model, and Telegram alerts fire when remaining quota drops below your threshold. Usage analytics break down request counts, provider share, model statistics, error rates, and estimated cost. Configuration syncs to OpenCode automatically, model configurations travel as share codes, and backups can be created, scheduled, previewed, and restored from settings. One-click updates refresh the dashboard and proxy images, containers start and stop from the panel, and automatic TLS keeps the console reachable under your domain. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
Antirion
Your apps keep using the OpenAI SDK while Antirion, a self-hosted AI gateway, decides which provider answers, what each team may spend, and what gets logged. Clients speak the OpenAI, Anthropic, Gemini, or Bedrock APIs, and Antirion translates between them, so a Claude deployment can answer an OpenAI-style call, streams included. Add providers such as Amazon Bedrock, Vertex AI, Mistral, Groq, DeepSeek, or a vLLM server, then publish them as named Models. Routing rules send traffic by team or project with fallback chains, weighted splits, least-cost or least-latency targets, retries, hedging, and circuit breakers. Budgets and rate limits in dollars or tokens apply per organization, team, project, and key, with projections and alerts before money runs out. Guardrails check for personal data, secrets, keywords, and regex matches, then block, redact, flag, or divert. Exact and semantic caching answers repeated prompts without calling a provider. The request log records every attempt, route, token count, cost, and guardrail verdict, with Prometheus metrics and OTLP traces. An MCP gateway and A2A proxy put tools and agents behind the same keys. Sign in with OIDC, SAML, or GitHub, provision users with SCIM, and review every change in the audit log. Changes you choose can require a change request or a second person's approval, and the Playground sends requests from the console. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
Ferro Labs AI Gateway
Thirty model providers, one OpenAI-compatible endpoint: Ferro Labs AI Gateway routes every request from your applications to the provider that should answer. Eight routing strategies cover fallback chains, weighted load balancing, lowest latency, lowest cost, content-based rules, A/B tests, and conditional targets, each with retries and circuit breakers. Guardrail plugins filter blocked words, redact personal data, scan for leaked secrets, block prompt injection, validate response schemas, and enforce rate limits and per-key spend budgets. Identical prompts can come back from a response cache, and tool servers connect through MCP so the gateway can run the tool-call loop itself. The console opens with a getting-started checklist, then charts traffic, token throughput, latency percentiles, and cost by model. Providers, routing targets, and plugins each get their own page, a playground sends test chats through the real routing path, and request logs plus an audit trail record who changed what. Scoped admin and read-only keys give every operator separate access, and configuration history allows a rollback. OpenTelemetry traces and Prometheus metrics feed existing dashboards. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
BitRouter
BitRouter is a context-aware LLM router that learns which model delivers the cheapest successful outcome per workflow step, cutting agent costs by up to 80% while maintaining 96% quality versus all-frontier baselines. Point any agent runtime at http://localhost:4356 with a one-line OPENAI_BASE_URL change and BitRouter routes to OpenAI, Anthropic, Google, Groq, DeepSeek, Mistral, Moonshot, MiniMax, Nvidia, and any OpenAI-compatible endpoint simultaneously, normalizing authentication, streaming, and cross-protocol translation between wire formats. The act-observe-evaluate-learn loop traces every hop with cost, tokens, and latency attribution, scores each decision against a versioned policy-lock.yaml, then tightens routes automatically with no LLM judge in the path. Native MCP gateway auto-discovers tools from connected servers and makes them routable and governed alongside model calls. Agent Client Protocol integration enables the TUI to manage Claude Code, Codex, OpenCode, OpenClaw, Gemini, and Copilot sessions in real time with inline tool-call approval and live streaming. Built-in guardrails inspect, redact, or block risky content before requests leave your network. Virtual keys scope API access per agent or user without exposing upstream credentials. Per-agent spend caps and loop guards contain runaway cost automatically. Multi-account failover reroutes mid-run so rate limits never re-pay completed work. Ships as a single Rust binary via npm or Cargo. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.
CliRelay
Anyone who pays for Claude Code, Codex, and Gemini CLI separately ends up juggling three endpoints, three sets of keys, and three kinds of rate-limit surprise, and CliRelay collapses all of that into one self-hosted gateway with a control panel. Clients speak the OpenAI Chat or Responses, Anthropic Messages, or Gemini protocol, and CliRelay translates each request for whichever upstream account is healthy. Channel groups limit where each key may send traffic, round-robin, fill-first, and session-sticky scheduling spread it, and cooldowns with automatic failover move requests off accounts that have run out of quota. Add upstreams from the /manage console through browser sign-in, device codes, or bulk credential import, covering Claude, Codex, Gemini, Antigravity, Vertex AI, AWS Bedrock, Grok, Qwen, Kimi, and any OpenAI-compatible service. Portal accounts own client keys with daily, period, and lifetime quotas, RPM and TPM limits, and per-model pricing. A monitor center scores health and charts live traffic, P50 to P99 latency, and time to first token, while every request lands in a searchable log with tokens, latency, and cost. Tenants, roles with resource.action permissions, content moderation profiles, an outbound proxy pool, and an audit trail make shared deployments workable, and the console speaks English, Simplified Chinese, and Russian. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
LiteLLM
Backed by 56,000+ GitHub stars and over 240 million Docker pulls, LiteLLM delivers the open-source AI gateway trusted by Netflix, Lemonade, Rocket Money, and thousands of engineering teams to route every LLM request through one unified API. The Rust-core gateway adds sub-millisecond overhead per request with 8ms P95 latency at 1,000 RPS, 15x throughput improvement and 11x lower memory footprint compared to Python-only proxies. A single OpenAI-compatible endpoint connects to 100+ providers and 1,800+ models spanning OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Vertex AI, Hugging Face, vLLM, Nvidia NIM, Ollama, and Mistral with day-zero support for new model releases. The Auto Router V2 classifies request complexity across four tiers using rule-based scoring, semantic keyword matching, and adaptive Thompson sampling to route each request to the most cost-effective model without API calls or training data. Virtual API keys enable multi-tenant governance with per-team, per-user, and per-project cost tracking, budget caps with automatic fallback rerouting, and role-based access control. Built-in guardrails provide PII masking, prompt injection detection, and model-graded evaluation before requests reach providers. The Agent Gateway extends routing from model calls to agent workflows with MCP server integration. Observability integrates with Langfuse, Arize Phoenix, OpenTelemetry, and MLflow for complete request tracing. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
AIHelms
Every employee gets one AI key, and every dollar of model spending gets a name next to it. AIHelms is an admin console and user portal that sits in front of your model providers, so a team can use Claude, DeepSeek, GPT, and local models through one entry point, with IT keeping control. Administrators onboard providers, publish models, and balance traffic across several deployments of the same model, with both OpenAI and Anthropic request formats accepted. Each AI identity carries a model allow-list, quota, rate limits, and an expiry date. Budgets can be set per person, department, project, or model, with soft alerts and hard cut-offs. Internal settlement prices sit beside real provider costs, so departments can be billed with or without a markup. Dashboards show adoption, daily calls, token use, and top users, and weekly or monthly efficiency reports drill down by department. A built-in marketplace registers, approves, and distributes MCP servers and agent Skills, and an AI policy scan flags risky Skills before anyone installs them. Audit logs record every administrator action. Employees see their key, endpoint, models, and monthly spend in the portal. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. GPL-3.0 licensed.
LLM Gateway
One OpenAI-compatible API fronts more than 250 models across 40 providers in LLM Gateway, with routing, cost analytics, and key management in a single dashboard. Existing OpenAI SDK code keeps working: change the base URL and model name to reach OpenAI, Anthropic, Google, xAI, DeepSeek, Groq, and dozens more. Every request lands in an activity log with its model, cache status, token counts, duration, and cost, and opening a request shows time to first token, throughput, and cached token usage. Spend splits by model, provider, project, and API key over 7 or 30 days, so the expensive endpoint stops hiding inside one monthly invoice. Scoped API keys carry spend caps and recurring limits, and requests stop automatically at the cap. Provider errors, timeouts, and rate limits trigger a retry on another provider for the same model before the caller hears about it. Coding agents and automation tools get their own usage views with requests, tokens, and spend per tool. Self-hosting runs the unified Docker image or a Kubernetes Helm chart on your own network. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.
Kong
With over 43,000 GitHub stars and adoption by companies including Nasdaq, Samsung, and Expedia, Kong Gateway is the world's most deployed open-source API gateway, processing billions of API requests daily across hybrid-cloud and multi-cloud architectures. Built on the battle-tested NGINX engine with OpenResty's LuaJIT runtime, Kong delivers sub-millisecond proxy latency while supporting REST, gRPC, GraphQL, WebSocket, SOAP, and Kafka protocols. The plugin architecture includes authentication via JWT, Basic Auth, HMAC, key authentication, OAuth 2.0, and LDAP, alongside rate limiting with configurable windows per consumer, IP address, or API key. The AI Proxy plugin provides a universal LLM API that routes across OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure AI, Databricks, Mistral, and Hugging Face through a single standardized interface, while MCP proxy capabilities convert REST APIs into MCP tools and provide traffic governance for AI agents. Kong supports declarative configuration via YAML for GitOps workflows, a RESTful Admin API for dynamic configuration, and decK CLI for version-controlled infrastructure-as-code management. Upstream health checking with active and passive probes enables automatic failover, and the ring balancer distributes traffic across upstream targets with consistent hashing, round-robin, or least-connections algorithms. The Kong Plugin Hub hosts over 100 community and official plugins covering logging, monitoring, transformation, security, and traffic control. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.
SubLane
Five teammates sharing three AI subscriptions usually means a password in a group chat; SubLane replaces that with a gateway you host, where accounts are pooled and every person gets a managed key. Connect Codex, Claude, Antigravity, and Grok Build subscriptions once, by browser OAuth or credential import, and the gateway snapshots each account's quota windows and allowances so routing knows who still has room. Add API channels for OpenAI-compatible services alongside the subscriptions, then group everything into resource pools with model allowlists, conversation affinity, concurrency controls, and cooldown recovery for accounts that hit a limit. Each member receives a personal key scoped to one group, with its own expiry, rate and concurrency limits, and an allowance measured in tokens, internal dollars, or estimated quota share; keys can be paused or revoked without touching anyone else. Whatever the client speaks, the gateway answers: OpenAI Responses and Chat Completions, Claude Messages, and Gemini formats flow over HTTP, SSE, or WebSocket, independent of which subscription actually serves the request. Administrators watch per-member and per-model usage charts, activity heatmaps, and request diagnostics, bind a fixed outbound proxy to any account, and apply workspace content rules before dispatch. It all runs as one Go process with SQLite and an embedded dashboard, backed up and restored from the interface. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.
Inference Gateway
Inference Gateway puts a single OpenAI-compatible API endpoint in front of OpenAI, Anthropic, Groq, Cohere, Ollama, DeepSeek, Google, Mistral, MiniMax, Moonshot, Nvidia, and llama.cpp, so your application code never changes when you switch models or providers. The Go binary starts on port 8080 and normalizes authentication, streaming protocols, and response formats across all backends transparently. Native Model Context Protocol support auto-discovers tools from connected MCP servers and injects them into LLM requests without client-side management, enabling server-side tool execution across any provider that supports function calling. Agent-to-Agent protocol integration allows distributed agent communication through a declarative Agent Definition Language that generates production-ready Go or Rust servers from a single YAML manifest. The dedicated Kubernetes Operator manages Gateway, Agent, MCP, and Orchestrator custom resources with automatic HPA scaling, OIDC authentication, and service discovery that rebuilds MCP configurations when the discovered server set changes. Prometheus metrics and OpenTelemetry tracing provide full request-level observability across the entire inference pipeline. Middleware controls enable per-request provider selection, model routing, and fallback strategies. Official SDKs in Go, Python, TypeScript, and Rust provide typed client interfaces with streaming support. Docker Compose deployment requires only environment variables for API keys. A CNCF Sandbox applicant. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.
APIPark
One gateway, every AI model: APIPark gives your applications a single, consistent API for OpenAI, Anthropic, Google Gemini, DeepSeek, and 100+ other models, and gives your team a portal to publish and share whatever gets built on top. Standardized request and response formats mean swapping a provider or rewriting a prompt never touches client code. Pair a model with a prompt template and it becomes a ready-made API for sentiment analysis or translation, listed in the developer portal with its own readme and generated API docs. Model Fallback swaps in the highest-priority available model when one misbehaves. API key balancing spreads traffic across several keys for the same provider. Already have REST services? Import an OpenAPI document, file the service under a category and tags, and let consumers subscribe, with optional manual review before anyone gets access. Any service can be switched on as an MCP tool that AI assistants can discover and call, and local open-source models can be deployed and exposed the same way. Usage charts follow requests, traffic, and tokens per service and consumer. Request logs flow out to files, HTTP endpoints, Kafka, NSQ, or Syslog. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
CPA Usage Keeper
Somewhere between the third coding agent and the fifth model subscription, nobody can say where the tokens went. CPA Usage Keeper keeps the receipts for a CLIProxyAPI gateway, saving every request locally with scheduled backups so history survives restarts. The Overview page shows requests, success rate, tokens, cache hit rate, and estimated cost with sparklines and a calendar heatmap, and Realtime plots time to first token against total latency and shows rolling cache levels and model speed. Analysis breaks usage down by API key, model, credential, or provider with donut charts and ranked lists. The Request Events log filters by model, source, and status, adjusts its columns, and exports records. Credentials cards show success rates, remaining five-hour and weekly quotas, priorities, and enable switches, and quota history charts how many tokens and dollars each percentage point costs over a cycle. Individual API keys can be given a read-only usage view. Deployment uses a Docker Compose file that bundles CPA with Keeper or runs Keeper beside an existing gateway, and the interface switches between English and Chinese and between light and dark themes. Check the dashboard before the invoice arrives and see exactly who spent what. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
1FlowBase
1FlowBase gives teams a single self-hosted foundation that connects model providers, retains every AI conversation, and turns that activity into working business applications. You connect OpenAI, Anthropic, Gemini, DeepSeek, Alibaba Cloud Bailian, or any OpenAI-compatible API through provider plugins and publish one stable endpoint for clients. Requests convert between Anthropic Messages, OpenAI Chat Completions, and OpenAI Responses, so applications keep working when a provider changes. You can route traffic by model name, fall back across branches when a provider fails, and combine planning, execution, and review models into a virtual model that callers use like any other model. Every gateway conversation is recorded with its model, reasoning effort, status, token totals, recorded cost, and latency, then broken down by model and by user in statistics views. You define data models and data sources, expose CRUD APIs, schedule workflows, and publish an OpenAPI 3.1 document for each application. Agents reach the same runtime through MCP with progressive list, get, and call tool discovery, and you manage MCP instances and third-party servers from the console. Pages come from native React blocks that you edit in place with a built-in AI assistant. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
Butterbase
Butterbase gives AI applications a complete backend they can run themselves, from a dedicated PostgreSQL database for every app to an MCP server that lets agents operate that backend directly. Define schemas declaratively, apply migrations, protect rows with Row-Level Security policies, and call the generated REST endpoints without building a separate data API. Add email and OAuth sign-in with Google, GitHub, Apple, X, and other providers, then tune JWT behavior, post-login hooks, service keys, and API keys for each application. Store files in S3 or R2 compatible object storage with presigned URLs and access controls, and keep regional key-value data with TTLs and an audit trail. Run TypeScript functions on Deno, coordinate chat rooms or rate limiters as durable per-key objects, and stream table changes to live interfaces over WebSocket subscriptions. Route chat and embedding calls through one AI gateway, ingest documents into RAG collections, and build checkpointed agent workflows that can pause for human approval before continuing. Host static frontends and edge handlers, expose webhooks for application events, and manage schemas, storage, functions, realtime channels, and integrations through more than forty MCP tools. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
Bifrost
Bifrost is an open-source AI gateway that unifies 23+ LLM providers into a single OpenAI-compatible endpoint with automatic failover, semantic caching, and built-in cost governance, so one provider going down never takes your production AI application with it. Point your existing OpenAI or Anthropic SDK at Bifrost's local endpoint and gain access to OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure, Groq, Mistral, and Ollama without changing application code. Define fallback chains that automatically switch providers when one returns errors or exceeds latency thresholds, keeping response times stable during outages. The built-in web dashboard at port 8080 lets you configure providers, create virtual API keys, monitor live request traffic, and review analytics without editing configuration files. Semantic caching combines exact hash matching with vector similarity search via Weaviate, serving cached responses for identical or paraphrased prompts in sub-millisecond time to cut costs on repetitive workloads. The MCP gateway connects AI agents to external tools like filesystems, databases, and web APIs, exposing them to clients such as Claude Desktop and Cursor with per-key allow-lists. Four-tier budget hierarchy at customer, team, virtual key, and provider levels enforces spend caps, rate limits, and model restrictions across your organization. Extend functionality through custom Go plugins for analytics, monitoring, or security middleware. Native Prometheus metrics and OpenTelemetry distributed tracing give operations teams full production observability. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.