FreeLLMAPI
FreeLLMAPI collapses the chaos of 29 free LLM providers — Google AI, Cerebras, Groq, Mistral, OpenRouter, GitHub Models, Cohere, Cloudflare Workers AI, NVIDIA NIM, HuggingFace, SiliconFlow, Reka, Z.ai, and more — into a single /v1 endpoint that speaks both OpenAI and Anthropic protocols. The smart router selects the best available model for each request, automatically fails over to the next provider when rate limits hit, and tracks per-key token consumption so you never exceed a free-tier cap. Keys are stored with AES-256-GCM encryption and clients authenticate using a single unified bearer token, never exposing upstream provider credentials to downstream applications. The catalog tracks 251 model families across 358 provider/model endpoints with approximately 4 billion tokens per month of aggregate free-tier capacity, auto-refreshing from a signed manifest at freellmapi.co twice daily without requiring git pulls. Beyond chat completions, the proxy handles embedding, image generation, and audio/TTS endpoints, plus structured outputs with JSON schema forwarding, JSON healing, and format-ignore failover. An integrated MCP server at /mcp provides gateway introspection for coding agents, while the self-hosted OpenAPI reference at /v1/docs documents every route. Compatible with OpenAI SDKs, LangChain, LlamaIndex, Continue, Claude Code, and Hermes — just change base_url. Deploy via Docker, npm, or build from source. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
Apache APISIX
With 17,000 GitHub stars, 460+ contributors, and deployments across telecommunications, automotive, and financial services running on over 10,000 CPU cores at the largest known installations, Apache APISIX delivers a fully dynamic API gateway achieving 140,000 QPS on eight cores with sub-millisecond latency through NGINX's event-driven architecture and LuaJIT-compiled plugin execution. The 100+ open-source plugins cover authentication (JWT, OAuth 2.0, OIDC, Keycloak, LDAP), observability (Prometheus, Datadog, SkyWalking, OpenTelemetry), traffic management (rate limiting, circuit breaking, canary releases, traffic splitting), and security (CORS, IP restriction, CSRF protection) — all hot-reloadable without process restarts via etcd-based real-time configuration synchronization. Multi-protocol support handles HTTP, gRPC, MQTT, TCP, UDP, and WebSocket traffic for both north-south API access and east-west service mesh communication. AI gateway capabilities proxy requests to 20+ LLM providers with semantic caching, token-aware rate limiting, provider failover routing, and content moderation. Custom plugins extend the gateway in Lua, Go, Java, Python, or WebAssembly. Radixtree route matching handles 100,000+ routes without performance degradation. Functions as a Kubernetes ingress controller with native service discovery for Consul, Nacos, and Eureka. Deploy via Docker or Helm charts with horizontal scaling through etcd cluster coordination. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.
Higress
Send every AI request through one gateway that holds your model providers, API keys, and access rules. The web console starts with a first-run admin setup, then an LLM Provider page where OpenAI-compatible endpoints, Anthropic Claude, Azure OpenAI, Tongyi Qianwen, Moonshot, Zhipu, and other services are added with their tokens. AI Route Config maps path prefixes and model match rules to weighted target services, with token failover and first-packet timeouts to keep traffic moving when a key fails. Consumer Management issues key, OAuth2, and JWT credentials, and each route can limit access to named consumers. Plugin Management lists ready-made AI plugins for caching, context limits, data masking, prompt templates, prompt decorators, load balancing, and intent checks, plus traffic and security plugins that can be configured per route. MCP Management hosts MCP servers behind the same authentication and rate limits so agents call tools through one governed address. Service Sources import backends from Nacos, Zookeeper, Consul, Eureka, static addresses, or domains, and domain and certificate pages handle HTTPS, including free automatic certificates from Let's Encrypt. An LLM proxy for a product team, a shared model endpoint for several agents, or a replacement for an ingress controller all fit this console. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
Faucet
One binary and one command is all it takes: the SQL database you already run gains a secure REST API and MCP server, with no code generation and no ORM boilerplate. Point it at PostgreSQL, MySQL, MariaDB, SQL Server, Oracle, Snowflake, or SQLite and it introspects the schema at runtime, generating full CRUD endpoints with filtering, ordering, and pagination plus a live OpenAPI 3.1 specification. The embedded admin UI connects databases with plain host, port, user, and password fields, tests the connection before saving, and tells you exactly what to fix when it fails. You browse tables, columns, keys, and data, build roles with per-table verb permissions, and issue API keys that are SHA-256 hashed with a role assigned to each. Schema contract locking watches for drift that would silently break your API, with none, auto, and strict modes managed from the UI or CLI. The API explorer builds filtered, paginated requests and copies them out as curl, JavaScript, or Python. An MCP server on the same port gives Claude Code, Cursor, VS Code, Windsurf, and other AI tools governed access to your data under exactly the same roles and keys as any API client. Legacy databases such as SQL Server 2012 or PostgreSQL 9.6 gain a modern API without code changes or migration. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
KeiRouter
One endpoint, 130+ models from 90+ providers: KeiRouter is a self-hosted AI gateway, so apps, coding tools, and agents connect once and stop juggling provider keys. Your code speaks OpenAI Chat, OpenAI Responses, Anthropic Messages, or native Gemini, and KeiRouter translates to whichever upstream you want, including AWS Bedrock, Azure AI Foundry, Vertex, Snowflake Cortex, and self-hosted runtimes like Ollama and vLLM. Fallback chains keep requests moving when a provider goes down or hits a rate limit, using priority, round-robin, latency, or cost ordering, so coding sessions do not stop mid-task. Five token savers compress prompts on the way in and trim responses on the way out, with a live dashboard showing savings recovered. A response cache answers repeated prompts instantly for zero marginal cost, with optional semantic matching. Per-key budgets and rate plans set USD, token, RPM, and concurrency limits with auto-cutoff, stopping surprise bills. Guardrails scan for PII, prompt injection, toxicity, and banned topics at global, provider, model, chain, and key scopes, with a monitor showing what got blocked and what it cost. The dashboard tracks usage by provider and model, latency, a live console tracing each request through its fallbacks, and provider health. You can import from 9router or OmniRoute, white-label the portal for your team, and run replicas on Postgres and Redis for high availability. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
Fusio
Fusio turns the data and services you already run into a managed API that partners, apps, and AI agents can actually use. The workflow starts small: add a database connection and a table becomes a REST endpoint, or proxy a remote service and route traffic between internal microservices. Each operation pairs an HTTP path with an action and a schema, so requests are validated and an OpenAPI specification plus client SDKs for major languages come out without extra effort. Custom behavior lives in reusable actions, and an AI assistant can draft actions and schemas from a plain-language prompt. Native Model Context Protocol support then offers those actions to autonomous agents as tools. Third-party developers get a self-service portal with documentation, testing tools, and their own keys. Every endpoint can be protected with scopes and rate limits. Asynchronous work runs through events, webhooks, cronjobs, and triggers. When the API becomes a product, plans, quotas, and transactions handle billing, and analytics follow usage, performance, and errors. A marketplace installs ready-made actions and apps, and the generator and test panels speed up development. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
Obsidian Arc
Teams and communities sign in to a private AI chat site, and one admin console routes and meters every request. Users pick a model from the menu and chat with streamed answers, visible reasoning, projects that share a system prompt, searchable history, archives, and an Image Lab for generated pictures. Administrators connect providers that speak the OpenAI or Anthropic protocols, map several models onto each, and place users in groups with their own allowances counted in requests, tokens, or credits per five hours, week, or month. A developer endpoint accepts API keys and serves chat completions, Anthropic messages, responses, images, and a model list, so coding assistants and scripts can share the same pool. The dashboard charts requests, tokens, and spend by model and by person, and Availability probes idle models and trips a circuit breaker after repeated failures. Registration can be open, invite-only, or closed, with invite codes, email rules, authenticator-app two-step sign-in, and GitHub, Google, or OpenID Connect login. Announcements, a feedback inbox, an optional leaderboard, a guest trial chat, and scheduled backups to S3-compatible storage round out the operator toolkit. A company AI portal, a classroom, a research group, or a paid community with trial codes can all run on it. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
MCPJungle
MCPJungle puts every MCP server your AI tools use behind one endpoint, so Claude, Cursor, Codex, and your own agents all connect to a single gateway instead of a tangle of per-client configurations. Register remote HTTP servers and local STDIO servers once, and their tools, prompts, and resources become discoverable through the gateway in one place. Tool groups expose curated subsets at their own endpoints, so a coding agent sees only the tools its job needs instead of hundreds of irrelevant ones competing for context. The dashboard gives you a visual registry of servers, tools, and groups for everyday management, while the CLI and REST API cover scripting and automation. Development mode runs with zero authentication for a personal setup; enterprise mode adds per-client tokens that allow-list exactly which servers each client may reach. User accounts and manual server initialization give teams a governed shared deployment, with OpenTelemetry metrics showing what clients call and how the gateway performs. Upstream servers can authenticate with bearer tokens or OAuth, so credentials stay centralized in the gateway rather than copied into every client config. Registry data persists in a local file for solo use or in PostgreSQL when the gateway becomes shared team infrastructure. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MPL-2.0 licensed.
MCP Gateway & Registry
Every team wiring its own MCP servers by hand ends up with credentials scattered across dotfiles and no list of what exists; MCP Gateway and Registry replaces that with one governed front door. Register an MCP server, an A2A agent, a reusable skill, or a custom entity type once, and the Discover page lists it with tags, ratings, and search by natural language. Coding assistants and agents connect to a single authenticated gateway backed by Keycloak, Entra ID, Okta, Auth0, or Cognito, with scopes that decide who may call which tool. Virtual servers bundle tools from several backends behind one endpoint. Connected Accounts brokers third-party logins for Slack, Atlassian, and GitHub so tokens stay off laptops. Every registration is security scanned, and an admission gate holds unsafe items for review. The settings area offers audit log filtering with JSONL and CSV export, federation with outside registries, per-group rate limits, and a searchable configuration viewer. OpenTelemetry metrics and health checks are built in. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
Doorman
Doorman puts one controlled front door in front of every API you run, instead of teaching each service to reinvent keys, quotas, and abuse protection. It routes REST, SOAP, GraphQL, gRPC, gRPC-Web, and AI traffic through a single gateway while its control plane handles the surrounding work. Catalog APIs in a visual builder, configure protocols and endpoints, validate schemas, and manage semantic versions with deprecation and sunset dates as interfaces evolve. Control who may call what through users, roles, groups, and subscriptions, then attach credit tiers and quotas so heavy consumers stay inside the plan you sold them. Slow abusive clients with rate limits, throttling, and bandwidth caps, and keep flaky upstreams from cascading through retries and circuit breaking. Follow every request in searchable logs, review security controls and audit activity, and move configuration between environments with import and export. Start in a self-contained in-memory mode for a small deployment, then switch to shared MongoDB and Redis when several gateway instances need the same counters, revocations, and routing state. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.
Convoy
Convoy is an enterprise-grade webhooks gateway that manages both incoming and outgoing webhook traffic to guarantee reliable event delivery without exposing internal microservices to the public internet. Organizations deploy the platform at the edge to ingest events from message brokers such as Apache Kafka, RabbitMQ, and Google Cloud PubSub, or receive HTTP webhooks from third-party services directly. The gateway enforces delivery policies through configurable rate limiting per endpoint, circuit breaking during downstream outages, and automated retries using constant or exponential backoff with jitter. Developers can generate customer-facing webhook portals embedded via iframes, allowing end users to inspect delivery attempts, verify HMAC-SHA256 signatures, and manually replay failed events. Comprehensive security controls include static egress IP proxying to prevent server-side request forgery, automated rolling secret keys, and instant alerting via Slack or email when endpoints fail consecutively. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Elastic License 2.0 licensed.
OpenGateLLM
One endpoint, every model you run, and a government-grade paper trail for each request. OpenGateLLM sits in front of your AI infrastructure as the single door: applications call one OpenAI-compatible API, and the gateway decides which backend answers, a self-hosted vLLM cluster, an Ollama box in the corner, a Hugging Face TEI embeddings service, or a hosted provider when you allow one. You publish friendly model names as routers and attach real provider APIs behind them, then load-balance across those backends by shuffle or least-busy so a second GPU node starts earning its keep the moment you register it. Chat completions, embeddings, reranking, OCR, and audio transcription each get their standard endpoint, so existing OpenAI SDK code, LangChain, and LlamaIndex projects point at a new base URL and keep working. Governance is built in rather than bolted on: organizations, users, and roles control who may call which model, API keys authenticate every request, and rate limiting keeps one enthusiastic team from eating the whole cluster. Usage monitoring follows every inference, and carbon footprint estimates attach to models through their hosting zone and parameter counts. Retrieval-augmented generation against Elasticsearch or Qdrant plugs into the same surface. No chat history is stored, which is rather the point when the data is yours. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
Codex LB Enhanced
Codex LB Enhanced is a session-aware gateway that pools your ChatGPT accounts so a long Codex session survives quota limits, dropped connections, and paused accounts without losing the conversation. It serves Codex desktop, CLI, and IDE clients through the native Responses protocol and WebSocket transport, and answers any OpenAI-compatible client through the familiar /v1 endpoints. When an account runs out of quota, gets suspended, times out, or drops mid-stream, the gateway classifies the failure, removes that account from the current request, and selects the next one through your load-balancing policy. Verified request history, including interrupted tool-call context, is replayed across the account switch when it is safe, so the client sees a slower answer instead of a dead stream. Every API key carries its own policy: time windows from five hours to monthly, limits by credits, tokens, or cost, and model-specific rules. Usage appears in native Codex quota headers and in a /v1/usage view backed by the same data, so editors and automation agree on what is left. Diagnostics correlate each request with its upstream account, transport, failover stage, and retry count, and a web dashboard manages accounts, keys, usage windows, request logs, and recovery reports. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.