FastLLM Proxy screenshot thumbnail

FastLLM Proxy

Local vLLM and llama.cpp boxes and hosted providers like OpenRouter, Anthropic, Bedrock, and Gemini all answer to one OpenAI-compatible address once FastLLM Proxy sits in front of them. Clients ask for a frontend model by name, and ordered rules pick the target by caller, prompt size, headers, budget spent, time of day, or how busy a backend is. Prompts that share a prefix return to the node holding their cache, and semantic routing sends coding questions one way and chat another using example prompts you write. API keys carry per-model grants, rate limits, and token or spend budgets, and the management console shows traffic, usage and spend, an append-only audit log, and a fleet topology. Failures fall through to the next target before a byte reaches the caller, and an admission gate turns a flooded engine into a bounded queue. An MCP gateway and an A2A agent endpoint put tool servers and agents behind the same address. Existing LiteLLM configs import unchanged. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Deploy
Unkey screenshot thumbnail

Unkey

Unkey is the open-source platform that unifies API key management, rate limiting, deployment, and observability into a single control plane. The Go API service validates keys with sub-millisecond latency using regional Redis caches and MySQL 8.0 persistent storage, while ClickHouse captures every verification event for per-key and per-keyspace analytics with filterable time-series charts, request counters, and active key tracking. Keyspaces organize API keys by product, environment, or tier, each configurable with custom prefixes, byte lengths, IP whitelists, encrypted key recovery, and delete protection. Per-key settings include expiration dates, rate limit quotas with configurable windows, RBAC roles and permissions, owner identities linking multiple keys to a single user or organization, and key rotation with grace periods from immediate revocation through 24-hour overlap. The deployment pipeline connects GitHub repositories for automatic Docker container builds, generates preview environments per commit, promotes tested versions to production, and validates releases with OpenAPI diff detection flagging breaking changes before production. The edge gateway authenticates and rate-limits requests at the closest region before routing to the nearest API instance. Immutable audit logs track every key creation, verification, deletion, and configuration change with actor, timestamp, and event metadata. The CLI provides terminal access to key management, analytics queries, and deployment operations. On RepoCloud, deploy Unkey on a dedicated VPS with Docker, root SSH access, and complete control over your API infrastructure, all under the AGPL license.

Deploy