Conductor screenshot thumbnail

Conductor

Originally built at Netflix to orchestrate microservices powering 230 million subscribers and now trusted in production at Tesla, LinkedIn, and J.P. Morgan, Conductor is the most battle-tested open-source workflow engine available — with 32,000 GitHub stars and horizontal scalability to billions of executions. The architecture cleanly separates orchestration from business logic: workflows are defined in declarative JSON while workers execute tasks in any of seven supported languages (Java, Python, Go, JavaScript, C#, Ruby, Rust) with zero framework constraints. Durable execution persists every state transition, enabling automatic retries, configurable timeouts, crash recovery, and instant replay from any failure point without re-executing completed tasks. Native AI agent orchestration supports 14+ LLM providers (Anthropic, OpenAI, Google Gemini, AWS Bedrock, Mistral, Cohere, HuggingFace, Ollama), MCP tool calling, function calling, human-in-the-loop approval gates, and vector database integration (Pinecone, pgvector, MongoDB Atlas) for RAG pipelines. Deploy with your choice of five persistence backends (PostgreSQL, Redis, MySQL, Cassandra, SQLite), six message brokers, and Elasticsearch or OpenSearch for workflow indexing — all configurable via Docker Compose files included in the repository. The built-in web UI provides workflow visualization, execution monitoring, task queue inspection, and manual intervention controls. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Deploy
Hatchet screenshot thumbnail

Hatchet

Processing over one billion tasks per month on Hatchet Cloud and holding 7,600+ GitHub stars, Hatchet is the open-source orchestration engine that replaces fragile legacy queues with durable, fault-tolerant task execution built entirely on PostgreSQL — no Redis, RabbitMQ, or Kafka required. Born from the creators' experience scaling Uber's Cadence-inspired patterns, the v1 engine achieves 10,000 tasks per second sustained throughput with 20ms average queue latency through dynamic buffer flushing and batch insert optimization. Define tasks, durable workflows, and DAG pipelines as code using native SDKs for Python, TypeScript, Go, and Ruby — every function gets automatic retries with configurable backoff, concurrency control with group round robin or cancellation policies, priority queuing, and dynamic rate limiting for third-party API protection. Durable execution persists the complete history of every task and state transition, enabling replay from failure, debugging via full event timelines, and complex pause/resume conditions using durable sleep and event waits. The real-time web dashboard provides workflow run visualization with DAG timeline rendering, worker health monitoring with slot utilization, queue depth metrics, task throughput charts, and error rate tracking — all filterable by status, workflow, or time window. OpenTelemetry integration and Prometheus metrics export enable advanced observability. Multi-tenant by default with users, roles, and namespace isolation. Self-host via Docker Compose with PostgreSQL and optional RabbitMQ, or use the single-container Hatchet Lite image for development. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy