Anakin screenshot thumbnail

Anakin

Backed by Y Combinator and powering scraping infrastructure across 195 countries, Anakin delivers a production-grade web scraping API purpose-built for AI agents and RAG pipelines that need clean, structured data from sites that actively block conventional scrapers. The single Go binary server handles JavaScript-heavy SPAs through its Camoufox anti-detect browser service with automatic fingerprint rotation, while the HTTP-first handler chain tries lightweight extraction before escalating to full browser rendering — keeping response times under 2 seconds for static pages. The built-in React 19 dashboard provides visual scraping with live results, job tracking with status filters, domain configuration management with handler chain CRUD, and proxy performance monitoring via Thompson Sampling scoring. Structured JSON extraction leverages Gemini AI to transform raw HTML into typed schemas without manual selector maintenance. SDKs span Python, TypeScript, Go, .NET, Java, and Ruby, while the MCP server exposes all 21 tools directly to Claude, Cursor, Windsurf, and any Model Context Protocol-compatible agent. The hosted platform extends the open-source engine with AI web search returning full page content with citations, multi-source agentic research across 20+ sources per query, Wire pre-built actions covering 944 websites with 5,201 structured endpoints, persistent browser sessions for authenticated scraping, and website change monitoring with scheduled alerts. Deploy via Docker Compose with three containers or run the binary directly with optional PostgreSQL persistence. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Deploy
Knowhere screenshot thumbnail

Knowhere

With 2,600+ GitHub stars since its May 2026 open-source launch, Knowhere solves the last-mile problem of document intelligence for AI systems — transforming complex unstructured PDFs, reports, and multi-page documents into structured JSON chunks that LLMs can consume without hallucination. The platform processes documents through an AI-native parsing pipeline that handles 20+ page documents with deep hierarchies, intricate tables, and multimodal content including images with OCR, achieving 95% precision in information extraction while reducing token costs by 50% compared to raw document ingestion. The knowledge tree architecture maintains historical context across multiple documents, enabling cross-document graph navigation for agentic retrieval that goes beyond simple chunk-based RAG. Built on Python 3.11+ with MinerU as the default PDF parser, the backend API runs alongside async workers that process document ingestion, graph construction, and embedding generation. The self-hosted Docker Compose stack packages the API server, processing workers, and Next.js dashboard for managing API keys, webhooks, and document-processing jobs, backed by PostgreSQL and Redis. Both Python and Node.js SDKs provide programmatic access for integration into existing AI pipelines and agent frameworks. LLM providers include DeepSeek and Alibaba Cloud DashScope with configurable key rotation for rate-limit management. Deploy on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Deploy
CRW screenshot thumbnail

CRW

CRW gives your apps and AI agents a private web data API that scrapes pages, crawls sites, maps links, and searches the web without sending every request to a hosted scraping service. Post a URL to the scrape endpoint and receive clean Markdown, HTML, screenshots, links, or structured JSON shaped by a schema you supply. Start a crawl when a whole section matters, then poll for progress while CRW walks pages asynchronously and returns the collected content in one job. Use map first to discover the URLs on a site before spending effort extracting pages you do not need. Connect agent tools through the MCP endpoint so assistants can search, scrape, and crawl from the same self-hosted service your applications call. Add browser rendering when JavaScript-heavy pages hide content from a plain HTTP fetch, and keep simpler pages on the fast lightweight path. Protect a public deployment with Bearer token authentication, your own reverse proxy, logging, and rate limits, or keep the service inside a private network for internal tools. Run one Docker container for the core API, or use the Compose stack when you want bundled search and rendering sidecars beside it. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Deploy
CyberScraper 2077 screenshot thumbnail

CyberScraper 2077

With 3,100+ GitHub stars, CyberScraper 2077 replaces brittle CSS selectors and XPath queries with natural language data extraction powered by Large Language Models. Users paste a URL, describe the data they want in plain English, and the AI extracts structured results from any website — no HTML parsing knowledge required. The tool supports three LLM backends: OpenAI GPT models for maximum accuracy, Google Gemini for cost-effective extraction, and local Ollama instances for fully private scraping where URLs and data never leave your server. Built on Python asyncio with Playwright browser automation, it handles concurrent page fetching with content-based and query-based LRU caching to minimize redundant API calls. The Streamlit web interface runs on port 8501 and provides one-click export to JSON, CSV, HTML, SQL, Excel, and direct Google Sheets upload. Tor network integration routes requests through onion routing for anonymous scraping of both clearnet and .onion hidden service sites with automatic circuit management and stream isolation. Stealth mode randomizes user agents, manages cookies, and controls JavaScript execution timing to bypass bot detection systems. Multi-page scraping navigates through paginated results with automatic URL pattern detection. Docker deployment packages all dependencies including Playwright browsers into a single container. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
HeadlessX screenshot thumbnail

HeadlessX

With 2,000 GitHub stars and 10 releases since its September 2025 launch, HeadlessX delivers a self-hosted browser automation platform that replaces Chromium-based scraping with Camoufox — a Firefox fork performing kernel-level fingerprint spoofing to achieve 0% detection across Cloudflare, DataDome, PerimeterX, and other anti-bot systems where Puppeteer and Playwright regularly fail. The web dashboard provides workspace-based job organization with a visual interface for configuring scrape targets, managing browser profiles, monitoring queue status, and viewing extracted results in real time. The protected REST API accepts requests with API key authentication for programmatic access, supporting HTML extraction, screenshot capture, PDF generation, and structured data parsing with configurable stealth parameters. Profile-based scraping maintains persistent browser contexts with cookie jars, localStorage, and fingerprint configurations that survive between requests — reducing cold-start latency from 25 seconds to under 2 seconds on subsequent requests. Queue-backed workflows enable batch processing of URLs with configurable concurrency, retry logic, and webhook notifications on completion. The Google AI Search integration provides AI-assisted web research workflows through dedicated endpoints. Remote MCP support exposes automation capabilities as tool endpoints for AI agent integration. Deploy via the official CLI with `headlessx init` and `headlessx start` commands, scaffolding a Docker Compose stack with Caddy reverse proxy for automatic HTTPS. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
Firecrawl screenshot thumbnail

Firecrawl

With over 164,000 GitHub stars and one of the fastest-growing open-source projects in the AI tooling ecosystem, Firecrawl is the web context API that turns any website into clean markdown, structured JSON, or screenshots optimized for large language models. The Scrape endpoint converts a single URL into LLM-ready output with approximately 67% fewer tokens than raw HTML, handling JavaScript rendering, rotating proxies, anti-bot bypasses, and dynamic content extraction with zero configuration. The Crawl endpoint recursively scrapes entire websites from a single request with configurable depth, URL filters, and concurrent page limits. The Map endpoint discovers all URLs on a domain instantly for sitemap generation. The Search endpoint performs web searches and returns full page content from results. The Interact endpoint scrapes a page then continues working with it — clicking buttons, filling forms, and extracting dynamic content using AI prompts or code. The Agent endpoint provides autonomous web data gathering where users describe what they need in plain English. SDKs are available for Python, Node.js, Go, Rust, Ruby, PHP, Java, C#/.NET, and Elixir, with an MCP server for connecting to any AI agent or MCP client. Self-hosting deploys via Docker Compose and requires Redis and a Playwright-based browser service for JavaScript rendering. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Deploy
Obscura screenshot thumbnail

Obscura

Obscura is the headless browser you point Puppeteer or Playwright at when Chromium feels like renting a truck to fetch a letter. Start the server and your existing automation connects over the usual DevTools protocol, opens pages, clicks, types, waits for selectors, and reads the fully rendered result, JavaScript included. Scrape one page or fan out across many in parallel, evaluating an expression on each and getting structured output back. Capture viewport or full-page screenshots, export PDFs, intercept requests to block or rewrite them, and manage cookies and headers per session. An MCP mode lets AI agents drive the browser as a tool instead of shelling out to scripts. Stealth mode randomizes fingerprints per session, presents realistic browser identity signals, and blocks thousands of known tracker domains before they load. Proxies, persistent storage for cookies and local storage, and robots handling round out the controls for longer crawls. The whole thing starts instantly and sips memory compared with a conventional headless Chrome, so a modest server can keep many more pages in flight. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Deploy
Maxun screenshot thumbnail

Maxun

With over 16,800 GitHub stars and growing rapidly, Maxun has become the go-to open-source platform for teams who need structured web data without writing scrapers. The TypeScript-based platform provides a no-code visual recorder that captures point-and-click interactions in real-time browser sync, automatically generating reusable extraction robots that handle pagination, infinite scrolling, and dynamic content. LLM-powered extraction accepts natural language prompts like "Extract 10 companies from the Y Combinator website" without requiring a URL — Maxun identifies the source and performs the extraction autonomously. The platform handles authentication-protected pages, adapts automatically to website layout changes through self-healing selectors, and exports directly to Google Sheets, Airtable, or any destination via webhooks. Robots run on configurable schedules with cron-based timing, turning any website into a perpetually fresh RESTful API endpoint. The crawl engine discovers and processes linked pages across entire domains with configurable depth and URL filtering, while the search capability runs automated queries across multiple engines. Official Node.js and Python SDKs provide programmatic control over robot creation, execution, and data retrieval, with MCP integration enabling direct connection to AI tools like Claude. The n8n community node enables workflow automation without custom code. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPLv3 licensed.

Deploy
Douyin TikTok Download API screenshot thumbnail

Douyin TikTok Download API

Paste a Douyin, TikTok, or Bilibili link and get back clean structured data plus a watermark-free download, all from a server you own. The playground in the web console parses a shared link into normalized post, author, comment, sound, and hashtag data, and the same call is available through a REST API with 126 operations for scripts and pipelines. Downloads select the clean stream the platform already publishes, including the clip behind a Douyin live photo, and finished videos can be transcribed offline into Mandarin text with punctuation, without any speech API. Collected posts are archived in PostgreSQL, so material deleted upstream stays readable in your own library. A self-maintaining identity pool mints guest identities on a timer, tests and cools them automatically, and tracks live health scores for every identity and endpoint, with circuit breakers tripping before risk controls burn the pool. Scheduling, request logs, download progress from the Go sidecar, and multi-part Bilibili downloads are all managed from the console. AI agents can drive the whole service over MCP, calling the same service layer as the API and the dtk command line instead of a wrapper. Request signing for each platform is implemented natively, short links are expanded against an allowlist before fetching, and one Docker Compose command starts the stack. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache License 2.0 licensed.

Deploy
Google Maps Scraper screenshot thumbnail

Google Maps Scraper

The leading open-source tool for extracting business leads from Google Maps at production scale. The Go-based engine processes approximately 120 places per minute with optimized concurrency, extracting 33+ data points per listing including business name, address, phone number, website URL, rating, review count, latitude and longitude, opening hours, price level, and optionally crawling business websites for email addresses. Three interfaces serve different workflows: the CLI accepts query files for cron jobs and CI/CD pipelines with output to CSV, JSON, PostgreSQL, S3, or LeadsDB; the Web UI provides a browser-based dashboard with real-time job monitoring, a map view of scraped places, and interactive query submission; and the REST API at /api/v1 enables programmatic integration with full Swagger documentation at /api/docs. Built-in proxy rotation supports SOCKS5, HTTP, and HTTPS with authentication for large-scale runs, while the architecture scales from a laptop to Kubernetes clusters with queue-based worker distribution. The SaaS edition adds multi-user access with API key management, admin UI with 2FA, job queue orchestration, and one-command cloud deployment via an interactive wizard. An AI Agent Skill enables coding agents to run scrapes programmatically. Deploy via Docker or build from source requiring Go 1.26.5+. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
Docling Studio screenshot thumbnail

Docling Studio

Docling Studio shows you exactly what a document parser sees, drawing a colored box around every title, paragraph, table, and picture it extracts from your PDFs. Import a PDF, run an analysis, and the result opens with three linked panels: the document tree on the left, the paged preview in the center, and the selected element on the right with its type, page, position, and text or table. Click any box on the page and the same element lights up in the tree and properties panel as other boxes fade away. The layers bar counts each element type and toggles boxes per type, or hides them all to reveal the bare page. You can analyze several documents at once from the list, watch progress percentages on long files, and queue work three analyses at a time. Ask a question and a local model answers from the document, with a reasoning timeline that links each step back to the passage it read. Finished results download as the original PDF, clean Markdown, or Docling JSON for downstream pipelines. AI agents connect over MCP to read and cite your documents, and an optional connection to your own Docling Serve server handles heavier parsing loads. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy