PullMD
PullMD turns any URL or file you point it at into clean Markdown your AI agent can actually afford to read. Paste a web page and get back tidy body text with metadata tucked into frontmatter instead of navigation soup and cookie banners. Send it a Reddit or Hacker News thread and it returns the full comment tree with depth and count under your control. Hand it a PDF, Word file, PowerPoint, spreadsheet, or EPUB and it hands back Markdown, with an optional OCR tier for stubborn table-heavy documents. YouTube links come back as title, description, and a transcript with clickable timecodes, no API key required. The query-scoped mode answers a question about a long page by returning only the relevant sections, typically cutting 70 to 95 percent of the tokens. Every conversion gets a short share link that re-fetches the source when it goes stale and serves the last good snapshot if the original dies. Agents connect through the built-in MCP server with OAuth 2.1, a plain REST API, or a downloadable Claude Code skill, while you keep history, an archive, and cache statistics in the web app. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.
Pagesift
Pagesift converts messy web pages, PDFs, and Office documents into clean Markdown and structured JSON that language models can actually use, from one self-hosted binary you run yourself. Call it the way you already call Firecrawl: the HTTP API speaks the Firecrawl v1 and v2 formats, so existing scrape, crawl, and batch jobs point at your server instead, and a Jina Reader style endpoint answers simple /r/ URL requests. Scrape a single page, submit batches, or crawl whole sites with sitemap support, focused crawling by query, robots.txt respect, and per-host rate limits by default. Headless rendering kicks in only when a page needs JavaScript, keeping plain pages fast. Documents work offline too: Word, Excel, PowerPoint, EPUB, and CSV files become Markdown with titles, links, images, and publication metadata attached. Jobs persist so long crawls survive restarts, webhooks report completions, and per-API-key limits and quotas keep multi-tenant use civilized, with Prometheus metrics and a health endpoint for operators. AI agents can drive the same engine directly through the bundled MCP server over stdio or HTTP, while developers get Python, Node, and Rust libraries. Memory stays bounded under load by design, sized from container limits rather than hope. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.