Deploy Now

Stars

351

Forks

20

Watchers

1

Developer links

Redd-Archiver

Redd-Archiver builds you a private, permanent copy of Reddit's history: feed it public data dumps and it returns a browsable, full-text-searchable archive of the communities you choose. The source material is enormous and already public: the full Pushshift and Arctic Shift Reddit datasets hold over 2.38 billion posts from 40,000 subreddits, the complete Voat archive adds 3.81 million posts, and Ruqqus contributes another half million, all importable by community instead of wholesale. One import into PostgreSQL becomes three possible websites: a static export that runs on any host down to a USB stick, the default hybrid of static pages plus a live search server, or a fully dynamic site that renders straight from the database with flair, domain, score and date filters. Search understands keywords, subreddit, author, date and score operators, and the same archive answers scripts and AI agents through thirty-plus REST endpoints and an MCP server with 29 tools. Monthly Arctic Shift dumps keep everything current: updates import only your tracked subreddits, skip themselves by checksum when re-run, refresh scores, and never let a later deletion overwrite text you preserved. Subreddit rules, descriptions and wiki pages ride along with the posts, eleven themes restyle the result, and the whole thing can hide behind a Tor hidden service or stand on HTTPS with its own domain. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Unlicense licensed.

Redd-Archiver
Redd-Archiver
Redd-Archiver
Redd-Archiver
Redd-Archiver

Benefits

  • History That Cannot Vanish
  • Import once and the archive is yours: banned communities, deleted posts and dead platforms stay browsable because later deletions in monthly dumps never overwrite preserved text.
  • Search 2.4 Billion Posts
  • PostgreSQL full-text search with Google-style operators filters by keyword, subreddit, author, date and score across the full Pushshift and Arctic Shift Reddit datasets.
  • Three Ways To Serve
  • Export static HTML for any web host, run the hybrid nginx and Flask stack, or serve dynamically from PostgreSQL with live filters and instant imports.
  • Current, Automatically And Idempotently
  • Monthly Arctic Shift updates import only tracked subreddits, skip re-runs by SHA-256 checksum, refresh scores, and re-export just the listings that changed.

Features

  • Multi-Platform Dump Import
  • Reddit .zst JSON Lines, Voat SQL dumps and Ruqqus .7z archives are detected automatically by format, with per-subreddit selection and one canonical PostgreSQL store.
  • Full-Text Search Engine
  • PostgreSQL FTS indexes every post and comment with keyword, subreddit, author, date and score operators behind both the web UI and the REST API.
  • REST And MCP Access
  • More than 30 REST endpoints and an MCP server with 29 tools expose the archive to scripts, dashboards and AI agents over your own infrastructure.
  • Monthly Incremental Updates
  • Arctic Shift RS and RC dump pairs apply oldest-first through --update-all, tracked in an update_history table so cron runs are safe and idempotent.
  • Themes And Accessibility
  • Eleven operator-selectable palettes, mobile-first pages at roughly 13KB of gzipped CSS, and WCAG-compliant markup scoring 100 on Lighthouse accessibility audits.
  • Context Beyond Posts
  • Subreddit descriptions, rules and wiki pages import alongside posts; Voat subverses gain metadata, user profiles, moderator lists, flair and thumbnails automatically.

Apps Similar to Redd-Archiver