Deploy Now

Stars

92

Forks

0

Watchers

0

Developer links

Geo-Monitor

Search is being answered by AI crawlers first and humans second, yet most site owners cannot name a single bot that read their pages last week; Geo-Monitor answers that from the access logs you already have. A small collector sits beside Nginx or OpenResty, mounts the log read-only, and streams only new lines in batches, resuming after outages and surviving log rotation without ever touching your site's code. The console separates today, the last week, and the last month into identified requests, crawled pages, active crawlers, and trend lines, then drills into every visit with time, path, method, status code, claimed identity, and verification state. Identification and verification are deliberately different things here: a user agent only proves what a request claims to be, while a verified badge requires trusted log addresses and official IP evidence to agree. Twenty built-in identities cover OpenAI, Anthropic, Perplexity, Kimi, and Bytespider crawlers, and you can add, edit, or disable rules as new bots appear. Your sitemap syncs or imports as the content catalog, so coverage views show which pages crawlers actually reached, and collector health exposes heartbeat, backlog, and parsing problems. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Geo-Monitor

Benefits

  • See Every Identified AI Visit
  • Overviews for today, seven days, and thirty days count identified requests, crawled pages, and active crawlers with trends, while detail views expose time, path, method, status, and identity per visit.
  • Verification, Not Just User Agents
  • A matching user agent only marks a claimed identity; verified status additionally requires trusted log addresses and official IP evidence, with missing, stale, or mismatched evidence shown as distinct states.
  • Coverage Against Your Sitemap
  • Sync a sitemap or import XML, CSV, or JSON catalogs, register www aliases, and compare the catalog against observed visits to see which pages AI crawlers actually reached.
  • Collector That Stays Out Of The Way
  • The independent collector mounts logs read-only, needs no inbound port, batches uploads, persists its position, retries through outages, handles rotation, and runs within a quarter-CPU, 128 MiB default budget.

Features

  • Visit Detail Explorer
  • Filter the visit stream by time, path, method, status code, crawler identity, and verification state, then export a bounded CSV for deeper analysis elsewhere.
  • Dynamic Crawler Rules
  • Twenty built-in HTTP identities ship with verification evidence, and administrators can add, edit, or disable rules and maintain the evidence as new crawlers appear.
  • Page Coverage Analysis
  • Page rankings and exact per-page detail compare your synced or imported content catalog against observed crawler visits, exposing popular targets and untouched pages alike.
  • Collector Health Watch
  • Independent heartbeats, last-received timestamps, backlog depth, parsing anomalies, and known collection gaps are displayed openly, so silent collection failure cannot masquerade as zero visits.
  • Privacy-Conscious Log Handling
  • Raw IPs stay in memory only for verification and are masked before persistence, detail retention defaults to thirty days, and the collector never copies the raw source log.

Apps Similar to Geo-Monitor