Worker or JS tag
Cloudflare Worker (recommended) or a simple JS tag. Same four fields into the same Feed.
Crawl visibility at the edge — four fields, no full log dumps. Free to signup, no credit card.
URL, IP, user-agent, timestamp. Enough to verify a bot and know when it hit. Nothing else.
Cloudflare Worker (recommended) or a simple JS tag. Same four fields into the same Feed.
Googlebot and other crawlers, checked against published IP ranges when we can. Spoofs get called out.
Unlimited domains, rolling 7-day Feed, Bots/URLs summary. Upgrade a domain when you need full Bots and URLs.
Useful bot data meant waiting on IT and sitting on PII. CrawlerLogs is the thin version: four fields at the edge, verified when we can, no dump.
Built by John Murch · johnmurch.com · @johnmurch