Capture less data
No cookies, bodies, or full logs. Just the four fields that prove a crawler showed up.
We keep URL, IP, user-agent, and timestamp. No cookies, bodies, or visitor profiles.
No cookies, bodies, or full logs. Just the four fields that prove a crawler showed up.
IP checks against published ranges. Spoofs stay labeled, not mixed into “verified.”
Last-crawled across URLs and domains — without server-log access.
Read the privacy policy and docs for the stored field list.