pagesift-policy v0.12.1 — Polite crawling for pagesift: RFC 9309 robots.txt, per-host rate limits, adaptive backoff and unified error codes.

Sign in to join the discussion — your thebay.events account works here.