pagesift-frontier v0.90.0 — pagesift crawl frontier and focused-crawl scoring: deduplication, URL traps, link scoring, stop rules.

Sign in to join the discussion — your thebay.events account works here.