Merging overlapping scrape results without double counting: 1,869 rows in, 1,671 out

Most of my scraping jobs don't produce one clean dataset. They produce several that overlap: the same...