Google-Extended isn't a crawler. Why our fetcher honours it anyway

Disclosure: we're Hybrid Forge Lab and we built Distill, the URL-to-Markdown API in this post....