Don't Rate-Limit Googlebot Like a Proxy Farm: Route Crawlers by IP Signal

Your content and API edge sees two kinds of automation that look similar in the logs: search-engine...