the.bay.news

Three ETL failure patterns I now write into the output file, not just the logs

DEV Community
Three ETL failure patterns I now write into the output file, not just the logs
After a Reddit scraper failed silently for 71 days, I added three self-reporting patterns to my market-listening ETL: sources_ok flags, an errors array, and a vacuous-true guard.

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.