Why is nobody talking about how broken web scraping is for AI agents right now?
I thought I was being smart building an AI competitor analysis tool. I hooked up Puppeteer to scrape pricing pages, but I didn't realize target sites had updated their bot protection. My scraper got caught in an infinite Cloudflare Turnstile captch…