And why can't CloudFlare offer some way for us lowly non-AI's to prove we're human, once, for our entire web experience, versus on. every. damned. website. one. at. a. time?
So like a tracking cookie? Not a great idea for privacy, we've been there before...
Also, the reason is that if that worked, then the scrapers would just need to use a human to pass turnstile once, and then let their scraper run wild for the rest of the day, defeating the entire purpose of it.
None of this would be issue if the AI scrapers would just actually follow robots.txt, but they won't, so here we are :(