this post was submitted on 07 Mar 2025
25 points (100.0% liked)
TechTakes
1675 readers
48 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
This is pure gut instinct, but I suspect this is gonna prompt an uptick in Google crawlers getting blocked. Mainly because Google just removed any real reason for people not to block them.
nah, not yet, imo. reasons: you overestimate how much & how many people care, and the complexities of doing such blocks well
I run the hosting of some small (by global standards) media setups and I've floated crawler defense there and had fairly little bite so far despite the issues the crawlers have caused. engagement brain is still extremely fucking prevalent
using it to source data in the meantime. I can tell you with absolute certainty that openai lies about its sourcing