this post was submitted on 14 Aug 2023
83 points (100.0% liked)
Technology
37717 readers
406 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
There's no need to wait for a sentient AI for that. I mean, the current publicized method for blocking these bots is via robots.txt, which is only a very polite way of asking bots to duck off - they really have no reason to respect it, if they wanted to. OpenAI (or anyone else) could also use multiple public proxy servers for scraping, so websites won't be able to point fingers at them. Even if the bot makers avoid using proxies, they could still get the content indirectly by scraping other sites which repost the content, such as archive.org or even just normal sites which repost stuff. Heck, they could scrape off say, Lemmy indirectly, for instance we've got the AutoTLDR bot here, combine that with comments and quotes from several people, and any competent LLM could easily learn the content of the original article without even having to directly touch it.
So unless the site has posted a 100% unique piece of information, which hasn't been published anywhere else, AND they've also implemented a strict "no reproduction in any form" rule that also extends to prohibiting any discussion of the source material, it would be near-impossible to stop or blame the bot creators of bypassing ToS. And we all know what happens when you go to great lengths to try and silence a subject matter on the internet...