194
Copilot AI calls journalist a child abuser, Microsoft tries to launder responsibility
(pivot-to-ai.com)
this post was submitted on 23 Aug 2024
194 points (100.0% liked)
TechTakes
1432 readers
102 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Highly unlikely. This is what corporation's public facing products can do.
are there mechanisms known to researchers that Microsoft’s not using that can prevent this type of failure case in an LLM without resorting to whack-a-mole with a regex?
Yeah there's already a lot of this in play.
You run the same query multiple times through multiple models and do a web search looking for conflicting data.
I've had copilot answer a query, then erase the output and tell me it couldn't answer it after about 5 seconds.
I've also seen responses contradict themselves later paragraphs saying there are other points of view.
It would be a simple matter to have it summarize the output it's about to give you and dump the output of it paints the subject in a negative light.
Exactly, and all of this is a simple matter of having multiple models trained on different instances of the entire public internet and determining whether their outputs contradict each other or a web search.
I wonder how they prevented search engine results from contradicting data found through web search before LLMs became a thing?
They didn't really have to before LLM. Search engine results, in the heyday we're backlink driven. You could absolutely search disinformation and find it. But if you searched for a credible article on someone, chances are more people would have links to the good article than the disinformation. However, conspiracy theories often leaked through into search results. And in that case they just gave you the web pages and you had to decide for yourself.
No shit. Maybe they should just get rid of the extra bullshit generator and serve the sources instead of piling more LLM on the problem that only exists because of it.
this naive revisionist shit still standing in ignorance of easily 15y+ of SEO-fuckery (first for influence, and then for spam) is hilarious