this post was submitted on 23 Mar 2025
767 points (97.8% liked)

Technology

68066 readers
4237 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

A Norwegian man said he was horrified to discover that ChatGPT outputs had falsely accused him of murdering his own children.

According to a complaint filed Thursday by European Union digital rights advocates Noyb, Arve Hjalmar Holmen decided to see what information ChatGPT might provide if a user searched his name. He was shocked when ChatGPT responded with outputs falsely claiming that he was sentenced to 21 years in prison as "a convicted criminal who murdered two of his children and attempted to murder his third son," a Noyb press release said.

you are viewing a single comment's thread
view the rest of the comments
[–] MagicShel@lemmy.zip 186 points 1 week ago (15 children)

It's AI. There's nothing to delete but the erroneous response. There is no database of facts to edit. It doesn't know fact from fiction, and the response is also very much skewed by the context of the query. I could easily get it to say the same about nearly any random name just by asking it about a bunch of family murders and then asking about a name it doesn't recognize. It is more likely to assume that person is in the same category as the others and if the one or more of the names have any association (real or fictional) with murder.

[–] bluGill@fedia.io 102 points 1 week ago (5 children)

I don't care why. That is still libel and it is illegal for good reason. if you can't stop this for all cases then you ai is and should be illegal.

[–] tfm@europe.pub 47 points 1 week ago (1 children)

None of the moneybags will listen, unfortunately. But I'm with you. The rollout of AI was extremely irresponsible. Just to make it profitable as quickly as possible.

[–] Flagstaff@programming.dev 10 points 1 week ago

To be fair, based on observations after these years, it doesn't appear that waiting longer before release would have significantly improved Autocomplete Idiocy in any way.

[–] MagicShel@lemmy.zip 20 points 1 week ago (2 children)

Seems to me libel would require AI to have credibility, which it does not.

It's a tool. Like most useful tools it can do harmful things. We know almost nothing about the provenance of this output. It could have been poisoned either accidentally or deliberately.

But above all, the problem is ignorant people believing the output of AI is truth. It's pretty good at some things, but the more esoteric the knowledge, the less reliable it is. It's best to treat AI as a storyteller. Yeah there are a lot of facts in there but when they don't serve the story they can be embellished. I don't see the harm in just acknowledging that and moving on.

[–] deur@feddit.nl 22 points 1 week ago (1 children)

Im not a lawyer but the most conclusive missing piece of what we commonly understand to be libel is the information has to be published.

[–] MagicShel@lemmy.zip 4 points 1 week ago

I thought about that.

The definition of publish could get a little murky here. Actually the best defense here is that, so far as we know, this was not disclosed to a third party by ChatGPT (that's pretty flimsy, though, because it likely has no idea who it is talking to.)

I acknowledge there is some level of nuance here, which is why I come back to no one should have any expectation that AI will be factual. The disclaimers are everywhere. There is really no excuse for anyone to treat the output as gospel.

[–] kibiz0r@midwest.social 20 points 1 week ago (1 children)

Meanwhile, AI vendors:

“AI will soon be the only way we access information and make decisions!”

and those marketers should get punished, not for spreading misinformation but for being marketers.

[–] ech@lemm.ee 16 points 1 week ago (1 children)

Except it's not libel. It's a one time string of text generated exclusively for him. Literally no one would have known what it said if the guy didn't get the exact thing he wants "deleted" published online for everyone to see. Now it'll be linked to his name forever, but the llm didn't do that.

It's been shown repeatedly that putting the same input into a gen AI will often get the same output, or extremely similar. So he has grounds to be concerned that anybody else asking the LLM about him would be getting the same libelous result.

[–] JohnEdwa@sopuli.xyz 12 points 1 week ago* (last edited 1 week ago)

Libel requires the claims to be published or broadcasted, so it isn't. A predictive text algorithm strung some random words together, and the guy got offended.
It's like suing because your phone keyboard autosuggested "is a murderer" as the next words after you wrote your name. Btw, I tried it a few times for lulz and managed to get it to write out "bluGill and the kids are going to get it on", so I guess you can sue Google now?

[–] Fjern@lemmy.world 6 points 1 week ago (1 children)

I read it as they aren't using libel as cause for their complaint but failure to comply with GDPR

load more comments (1 replies)
[–] surewhynotlem@lemmy.world 44 points 1 week ago (4 children)

I have this gun machine that shoots in all directions randomly. I can't predict it, so I can't stop it from shooting you. So sorry. It's uncontrollable.

[–] MagicShel@lemmy.zip 11 points 1 week ago (2 children)

Yeah but I can just ignore the bullets because they are nerf. And I have my own nerf guns as well.

I mean at some point any analogy fails, but AI is nothing like a gun.

[–] cecilkorik@lemmy.ca 12 points 1 week ago (3 children)

They may seem like nerf when they first come out of the AI, but they turn into real bullets once they start filling people's heads with convincing enough lies and falsehoods, and those people start wielding their own weapons against minorities, democracy, and the government. If the election of Trump 2.0 has not convinced you of the immense danger of disinformation and misinformation, I have literally no idea how anything could ever possibly get through to you.

[–] MagicShel@lemmy.zip 5 points 1 week ago* (last edited 1 week ago)

That doesn't really change anything. The internet is full of AI slop and just people outright lying. Nothing is reliable any more outside of the word of an actual expert.

This has been happening since before Trump. Hell Trump 45 was before the wave of truly capable AI.

AI doesn't change this at all except people ought to know they are getting info from a bullshit source if they are getting it from AI themselves.

load more comments (2 replies)
[–] surewhynotlem@lemmy.world 2 points 1 week ago (1 children)

AI is a thing people choose to host and are responsible for the outcomes of its use. The internal working and limitations of the machine do not make the owners less responsible.

[–] MagicShel@lemmy.zip 2 points 1 week ago (3 children)

Okay, so I agree with none of that, but you're saying as long as we host our own AI or rent our own processing from the cloud we're in the clear? I want to make sure that's your fundamental argument because that leaves all open models in the clear and frankly I could be down with that. I like AI but I'm not a huge fan of AI companies.

[–] SendPrudes@lemm.ee 4 points 1 week ago (1 children)

So insurance companies use AI to screen claims.

It denies a claim for life saving intervention - person dies. Who is responsible for that? Historically it would be the insurance company - and worker. Would it be them or the AI company?

Psych screening tools were using it to pre screen calls.

Ai tells the person to kill themselves - who is at fault if they do it. Psych screener would lose their job and their license. What and who is impacted if AI does it.

QA check on a car or product is passed by AI but should have failed.

Thousands die before the recall. Who is at fault for it? The Company leveraging AI. Or the AI itself?

[–] MagicShel@lemmy.zip 5 points 1 week ago (3 children)

Company using AI for that shit is responsible. There is no responsible way to remove a human from there process. These aren't reasonable uses of AI no matter how bad companies want to save money by not hiring.

load more comments (3 replies)
load more comments (2 replies)
[–] General_Effort@lemmy.world 10 points 1 week ago (3 children)

If creating text is like shooting bullets, we should require a license for text editors.

[–] Earflap@reddthat.com 6 points 1 week ago (1 children)

You can pry Vim from my cold, dead hands!

[–] ouRKaoS@lemmy.today 6 points 1 week ago

Can't exit it on your own?

load more comments (2 replies)
[–] michaelmrose@lemmy.world 7 points 1 week ago (4 children)

Maybe people need to learn that AI hallucinates

[–] Petter1@lemm.ee 5 points 1 week ago

Yea, I’m mind blown, how, after 3 years people still don’t know how to use LLM effectively in use cases they bring value (by reducing work time)

  • start a second chat and ask different to verify
  • if you use chatGPT reason feature, read reasoning output as well!
  • best search for verifiable thing, like code, that you can run or similar
  • if you use it for research, only trust the info, if it used web search and you have read the webpages it used to summarise as well, or use traditional web search to verify based on the output
  • it is great to manipulate text until sounds as desired (if you are not good in wording stuff anyway)
  • plan what steps to do in a project next (like “i want to do xxx have y and need it to be z, make me a list of todos)
  • and of course it is great to generate simple python scripts fast (I often use it as my python writing slave)

Using AI like this, helped me enormously in work and live Like, I learned a lot C, C++, how linux kernel modules work, how PO/POT works, helped me with translations, introduced me into music production, helped me set up appFlowy and general windows/linux issues.

[–] pyre@lemmy.world 5 points 1 week ago (1 children)

you misspelled "is fucking wrong all the goddamn time"

[–] michaelmrose@lemmy.world 4 points 1 week ago (3 children)

It would be more accurate to say that rather than knowing anything at all they have a model of the statistical relationship between a series of tokens and subsequent tokens which words are apt to follow other words and because the training set contains many true things the words produced in response to queries often contain true statements and almost always contain statements that LOOK like true statements.

Since it has no inherent model of the world to draw on and only such statistical relationships you should check anything important

load more comments (3 replies)
[–] BakerBagel@midwest.social 3 points 1 week ago (4 children)

So then what's the use of the program if it uses a bunch of energy to just make shit up?

[–] lime@feddit.nu 5 points 1 week ago

sometimes you need a machine that makes things up according to a given specification.

load more comments (3 replies)
[–] surewhynotlem@lemmy.world 2 points 1 week ago (1 children)

And when it hallucinates harmful things, protections need to be put onto the output.

[–] michaelmrose@lemmy.world 3 points 1 week ago (1 children)

Ok so explain particularly what this means

[–] surewhynotlem@lemmy.world 3 points 1 week ago (1 children)

If you have a service, and that service is generating things that harm people, you should have to stop it.

[–] michaelmrose@lemmy.world 3 points 1 week ago (1 children)

We value the gains both immediate and presumed more than the harm

load more comments (1 replies)
[–] BradleyUffner@lemmy.world 4 points 1 week ago

I have this gun machine that shoots in all directions randomly. I can't predict it, so I can't stop it from shooting you. So sorry. It's uncontrollable.

I'm sorry, as an American, I'm not seeing the problem. Don't you just need a second gun that shoots in random directions to stop the first gun? And then a third gun to shoot the 2nd gun? I mean come on now, this is basic 3rd grade common sense!

[–] HK65@sopuli.xyz 6 points 1 week ago (5 children)

From the GDPR's standpoint, I wonder if it's still personal information if it is made up bullshit. The thing is, this could have weird outcomes. Like for example, by the letter of the law, OpenAI might be liable for giving the same answer to the same query again.

[–] FiskFisk33@startrek.website 5 points 1 week ago (8 children)

then again

but it also mixed "clearly identifiable personal data"—such as the actual number and gender of Holmen's children and the name of his hometown—with the "fake information,"

The made up bullshit aside, this should be a quite clear indicator of an actual GDPR breach

load more comments (8 replies)
load more comments (4 replies)
[–] CosmoNova@lemmy.world 4 points 1 week ago* (last edited 1 week ago)

Which is why OpenAI should compensate anyone they have damaged in some way and yes that would mean it would cease to exist overnight. That‘s because a criminal organization shouldn‘t be profitable in the first place.

load more comments (11 replies)