this post was submitted on 25 Jan 2024
23 points (100.0% liked)

SneerClub

989 readers
3 users here now

Hurling ordure at the TREACLES, especially those closely related to LessWrong.

AI-Industrial-Complex grift is fine as long as it sufficiently relates to the AI doom from the TREACLES. (Though TechTakes may be more suitable.)

This is sneer club, not debate club. Unless it's amusing debate.

[Especially don't debate the race scientists, if any sneak in - we ban and delete them as unsuitable for the server.]

founded 1 year ago
MODERATORS
self@awful.systems
blakestacey@awful.systems
dgerard@awful.systems
23
Cultists Draw a Boogeyman on Cardboard, Become Afraid Of It (futurism.com)
submitted 10 months ago* (last edited 10 months ago) by skillissuer@discuss.tchncs.de to c/sneerclub@awful.systems
16 comments fedilink hide all child comments
 

cross-posted from: https://lemmy.world/post/11178564

Scientists Train AI to Be Evil, Find They Can't Reverse It::How hard would it be to train an AI model to be secretly evil? As it turns out, according to Anthropic researchers, not very.

you are viewing a single comment's thread
view the rest of the comments
[–] swlabr@awful.systems 10 points 10 months ago (1 children)

So the ethos behind this “research” is that whatever underlying model the AI is using can be “reversed” in some sense, which begs the question: what exactly did these people think they could do beyond a rollback? That they could beg the AI to stop being mean or something?

They were probably inspired by the blanka creation scene from the street fighter movie where they brainwash some guy by showing him video clips of bad stuff and then switch it to showing good stuff.

[–] skillissuer@discuss.tchncs.de 11 points 10 months ago* (last edited 10 months ago) (1 children)

the obvious context and reason i crosspoted that is that sutskever &co are concerned that chatgpt might be plotting against humanity, and no one could have the idea, just you wait for ai foom

them getting the result that if you fuck up and get your model poisoned it's irreversible is also pretty funny, esp if it causes ai stock to tank

[–] swlabr@awful.systems 9 points 10 months ago

to be read in the low bit cadence of SF2 Guile “ai doom!”

It’s not a huge surprise that these AI models that indiscriminately inhale a bunch of ill-gotten inputs are prone to poisoning. Fingers crossed that it makes the number go down!