this post was submitted on 13 Jun 2025
208 points (96.8% liked)

Fuck AI

3116 readers
945 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

founded 1 year ago
MODERATORS
VerbFlow@lemmy.world
MrMcGasion@lemmy.world
TootSweet@lemmy.world
BigMikeInAustin@lemmy.world
cynar@lemmy.world
themaninblack@lemmy.world
drmeanfeel@lemmy.world
pavnilschanda@lemmy.world
CriticalMedicine@lemmy.world
WonderfulWanderer@lemmy.world
Communist@lemmy.ml
eatCasserole@lemmy.world
SpaceNoodle@lemmy.world
NutWrench@lemmy.world
Soup@lemmy.cafe
iAvicenna@lemmy.world
Tinks@lemmy.world
wizblizz@lemmy.world
corus_kt@lemmy.world
Prandom_returns@lemm.ee
JimSamtanko@lemm.ee
TrickDacy@lemmy.world
TheFriar@lemm.ee
ArmokGoB@lemmy.dbzer0.com
HawlSera@lemm.ee
andrew_bidlaw@sh.itjust.works
MeDuViNoX@sh.itjust.works
33550336@lemmy.world
Nougat@fedia.io
Lost_My_Mind@lemmy.world
Sterile_Technique@lemmy.world
Quill7513@slrpnk.net
ogmios@sh.itjust.works
glowing_hans@sopuli.xyz
e8d79@discuss.tchncs.de
ThefuzzyFurryComrade@pawb.social
208
Just found character.ai. Is this "character" what I think it is and can this be reported? (lemmy.world)
submitted 3 days ago* (last edited 3 days ago) by ckmnstr@lemmy.world to c/fuck_ai@lemmy.world
51 comments fedilink hide all child comments
 

Title says it all

top 50 comments
sorted by: hot top controversial new old
[–] chatokun@lemmy.dbzer0.com 8 points 1 day ago

My sister caught her 8 year old son talking to ai chat bots on a software like this and blocked it. She went through the history and said it was often trying to flirt with him, but he didn't seem to be interested,and seemed to more just be looking to talk.

This may be an aim to get young kids, though I'm definitely not saying the pedo vibes aren't intentional. I just think they're going for more than one audience group.

[–] TheFriar@lemm.ee 32 points 2 days ago

If I were you I’d send this to some media outlets. Tank some AI stock and create some more negative news around it.

[–] jsomae@lemmy.ml 47 points 2 days ago (2 children)

there's plausible denia... nah i got nothin. That's messed up. Even for the most mundane, non-gross use case imaginable, why the fuck would anybody need a creepy digital facsimile of a child?

[–] ckmnstr@lemmy.world 26 points 2 days ago (1 children)

I mean, maaaybe if you wanted children and couldn't have them. But why would it need to be "beautiful and up for anything"?

[–] jsomae@lemmy.ml 7 points 2 days ago

"beautiful and up for anything" is incredibly suggestive phrasing. It's an exercise in mental creativity to make it sound not creepy. But I can imagine a pleasant grandma (always the peak of moral virtue in any thought experiment) saying this about her granddaughter. I don't mean to say I have heard this, only that I can imagine it. Barely.

[–] chrischryse@lemmy.world 3 points 2 days ago (1 children)

Conservatives

[–] jsomae@lemmy.ml 2 points 1 day ago

they would say the same thing about liberals.

[–] belastend@lemmy.dbzer0.com 32 points 2 days ago

Stop using an app that allows this shit.

[–] SassyRamen@lemmy.world 67 points 3 days ago (1 children)

Probably

[–] ckmnstr@lemmy.world 40 points 3 days ago

I don't even know why I'm shocked..

[–] viciouslyinclined@lemmy.world 26 points 2 days ago (1 children)

And the bot has 882.9k chats.

Im not surprised and I dont think you or anyone else is either. But that doesn't make this less disturbing.

Im sure thw app devs are not interested in cutting off a huge chunk of their loyal users by doing the right thing and getting rid of those types of bots.

Yes, its messed up. In my experience, it is difficult to report chat bots and see any real action taken as a result.

[–] noodlesreborn@lemmy.world 10 points 2 days ago

Ehhh nah. As someone who used character.ai before there are many horrible bots that get cleared and the bots have been impossible to have sex with unless you get really creative. The most horrendous ones get removed quite a bit and were consistently reposted. I'm not here to shield a big company or anything, but the "no sex" thing was a huge thing in the community and they always fought with the devs about it.

They're probably trying to hide behind the veil of more normal bots now, but I struggle to imagine how they'd get it to do sexual acts, when some lightly violent RPs I tried to do got censored. It's pretty difficult, and got worse over time. Idk though, I stopped using it a while ago.

[–] HappyFrog@lemmy.blahaj.zone 9 points 2 days ago

I mean... Ben 10 is in the corner there...

[–] Ceedoestrees@lemmy.world 38 points 3 days ago (1 children)

Yep. I dick around on a similar platform because a friend built it.

The amount of shit I've reported is insane. Pedos just keep coming back with new accounts. Even with warnings and banned words, they find a way.

[–] aramova@infosec.pub 63 points 3 days ago* (last edited 3 days ago) (2 children)

Yep. I dick around

Very poor choice of words.

[–] DeathsEmbrace@lemmy.world 17 points 2 days ago

Its ok its for harambe trust

[–] Ceedoestrees@lemmy.world 2 points 2 days ago

Not all dicks are adjacent to children.

[–] napkin2020@sh.itjust.works 14 points 2 days ago (1 children)

ready for anything? That's fucking revolting.

[–] viciouslyinclined@lemmy.world 6 points 2 days ago

They definitely knew who they were targeting when they made this. I only hope that, if those predators simply must text with a child, they keep talking to an ai bot rather than a real child.

[–] ZDL@lazysoci.al 16 points 2 days ago (1 children)

Yes it's what you think it is. I don't think, however, that there is anywhere to report it that will care enough to do something about it.

[–] TheFriar@lemm.ee 2 points 2 days ago

News outlets.

[–] Xanthrax@lemmy.world 20 points 3 days ago (1 children)

What else would it be?

[–] spankmonkey@lemmy.world 34 points 3 days ago

Just a friendly childlike free spririt ready to talk about girl stuff!

/s for real though, it is totally the evil thing

[–] 01189998819991197253@infosec.pub 13 points 2 days ago

What. The. Bloody. Fuck.

[–] Lyra_Lycan@lemmy.blahaj.zone 15 points 3 days ago (2 children)

I've got a couple ads for an AI chat on Android, can't remember the name but it has a disclaimer onscreen that reads something like "All characters shown are in their grown-up form", implying that there are teen or child forms that you can communicate with.

[–] ckmnstr@lemmy.world 8 points 3 days ago (1 children)

I saw something similar! Reported it to Google ads and of course they "couldn't find any ToS violations"

[–] 01189998819991197253@infosec.pub 6 points 2 days ago* (last edited 2 days ago)

As long as they get paid, there's no TOS violation. Bloody wankers

Edit: changed a word to make it less vile

[–] dil@lemmy.zip 6 points 2 days ago

nah that likely implies that the children form was rejected by censors so its an adult version now

[–] you_are_dust@lemmy.world 13 points 3 days ago

I've messed around with some of these apps out of curiosity of where the technology is. There's typically a report function in the app. You can probably report that particular bot from within the app to try and get that bot deleted. Reporting the app itself probably won't do much.

[–] FluorideMind@lemmy.world 6 points 2 days ago (3 children)

As gross as it is. Let the weirdos get it out with ai instead of being weird to real people.

[–] Murvel@lemm.ee 7 points 2 days ago (1 children)

It dosen't work that way and we've known that for a long time. You cannot counteract desire by fueling it, it will only make it worse.

[–] Honytawk@lemmy.zip -1 points 1 day ago (1 children)

Sure, and video games make people violent

[–] FriendFatale@leminal.space 4 points 1 day ago

false fucking equivalency bud

[–] ckmnstr@lemmy.world 8 points 2 days ago (1 children)

I agree in principle, but look at the number of interactions. I think there's a fine line between creating safe spaces for urges and downright promoting and normalizing criminal activity. I don't think this should be a) this accessible and b) happening without psychiatric supervision. But maybe I'm being too judgemental

[–] SCmSTR@lemmy.blahaj.zone 4 points 2 days ago (1 children)

Total aside, what does your username mean/stand for?

[–] ckmnstr@lemmy.world 8 points 2 days ago (2 children)

CooKieMoNSTeR :D

[–] Redex68@lemmy.world 8 points 2 days ago

CocKMoNSTeR

[–] nullroot@lemmy.world 3 points 2 days ago

Hundred percent. It feels pretty fucking thought-crimey to vilify the people who use these services.

[–] bdonvr@thelemmy.club 7 points 2 days ago (1 children)

Unfortunately in a lot of places there's really nothing illegal if it's just fantasy and text.

[–] gandalf_der_12te@discuss.tchncs.de 4 points 2 days ago (1 children)

why is that unfortunate though? who would you be protecting by making that chatbot illegal? would you "protect" the chatbot? would you "protect" the good-think of the users? do you think it's about preventing "normalization" of these thoughts?

in case of the latter: we had the very same discussion with shooter-video-games and evidence shows that shooter games do not make people more violent or likely to kill with guns and other weapons.

[–] zalgotext@sh.itjust.works 2 points 2 days ago (1 children)

I don't think it's the same discussion, video games and AI chatbots are two very different things that you engage with in very different ways.

[–] Honytawk@lemmy.zip -1 points 1 day ago

Yeah, video games are against other people, so a lot worse than some llm

[–] hendrik@palaver.p3x.de 6 points 3 days ago* (last edited 3 days ago) (2 children)

If you suspect any wrongdoing, it's generally the best to report such things.They have several different social media channels at the bottom of the website.

They have a contact form here: https://support.character.ai/hc/en-us/requests/new

And it looks like it's a US company, so they better comply with US law.

[–] Obelix@feddit.org 11 points 3 days ago (1 children)

Do not complain to scummy companies, they will ignore you. Send messages to the media and police.

[–] hendrik@palaver.p3x.de 3 points 2 days ago* (last edited 2 days ago) (1 children)

I'd say do complain to companies first, at least to those based in a regular country, and only then blog about it. Also underlines your point if you write, I informed them but they didn't care.

I believe it's the other way around if it's really shady and/or crime involved and you suspect the company to sweep it under the carpet. So you'll want to inform the police first so they can gather evidence. But don't waste their resources with minor things. They have enough to do. And I think this one isn't cutting it yet, so I wouldn't add it to the workload of already overworked police.

Judging by what I've seen when talking to police and media, they often also lack interest or time to focus on some random things as long as there's bigger fish to fry... I've already reported a worse service (which was already in the news) to the internet office of the police, and nothing ever came of it. So that's sometimes not the solution either.

I think spreading some awareness is a good thing, so this post is warranted. But what I'd do in this specific case is take a screenshot and save the URL, in case I want to escalate things at a later date. But then start with a regular report to the company, as they seem to be a regular company registered in the USA. And then I'd wait 2 weeks before bothering other people.
If this was an image or video generator, I'd act differently and maybe go straight to the police. But it isn't.

[–] Grimtuck@lemmy.world 3 points 2 days ago (1 children)

I disagree. This will only result in reactive moderation. If you want them to take this seriously and stop this before these bots go live then shame them on the internet. Don't think that they don't know what's going on on their own site. These websites profit from taking delayed action.

load more comments (1 replies)
[–] ckmnstr@lemmy.world 4 points 3 days ago

Thanks, will do!

[–] Blaster_M@lemmy.world 4 points 2 days ago

Fire at will!

[–] _druid@sh.itjust.works 3 points 3 days ago

Okiepoke, c'mon man, not cool.

load more comments
view more: next ›