this post was submitted on 30 Jan 2025
77 points (95.3% liked)

TechTakes

1590 readers
328 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS
 

So I was just reading this thread about deepseek refusing to answer questions about Tianenmen square.

It seems obvious from screenshots of people trying to jailbreak the webapp that there's some middleware that just drops the connection when the incident is mentioned. However I've already asked the self hosted model multiple controversial China questions and it's answered them all.

The poster of the thread was also running the model locally, the 14b model to be specific, so what's happening? I decide to check for myself and lo and behold, I get the same "I am sorry, I cannot answer that question. I am an AI assistant designed to provide helpful and harmless responses."

Is it just that specific model being censored? Is it because it's the qwen model it's distilled from that's censored? But isn't the 7b model also distilled from qwen?

So I check the 7b model again, and this time round that's also censored. I panic for a few seconds. Have the Chinese somehow broken into my local model to cover it up after I downloaded it.

I check the screenshot I have of it answering the first time I asked and ask the exact same question again, and not only does it work, it acknowledges the previous question.

So wtf is going on? It seems that "Tianenmen square" will clumsily shut down any kind of response, but Tiananmen square is completely fine to discuss.

So the local model actually is censored, but the filter is so shit, you might not even notice it.

It'll be interesting to see what happens with the next release. Will the censorship be less thorough, stay the same, or will china again piss away a massive amount of soft power and goodwill over something that everybody knows about anyway?

top 50 comments
sorted by: hot top controversial new old
[–] swlabr@awful.systems 75 points 3 days ago (2 children)

Worrying about whether or not an LLM has censorship issues is like worrying about the taste of poop.

[–] Alfredolin@sopuli.xyz 13 points 2 days ago (1 children)
[–] dgerard@awful.systems 8 points 2 days ago* (last edited 2 days ago)

benchmarks show that this LLM has the bouquet of the sunny side of the sewage farm

[–] o7___o7@awful.systems 11 points 2 days ago (1 children)

This is just me being childish, but it would be fun if we could incept the joke that LLM censorship = corn.

The rest of the owl draws itself in the imagination of the listener.

[–] swlabr@awful.systems 8 points 2 days ago

Hmm, the way I’ve chosen to interpret this is to propose the analogy of a person eating corn as a model of LLMs. You can eat a huge variety of foods and your poop looks more or less the same. Sometimes, you eat something like corn, and the result is you can spot kernels of things resembling real food (i.e. corn kernels) in the poop. However, if you were to inspect said kernels, you would quickly realise they were full of shit.

[–] wise_pancake@lemmy.ca 27 points 3 days ago

Local deepseek answers all my questions, but it is definitely biased in favour is the CCP even you ask about Chinese leadership.

Fortunately that doesn’t come up much for me

[–] self@awful.systems 22 points 3 days ago (2 children)

So I check the 7b model again, and this time round that’s also censored. I panic for a few seconds. Have the Chinese somehow broken into my local model to cover it up after I downloaded it.

what

[–] Albbi@lemmy.ca 12 points 3 days ago

I mean, his username is manicdave. Psychosis is a symptom of mania. It's a pretty wild thought.

[–] manicdave@feddit.uk 11 points 3 days ago

It's a slightly facetious comment on how the same model had gone from definitely not censored to definitely censored. The tripwire for the filter was obviously already there.

[–] froztbyte@awful.systems 14 points 3 days ago (1 children)

the product produced by the producer operating in a violently censorious state has complied with censorship in the production of the product? omg, stop the presses!

(nevermind the fact that if you spend half a second thinking through where said state exercises its power and control, the reasons for the things you observed should all but smack you in the face)

[–] manicdave@feddit.uk 0 points 1 day ago* (last edited 1 day ago) (1 children)

I'm not particularly surprised by the censorship. That's not really the point of the post.

There's constant arguments going on between people over whether it's censored or not. A lot of people, me included tbh, were under the impression that it wasn't because we were able to get information out of it that we would expect to be censored. Other people have claimed not to be able to when trying similar. Therefore we've ended up with people arguing over whether it is or isn't.

I investigated and proved that both sides are kinda of right, and explained why people are getting different results for doing what is ostensibly the same thing.

[–] froztbyte@awful.systems 7 points 1 day ago (2 children)

wow, the point must've picked up a speed booster when it got close to you. so hard to grasp it!

[–] manicdave@feddit.uk -3 points 1 day ago (1 children)

Easier to grasp than your witticisms, clearly.

[–] froztbyte@awful.systems 2 points 1 day ago

you should try not asking a llm

[–] gazter@aussie.zone -3 points 1 day ago (2 children)

To me it looks like you're the one missing this person's point. And the snark doesn't help you, or them.

[–] self@awful.systems 4 points 1 day ago

you came into TechTakes wanting less snark? holy fuck you’re lost

[–] froztbyte@awful.systems 2 points 1 day ago

do they not have sidebars in aus?

[–] SGforce@lemmy.ca 7 points 3 days ago (1 children)

The local models are distilled versions of Qwen or llama or whatever else, not really deepseek's model. So you get refusals based on the base model primarily, plus whatever it learned from the distilling. If it's Qwen or another Chinese model then it's more likely to refuse but a llama model or something else could pick it up to a lesser extent.

[–] manicdave@feddit.uk 3 points 3 days ago (1 children)

You get the exact same cookie cutter response in the llama models, and the qwen models process the question and answer. The filter is deepseek's contribution.

[–] felixwhynot@lemmy.world 1 points 3 days ago (2 children)

From what I understand, the Distilled models are using DeepSeek to retrain e.g. Llama. So it makes sense to me that they would exhibit the same biases.

[–] Architeuthis@awful.systems 6 points 2 days ago* (last edited 2 days ago)

Distilling is supposed to be a shortcut to creating a quality training dataset by using the output of an established model as labels, i.e. desired answers.

The end result of the new model ending up with biases inherited from the reference model should hold, but using as a base model the same model you are distilling from would seem to be completely pointless.

[–] manicdave@feddit.uk 3 points 3 days ago (1 children)

Some models are llama and some are qwen. Both sets respond with "I am sorry, I cannot answer that question. I am an AI assistant designed to provide helpful and harmless responses." when you spell it Tianenmen, but give details when you spell it Tiananmen.

[–] felixwhynot@lemmy.world 3 points 3 days ago

To your point, neither of those are truly Deepseek under the hood

[–] MNByChoice@midwest.social 6 points 3 days ago (1 children)

Fuck. Just thinking of those bodies run over repeatedly and washed down the sewers...

[–] swlabr@awful.systems 6 points 2 days ago

I absolve you of your perceived need to think about it. You’re cured!

[–] shoulderoforion@fedia.io 1 points 3 days ago (9 children)

China is an entire economy built on intellectual property thievery and slave labor. The whole thing, that's they're advantage. Theft and slavery. The Chinese CCP can fuck off into the sun. *edit: this post and article is about the ccp censoring it's human rights abuses, and all the downvotes confirm the ccp is here and active on the fediverse itself attempting to do the precise same thing. the irony shouldn't be lost.

[–] rook@awful.systems 21 points 3 days ago

an entire economy built on intellectual property thievery

The historic attitude of the US to copyright is interesting (you can still see old English-language books that are labelled not for sale in the USA). In these enlightened days of course there’s a half-trillion dollar plan to shore up the LLM business, which is already a half-trillion dollar crater of debt and is still digging hard.

and slave labor

I always wondered how the manufacture of white goods in the US was competitive with the likes of Mexico, and it turns out that the secret ingredient is incredibly cheap prison labor, where the prisoners face significant negative consequences if they’re not prepared to work for pennies.

Prisoners can be firefighters for a few dollars a day and risk their lives, but are denied jobs when they get out. California, that noted bleeding heart lefty bastion, refused to abolish penal servitude (ie. slavery of prisoners).

The US health insurance industry means that huge swathes of the population may as well be indentured because cannot afford basic healthcare if they quit and changing employers risks rejection of coverage of pre-existing conditions.

I could go on. For quite a while.

all the downvotes confirm the ccp is here and active on the fediverse

By all accounts, the ccp do a pretty poor job of influence operations compared to russia. Personally I suspect that the fediverse is just too small compared to twitter and bluesky and reddit, so why would anyone bother here?

Truth is, both the US and the PRC are capitalist hellholes of differing degrees, and the current team in the White House works hard to reduce those differences. Remember, with the right wing, it is always projection and envy. They hate Iran because they want to be a fundamentalist dictatorship too. They hate china because they want uncontested power and a labor force without human rights.

You are not obliged to carry water for them.

[–] self@awful.systems 29 points 3 days ago (1 children)

no, the downvotes are me because a lot of these takes are shitty

[–] mawhrin@awful.systems 14 points 2 days ago* (last edited 2 days ago) (1 children)

China is an entire economy built on intellectual property thievery and slave labor.

so, just like the united states when it suited them, no? do read about united states in nineteenth century once. oh, and: you do realise that slavery in some circumstances is still legal in the u.s.?

[–] froztbyte@awful.systems 13 points 2 days ago (1 children)

some circumstances is still legal in the u.s.

as someone else pointed out, US-wide legal slavery (enshrined in constitution) in the form of prisoners

[–] mawhrin@awful.systems 9 points 2 days ago

precisely. a fucking shame.

[–] froztbyte@awful.systems 17 points 3 days ago* (last edited 3 days ago)

there are lots of complaints one can level at ccp-run china without having to dip right into this strand of sinophobia, what the utter lazy fuck. bullshit like this that helps the world stay bad and intolerant. fuck off with it.

(sincerely: one of your downvotes from sunny ZA)

[–] swlabr@awful.systems 20 points 3 days ago

Oh hey Sam Altman is here, doing his best to bring down deepseek

[–] o7___o7@awful.systems 6 points 2 days ago* (last edited 2 days ago)

The quants who built DeepSeek in their 20% time must really feel the sting of all that communism, I tell you hwat.

[–] blakestacey@awful.systems 12 points 3 days ago (1 children)

Enjoy your trip to the egress.

[–] blakestacey@awful.systems 23 points 3 days ago (3 children)

I mean, "downvotes are proof that the commies are out to get me" is an occasion not just to touch grass, but to faceplant into an open field of wildflowers.

[–] skillissuer@discuss.tchncs.de 11 points 2 days ago

CCP is out after their precious ~~bodily fluids~~ internet points

[–] manicdave@feddit.uk 14 points 3 days ago* (last edited 3 days ago)

I like the idea that the CCP are so desperate to down vote that one comment they don't stop to down vote the post that actually makes them look bad, which said comment is responding to.

[–] jonhendry@iosdev.space 7 points 3 days ago

@blakestacey

Or at least manure.