Calls it "Deepsneak", failing to make it clear that the reason people love Deepseek is that you can download and it run it securely on any of your own private devices or servers - unlike most of the competing SOTA AIs.

I can't speak for Proton, but the last couple weeks are showing some very clear biases coming out.

you are viewing a single comment's thread
view the rest of the comments

[–] simple@lemm.ee 106 points 2 days ago (3 children)

DeepSeek is open source, meaning you can modify code(new window) on your own app to create an independent — and more secure — version. This has led some to hope that a more privacy-friendly version of DeepSeek could be developed. However, using DeepSeek in its current form — as it exists today, hosted in China — comes with serious risks for anyone concerned about their most sensitive, private information.

Any model trained or operated on DeepSeek’s servers is still subject to Chinese data laws, meaning that the Chinese government can demand access at any time.

What???? Whoever wrote this sounds like he has 0 understanding of how it works. There is no "more privacy-friendly version" that could be developed, the models are already out and you can run the entire model 100% locally. That's as privacy-friendly as it gets.

"Any model trained or operated on DeepSeek's servers are still subject to Chinese data laws"

Operated, yes. Trained, no. The model is MIT licensed, China has nothing on you when you run it yourself. I expect better from a company whose whole business is on privacy.

[–] lily33@lemm.ee 32 points 2 days ago (1 children)

To be fair, most people can't actually self-host Deepseek, but there already are other providers offering API access to it.

[–] halcyoncmdr@lemmy.world 30 points 2 days ago (2 children)

There are plenty of step-by-step guides to run Deepseek locally. Hell, someone even had it running on a Raspberry Pi. It seems to be much more efficient than other current alternatives.

That's about as openly available to self host as you can get without a 1-button installer.

[–] tekato@lemmy.world 14 points 2 days ago (2 children)

You can run an imitation of the DeepSeek R1 model, but not the actual one unless you literally buy a dozen of whatever NVIDIA’s top GPU is at the moment.

[–] lily33@lemm.ee 8 points 2 days ago

A server grade CPU with a lot of RAM and memory bandwidth would work reasonable well, and cost "only" ~$10k rather than 100k+...

[–] alcoholicorn@lemmy.ml 0 points 2 days ago

I saw posts about people running it well enough for testing purposes on an NVMe.

[–] Dyf_Tfh@lemmy.sdf.org 6 points 2 days ago* (last edited 2 days ago)

Those are not deepseek R1. They are unrelated models like llama3 from Meta or Qwen from Alibaba "distilled" by deepseek.

This is a common method to smarten a smaller model from a larger one.

Ollama should have never labelled them deepseek:8B/32B. Way too many people misunderstood that.

[–] fmstrat@lemmy.nowsci.com 4 points 1 day ago

I think they mean privacy friendly version of the infrastructure could be developed.

[+] ReversalHatchery@beehaw.org -13 points 2 days ago (5 children)

What???? Whoever wrote this sounds like he has 0 understanding of how it works. There is no "more privacy-friendly version" that could be developed, the models are already out and you can run the entire model 100% locally. That's as privacy-friendly as it gets.

Unfortunately it is you who have 0 understanding of it. Read my comment below. Tldr: good luck to have the hardware

[–] simple@lemm.ee 16 points 2 days ago* (last edited 2 days ago) (1 children)

I understand it well. It's still relevant to mention that you can run the distilled models on consumer hardware if you really care about privacy. 8GB+ VRAM isn't crazy, especially if you have a ton of unified memory on macbooks or some Windows laptops releasing this year that have 64+GB unified memory. There are also websites re-hosting various versions of Deepseek like Huggingface hosting the 32B model which is good enough for most people.

Instead, the article is written like there is literally no way to use Deepseek privately, which is literally wrong.

[–] superglue@lemmy.dbzer0.com 2 points 2 days ago

So I've been interested in running one locally but honestly I'm pretty confused what model I should be using. I have a laptop with a 3070 mobile in it. What model should I be going after?

[–] thingsiplay@beehaw.org 5 points 2 days ago (1 children)

Is it Open Source? I cannot find the source code. The official repository https://github.com/deepseek-ai/DeepSeek-R1 only contains images, a PDF file, and links to download the model. But I don't see any code. What exactly is Open Source here?

[–] deathbird@mander.xyz 5 points 2 days ago (1 children)

I don't see the source either. Fair cop.

[–] thingsiplay@beehaw.org 5 points 2 days ago (1 children)

Thanks for confirmation. I made a top level comment too, because this important information gets lost in the comment hierarchy here.

[–] Hotzilla@sopuli.xyz 2 points 19 hours ago* (last edited 19 hours ago)

Open source is in general wrong term in all of these "open source" LLM's (like LLAMA and R1), the model is shared, but there is no real way of reproducing the model. This is because the training data is never shared.

In my mind open source means that you can reproduce the same binary from source. The models are shared for free, but not "open".

[–] v_krishna@lemmy.ml 3 points 2 days ago

Obviously you need lots of GPUs to run large deep learning models. I don't see how that's a fault of the developers and researchers, it's just a fact of this technology.

[–] lily33@lemm.ee 2 points 2 days ago

There are already other providers like Deepinfra offering DeepSeek. So while the the average person (like me) couldn't run it themselves, they do have alternative options.

[–] azron@lemmy.ml 1 points 2 days ago* (last edited 2 days ago)

Down votes be damned, you are right to call out the parent they clearly dont articulate their point in a way that confirms they actually understand what is going on and how an open source model can still have privacy implications if the masses use the company's hosted version.