this post was submitted on 09 Jan 2025
480 points (99.2% liked)

Opensource

2137 readers
61 users here now

A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!

CreditsIcon base by Lorc under CC BY 3.0 with modifications to add a gradient



founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] kautau@lemmy.world 116 points 2 months ago* (last edited 2 months ago) (16 children)

The most important part is that it’s a local ~~LLM~~ model running on your machine. The problem with AI is less about LLMs themselves, and more about their control and application by unethical companies and governments in a world driven by profit and power. And it’s none of those things, it’s just some open source code running on your device. So that’s cool and good.

[–] technomad@slrpnk.net 40 points 2 months ago (15 children)

Also the incessant ammounts of power/energy that they consume.

[–] jsomae@lemmy.ml 21 points 2 months ago (12 children)

Running an llm llocally takes less power than playing a video game.

[–] jonjuan@programming.dev 1 points 1 month ago

They aren't using a LLM, this is a speech to text model like Whisper.

load more comments (11 replies)
load more comments (13 replies)
load more comments (13 replies)