LocalLLaMA

2244 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

LLMs made into single-file executables with llamafile (hacks.mozilla.org)

submitted 11 months ago* (last edited 11 months ago) by meteokr@community.adiquaints.moe to c/localllama@sh.itjust.works

4 comments fedilink hide all child comments

Seems like a really cool project. Lowering the barrier to entry of locally run models. As llamacpp supports a ton of models, I imagine it be easy to adapt this for other models other than the prebuilt ones.

top 4 comments

sorted by: hot top controversial new old

[–] kakes@sh.itjust.works 13 points 11 months ago* (last edited 11 months ago) (1 children)

My first thought is that this makes it a lot easier for a game dev to create a game that uses a local LLM. I'll definitely be keeping an eye on this for my own projects.

Edit: Trying it out now, color me impressed! I opened the file, and it worked instantly without a single finick to be found. Super excited for this!

[–] kakes@sh.itjust.works 1 points 11 months ago

When I upload an image, it seems to be getting re-encoded every time I send a message, which takes a while. I've never really messed around with images in Llama - is this a normal/necessary thing?

[–] kurwa@lemmy.world 5 points 11 months ago

That's pretty dope. I've been imagining some programs where having a small enough locally runnable model could be useful.

[–] RandomLegend@lemmy.dbzer0.com 4 points 11 months ago

Works like a charm!