this post was submitted on 29 Sep 2023
27 points (96.6% liked)

Free Open-Source Artificial Intelligence

3694 readers
2 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 2 years ago
MODERATORS
Blaed@lemmy.world
fosai@lemmy.world
27
Meet Mistral 7B, Mistral’s first LLM that beats Llama 2 (dataconomy.com)
submitted 2 years ago by ylai@lemmy.ml to c/fosai@lemmy.world
5 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] ylai@lemmy.ml 6 points 2 years ago* (last edited 2 years ago) (1 children)

Not true. See — or actually nothing to be seen here, since “it just works”: https://github.com/ggerganov/llama.cpp/discussions/3368 and https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF

And here is someone describing how to do the quantization yourself: https://advanced-stack.com/resources/running-inference-using-mistral-ai-first-released-model-with-llama-cpp.html

[–] vicfic@iusearchlinux.fyi 2 points 2 years ago

Ooh, thanks. 🤗