this post was submitted on 03 Nov 2024
387 points (98.3% liked)

Open Source

31184 readers
142 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] AliasAKA@lemmy.world 13 points 1 week ago (3 children)

Is there any interest in getting local models to run using this? I’d rather not use Gemini, and then all the data can reside locally (and not require a login).

I’d be happy to work on this, though I’m a python developer not a typescript one.

[–] Cr4yfish@lemmy.world 6 points 1 week ago (2 children)

Yeah, good idea. It's possible to do that with WebLLM & Langchain. Once Langchain is integrated, it's kinda similar to the Python Version so should be do-able I think.

[–] AliasAKA@lemmy.world 2 points 1 week ago (1 children)

Ah interesting — again happy to help out if there’s anything I can contribute to. I can make a feature request on github if there’s interest.

[–] Cr4yfish@lemmy.world 2 points 1 week ago

Please do :). I take any help I can get.