Self-Hosted Main

515 readers

1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

For Example

Service: Dropbox - Alternative: Nextcloud
Service: Google Reader - Alternative: Tiny Tiny RSS
Service: Blogger - Alternative: WordPress

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

Awesome-Selfhosted List of Software
Awesome-Sysadmin List of Software

founded 1 year ago

MODERATORS

communick@selfhosted.forum

-1

leading self hostable chatbot like chatgpt (alien.top)

submitted 11 months ago by TheRealTrailblaster@alien.top to c/main@selfhosted.forum

22 comments fedilink hide all child comments

What is currently the leading chatbot that can be self hosted on your computer?

I have heard about alot of them and it seems like everyone and there dog is making one however I'm not sure which one I should be use.

Edit : I am running a 3060 with 12GB of ram

you are viewing a single comment's thread
view the rest of the comments

[–] remghoost7@alien.top 1 points 11 months ago

I'd recommend koboldcpp for your backend, SillyTavern for your frontend, and I've been a fan of dolphin-2.1-mistral-7B. I've been using the Q4_K_S. But you could probably run a 13B model just fine.

I've heard good things about the nous-hermes models (I was a big fan of their Llama2 model). I'd stick to mistral variants, personally. Their dataset/training has far surpassed base Llama2 stuff in my opinion.