this post was submitted on 30 Jul 2024
1197 points (98.0% liked)

linuxmemes

20761 readers
1878 users here now

I use Arch btw

Sister communities:

Community rules

  1. Follow the site-wide rules and code of conduct
  2. Be civil
  3. Post Linux-related content
  4. No recent reposts

Please report posts and comments that break these rules!

founded 1 year ago
MODERATORS
poopsmith@lemmy.world
zephyr@lemmy.world
1197
What is this? (Its OC!) (lemmy.world)
submitted 1 month ago* (last edited 1 month ago) by Smokeydope@lemmy.world to c/linuxmemes@lemmy.world
108 comments fedilink hide all child comments
 

List of icons/services suggested:

  • Calibre
  • Jitsi
  • Kiwix
  • Monero (Node)
  • Nextcloud
  • Pihole
  • Ollama (Should at least be able to run tiny-llama 1.1B)
  • Open Media Vault
  • Syncthing
  • VLC Media Player Media Server
you are viewing a single comment's thread
view the rest of the comments
[–] brucethemoose@lemmy.world 1 points 1 month ago* (last edited 1 month ago)

Oh I got you mixed up with the other commenter, apologies.

I'm not sure when llama 8b starts to degrade at long context, but I wanna say its well before 128K, and where other "long context" models start to look much more attractive depending on the task. Right now I am testing Amazon's mistral finetune, and it seems to be much better than Nemo or llama 3.1 out there.