this post was submitted on 25 Dec 2023
1890 points (97.8% liked)

People Twitter

5268 readers
836 users here now

People tweeting stuff. We allow tweets from anyone.

RULES:

  1. Mark NSFW content.
  2. No doxxing people.
  3. Must be a tweet or similar
  4. No bullying or international politcs
  5. Be excellent to each other.

founded 1 year ago
MODERATORS
SendMeYourTaTas@sh.itjust.works
pelespirit@sh.itjust.works
1890
The dream (lemmy.world)
submitted 11 months ago by Stamets@lemmy.world to c/whitepeopletwitter@sh.itjust.works
178 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] art@lemmy.world 2 points 10 months ago

Those server farms are because the needs of corporations might just be different from the needs of regular users.

I'm running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago.

It's almost as if technology can get better and more efficient over time.