this post was submitted on 13 Aug 2023
376 points (74.1% liked)

Technology

59600 readers
3397 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] _danny@lemmy.world 2 points 1 year ago

I feel like you're undereducated on how and when AI models are trained. Especially for the gpt model, it's not "constantly learning" like other models. It's being tweaked in discreet increments by developers trying to cover their ass, and get it to less frequently say things they can be sued for.

Also, AI are already training other AI, that's kinda how AI are made.... There's an AI that detects how well a given phrase follows another phrase, and that's used to train the part of the AI you interact with. (arguably they are part of the same whole, depending on how you view the architecture)

CGP gray has a good into video on how bots learn, it's pretty outdated and not really applicable to how LLMs learn, but the general idea is still there.