this post was submitted on 30 Jun 2025
-2 points (46.4% liked)
Technology
72156 readers
3154 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
And the risk is that if we rely on AI in any meaningful capacity, it will eventually erode away the expertise who would be knowledgeable enough to detect the problems that the future AI may create/ignore. This assumes even best case where AI isn't being specifically tampered with.
I agree with you. I think this will likely happen to some degree. At the same time, that kind of argument could be used against many new technologies and is not a valid one to not utilize new tech.
Simply using AI isn't an issue... Allowing it to take over in a way that accelerates the removal of the knowledge from our pools of knowledge is a problem. Allowing companies to use AI as a direct replacement of actual medical professionals will remove knowledge from society. We already know that we can't use AI to fuel more AI learning... the models implode. In order to continue learning more from medicine, we need to keep pushing for human learning and understanding.
Funny that you agree with me and apparently see useful discussion to have here... but downvote me even though the comment certainly added to the discussion.
Oh, and next time don't put words into someone's mouth, very much a bad faith action that harms meaningful discussion. I never said we should ban it or never use it. A better answer would be to legislate that doctors must still oversee, or must be the approving authority. That AI can never have a final say in someone's care and that research must never be sourced from AI sources. All I said, is that if we continue what we're doing and rely on AI in any meaningful capacity, we will run into problems. Especially in the context of the comment I responded to which opined upon corporation controlled AI.
FFS... they can't even run a vending machine. https://www.anthropic.com/research/project-vend-1
Oh.. and actually I would consider the 85% that it gets to be pretty poor considering that the AI was likely trained on the full breadth of NEJM information. Doctors don't have that ability to retain and train on 100% of all knowledge of the NEJM, so mistaking things makes sense for them. It doesn't make sense for something that was trained on NEJM data to screw up on an NEJM case.
My stance is the same for all AI. I'll use it to generate basic code for me. I'll never run that without review. Or to jumpstart research into a topic... and validate the information presented with outside direct sources.
TL;DR: Tool is good... Source is bad.