Doctors’ AI scribes get names of drugs and diagnoses wrong, NHS watchdog warns
who could have fucking predicted this at length the second it was announced
Discussion
Doctors’ AI scribes get names of drugs and diagnoses wrong, NHS watchdog warns
who could have fucking predicted this at length the second it was announced
@davidgerard whilst I am concerned by the accuracy of AI transcription, and also that confidential information may leak or be misused - don’t overestimate the quality of notes made by humans (yes drug names and diagnoses get misspelled)
I am now wondering who pays the fines for harm resulting from the slop generators messing up someone's meds or records.
@davidgerard I'm pretty sure this is how the doctor's notes claimed. I was turning down therapy, instead of accepting it
@davidgerard Hippocrates rolling in his grave
@davidgerard Isn't scribing also a way for junior medical professionals to get experience with the lingo and notation... talent pipeline xyzzy grr
@davidgerard
So, the "you should eat three rocks per day and put glue on pizza"-machine works just as well (i.e. not at all) in health care as it does for cooking and nutrition advice?
Well, keep trying - at some point we have got to find a useful purpose for this trillions of dollars investment.
@davidgerard My physician, at a university medical center, said the school had them use AI transcription for a year. Everyone hated it, for the reasons you cite and others, people quickly stopped using the transcripts, and that was that.
@davidgerard Probably don't need a lot more reason to remove abusive power.
Don't worry, when the NHS rolled this out they required GPs to accept legal liability for inaccuracies, so I'm sure overworked GPs are reading the transcripts in detail! Oh, they're not? Well, at the very least, the companies selling this have a liability shield to hide behind, and that's the important thing.
@david_chisnall @davidgerard Reverse centaurs yet again.
@david_chisnall the doctors frequently fucking love it, and i can fully understand why. one of these that *worked* would be a godsend. but uh.
@davidgerard is a #health , #safety & #Insurance concern
@davidgerard I think it is a variant of the Gell-Mann Amnesia effect. You forget that all the mistakes you see AI make apply to /everything/ it does. Although management may just be too stupid to have recognised the mistakes....
@davidgerard Haven't you heard?
AI doesn't need organic life.
@davidgerard Who signed off untested AI for any health staff?
It is fundamentally not trustworthy - not least it has no feelings and hence no sense of caring.
@davidgerard "More than half the 1,003 UK GPs in her survey last year believed that their ambient AI records were more accurate than those produced themselves, Blease said."
People believe a lot of things. More than half the voters in the USA thought Trump should get a second term. Just because a lot of people believe something doesn't make it true...
@davidgerard well who could have seen this one coming.
@capnthommo if only a few thousand more people had pointed out the obvious