Hot take: AI hit 97% accuracy on my medical scans but I still don't fully trust it

I ran 200 chest X-rays through a new AI diagnostic tool last month. It flagged 12 issues, and the radiologist confirmed 11 were real. That 91% match rate was higher than I expected, but the one false positive was a harmless shadow it called a nodule. So now I'm torn: do we lean into the 91% accuracy and speed up diagnoses, or does that 9% error rate matter more than raw numbers? Anyone else hit a milestone where the numbers felt good but the doubt stuck around?

1 comments

1 Comment

dakotab1352m ago

My buddy had a similar thing happen with his knee MRI, still bugs him.