With the release of the iPhone 4S and Siri, Apple has introduced speech recognition (SR) technology to the masses. Apple bills and markets Siri as a “humble personal assistant.” However, I doubt many radiologists, who have been working with SR technology for multiple years, would describe their SR software systems this way.
With the release of the iPhone 4S and Siri, Apple has introduced speech recognition (SR) technology to the masses. Apple bills and markets Siri as a “humble personal assistant.” However, I doubt many radiologists, who have been working with SR technology for multiple years, would describe their SR software systems this way.
Radiologists who use SR software to dictate their reports often describe the experience as frustrating. Much of this frustration, I believe, stems from the introduction of SR before its maturity.
Apple is renowned for their elegant consumer gadgets. They delay release of their products until their engineers believe that a technology has improved to a point where its implementation will not cause undue frustration on the part of their users. Case in point, while the tablet computer existed long before the iPad, Jobs and Co. at Apple realized that it would not be readily embraced by the average user until the product could be very thin, very responsive, and light. Apparently the “magic” (to borrow a term Jobs liked to throw around) year when technology was robust enough to accomplish this was 2010.
Now that Apple has determined SR technology to be mature enough to incorporate it into its iconic iPhone, should radiologists stop their grumbling?
Speech recognition software, which facilitates radiology dictations, has many proven benefits. Last year in AJR I wrote about our experience at UNC Hospitals incorporating SR software into the radiologist’s workflow. We noticed substantial improvements in report turn around time similar to what other observers had demonstrated, but also found that improvements in turn around time varied significantly between users due predominately to different work habits. Users who spent greater time training the system to recognize their voice and adding and revising terms in the vocabulary library, for example, benefited the most.
If you read between the lines of Apple’s marketing onslaught you will realize that they advise the same type of behavior to improve Siri (the more you use it, the better it will get). Additional benefits of SR driven dictation systems include the ability to leverage templates, mini macros, and structured reporting to improve accuracy, consistency, and billing. Moreover, advances in natural language processing coupled to SR software may allow for the ability to integrate targeted radiology decision support at the time of dictation, the ability to structure unstructured reports, and identify key content and highlight critical findings.
However, despite these benefits SR software has potential drawbacks. Most notably errors can result from incorrect capture of a radiologist’s voice and more important, the intent of their language. Most recently Sarah Basma and her group at Women’s College Hospital in Toronto, found an alarmingly high rate of errors using SR software vis a vis traditional transcriptionists for breast imaging reports. After correcting for multiple variables Basma’s group found that reports generated with SR were eight times more likely to contain major errors than those generated by traditional transcription.
The conflicting reports on SR software should give us pause as we move forward. The companies producing SR software have improved their products significantly over the last few years. Despite these improvements, a recent Diagnostic Imaging poll shows that while 80 percent of users use SR software, 30 percent still find it hard to use and not as accurate as traditional transcription services.
Apple believes the technology is ready for prime time. However as in most things tech, what is good enough for the average consumer product doesn’t necessarily stand up to the rigorous standards of healthcare. If Siri misinterprets your request for the weather forecast, you may get rained on. However, if a radiologist’s breast imaging report is recorded incorrectly the potential consequences are much more substantial.
New Study Examines Short-Term Consistency of Large Language Models in Radiology
November 22nd 2024While GPT-4 demonstrated higher overall accuracy than other large language models in answering ACR Diagnostic in Training Exam multiple-choice questions, researchers noted an eight percent decrease in GPT-4’s accuracy rate from the first month to the third month of the study.
FDA Grants Expanded 510(k) Clearance for Xenoview 3T MRI Chest Coil in GE HealthCare MRI Platforms
November 21st 2024Utilized in conjunction with hyperpolarized Xenon-129 for the assessment of lung ventilation, the chest coil can now be employed in the Signa Premier and Discovery MR750 3T MRI systems.
FDA Clears AI-Powered Ultrasound Software for Cardiac Amyloidosis Detection
November 20th 2024The AI-enabled EchoGo® Amyloidosis software for echocardiography has reportedly demonstrated an 84.5 percent sensitivity rate for diagnosing cardiac amyloidosis in heart failure patients 65 years of age and older.