An updated machine learning model demonstrated a 23 percent improvement in accuracy and a 36.1 percent improvement in sensitivity over visual radiologist assessment of ultrasound images for differentiating malignant lymph nodes and benign COVID-19 vaccination-related changes to lymph nodes.
When it comes to differentiating between malignant lymph node changes and benign lymph node changes due to COVID-19 vaccination, combining a machine learning model with ultrasound may be more beneficial than visual ultrasound assessment by radiologists.
The retrospective study, recently published in the European Journal of Radiology, examined a machine learning model with ultrasound images drawn from patients who had routine breast and axillary lymph node assessment between November 2018 and February 2020 at a hospital in Barcelona. The study authors noted that the ultrasound images, acquired by breast imaging radiologists, came from patients with breast cancer as well as patients without breast cancer.
After training of the deep learning model with 10 cases and 61 controls, the study authors compared the effectiveness of the model to visual lymph node assessment by radiologists with a review of 109 ultrasound images from 36 cases and 73 controls. Visual inspection of axillary lymph nodes via ultrasound by radiologists resulted in 69.7 percent accuracy, 41.7 percent sensitivity and 83.6 percent specificity, according to the study. In contrast, the study authors noted that use of the deep learning model in concert with ultrasound led to a 92.7 percent accuracy rate, 77.8 percent sensitivity and 100 percent specificity.
“This direct comparison on the same images clearly suggests that the proposed methods can improve radiologists’ performance and also indicate that visual techniques are not enough to correctly classify nodes in patients after COVID-19 vaccination,” maintained Xavier P. Burgos-Artizzu, BEng, MSc, PhD, who is affiliated with the Barcelona Center for Maternal-Fetal and Neonatal Medicine at the Hospital Clinic de Barcelona in Spain, and colleagues.
The study authors noted that software incorporating the deep learning algorithm could prevent unnecessary biopsies and augment decision-making for patients with suspicious lymph nodes revealed during ultrasound exams.
Use of the deep learning software may also facilitate non-invasive assessment of axillary lymph nodes after a patient has been treated with neoadjuvant chemotherapy, suggested Burgos-Artizzu and colleagues.
In regard to study limitations, the study authors acknowledged the small numbers in the data set used to assess the machine learning model and maintained that large multicenter trials are needed to validate the results of this study.
New Study Examines Short-Term Consistency of Large Language Models in Radiology
November 22nd 2024While GPT-4 demonstrated higher overall accuracy than other large language models in answering ACR Diagnostic in Training Exam multiple-choice questions, researchers noted an eight percent decrease in GPT-4’s accuracy rate from the first month to the third month of the study.
FDA Clears AI-Powered Ultrasound Software for Cardiac Amyloidosis Detection
November 20th 2024The AI-enabled EchoGo® Amyloidosis software for echocardiography has reportedly demonstrated an 84.5 percent sensitivity rate for diagnosing cardiac amyloidosis in heart failure patients 65 years of age and older.
The Reading Room: Artificial Intelligence: What RSNA 2020 Offered, and What 2021 Could Bring
December 5th 2020Nina Kottler, M.D., chief medical officer of AI at Radiology Partners, discusses, during RSNA 2020, what new developments the annual meeting provided about these technologies, sessions to access, and what to expect in the coming year.
Ultrasound Device Garners FDA De Novo Nod for Kidney Stone Clearance
November 14th 2024Emerging research demonstrated that the Stone Clear device, which facilitates post-lithotripsy clearance of kidney stone fragments, led to a 70 percent lower risk of relapse in comparison to observation in a control group.