OBJECTIVE: Research on implementation of artificial intelligence (AI) in radiology workflows and its impact on
reports remains scarce. In this study, we aim to assess if an AI platform would perform better than clinical radiology
reports in evaluating noncontrast chest computed tomography (CT) scans.
METHODS: Consecutive patients who had undergone noncontrast chest CT were retrospectively identified. The radiology
reports were reviewed in a binary fashion for reporting of pulmonary lesions, pulmonary emphysema, aortic dilatation, coronary artery calcifications (CAC), and vertebral compression fractures (VCF). CT scans were then processed using an AI platform. The reports\' findings and the AI results were subsequently compared to a consensus read by two board-certificated radiologists as reference.
RESULTS: A total of 100 patients (mean age: 64.2 ± 14.8 years; 57% males) were included in this study. Aortic segmentation and calcium quantification failed to be processed by AI in 2 and 3 cases, respectively. AI showed superior diagnostic performance in identifying aortic dilatation (AI: sensitivity: 96.3%, specificity: 81.4%, AUC: 0.89) vs (Reports: sensitivity: 25.9%, specificity: 100%, AUC: 0.63), p <0.001; and CAC (AI: sensitivity: 89.8%, specificity: 100, AUC: 0.95) vs (Reports: sensitivity: 75.4%, specificity: 94.9%, AUC: 0.85), p = 0.005.
Reports had better performance than AI in identifying pulmonary lesions (
Reports: sensitivity: 97.6%, specificity: 100%, AUC: 0.99) vs (AI: sensitivity: 92.8%, specificity: 82.4%, AUC: 0.88), p = 0.024; and VCF (Reports: sensitivity:100%, specificity: 100%, AUC: 1.0) vs (AI: sensitivity: 100%, specificity: 63.7%, AUC: 0.82), p <0.001. A comparable diagnostic performance was noted in identifying pulmonary emphysema on AI (sensitivity: 80.6%, specificity: 66.7%. AUC: 0.74) and
reports (sensitivity: 74.2%, specificity: 97.1%, AUC: 0.86), p = 0.064.
CONCLUSIONS: Our results demonstrate that incorporating AI support platforms into radiology workflows can provide significant added value to clinical radiology reporting.