%0 Journal Article %T Convolutional neural network assistance significantly improves dermatologists' diagnosis of cutaneous tumours using clinical images. %A Ba W %A Wu H %A Chen WW %A Wang SH %A Zhang ZY %A Wei XJ %A Wang WJ %A Yang L %A Zhou DM %A Zhuang YX %A Zhong Q %A Song ZG %A Li CX %J Eur J Cancer %V 169 %N 0 %D 07 2022 %M 35569282 %F 10.002 %R 10.1016/j.ejca.2022.04.015 %X Convolutional neural networks (CNNs) have demonstrated expert-level performance in cutaneous tumour classification using clinical images, but most previous studies have focused on dermatologist-versus-CNN comparisons rather than their combination. The objective of our study was to evaluate the potential impact of CNN assistance on dermatologists for clinical image interpretation.
A multi-class CNN was trained and validated using a dataset of 25,773 clinical images comprising 10 categories of cutaneous tumours. The CNN's performance was tested on an independent dataset of 2107 images. A total of 400 images (40 per category) were randomly selected from the test dataset. A fully crossed, self-control, multi-reader multi-case (MRMC) study was conducted to compare the performance of 18 board-certified dermatologists (experience: 13/18 ≤ 10 years; 5/18>10 years) in interpreting the 400 clinical images with or without CNN assistance.
The CNN achieved an overall accuracy of 78.45% and kappa of 0.73 in the classification of 10 types of cutaneous tumours on 2107 images. CNN-assisted dermatologists achieved a higher accuracy (76.60% vs. 62.78%, P < 0.001) and kappa (0.74 vs. 0.59, P < 0.001) than unassisted dermatologists in interpreting the 400 clinical images. Dermatologists with less experience benefited more from CNN assistance. At the binary classification level (malignant or benign), the sensitivity (89.56% vs. 83.21%, P < 0.001) and specificity (87.90% vs. 80.92%, P < 0.001) of dermatologists with CNN assistance were also significantly improved than those without.
CNN assistance improved dermatologist accuracy in interpreting cutaneous tumours and could further boost the acceptance of this new technique.