BACKGROUND

To evaluate the efficiency of artificial intelligence (AI)-assisted diagnosis system in the pulmonary nodule detection and diagnosis training of junior radiology residents and medical imaging students.

METHODS

The participants were divided into three groups. Medical imaging students of Grade 2020 in the Jinzhou Medical University were randomly divided into Groups 1 and 2; Group 3 comprised junior radiology residents. Group 1 used the traditional case-based teaching mode; Groups 2 and 3 used the 'AI intelligent assisted diagnosis system' teaching mode. All participants performed localisation, grading and qualitative diagnosed of 1,057 lung nodules in 420 cases for seven rounds of testing after training. The sensitivity and number of false positive nodules in different densities (solid, pure ground glass, mixed ground glass and calcification), sizes (less than 5 mm, 5-10 mm and over 10 mm) and positions (subpleural, peripheral and central) of the pulmonary nodules in the three groups were detected. The pathological results and diagnostic opinions of radiologists formed the criteria. The detection rate, diagnostic compliance rate, false positive number/case, and kappa scores of the three groups were compared.

RESULTS

There was no statistical difference in baseline test scores between Groups 1 and 2, and there were statistical differences with Group 3 (P = 0.036 and 0.011). The detection rate of solid, pure ground glass and calcified nodules; small-, medium-, and large-diameter nodules; and peripheral nodules were significantly different among the three groups (P<0.05). After seven rounds of training, the diagnostic compliance rate increased in all three groups, with the largest increase in Group 2. The average kappa score increased from 0.508 to 0.704. The average kappa score for Rounds 1-4 and 5-7 were 0.595 and 0.714, respectively. The average kappa scores of Groups 1,2 and 3 increased from 0.478 to 0.658, 0.417 to 0.757, and 0.638 to 0.791, respectively.

CONCLUSION

The AI assisted diagnosis system is a valuable tool for training junior radiology residents and medical imaging students to perform pulmonary nodules detection and diagnosis.