Center of Digital Dentistry, Peking University School and Hospital of Stomatology & National Engineering Laboratory for Digital and Material Technology of Stomatology & Research Center of Engineering and Technology for Digital Dentistry of Ministry of Health & Beijing Key Laboratory of Digital Stomatology, Beijing, China.
Center of Signal and Information Processing (CSIP), School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA.
Sci Rep. 2019 Mar 7;9(1):3840. doi: 10.1038/s41598-019-40414-y.
We propose using faster regions with convolutional neural network features (faster R-CNN) in the TensorFlow tool package to detect and number teeth in dental periapical films. To improve detection precisions, we propose three post-processing techniques to supplement the baseline faster R-CNN according to certain prior domain knowledge. First, a filtering algorithm is constructed to delete overlapping boxes detected by faster R-CNN associated with the same tooth. Next, a neural network model is implemented to detect missing teeth. Finally, a rule-base module based on a teeth numbering system is proposed to match labels of detected teeth boxes to modify detected results that violate certain intuitive rules. The intersection-over-union (IOU) value between detected and ground truth boxes are calculated to obtain precisions and recalls on a test dataset. Results demonstrate that both precisions and recalls exceed 90% and the mean value of the IOU between detected boxes and ground truths also reaches 91%. Moreover, three dentists are also invited to manually annotate the test dataset (independently), which are then compared to labels obtained by our proposed algorithms. The results indicate that machines already perform close to the level of a junior dentist.
我们建议在 TensorFlow 工具包中使用具有卷积神经网络特征的快速区域(faster R-CNN)来检测和编号牙片的牙齿。为了提高检测精度,我们根据某些先验领域知识,提出了三种后处理技术来补充基线更快的 R-CNN。首先,构建了一个过滤算法来删除与同一颗牙齿相关的更快 R-CNN 检测到的重叠框。接下来,实现了一个神经网络模型来检测缺失的牙齿。最后,提出了一个基于牙齿编号系统的规则模块,以匹配检测到的牙齿框的标签,修改违反某些直观规则的检测结果。通过计算检测到的框和地面真实框之间的交并比 (IOU) 值,在测试数据集上获得精度和召回率。结果表明,精度和召回率均超过 90%,检测框和地面真实框之间的 IOU 平均值也达到 91%。此外,还邀请了三位牙医独立手动标注测试数据集,然后将其与我们提出的算法获得的标签进行比较。结果表明,机器已经接近初级牙医的水平。