Wyant College of Optical Sciences, United States.
Mazumdar Shaw Cancer Ctr., India.
J Biomed Opt. 2022 Nov;27(11). doi: 10.1117/1.JBO.27.11.115001.
SIGNIFICANCE: Oral cancer is one of the most prevalent cancers, especially in middle- and low-income countries such as India. Automatic segmentation of oral cancer images can improve the diagnostic workflow, which is a significant task in oral cancer image analysis. Despite the remarkable success of deep-learning networks in medical segmentation, they rarely provide uncertainty quantification for their output. AIM: We aim to estimate uncertainty in a deep-learning approach to semantic segmentation of oral cancer images and to improve the accuracy and reliability of predictions. APPROACH: This work introduced a UNet-based Bayesian deep-learning (BDL) model to segment potentially malignant and malignant lesion areas in the oral cavity. The model can quantify uncertainty in predictions. We also developed an efficient model that increased the inference speed, which is almost six times smaller and two times faster (inference speed) than the original UNet. The dataset in this study was collected using our customized screening platform and was annotated by oral oncology specialists. RESULTS: The proposed approach achieved good segmentation performance as well as good uncertainty estimation performance. In the experiments, we observed an improvement in pixel accuracy and mean intersection over union by removing uncertain pixels. This result reflects that the model provided less accurate predictions in uncertain areas that may need more attention and further inspection. The experiments also showed that with some performance compromises, the efficient model reduced computation time and model size, which expands the potential for implementation on portable devices used in resource-limited settings. CONCLUSIONS: Our study demonstrates the UNet-based BDL model not only can perform potentially malignant and malignant oral lesion segmentation, but also can provide informative pixel-level uncertainty estimation. With this extra uncertainty information, the accuracy and reliability of the model’s prediction can be improved.
意义:口腔癌是最常见的癌症之一,尤其是在印度等中低收入国家。口腔癌图像的自动分割可以改善诊断工作流程,这是口腔癌图像分析中的一项重要任务。尽管深度学习网络在医学分割方面取得了显著的成功,但它们很少为其输出提供不确定性量化。
目的:我们旨在估计深度学习方法对口腔癌图像语义分割的不确定性,并提高预测的准确性和可靠性。
方法:这项工作引入了一种基于 U-Net 的贝叶斯深度学习(BDL)模型,用于分割口腔中可能恶性和恶性病变区域。该模型可以量化预测中的不确定性。我们还开发了一种高效的模型,提高了推理速度,比原始的 U-Net 小近六倍,快两倍(推理速度)。本研究中的数据集是使用我们定制的筛查平台收集的,并由口腔肿瘤专家进行注释。
结果:所提出的方法实现了良好的分割性能和良好的不确定性估计性能。在实验中,我们观察到通过去除不确定像素,像素准确率和平均交并率有所提高。这一结果反映出,在不确定区域,模型提供的预测可能不太准确,需要更多关注和进一步检查。实验还表明,在某些性能折衷的情况下,高效模型减少了计算时间和模型大小,这扩大了在资源有限的环境中使用便携式设备实现的潜力。
结论:我们的研究表明,基于 U-Net 的 BDL 模型不仅可以进行可能恶性和恶性口腔病变的分割,还可以提供有用的像素级不确定性估计。通过这种额外的不确定性信息,可以提高模型预测的准确性和可靠性。
BMC Med Imaging. 2023-10-19
Int J Comput Assist Radiol Surg. 2021-7
Comput Intell Neurosci. 2022
Comput Methods Programs Biomed. 2019-7-8
J Mech Behav Biomed Mater. 2023-1
Lin Chuang Er Bi Yan Hou Tou Jing Wai Ke Za Zhi. 2023-6
Biomed Opt Express. 2021-9-20
Oral Oncol. 2020-3
Light Sci Appl. 2019-11-20