Faculty of Engineering, Alexandria University, Alexandria, Egypt.
Department of Basic Science, Faculty of Engineering, Pharos University, Alexandria, Egypt.
Curr Med Imaging. 2020;16(5):611-621. doi: 10.2174/1573405615666190503142031.
Accurate segmentation of Breast Infrared Thermography is an important step for early detection of breast pathological changes. Automatic segmentation of Breast Infrared Thermography is a very challenging task, as it is difficult to find an accurate breast contour and extract regions of interest from it. Although several semi-automatic methods have been proposed for segmentation, their performance often depends on hand-crafted image features, as well as preprocessing operations.
In this work, an approach to automatic semantic segmentation of the Breast Infrared Thermography is proposed based on end-to-end fully convolutional neural networks and without any pre or post-processing.
The lack of labeled Breast Infrared Thermography data limits the complete utilization of fully convolutional neural networks. The proposed model overcomes this challenge by applying data augmentation and two-tier transfer learning from bigger datasets combined with adaptive multi-tier fine-tuning before training the fully convolutional neural networks model.
Experimental results show that the proposed approach achieves better segmentation results: 97.986% accuracy; 98.36% sensitivity and 97.61% specificity compared to hand-crafted segmentation methods.
This work provided an end-to-end automatic semantic segmentation of Breast Infrared Thermography combined with fully convolutional networks, adaptive multi-tier fine-tuning and transfer learning. Also, this work was able to deal with challenges in applying convolutional neural networks on such data and achieving the state-of-the-art accuracy.
准确分割乳腺红外热图是早期发现乳腺病变的重要步骤。乳腺红外热图的自动分割是一项极具挑战性的任务,因为很难找到准确的乳腺轮廓并从中提取感兴趣区域。尽管已经提出了几种半自动方法用于分割,但它们的性能通常取决于手工制作的图像特征以及预处理操作。
本研究提出了一种基于端到端全卷积神经网络的乳腺红外热图自动语义分割方法,无需任何预处理或后处理。
缺乏标记的乳腺红外热图数据限制了全卷积神经网络的完全利用。所提出的模型通过应用数据增强和从更大的数据集进行两级迁移学习,结合自适应多层次微调,在训练全卷积神经网络模型之前克服了这一挑战。
实验结果表明,与手工分割方法相比,所提出的方法具有更好的分割效果:准确率为 97.986%;灵敏度为 98.36%;特异性为 97.61%。
本研究提出了一种结合全卷积网络、自适应多层次微调以及迁移学习的乳腺红外热图端到端自动语义分割方法。此外,本研究还能够应对在这类数据上应用卷积神经网络并达到最先进的准确性方面的挑战。