He Qiang, Duan Yujie, Yang Zhiyu, Wang Yaxuan, Yang Liyu, Bai Lin, Zhao Liang
Precision Medicine Research Center, Taihe Hospital, Hubei University of Medicine, Shiyan, China.
School of Computing and Electronic Information, Guangxi University, Nanning, China.
Quant Imaging Med Surg. 2023 Aug 1;13(8):5043-5057. doi: 10.21037/qims-22-1399. Epub 2023 Jul 5.
Data augmentation with context has been an effective way to increase the robustness and generalizability of deep learning models. However, to our knowledge, shape uniformity, expansion limit, and fusion strategy of context have yet to be comprehensively studied, particularly in lesion segmentation of medical images.
To examine the impact of these factors, we take liver lesion segmentation based on the well-known deep learning architecture U-Net as an example and thoroughly vary the context shape, the expansion bandwidth as well as three representative fusion methods. In particular, the context shape includes rectangular, circular and polygonal, the expansion bandwidth is scaled by a maximum value of 2 compared to the lesion size, and the context fusion weighting strategy is composed of average, Gaussian and inverse Gaussian.
Studies conducted on a newly constructed high-quality and large-volume dataset show that (I) uniform context improves lesion segmentation, (II) expanding the context with either 5 or 7 pixels yields the highest performance for liver lesion segmentation, depending on the lesion size, and (III) an unevenly distributed weighting strategy for context fusion is appreciated but in the opposite direction, depending on lesion size as well.
Our findings and newly constructed dataset are expected to be useful for liver lesion segmentation, especially for small lesions.
利用上下文进行数据增强一直是提高深度学习模型鲁棒性和泛化能力的有效方法。然而,据我们所知,上下文的形状均匀性、扩展限度和融合策略尚未得到全面研究,尤其是在医学图像病变分割方面。
为了研究这些因素的影响,我们以基于著名深度学习架构U-Net的肝脏病变分割为例,全面改变上下文形状、扩展带宽以及三种具有代表性的融合方法。具体而言,上下文形状包括矩形、圆形和多边形,扩展带宽相对于病变大小按最大值2进行缩放,上下文融合加权策略由平均、高斯和反高斯组成。
在新构建的高质量大容量数据集上进行的研究表明,(I)均匀的上下文可改善病变分割;(II)根据病变大小,将上下文扩展5或7个像素可在肝脏病变分割中产生最高性能;(III)上下文融合的不均匀分布加权策略也受到青睐,但方向相反,同样取决于病变大小。
我们的研究结果和新构建的数据集有望用于肝脏病变分割,尤其是对于小病变。