Chen Jintai, Ying Haochao, Liu Xuechen, Gu Jingjing, Feng Ruiwei, Chen Tingting, Gao Honghao, Wu Jian
IEEE/ACM Trans Comput Biol Bioinform. 2021 Jan-Feb;18(1):103-113. doi: 10.1109/TCBB.2020.2991173. Epub 2021 Feb 3.
Higher-resolution biopsy slice images reveal many details, which are widely used in medical practice. However, taking high-resolution slice images is more costly than taking low-resolution ones. In this paper, we propose a joint framework containing a novel transfer learning strategy and a deep super-resolution framework to generate high-resolution slice images from low-resolution ones. The super-resolution framework called SRFBN+ is proposed by modifying a state-of-the-art framework SRFBN. Specifically, the structure of the feedback block of SRFBN was modified to be more flexible. Besides, it is challenging to use typical transfer learning strategies directly for the tasks on slice images, as the patterns on different types of biopsy slice images are varying. To this end, we propose a novel transfer learning strategy, called Channel Fusion Transfer Learning (CF-Trans). CF-Trans builds a middle domain by fusing the data manifolds of the source domain and the target domain, serving as a springboard for knowledge transfer. Thus, in the transfer learning setting, SRFBN+ can be trained on the source domain and then the middle domain and finally the target domain. Experiments on biopsy slice images validate SRFBN+ works well in generating super-resolution slice images, and CF-Trans is an efficient transfer learning strategy.
高分辨率活检切片图像揭示了许多细节,在医学实践中被广泛使用。然而,获取高分辨率切片图像的成本比获取低分辨率图像更高。在本文中,我们提出了一个联合框架,该框架包含一种新颖的迁移学习策略和一个深度超分辨率框架,用于从低分辨率切片图像生成高分辨率切片图像。名为SRFBN+的超分辨率框架是通过修改一个先进的框架SRFBN提出的。具体来说,SRFBN的反馈块结构被修改得更加灵活。此外,直接将典型的迁移学习策略用于切片图像任务具有挑战性,因为不同类型活检切片图像上的模式各不相同。为此,我们提出了一种新颖的迁移学习策略,称为通道融合迁移学习(CF-Trans)。CF-Trans通过融合源域和目标域的数据流形构建一个中间域,作为知识迁移的跳板。因此,在迁移学习设置中,SRFBN+可以先在源域上训练,然后在中间域上训练,最后在目标域上训练。对活检切片图像的实验验证了SRFBN+在生成超分辨率切片图像方面表现良好,并且CF-Trans是一种有效的迁移学习策略。