IEEE Trans Med Imaging. 2020 Aug;39(8):2676-2687. doi: 10.1109/TMI.2020.2994459. Epub 2020 May 14.
Deep learning (DL) has proved successful in medical imaging and, in the wake of the recent COVID-19 pandemic, some works have started to investigate DL-based solutions for the assisted diagnosis of lung diseases. While existing works focus on CT scans, this paper studies the application of DL techniques for the analysis of lung ultrasonography (LUS) images. Specifically, we present a novel fully-annotated dataset of LUS images collected from several Italian hospitals, with labels indicating the degree of disease severity at a frame-level, video-level, and pixel-level (segmentation masks). Leveraging these data, we introduce several deep models that address relevant tasks for the automatic analysis of LUS images. In particular, we present a novel deep network, derived from Spatial Transformer Networks, which simultaneously predicts the disease severity score associated to a input frame and provides localization of pathological artefacts in a weakly-supervised way. Furthermore, we introduce a new method based on uninorms for effective frame score aggregation at a video-level. Finally, we benchmark state of the art deep models for estimating pixel-level segmentations of COVID-19 imaging biomarkers. Experiments on the proposed dataset demonstrate satisfactory results on all the considered tasks, paving the way to future research on DL for the assisted diagnosis of COVID-19 from LUS data.
深度学习(DL)已在医学成像领域取得了成功,并且在最近的 COVID-19 大流行之后,一些工作已经开始研究基于 DL 的解决方案,以辅助诊断肺部疾病。虽然现有工作主要集中在 CT 扫描上,但本文研究了将 DL 技术应用于分析肺部超声(LUS)图像。具体来说,我们提出了一个新的完全注释的 LUS 图像数据集,这些图像来自几家意大利医院,标签表示在帧级、视频级和像素级(分割掩模)的疾病严重程度。利用这些数据,我们引入了几个深度模型,以解决 LUS 图像自动分析的相关任务。特别是,我们提出了一种新颖的深度网络,它源自空间变换网络,能够以弱监督的方式同时预测与输入帧相关的疾病严重程度得分,并提供病理伪影的定位。此外,我们还引入了一种基于非单调逻辑的新方法,用于在视频级有效聚合帧得分。最后,我们对用于估计 COVID-19 成像生物标志物像素级分割的最新深度模型进行了基准测试。在提出的数据集上进行的实验在所有考虑的任务中都取得了令人满意的结果,为未来基于 LUS 数据的 COVID-19 辅助诊断的 DL 研究铺平了道路。