Suppr超能文献

基于深度学习在缺乏真实值的波动型纳米显微镜图像中去除伪影

Artefact removal in ground truth deficient fluctuations-based nanoscopy images using deep learning.

作者信息

Jadhav Suyog, Acuña Sebastian, Opstad Ida S, Singh Ahluwalia Balpreet, Agarwal Krishna, Prasad Dilip K

机构信息

Indian Institute of Technology (Indian School of Mines), Dhanbad 826004, India.

Department of Physics and Technology, UiT The Arctic University of Norway, Tromsø, Norway.

出版信息

Biomed Opt Express. 2020 Dec 8;12(1):191-210. doi: 10.1364/BOE.410617. eCollection 2021 Jan 1.

Abstract

Image denoising or artefact removal using deep learning is possible in the availability of supervised training dataset acquired in real experiments or synthesized using known noise models. Neither of the conditions can be fulfilled for nanoscopy (super-resolution optical microscopy) images that are generated from microscopy videos through statistical analysis techniques. Due to several physical constraints, a supervised dataset cannot be measured. Further, the non-linear spatio-temporal mixing of data and valuable statistics of fluctuations from fluorescent molecules that compete with noise statistics. Therefore, noise or artefact models in nanoscopy images cannot be explicitly learned. Here, we propose a robust and versatile simulation-supervised training approach of deep learning auto-encoder architectures for the highly challenging nanoscopy images of sub-cellular structures inside biological samples. We show the proof of concept for one nanoscopy method and investigate the scope of generalizability across structures, and nanoscopy algorithms not included during simulation-supervised training. We also investigate a variety of loss functions and learning models and discuss the limitation of existing performance metrics for nanoscopy images. We generate valuable insights for this highly challenging and unsolved problem in nanoscopy, and set the foundation for the application of deep learning problems in nanoscopy for life sciences.

摘要

在通过真实实验获取或使用已知噪声模型合成的监督训练数据集可用的情况下,使用深度学习进行图像去噪或伪影去除是可行的。对于通过统计分析技术从显微镜视频生成的纳米显微镜(超分辨率光学显微镜)图像,这两个条件都无法满足。由于几个物理限制,无法测量监督数据集。此外,数据的非线性时空混合以及来自荧光分子的波动的有价值统计与噪声统计相互竞争。因此,无法明确学习纳米显微镜图像中的噪声或伪影模型。在此,我们针对生物样本内亚细胞结构的极具挑战性的纳米显微镜图像,提出了一种深度学习自动编码器架构的强大且通用的模拟监督训练方法。我们展示了一种纳米显微镜方法的概念验证,并研究了跨结构以及模拟监督训练期间未包括的纳米显微镜算法的可推广范围。我们还研究了各种损失函数和学习模型,并讨论了纳米显微镜图像现有性能指标的局限性。我们为纳米显微镜中这个极具挑战性且未解决的问题产生了有价值的见解,并为深度学习问题在生命科学纳米显微镜中的应用奠定了基础。

相似文献

3
Denoising of stimulated Raman scattering microscopy images via deep learning.通过深度学习实现受激拉曼散射显微镜图像的去噪
Biomed Opt Express. 2019 Jul 10;10(8):3860-3874. doi: 10.1364/BOE.10.003860. eCollection 2019 Aug 1.
6
Unsupervised Image Restoration Using Partially Linear Denoisers.使用部分线性去噪器的无监督图像恢复
IEEE Trans Pattern Anal Mach Intell. 2022 Sep;44(9):5796-5812. doi: 10.1109/TPAMI.2021.3070382. Epub 2022 Aug 4.

本文引用的文献

5
Lysosomal size matters.溶酶体大小很重要。
Traffic. 2020 Jan;21(1):60-75. doi: 10.1111/tra.12714. Epub 2019 Dec 6.
7
Denoising of stimulated Raman scattering microscopy images via deep learning.通过深度学习实现受激拉曼散射显微镜图像的去噪
Biomed Opt Express. 2019 Jul 10;10(8):3860-3874. doi: 10.1364/BOE.10.003860. eCollection 2019 Aug 1.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验