Song Pingfan, Jadan Herman Verinaz, Howe Carmel L, Foust Amanda J, Dragotti Pier Luigi
Department of Engineering, University of Cambridge, Cambridge, CB2 1PZ, UK.
Department of Electronic and Electrical Engineering, Imperial College London, London, SW7 2AZ, UK.
IEEE Signal Process Mag. 2022 Mar;39(2):58-72. doi: 10.1109/MSP.2021.3123557.
Understanding how networks of neurons process information is one of the key challenges in modern neuroscience. A necessary step to achieve this goal is to be able to observe the dynamics of large populations of neurons over a large area of the brain. Light-field microscopy (LFM), a type of scanless microscope, is a particularly attractive candidate for high-speed three-dimensional (3D) imaging. It captures volumetric information in a single snapshot, allowing volumetric imaging at video frame-rates. Specific features of imaging neuronal activity using LFM call for the development of novel machine learning approaches that fully exploit priors embedded in physics and optics models. Signal processing theory and wave-optics theory could play a key role in filling this gap, and contribute to novel computational methods with enhanced interpretability and generalization by integrating model-driven and data-driven approaches. This paper is devoted to a comprehensive survey to state-of-the-art of computational methods for LFM, with a focus on model-based and data-driven approaches.
理解神经元网络如何处理信息是现代神经科学的关键挑战之一。实现这一目标的必要步骤是能够在大脑的大面积区域观察大量神经元的动态。光场显微镜(LFM)是一种无扫描显微镜,是高速三维(3D)成像特别有吸引力的候选技术。它在单次快照中捕获体积信息,允许以视频帧率进行体积成像。使用LFM对神经元活动进行成像的特定特征要求开发新颖的机器学习方法,以充分利用物理和光学模型中嵌入的先验知识。信号处理理论和波动光学理论可以在填补这一空白方面发挥关键作用,并通过整合模型驱动和数据驱动的方法,为具有增强的可解释性和泛化性的新型计算方法做出贡献。本文致力于对LFM计算方法的最新进展进行全面综述,重点关注基于模型和数据驱动的方法。