Har-Gil Hagai, Golgher Lior, Kain David, Blinder Pablo
Tel Aviv University, Sagol School of Neuroscience, Tel Aviv, Israel.
Tel Aviv University, Department of Neurobiology, George S. Wise Faculty of Life Sciences, Tel Aviv, Israel.
Neurophotonics. 2022 Jul;9(3):031920. doi: 10.1117/1.NPh.9.3.031920. Epub 2022 Sep 20.
rPySight brings a flexible and highly customizable open-software platform built around a powerful multichannel digitizer; combined, it enables performing complex photon counting-based experiments. We exploited advanced programming technology to share the photon counting stream with the graphical processing unit (GPU), making possible real-time display of two-dimensional (2D) and three-dimensional (3D) experiments and paving the road for other real-time applications. Photon counting improves multiphoton imaging by providing better signal-to-noise ratio in photon-deprived applications and is becoming more widely implemented, as indicated by its increasing presence in many microscopy vendor portfolios. Despite the relatively easy access to this technology offered in commercial systems, these remain limited to one or two channels of data and might not enable highly tailored experiments, forcing most researchers to develop their own electronics and code. We set to develop a flexible and open-source interface to a cutting-edge multichannel fast digitizer that can be easily integrated into existing imaging systems. We selected an advanced multichannel digitizer capable of generating 70M tags/s and wrote an open software application, based on Rust and Python languages, to share the stream of detected events with the GPU, enabling real-time data processing. rPySight functionality was showcased in real-time monitoring of 2D imaging, improved calcium imaging, multiplexing, and 3D imaging through a varifocal lens. We provide a detailed protocol for implementing out-of-the-box rPySight and its related hardware. Applying photon-counting approaches is becoming a fundamental component in recent technical developments that push well beyond existing acquisition speed limitations of classical multiphoton approaches. Given the performance of rPySight, we foresee its use to capture, among others, the joint dynamics of hundreds (if not thousands) of neuronal and vascular elements across volumes, as is likely required to uncover in a much broader sense the hemodynamic transform function.
rPySight带来了一个灵活且高度可定制的开放软件平台,该平台围绕强大的多通道数字化仪构建;两者结合,能够进行基于复杂光子计数的实验。我们利用先进的编程技术,将光子计数流与图形处理单元(GPU)共享,从而实现二维(2D)和三维(3D)实验的实时显示,并为其他实时应用铺平了道路。光子计数通过在光子匮乏的应用中提供更好的信噪比来改善多光子成像,并且正如其在许多显微镜供应商产品组合中越来越多的出现所表明的那样,它正得到更广泛的应用。尽管商业系统中提供了相对容易获得的这项技术,但这些系统仍限于一两个数据通道,可能无法进行高度定制的实验,这迫使大多数研究人员开发自己的电子设备和代码。我们着手开发一个灵活的开源接口,连接到一个前沿的多通道快速数字化仪,该数字化仪可以轻松集成到现有的成像系统中。我们选择了一个能够每秒生成7000万个标签的先进多通道数字化仪,并基于Rust和Python语言编写了一个开放软件应用程序,以与GPU共享检测到的事件流,实现实时数据处理。rPySight的功能在2D成像的实时监测、改进的钙成像、多路复用以及通过变焦镜头进行的3D成像中得到了展示。我们提供了一个详细的协议,用于实现开箱即用的rPySight及其相关硬件。应用光子计数方法正成为近期技术发展中的一个基本组成部分,这些技术发展远远超出了传统多光子方法现有的采集速度限制。鉴于rPySight的性能,我们预计它可用于捕获,尤其是跨体积的数百(甚至数千)个神经元和血管元件的联合动态,这很可能是在更广泛意义上揭示血液动力学转换函数所必需的。