Research Center of Mathematics for Social Creativity, Research Institute for Electronic Science, Hokkaido University, Sapporo 001-0020, Hokkaido, Japan.
Institute for Chemical Reaction Design and Discovery, Hokkaido University, Sapporo 001-0021, Hokkaido, Japan.
Proc Natl Acad Sci U S A. 2024 Mar 19;121(12):e2304866121. doi: 10.1073/pnas.2304866121. Epub 2024 Mar 14.
Accelerating the measurement for discrimination of samples, such as classification of cell phenotype, is crucial when faced with significant time and cost constraints. Spontaneous Raman microscopy offers label-free, rich chemical information but suffers from long acquisition time due to extremely small scattering cross-sections. One possible approach to accelerate the measurement is by measuring necessary parts with a suitable number of illumination points. However, how to design these points during measurement remains a challenge. To address this, we developed an imaging technique based on a reinforcement learning in machine learning (ML). This ML approach adaptively feeds back "optimal" illumination pattern during the measurement to detect the existence of specific characteristics of interest, allowing faster measurements while guaranteeing discrimination accuracy. Using a set of Raman images of human follicular thyroid and follicular thyroid carcinoma cells, we showed that our technique requires 3,333 to 31,683 times smaller number of illuminations for discriminating the phenotypes than raster scanning. To quantitatively evaluate the number of illuminations depending on the requisite discrimination accuracy, we prepared a set of polymer bead mixture samples to model anomalous and normal tissues. We then applied a home-built programmable-illumination microscope equipped with our algorithm, and confirmed that the system can discriminate the sample conditions with 104 to 4,350 times smaller number of illuminations compared to standard point illumination Raman microscopy. The proposed algorithm can be applied to other types of microscopy that can control measurement condition on the fly, offering an approach for the acceleration of accurate measurements in various applications including medical diagnosis.
加速对样本的测量,例如细胞表型的分类,在面临大量时间和成本限制时至关重要。自发拉曼显微镜提供无标记、丰富的化学信息,但由于散射截面极小,采集时间很长。一种可能的加速测量的方法是用适当数量的照明点测量必要的部分。然而,如何在测量过程中设计这些点仍然是一个挑战。为了解决这个问题,我们开发了一种基于机器学习(ML)中强化学习的成像技术。这种 ML 方法在测量过程中自适应地反馈“最佳”照明模式,以检测特定感兴趣特征的存在,从而实现更快的测量,同时保证区分准确性。使用一组人类滤泡甲状腺和滤泡甲状腺癌细胞的拉曼图像,我们表明,我们的技术在区分表型方面所需的照明次数比光栅扫描少 3,333 到 31,683 倍。为了根据所需的区分准确性定量评估照明次数,我们准备了一组聚合物珠混合物样本,以模拟异常和正常组织。然后,我们应用了一台带有我们算法的自制可编程照明显微镜,并证实该系统可以通过比标准点照明拉曼显微镜少 104 到 4,350 倍的照明次数来区分样本条件。所提出的算法可以应用于其他类型的显微镜,可以实时控制测量条件,为各种应用(包括医疗诊断)中的准确测量加速提供了一种方法。