Yang Wei, Knorr Florian, Latka Ines, Vogt Matthias, Hofmann Gunther O, Popp Jürgen, Schie Iwan W
Leibniz Institute of Photonic Technology Jena, Albert-Einstein-Straße 9, 07745, Jena, Germany.
Department of Trauma, Hand and Reconstructive Surgery, University Hospital Jena, Am Klinikum 1, 07747, Jena, Germany.
Light Sci Appl. 2022 Apr 8;11(1):90. doi: 10.1038/s41377-022-00773-0.
The steady progress in medical diagnosis and treatment of diseases largely hinges on the steady development and improvement of modern imaging modalities. Raman spectroscopy has attracted increasing attention for clinical applications as it is label-free, non-invasive, and delivers molecular fingerprinting information of a sample. In combination with fiber optic probes, it also allows easy access to different body parts of a patient. However, image acquisition with fiber optic probes is currently not possible. Here, we introduce a fiber optic probe-based Raman imaging system for the real-time molecular virtual reality data visualization of chemical boundaries on a computer screen and the physical world. The approach is developed around a computer vision-based positional tracking system in conjunction with photometric stereo and augmented and mixed chemical reality, enabling molecular imaging and direct visualization of molecular boundaries of three-dimensional surfaces. The proposed approach achieves a spatial resolution of 0.5 mm in the transverse plane and a topology resolution of 0.6 mm, with a spectral sampling frequency of 10 Hz, and can be used to image large tissue areas in a few minutes, making it highly suitable for clinical tissue-boundary demarcation. A variety of applications on biological samples, i.e., distribution of pharmaceutical compounds, brain-tumor phantom, and various types of sarcoma have been characterized, showing that the system enables rapid and intuitive assessment of molecular boundaries.
疾病医学诊断与治疗的稳步进展在很大程度上取决于现代成像模式的稳步发展与改进。拉曼光谱因其无需标记、非侵入性且能提供样品的分子指纹信息而在临床应用中受到越来越多的关注。与光纤探头相结合，它还能方便地对患者身体的不同部位进行检测。然而，目前使用光纤探头进行图像采集是不可能的。在此，我们介绍一种基于光纤探头的拉曼成像系统，用于在计算机屏幕和物理世界中对化学边界进行实时分子虚拟现实数据可视化。该方法是围绕基于计算机视觉的位置跟踪系统，结合光度立体视觉以及增强和混合化学现实技术开发的，能够实现分子成像并直接可视化三维表面的分子边界。所提出的方法在横向平面上实现了0.5毫米的空间分辨率和0.6毫米的拓扑分辨率，光谱采样频率为10赫兹，并且可以在几分钟内对大的组织区域进行成像，这使其非常适合临床组织边界的划定。已对生物样品上的各种应用进行了表征，即药物化合物的分布、脑肿瘤模型以及各种类型的肉瘤，结果表明该系统能够对分子边界进行快速且直观的评估。
