Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Medical Faculty, Heidelberg University, Heidelberg, Germany.
Sci Adv. 2023 Mar 10;9(10):eadd6778. doi: 10.1126/sciadv.add6778.
Laparoscopic surgery has evolved as a key technique for cancer diagnosis and therapy. While characterization of the tissue perfusion is crucial in various procedures, such as partial nephrectomy, doing so by means of visual inspection remains highly challenging. We developed a laparoscopic real-time multispectral imaging system featuring a compact and lightweight multispectral camera and the possibility to complement the conventional surgical view of the patient with functional information at a video rate of 25 Hz. To enable contrast agent-free ischemia monitoring during laparoscopic partial nephrectomy, we phrase the problem of ischemia detection as an out-of-distribution detection problem that does not rely on data from any other patient and uses an ensemble of invertible neural networks at its core. An in-human trial demonstrates the feasibility of our approach and highlights the potential of spectral imaging combined with advanced deep learning-based analysis tools for fast, efficient, reliable, and safe functional laparoscopic imaging.
腹腔镜手术已经发展成为癌症诊断和治疗的关键技术。虽然在部分肾切除术等各种手术中,组织灌注的特征化至关重要,但通过视觉检查来实现这一点仍然极具挑战性。我们开发了一种腹腔镜实时多光谱成像系统,该系统具有紧凑、轻便的多光谱相机,并且可以将功能信息以 25 Hz 的视频速率补充到患者的常规手术视图中。为了在腹腔镜部分肾切除术中实现无对比剂的缺血监测,我们将缺血检测问题表述为一种不依赖于任何其他患者数据的分布外检测问题,并使用一组可逆变体神经网络作为其核心。一项人体试验证明了我们方法的可行性,并强调了光谱成像与先进的基于深度学习的分析工具相结合,用于快速、高效、可靠和安全的功能腹腔镜成像的潜力。