Clancy Neil T, Jones Geoffrey, Maier-Hein Lena, Elson Daniel S, Stoyanov Danail
Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, United Kingdom; Centre for Medical Image Computing (CMIC), Department of Medical Physics and Biomedical Engineering, University College London, United Kingdom.
Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, United Kingdom; Centre for Medical Image Computing (CMIC), Department of Computer Science, University College London, United Kingdom.
Med Image Anal. 2020 Jul;63:101699. doi: 10.1016/j.media.2020.101699. Epub 2020 Apr 13.
Recent technological developments have resulted in the availability of miniaturised spectral imaging sensors capable of operating in the multi- (MSI) and hyperspectral imaging (HSI) regimes. Simultaneous advances in image-processing techniques and artificial intelligence (AI), especially in machine learning and deep learning, have made these data-rich modalities highly attractive as a means of extracting biological information non-destructively. Surgery in particular is poised to benefit from this, as spectrally-resolved tissue optical properties can offer enhanced contrast as well as diagnostic and guidance information during interventions. This is particularly relevant for procedures where inherent contrast is low under standard white light visualisation. This review summarises recent work in surgical spectral imaging (SSI) techniques, taken from Pubmed, Google Scholar and arXiv searches spanning the period 2013-2019. New hardware, optimised for use in both open and minimally-invasive surgery (MIS), is described, and recent commercial activity is summarised. Computational approaches to extract spectral information from conventional colour images are reviewed, as tip-mounted cameras become more commonplace in MIS. Model-based and machine learning methods of data analysis are discussed in addition to simulation, phantom and clinical validation experiments. A wide variety of surgical pilot studies are reported but it is apparent that further work is needed to quantify the clinical value of MSI/HSI. The current trend toward data-driven analysis emphasises the importance of widely-available, standardised spectral imaging datasets, which will aid understanding of variability across organs and patients, and drive clinical translation.
近期的技术发展使得能够在多光谱成像(MSI)和高光谱成像(HSI)模式下运行的小型化光谱成像传感器得以问世。与此同时,图像处理技术和人工智能(AI),尤其是机器学习和深度学习方面的进步,使得这些数据丰富的模式作为一种无损提取生物信息的手段极具吸引力。外科手术尤其有望从中受益,因为光谱分辨的组织光学特性在干预过程中可以提供增强的对比度以及诊断和引导信息。这对于在标准白光可视化下固有对比度较低的手术尤为重要。本综述总结了2013年至2019年期间从PubMed、谷歌学术和arXiv搜索中获取的外科光谱成像(SSI)技术的最新研究成果。描述了针对开放手术和微创手术(MIS)进行优化的新型硬件,并总结了近期的商业活动。随着尖端安装摄像头在MIS中越来越普遍,对从传统彩色图像中提取光谱信息的计算方法进行了综述。除了模拟、体模和临床验证实验外,还讨论了基于模型和机器学习的数据分析方法。报告了各种各样的外科试点研究,但显然还需要进一步的工作来量化MSI/HSI的临床价值。当前数据驱动分析的趋势强调了广泛可用的标准化光谱成像数据集的重要性,这将有助于理解不同器官和患者之间的变异性,并推动临床转化。