Department of Bioengineering, The University of Texas at Dallas, 800 W. Campbell Road, Richardson, TX 75080, USA.
Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain.
Sensors (Basel). 2019 Feb 22;19(4):920. doi: 10.3390/s19040920.
The main goal of brain cancer surgery is to perform an accurate resection of the tumor, preserving as much normal brain tissue as possible for the patient. The development of a non-contact and label-free method to provide reliable support for tumor resection in real-time during neurosurgical procedures is a current clinical need. Hyperspectral imaging is a non-contact, non-ionizing, and label-free imaging modality that can assist surgeons during this challenging task without using any contrast agent. In this work, we present a deep learning-based framework for processing hyperspectral images of human brain tissue. The proposed framework was evaluated by our human image database, which includes 26 hyperspectral cubes from 16 different patients, among which 258,810 pixels were labeled. The proposed framework is able to generate a thematic map where the parenchymal area of the brain is delineated and the location of the tumor is identified, providing guidance to the operating surgeon for a successful and precise tumor resection. The deep learning pipeline achieves an overall accuracy of 80% for multiclass classification, improving the results obtained with traditional support vector machine (SVM)-based approaches. In addition, an aid visualization system is presented, where the final thematic map can be adjusted by the operating surgeon to find the optimal classification threshold for the current situation during the surgical procedure.
脑癌手术的主要目标是对肿瘤进行精确切除,尽可能多地保留患者的正常脑组织。开发一种非接触式和无标记的方法,在神经外科手术过程中实时提供可靠的肿瘤切除支持,是当前的临床需求。高光谱成像是一种非接触式、非电离和无标记的成像方式,可以在不使用任何造影剂的情况下协助外科医生完成这项具有挑战性的任务。在这项工作中,我们提出了一个基于深度学习的处理人脑组织高光谱图像的框架。该框架通过我们的人类图像数据库进行了评估,该数据库包括 16 名不同患者的 26 个高光谱立方体,其中 258810 个像素被标记。该框架能够生成一个主题地图,其中勾勒出了脑实质区域,并确定了肿瘤的位置,为手术医生提供了成功和精确切除肿瘤的指导。深度学习管道实现了多类分类的总体准确性为 80%,优于基于传统支持向量机 (SVM) 的方法的结果。此外,还提出了一个辅助可视化系统,手术医生可以通过该系统调整最终的主题地图,以找到手术过程中当前情况的最佳分类阈值。