Texture-based Intraoperative Image Guidance for Tumor Localization in Minimally Invasive Surgery.

Intraoperative tumor localization in a deflated lung in minimally invasive surgery (MIS) is challenging as the lung cannot be manually palpated through small incisions. To do so remotely, an articulated multisensory imaging device combining tactile and ultrasound sensors was developed. It visualizes the surface tactile map and the depth of the tissue. However, with little maneuverability in MIS, localizing tumors using instrumented palpation is both tedious and inefficient. In this paper, a texture- based image guidance system that classifies tactile-guided ultrasound texture regions and provides beliefs on their types is proposed. The resulting interactive feedback allows directed palpation in MIS. A k-means classifier is used to first cluster gray-level co-occurrence matrix (GLCM)-based texture features of the ultrasound regions, followed by hidden Markov model-based belief propagation to establish confidence about the clustered features observing repeated patterns. When the beliefs converge, the system autonomously detects tumor and nontumor textures. The approach was tested on 20 ex vivo soft tissue specimens in a staged MIS. The results showed that with guidance, tumors in MIS could be localized with 98% accuracy, 99% sensitivity, and 97% specificity.Clinical Relevance- Texture-based image guidance adds efficiency and control to instrumented palpation in MIS. It renders fluidity and accuracy in image acquisition using a hand-held device where fatigue from prolonged handling affects imaging quality.