Department of Advanced Robotics (ADVR), Istituto Italiano di Tecnologia, Via Morego 30, 16136, Genoa, GE, Italy.
Department of Electronics, Information and Bioengineering (DEIB), Politecnico di Milano, Piazza Leonardo da Vinci, 32, 20133, Milan, MI, Italy.
Int J Comput Assist Radiol Surg. 2018 Sep;13(9):1357-1367. doi: 10.1007/s11548-018-1787-6. Epub 2018 May 23.
Fast and accurate graft hepatic steatosis (HS) assessment is of primary importance for lowering liver dysfunction risks after transplantation. Histopathological analysis of biopsied liver is the gold standard for assessing HS, despite being invasive and time consuming. Due to the short time availability between liver procurement and transplantation, surgeons perform HS assessment through clinical evaluation (medical history, blood tests) and liver texture visual analysis. Despite visual analysis being recognized as challenging in the clinical literature, few efforts have been invested to develop computer-assisted solutions for HS assessment. The objective of this paper is to investigate the automatic analysis of liver texture with machine learning algorithms to automate the HS assessment process and offer support for the surgeon decision process.
Forty RGB images of forty different donors were analyzed. The images were captured with an RGB smartphone camera in the operating room (OR). Twenty images refer to livers that were accepted and 20 to discarded livers. Fifteen randomly selected liver patches were extracted from each image. Patch size was [Formula: see text]. This way, a balanced dataset of 600 patches was obtained. Intensity-based features (INT), histogram of local binary pattern ([Formula: see text]), and gray-level co-occurrence matrix ([Formula: see text]) were investigated. Blood-sample features (Blo) were included in the analysis, too. Supervised and semisupervised learning approaches were investigated for feature classification. The leave-one-patient-out cross-validation was performed to estimate the classification performance.
With the best-performing feature set ([Formula: see text]) and semisupervised learning, the achieved classification sensitivity, specificity, and accuracy were 95, 81, and 88%, respectively.
This research represents the first attempt to use machine learning and automatic texture analysis of RGB images from ubiquitous smartphone cameras for the task of graft HS assessment. The results suggest that is a promising strategy to develop a fully automatic solution to assist surgeons in HS assessment inside the OR.
快速准确地评估移植后肝肝功能障碍风险至关重要。尽管活检肝组织的组织病理学分析是评估 HS 的金标准,但它具有侵入性且耗时。由于在肝脏获取和移植之间可用的时间很短,外科医生通过临床评估(病史、血液检查)和肝脏纹理视觉分析来评估 HS。尽管在临床文献中,视觉分析被认为具有挑战性,但很少有努力投入到开发用于 HS 评估的计算机辅助解决方案中。本文的目的是研究使用机器学习算法自动分析肝脏纹理,以实现 HS 评估过程的自动化,并为外科医生的决策过程提供支持。
分析了四十名不同供体的四十张不同的 RGB 图像。这些图像是在手术室(OR)中使用 RGB 智能手机相机拍摄的。其中 20 张图像是指被接受的肝脏,20 张图像是指被丢弃的肝脏。从每张图像中随机提取 15 个肝斑。斑块大小为 [Formula: see text]。这样,就获得了一个包含 600 个斑块的平衡数据集。研究了基于强度的特征(INT)、局部二值模式的直方图([Formula: see text])和灰度共生矩阵([Formula: see text])。还包括血液样本特征(Blo)。研究了监督和半监督学习方法在特征分类中的应用。采用留一患者交叉验证法估计分类性能。
使用表现最佳的特征集 [Formula: see text] 和半监督学习,获得的分类灵敏度、特异性和准确性分别为 95%、81%和 88%。
这项研究代表了首次尝试使用机器学习和来自无处不在的智能手机相机的 RGB 图像的自动纹理分析来完成移植肝 HS 评估任务。结果表明,这是开发一种完全自动的解决方案来协助外科医生在 OR 中进行 HS 评估的有前途的策略。