Saravi Babak, Hassel Frank, Ülkümen Sara, Zink Alisia, Shavlokhova Veronika, Couillard-Despres Sebastien, Boeker Martin, Obid Peter, Lang Gernot Michael
Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany.
Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany.
J Pers Med. 2022 Mar 22;12(4):509. doi: 10.3390/jpm12040509.
Healthcare systems worldwide generate vast amounts of data from many different sources. Although of high complexity for a human being, it is essential to determine the patterns and minor variations in the genomic, radiological, laboratory, or clinical data that reliably differentiate phenotypes or allow high predictive accuracy in health-related tasks. Convolutional neural networks (CNN) are increasingly applied to image data for various tasks. Its use for non-imaging data becomes feasible through different modern machine learning techniques, converting non-imaging data into images before inputting them into the CNN model. Considering also that healthcare providers do not solely use one data modality for their decisions, this approach opens the door for multi-input/mixed data models which use a combination of patient information, such as genomic, radiological, and clinical data, to train a hybrid deep learning model. Thus, this reflects the main characteristic of artificial intelligence: simulating natural human behavior. The present review focuses on key advances in machine and deep learning, allowing for multi-perspective pattern recognition across the entire information set of patients in spine surgery. This is the first review of artificial intelligence focusing on hybrid models for deep learning applications in spine surgery, to the best of our knowledge. This is especially interesting as future tools are unlikely to use solely one data modality. The techniques discussed could become important in establishing a new approach to decision-making in spine surgery based on three fundamental pillars: (1) patient-specific, (2) artificial intelligence-driven, (3) integrating multimodal data. The findings reveal promising research that already took place to develop multi-input mixed-data hybrid decision-supporting models. Their implementation in spine surgery may hence be only a matter of time.
全球医疗保健系统从许多不同来源生成大量数据。尽管这些数据对人类来说高度复杂,但确定基因组、放射学、实验室或临床数据中的模式和微小变化至关重要,这些数据能可靠地区分表型或在与健康相关的任务中实现高预测准确性。卷积神经网络(CNN)越来越多地应用于各种图像数据任务。通过不同的现代机器学习技术,将非成像数据转换为图像后再输入到CNN模型中,使得其用于非成像数据变得可行。还考虑到医疗保健提供者在决策时并非仅使用一种数据模式,这种方法为多输入/混合数据模型打开了大门,该模型使用患者信息的组合,如基因组、放射学和临床数据,来训练混合深度学习模型。因此,这反映了人工智能的主要特征:模拟人类自然行为。本综述聚焦于机器学习和深度学习的关键进展,允许对脊柱手术患者的整个信息集进行多视角模式识别。据我们所知,这是第一篇聚焦于脊柱手术深度学习应用混合模型的人工智能综述。这尤其有趣,因为未来的工具不太可能仅使用一种数据模式。所讨论的技术在基于三个基本支柱建立脊柱手术决策新方法方面可能变得很重要:(1)针对患者个体,(2)由人工智能驱动,(3)整合多模态数据。研究结果揭示了已经开展的有前景的研究,以开发多输入混合数据混合决策支持模型。因此,它们在脊柱手术中的应用可能只是时间问题。