Institute of Intensive Care Medicine, University Hospital of Zurich, Rämistrasse 100, 8091, Zurich, Switzerland.
Department of Intensive Care, Erasmus MC, University Medical Center, Rotterdam, The Netherlands.
Crit Care. 2022 Oct 14;26(1):311. doi: 10.1186/s13054-022-04190-y.
The sublingual microcirculation presumably exhibits disease-specific changes in function and morphology. Algorithm-based quantification of functional microcirculatory hemodynamic variables in handheld vital microscopy (HVM) has recently allowed identification of hemodynamic alterations in the microcirculation associated with COVID-19. In the present study we hypothesized that supervised deep machine learning could be used to identify previously unknown microcirculatory alterations, and combination with algorithmically quantified functional variables increases the model's performance to differentiate critically ill COVID-19 patients from healthy volunteers.
Four international, multi-central cohorts of critically ill COVID-19 patients and healthy volunteers (n = 59/n = 40) were used for neuronal network training and internal validation, alongside quantification of functional microcirculatory hemodynamic variables. Independent verification of the models was performed in a second cohort (n = 25/n = 33).
Six thousand ninety-two image sequences in 157 individuals were included. Bootstrapped internal validation yielded AUROC(CI) for detection of COVID-19 status of 0.75 (0.69-0.79), 0.74 (0.69-0.79) and 0.84 (0.80-0.89) for the algorithm-based, deep learning-based and combined models. Individual model performance in external validation was 0.73 (0.71-0.76) and 0.61 (0.58-0.63). Combined neuronal network and algorithm-based identification yielded the highest externally validated AUROC of 0.75 (0.73-0.78) (P < 0.0001 versus internal validation and individual models).
We successfully trained a deep learning-based model to differentiate critically ill COVID-19 patients from heathy volunteers in sublingual HVM image sequences. Internally validated, deep learning was superior to the algorithmic approach. However, combining the deep learning method with an algorithm-based approach to quantify the functional state of the microcirculation markedly increased the sensitivity and specificity as compared to either approach alone, and enabled successful external validation of the identification of the presence of microcirculatory alterations associated with COVID-19 status.
舌下微循环的功能和形态可能会出现特定的疾病变化。基于算法的手持式活体显微镜(HVM)中功能性微循环血液动力学变量的定量分析,最近已经能够识别与 COVID-19 相关的微循环血液动力学改变。在本研究中,我们假设可以使用监督深度学习来识别以前未知的微循环变化,并且与算法量化的功能变量相结合可以提高模型的性能,从而区分重症 COVID-19 患者和健康志愿者。
使用来自四个国际多中心的重症 COVID-19 患者和健康志愿者队列(n=59/n=40)进行神经元网络训练和内部验证,同时对功能性微循环血液动力学变量进行定量分析。模型的独立验证在第二个队列(n=25/n=33)中进行。
共纳入 157 名个体的 6092 个图像序列。经过自举法内部验证,基于算法、基于深度学习和组合模型检测 COVID-19 状态的 AUROC(CI)分别为 0.75(0.69-0.79)、0.74(0.69-0.79)和 0.84(0.80-0.89)。外部验证的个体模型性能分别为 0.73(0.71-0.76)和 0.61(0.58-0.63)。基于神经网络和基于算法的联合识别产生了最高的外部验证 AUROC,为 0.75(0.73-0.78)(P<0.0001,与内部验证和个体模型相比)。
我们成功地训练了一个基于深度学习的模型,用于区分舌下 HVM 图像序列中的重症 COVID-19 患者和健康志愿者。内部验证表明,深度学习优于算法方法。然而,将深度学习方法与基于算法的方法相结合来量化微循环的功能状态,与单独使用任何一种方法相比,都显著提高了敏感性和特异性,并成功地对与 COVID-19 状态相关的微循环改变的存在进行了外部验证。