Garbey Marc, Lesport Quentin, Girma Helen, Öztosen Gülṣen, Abu-Rub Mohammed, Guidon Amanda C, Juel Vern, Nowak Richard, Soliven Betty, Aban Inmaculada, Kaminski Henry J
medRxiv. 2024 Jul 19:2024.07.19.24310691. doi: 10.1101/2024.07.19.24310691.
Advances in video image analysis and artificial intelligence provide the opportunity to transform the approach to patient evaluation through objective digital evaluation.
We assessed ability to quantitate Zoom video recordings of a standardized neurological examination the myasthenia gravis core examination (MG-CE), which had been designed for telemedicine evaluations.
We used Zoom (Zoom Video Communications) videos of patients with myasthenia gravis undergoing the MG-CE. Computer vision in combination with artificial intelligence methods were used to build algorithms to analyze videos with a focus on eye or body motions. For the assessment of examinations involving vocalization, signal processing methods were developed, including natural language processing. A series of algorithms were built that could automatically compute the metrics of the MG-CE.
Fifty-one patients with MG with videos recorded twice on separate days and 15 control subjects were assessed once. We were successful in quantitating lid, eye, and arm positions and as well as well as develop respiratory metrics using breath counts. Cheek puff exercise was found to be of limited value for quantitation. Technical limitations included variations in illumination, bandwidth, and recording being done on the examiner side, not the patient.
Several aspects of the MG-CE can be quantitated to produce continuous measures via standard Zoom video recordings. Further development of the technology offer the ability for trained, non-physician, health care providers to perform precise examination of patients with MG outside the clinic, including for clinical trials.
Advances in video image analysis and artificial intelligence provide the opportunity to transform the approach to patient evaluation. Here, we asked whether video recordings of the typical telemedicine examination for the patient with myasthenia gravis be used to quantitate examination findings? Despite recordings not made for purpose, we were able to develop and apply computer vision and artificial intelligence to Zoom recorded videos to successfully quantitate eye muscle, facial muscle, and limb fatigue. The analysis also pointed out limitations of human assessments of bulbar and respiratory assessments. The neuromuscular examination can be enhanced by advance technologies, which have the promise to improve clinical trial outcome measures as well as standard care.
视频图像分析和人工智能的进展为通过客观数字评估改变患者评估方法提供了机会。
我们评估了对标准化神经系统检查即重症肌无力核心检查(MG-CE)的Zoom视频记录进行定量分析的能力,该检查是为远程医疗评估而设计的。
我们使用了接受MG-CE检查的重症肌无力患者的Zoom(Zoom视频通讯公司)视频。结合计算机视觉和人工智能方法构建算法,以分析视频,重点关注眼睛或身体动作。对于涉及发声的检查评估,开发了信号处理方法,包括自然语言处理。构建了一系列能够自动计算MG-CE指标的算法。
对51例MG患者进行了评估,他们的视频在不同日期录制了两次,对15名对照受试者进行了一次评估。我们成功地对眼睑、眼睛和手臂位置进行了定量分析,并且还通过呼吸计数得出了呼吸指标。发现脸颊吹气运动在定量分析方面价值有限。技术限制包括照明、带宽的变化以及记录是在检查者一方而非患者一方进行。
通过标准的Zoom视频记录,可以对MG-CE的几个方面进行定量分析,以产生连续测量值。该技术的进一步发展使经过培训的非医生医疗保健提供者有能力在诊所外对MG患者进行精确检查,包括用于临床试验。
视频图像分析和人工智能的进展为改变患者评估方法提供了机会。在此,我们询问重症肌无力患者典型远程医疗检查的视频记录是否可用于对检查结果进行定量分析?尽管记录并非为此目的而制作,但我们能够开发并将计算机视觉和人工智能应用于Zoom录制的视频,以成功定量分析眼肌、面部肌肉和肢体疲劳。分析还指出了对延髓和呼吸评估进行人工评估的局限性。先进技术可以增强神经肌肉检查,有望改善临床试验结果测量以及标准护理。