Vuong Caroline, Utkarsh Kumar, Stojancic Rebecca, Subramaniam Arvind, Fernandez Olivia, Banerjee Tanvi, Abrams Daniel M, Fijnvandraat Karin, Shah Nirmish
Department of Pediatric Hematology, Emma Children's Hospital, Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands.
Department of Engineering Sciences and Applied Mathematics, Northwestern University, Evanston, IL, United States.
Front Digit Health. 2023 Oct 25;5:1285207. doi: 10.3389/fdgth.2023.1285207. eCollection 2023.
In sickle cell disease (SCD), unpredictable episodes of acute severe pain, known as vaso-occlusive crises (VOC), disrupt school, work activities and family life and ultimately lead to multiple hospitalizations. The ability to predict VOCs would allow a timely and adequate intervention. The first step towards this ultimate goal is to use patient-friendly and accessible technology to collect relevant data that helps infer a patient's pain experience during VOC. This study aims to: (1) determine the feasibility of remotely monitoring with a consumer wearable during hospitalization for VOC and up to 30 days after discharge, and (2) evaluate the accuracy of pain prediction using machine learning models based on physiological parameters measured by a consumer wearable.
Patients with SCD (≥18 years) who were admitted for a vaso-occlusive crisis were enrolled at a single academic center. Participants were instructed to report daily pain scores (0-10) in a mobile app (Nanbar) and to continuously wear an Apple Watch up to 30 days after discharge. Data included heart rate (in rest, average and variability) and step count. Demographics, SCD genotype, and details of hospitalization including pain scores reported to nurses, were extracted from electronic medical records. Physiological data from the wearable were associated with pain scores to fit 3 different machine learning classification models. The performance of the machine learning models was evaluated using: accuracy, F1, root-mean-square error and area under the receiver-operating curve.
Between April and June 2022, 19 patients (74% HbSS genotype) were included in this study and followed for a median time of 28 days [IQR 22-34], yielding a dataset of 2,395 pain data points. Ten participants were enrolled while hospitalized for VOC. The metrics of the best performing model, the random forest model, were micro-averaged accuracy of 92%, micro-averaged F1-score of 0.63, root-mean-square error of 1.1, and area under the receiving operating characteristic curve of 0.9.
Our random forest model accurately predicts high pain scores during admission for VOC and after discharge. The Apple Watch was a feasible method to collect physiologic data and provided accuracy in prediction of pain scores.
在镰状细胞病(SCD)中,不可预测的急性剧烈疼痛发作,即血管闭塞性危机(VOC),会扰乱学校、工作活动和家庭生活,并最终导致多次住院治疗。预测VOC的能力将有助于及时进行充分干预。实现这一最终目标的第一步是使用方便患者且易于获取的技术来收集相关数据,以帮助推断患者在VOC期间的疼痛体验。本研究旨在:(1)确定在因VOC住院期间及出院后长达30天内使用消费级可穿戴设备进行远程监测的可行性,以及(2)评估基于消费级可穿戴设备测量的生理参数,使用机器学习模型进行疼痛预测的准确性。
在一个学术中心招募因血管闭塞性危机入院的SCD患者(≥18岁)。参与者被要求在移动应用程序(Nanbar)中报告每日疼痛评分(0-10),并在出院后持续佩戴Apple Watch长达30天。数据包括心率(静息心率、平均心率和心率变异性)和步数。从电子病历中提取人口统计学信息、SCD基因型以及住院细节,包括向护士报告的疼痛评分。将可穿戴设备的生理数据与疼痛评分相关联,以拟合3种不同的机器学习分类模型。使用以下指标评估机器学习模型的性能:准确率、F1值、均方根误差和受试者工作特征曲线下面积。
在2022年4月至6月期间,本研究纳入了19名患者(74%为HbSS基因型),中位随访时间为28天[四分位间距22-34],产生了一个包含2395个疼痛数据点的数据集。10名参与者在因VOC住院期间入组。表现最佳的模型,即随机森林模型,其指标为微平均准确率92%、微平均F1分数0.63、均方根误差1.1以及受试者操作特征曲线下面积0.9。
我们的随机森林模型能够准确预测因VOC住院期间及出院后的高疼痛评分。Apple Watch是收集生理数据的可行方法,并在疼痛评分预测方面具有准确性。