Kawamoto Shota, Morikawa Yoshihiko, Yahagi Naohisa
Graduate School of Media and Governance, Keio University, Fujisawa, Japan.
JMIR Form Res. 2024 Apr 12;8:e52412. doi: 10.2196/52412.
Respiratory syncytial virus (RSV) affects children, causing serious infections, particularly in high-risk groups. Given the seasonality of RSV and the importance of rapid isolation of infected individuals, there is an urgent need for more efficient diagnostic methods to expedite this process.
This study aimed to investigate the performance of a machine learning model that leverages the temporal diversity of symptom onset for detecting RSV infections and elucidate its discriminatory ability.
The study was conducted in pediatric and emergency outpatient settings in Japan. We developed a detection model that remotely confirms RSV infection based on patient-reported symptom information obtained using a structured electronic template incorporating the differential points of skilled pediatricians. An extreme gradient boosting-based machine learning model was developed using the data of 4174 patients aged ≤24 months who underwent RSV rapid antigen testing. These patients visited either the pediatric or emergency department of Yokohama City Municipal Hospital between January 1, 2009, and December 31, 2015. The primary outcome was the diagnostic accuracy of the machine learning model for RSV infection, as determined by rapid antigen testing, measured using the area under the receiver operating characteristic curve. The clinical efficacy was evaluated by calculating the discriminative performance based on the number of days elapsed since the onset of the first symptom and exclusion rates based on thresholds of reasonable sensitivity and specificity.
Our model demonstrated an area under the receiver operating characteristic curve of 0.811 (95% CI 0.784-0.833) with good calibration and 0.746 (95% CI 0.694-0.794) for patients within 3 days of onset. It accurately captured the temporal evolution of symptoms; based on adjusted thresholds equivalent to those of a rapid antigen test, our model predicted that 6.9% (95% CI 5.4%-8.5%) of patients in the entire cohort would be positive and 68.7% (95% CI 65.4%-71.9%) would be negative. Our model could eliminate the need for additional testing in approximately three-quarters of all patients.
Our model may facilitate the immediate detection of RSV infection in outpatient settings and, potentially, in home environments. This approach could streamline the diagnostic process, reduce discomfort caused by invasive tests in children, and allow rapid implementation of appropriate treatments and isolation at home. The findings underscore the potential of machine learning in augmenting clinical decision-making in the early detection of RSV infection.
呼吸道合胞病毒(RSV)会感染儿童,引发严重感染,尤其是在高危人群中。鉴于RSV的季节性以及快速隔离感染个体的重要性,迫切需要更高效的诊断方法来加快这一进程。
本研究旨在调查一种利用症状发作时间多样性来检测RSV感染的机器学习模型的性能,并阐明其鉴别能力。
该研究在日本的儿科和急诊门诊环境中进行。我们开发了一种检测模型,该模型基于使用包含熟练儿科医生鉴别要点的结构化电子模板获取的患者报告症状信息,远程确认RSV感染。使用4174名年龄≤24个月且接受了RSV快速抗原检测的患者的数据,开发了一种基于极端梯度提升的机器学习模型。这些患者在2009年1月1日至2015年12月31日期间就诊于横滨市立医院的儿科或急诊科。主要结局是机器学习模型对RSV感染的诊断准确性,通过快速抗原检测确定,使用受试者操作特征曲线下面积进行测量。通过根据自首次症状发作以来经过的天数计算鉴别性能以及根据合理敏感性和特异性阈值计算排除率来评估临床疗效。
我们的模型在受试者操作特征曲线下面积为0.811(95%CI 0.784 - 0.833),校准良好,对于发病3天内的患者为0.746(95%CI 0.694 - 0.794)。它准确地捕捉了症状的时间演变;基于与快速抗原检测等效的调整阈值,我们的模型预测整个队列中6.9%(95%CI 5.4% - 8.5%)的患者为阳性,68.7%(95%CI 65.4% - 71.9%)为阴性。我们的模型可以在大约四分之三的患者中无需额外检测。
我们的模型可能有助于在门诊环境中,甚至可能在家庭环境中即时检测RSV感染。这种方法可以简化诊断过程,减少儿童侵入性检测带来的不适,并允许在家中快速实施适当的治疗和隔离。这些发现强调了机器学习在增强RSV感染早期检测中的临床决策方面的潜力。