Department of Digital Health, SAIHST, Sungkyunkwan University.
Mobile Doctor Co. Ltd, South Korea.
Stud Health Technol Inform. 2022 May 25;294:581-582. doi: 10.3233/SHTI220533.
It is very important to ensure reliable performance of deep learning model for future dataset for healthcare. This is more pronounced in the case of patient generated health data such as patient reported symptoms, which are not collected in a controlled environment. Since there has been a big difference in influenza incidence since the COVID-19 pandemic, we evaluated whether the deep learning model can maintain sufficiently robust performance against these changes. We have collected 226,655 episodes from 110,893 users since June 2020 and tested the influenza screening model, our model showed 87.02% sensitivity and 0.8670 of AUROC. The results of COVID-19 pandemic are comparable to that of before COVID-19 pandemic.
对于未来的医疗保健数据集,确保深度学习模型的可靠性能非常重要。对于患者生成的健康数据(例如患者报告的症状),这种情况更为明显,因为这些数据不是在受控环境中收集的。由于自 COVID-19 大流行以来,流感的发病率有了很大的不同,因此我们评估了深度学习模型是否可以针对这些变化保持足够强大的性能。自 2020 年 6 月以来,我们已经从 110,893 位用户中收集了 226,655 个病例,并测试了流感筛查模型,我们的模型的灵敏度为 87.02%,AUROC 为 0.8670。大流行期间的 COVID-19 结果与 COVID-19 之前的结果相当。