• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

分箱数据可更好地对可穿戴设备中缺失时间序列数据进行插补。

Binned Data Provide Better Imputation of Missing Time Series Data from Wearables.

机构信息

Rhenix Lifesciences, Hyderabad 500038, India.

Department of BioSciences and BioEngineering, Indian Institute of Technology, Guwahati 781039, India.

出版信息

Sensors (Basel). 2023 Jan 28;23(3):1454. doi: 10.3390/s23031454.

DOI:10.3390/s23031454
PMID:36772494
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9919790/
Abstract

The presence of missing values in a time-series dataset is a very common and well-known problem. Various statistical and machine learning methods have been developed to overcome this problem, with the aim of filling in the missing values in the data. However, the performances of these methods vary widely, showing a high dependence on the type of data and correlations within the data. In our study, we performed some of the well-known imputation methods, such as expectation maximization, k-nearest neighbor, iterative imputer, random forest, and simple imputer, to impute missing data obtained from smart, wearable health trackers. In this manuscript, we proposed the use of data binning for imputation. We showed that the use of data binned around the missing time interval provides a better imputation than the use of a whole dataset. Imputation was performed for 15 min and 1 h of continuous missing data. We used a dataset with different bin sizes, such as 15 min, 30 min, 45 min, and 1 h, and we carried out evaluations using root mean square error (RMSE) values. We observed that the expectation maximization algorithm worked best for the use of binned data. This was followed by the simple imputer, iterative imputer, and k-nearest neighbor, whereas the random forest method had no effect on data binning during imputation. Moreover, the smallest bin sizes of 15 min and 1 h were observed to provide the lowest RMSE values for the majority of the time frames during the imputation of 15 min and 1 h of missing data, respectively. Although applicable to digital health data, we think that this method will also find applicability in other domains.

摘要

在时间序列数据集存在缺失值是一个非常常见和熟知的问题。已经开发了各种统计和机器学习方法来克服这个问题,目的是填补数据中的缺失值。然而,这些方法的性能差异很大,表现出对数据类型和数据内部相关性的高度依赖。在我们的研究中,我们对一些知名的插补方法进行了研究,如期望最大化、k-最近邻、迭代插补、随机森林和简单插补,以插补从智能可穿戴健康追踪器中获得的缺失数据。在本文中,我们提出了使用数据分箱进行插补。我们表明,在缺失时间间隔周围使用数据分箱提供了比使用整个数据集更好的插补。对 15 分钟和 1 小时的连续缺失数据进行了插补。我们使用了不同的分箱大小数据集,如 15 分钟、30 分钟、45 分钟和 1 小时,并使用均方根误差(RMSE)值进行了评估。我们观察到,期望最大化算法在使用分箱数据方面效果最好。其次是简单插补、迭代插补和 k-最近邻,而随机森林方法在插补期间对数据分箱没有影响。此外,对于 15 分钟和 1 小时缺失数据的插补,观察到最小的分箱大小为 15 分钟和 1 小时,分别为大多数时间帧提供了最低的 RMSE 值。虽然适用于数字健康数据,但我们认为该方法也将在其他领域找到适用性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/1fa9529e90d0/sensors-23-01454-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/42fd4120e536/sensors-23-01454-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/5e44cfa1556e/sensors-23-01454-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/054e0dc5b244/sensors-23-01454-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/3d4bd48efbf1/sensors-23-01454-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/8b0a25302162/sensors-23-01454-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/1fa9529e90d0/sensors-23-01454-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/42fd4120e536/sensors-23-01454-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/5e44cfa1556e/sensors-23-01454-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/054e0dc5b244/sensors-23-01454-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/3d4bd48efbf1/sensors-23-01454-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/8b0a25302162/sensors-23-01454-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2565/9919790/1fa9529e90d0/sensors-23-01454-g006.jpg

相似文献

1
Binned Data Provide Better Imputation of Missing Time Series Data from Wearables.分箱数据可更好地对可穿戴设备中缺失时间序列数据进行插补。
Sensors (Basel). 2023 Jan 28;23(3):1454. doi: 10.3390/s23031454.
2
Efficient use of binned data for imputing univariate time series data.有效利用分箱数据来插补单变量时间序列数据。
Front Big Data. 2024 Aug 21;7:1422650. doi: 10.3389/fdata.2024.1422650. eCollection 2024.
3
Advanced methods for missing values imputation based on similarity learning.基于相似性学习的缺失值插补先进方法。
PeerJ Comput Sci. 2021 Jul 21;7:e619. doi: 10.7717/peerj-cs.619. eCollection 2021.
4
Comparison of the effects of imputation methods for missing data in predictive modelling of cohort study datasets.缺失数据插补方法对队列研究数据集预测建模效果的比较。
BMC Med Res Methodol. 2024 Feb 16;24(1):41. doi: 10.1186/s12874-024-02173-x.
5
Missing Data Imputation Method Combining Random Forest and Generative Adversarial Imputation Network.结合随机森林与生成对抗插补网络的缺失数据插补方法
Sensors (Basel). 2024 Feb 8;24(4):1112. doi: 10.3390/s24041112.
6
Handling missing data in a rheumatoid arthritis registry using random forest approach.采用随机森林方法处理类风湿关节炎注册研究中的缺失数据。
Int J Rheum Dis. 2021 Oct;24(10):1282-1293. doi: 10.1111/1756-185X.14203. Epub 2021 Aug 12.
7
Extremely missing numerical data in Electronic Health Records for machine learning can be managed through simple imputation methods considering informative missingness: A comparative of solutions in a COVID-19 mortality case study.在电子健康记录中,针对机器学习的极度缺失数值数据可以通过考虑信息性缺失的简单插补方法来处理:一项关于COVID-19死亡率案例研究中各种解决方案的比较
Comput Methods Programs Biomed. 2023 Dec;242:107803. doi: 10.1016/j.cmpb.2023.107803. Epub 2023 Sep 7.
8
Self-Training With Quantile Errors for Multivariate Missing Data Imputation for Regression Problems in Electronic Medical Records: Algorithm Development Study.基于分位数误差的自训练在电子病历回归问题中对多变量缺失数据插补的应用:算法开发研究。
JMIR Public Health Surveill. 2021 Oct 13;7(10):e30824. doi: 10.2196/30824.
9
[Simulation study on missing data imputation methods for longitudinal data in cohort studies].队列研究中纵向数据缺失值插补方法的模拟研究
Zhonghua Liu Xing Bing Xue Za Zhi. 2021 Oct 10;42(10):1889-1894. doi: 10.3760/cma.j.cn112338-20201130-01363.
10
Imputation of missing values for cochlear implant candidate audiometric data and potential applications.人工耳蜗候选者听力学数据缺失值的推断及其潜在应用。
PLoS One. 2023 Feb 6;18(2):e0281337. doi: 10.1371/journal.pone.0281337. eCollection 2023.

引用本文的文献

1
Efficient use of binned data for imputing univariate time series data.有效利用分箱数据来插补单变量时间序列数据。
Front Big Data. 2024 Aug 21;7:1422650. doi: 10.3389/fdata.2024.1422650. eCollection 2024.
2
Missing Data Statistics Provide Causal Insights into Data Loss in Diabetes Health Monitoring by Wearable Sensors.缺失数据统计为可穿戴传感器监测糖尿病健康数据丢失提供了因果见解。
Sensors (Basel). 2024 Feb 27;24(5):1526. doi: 10.3390/s24051526.
3
Wearable Sensors as a Preoperative Assessment Tool: A Review.可穿戴传感器作为术前评估工具:综述。

本文引用的文献

1
Smart Consumer Wearables as Digital Diagnostic Tools: A Review.作为数字诊断工具的智能消费可穿戴设备:综述
Diagnostics (Basel). 2022 Aug 31;12(9):2110. doi: 10.3390/diagnostics12092110.
2
Effective Prevention and Management Tools for Metabolic Syndrome Based on Digital Health-Based Lifestyle Interventions Using Healthcare Devices.基于使用医疗设备的数字健康生活方式干预的代谢综合征有效预防和管理工具。
Diagnostics (Basel). 2022 Jul 16;12(7):1730. doi: 10.3390/diagnostics12071730.
3
Imputation by feature importance (IBFI): A methodology to envelop machine learning method for imputing missing patterns in time series data.
Sensors (Basel). 2024 Jan 12;24(2):482. doi: 10.3390/s24020482.
基于特征重要性的插补(IBFI):一种封装机器学习方法以插补时间序列数据中缺失模式的方法。
PLoS One. 2022 Jan 13;17(1):e0262131. doi: 10.1371/journal.pone.0262131. eCollection 2022.
4
A survey on missing data in machine learning.关于机器学习中缺失数据的一项调查。
J Big Data. 2021;8(1):140. doi: 10.1186/s40537-021-00516-9. Epub 2021 Oct 27.
5
Accuracy of random-forest-based imputation of missing data in the presence of non-normality, non-linearity, and interaction.基于随机森林的缺失数据插补在非正态性、非线性和交互作用存在下的准确性。
BMC Med Res Methodol. 2020 Jul 25;20(1):199. doi: 10.1186/s12874-020-01080-1.
6
Missing data imputation via the expectation-maximization algorithm can improve principal component analysis aimed at deriving biomarker profiles and dietary patterns.通过期望最大化算法进行缺失数据插补可以改进主成分分析,以得出生物标志物图谱和饮食模式。
Nutr Res. 2020 Mar;75:67-76. doi: 10.1016/j.nutres.2020.01.001. Epub 2020 Jan 9.
7
Imputing Missing Data In Large-Scale Multivariate Biomedical Wearable Recordings Using Bidirectional Recurrent Neural Networks With Temporal Activation Regularization.使用具有时间激活正则化的双向递归神经网络在大规模多变量生物医学可穿戴记录中插补缺失数据。
Annu Int Conf IEEE Eng Med Biol Soc. 2019 Jul;2019:2529-2534. doi: 10.1109/EMBC.2019.8856966.
8
Random forest-based imputation outperforms other methods for imputing LC-MS metabolomics data: a comparative study.基于随机森林的插补方法在 LC-MS 代谢组学数据插补方面优于其他方法:一项比较研究。
BMC Bioinformatics. 2019 Oct 11;20(1):492. doi: 10.1186/s12859-019-3110-0.
9
Evolution of Wearable Devices with Real-Time Disease Monitoring for Personalized Healthcare.用于个性化医疗保健的具有实时疾病监测功能的可穿戴设备的发展历程。
Nanomaterials (Basel). 2019 May 29;9(6):813. doi: 10.3390/nano9060813.
10
Finding the Optimal Imputation Strategy for Small Cattle Populations.寻找小型牛群的最优插补策略。
Front Genet. 2019 Feb 18;10:52. doi: 10.3389/fgene.2019.00052. eCollection 2019.