• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于时间序列连续分类的自适应模型训练策略。

Adaptive model training strategy for continuous classification of time series.

作者信息

Sun Chenxi, Li Hongyan, Song Moxian, Cai Derun, Zhang Baofeng, Hong Shenda

机构信息

School of Intelligence Science and Technology, Peking University, Beijing, China.

Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing, China.

出版信息

Appl Intell (Dordr). 2023 Feb 11:1-19. doi: 10.1007/s10489-022-04433-z.

DOI:10.1007/s10489-022-04433-z
PMID:36819946
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9922045/
Abstract

The classification of time series is essential in many real-world applications like healthcare. The class of a time series is usually labeled at the final time, but more and more time-sensitive applications require classifying time series continuously. For example, the outcome of a critical patient is only determined at the end, but he should be diagnosed at all times for timely treatment. For this demand, we propose a new concept, Continuous Classification of Time Series (CCTS). Different from the existing single-shot classification, the key of CCTS is to model multiple distributions simultaneously due to the dynamic evolution of time series. But the deep learning model will encounter intertwined problems of catastrophic forgetting and over-fitting when learning multi-distribution. In this work, we found that the well-designed distribution division and replay strategies in the model training process can help to solve the problems. We propose a novel Adaptive model training strategy for CCTS (ACCTS). Its adaptability represents two aspects: (1) Adaptive multi-distribution extraction policy. Instead of the fixed rules and the prior knowledge, ACCTS extracts data distributions adaptive to the time series evolution and the model change; (2) Adaptive importance-based replay policy. Instead of reviewing all old distributions, ACCTS only replays important samples adaptive to their contribution to the model. Experiments on four real-world datasets show that our method outperforms all baselines.

摘要

时间序列分类在医疗保健等许多实际应用中至关重要。时间序列的类别通常在最后时刻标记,但越来越多对时间敏感的应用需要对时间序列进行连续分类。例如,危急患者的结果仅在最后确定,但为了及时治疗,应随时对其进行诊断。针对这一需求,我们提出了一个新概念,即时间序列连续分类(CCTS)。与现有的单次分类不同,CCTS的关键在于由于时间序列的动态演变而同时对多个分布进行建模。但是深度学习模型在学习多分布时会遇到灾难性遗忘和过拟合的交织问题。在这项工作中,我们发现模型训练过程中精心设计的分布划分和重放策略有助于解决这些问题。我们提出了一种用于CCTS的新颖自适应模型训练策略(ACCTS)。其适应性体现在两个方面:(1)自适应多分布提取策略。ACCTS不是采用固定规则和先验知识,而是提取适应时间序列演变和模型变化的数据分布;(2)基于重要性的自适应重放策略。ACCTS不是回顾所有旧分布,而是仅重放对模型贡献具有适应性的重要样本。在四个真实世界数据集上的实验表明,我们的方法优于所有基线。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/c95eaf65f827/10489_2022_4433_Fig12_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/fd1907c3d755/10489_2022_4433_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/649f89543790/10489_2022_4433_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/cf9e2954dc53/10489_2022_4433_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/d11bf60b60d2/10489_2022_4433_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/cb2210d18304/10489_2022_4433_Figg_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/65eb1a465d91/10489_2022_4433_Figh_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/df43c5cdc766/10489_2022_4433_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/210ffd7e5d37/10489_2022_4433_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/e3f71da6e6b5/10489_2022_4433_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/95a92aef3c38/10489_2022_4433_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/ba83b4d6ad00/10489_2022_4433_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/1d9b3091fd53/10489_2022_4433_Fig10_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/379f8352440f/10489_2022_4433_Fig11_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/c95eaf65f827/10489_2022_4433_Fig12_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/fd1907c3d755/10489_2022_4433_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/649f89543790/10489_2022_4433_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/cf9e2954dc53/10489_2022_4433_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/d11bf60b60d2/10489_2022_4433_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/cb2210d18304/10489_2022_4433_Figg_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/65eb1a465d91/10489_2022_4433_Figh_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/df43c5cdc766/10489_2022_4433_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/210ffd7e5d37/10489_2022_4433_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/e3f71da6e6b5/10489_2022_4433_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/95a92aef3c38/10489_2022_4433_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/ba83b4d6ad00/10489_2022_4433_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/1d9b3091fd53/10489_2022_4433_Fig10_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/379f8352440f/10489_2022_4433_Fig11_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3f58/9922045/c95eaf65f827/10489_2022_4433_Fig12_HTML.jpg

相似文献

1
Adaptive model training strategy for continuous classification of time series.用于时间序列连续分类的自适应模型训练策略。
Appl Intell (Dordr). 2023 Feb 11:1-19. doi: 10.1007/s10489-022-04433-z.
2
Few Shot Class Incremental Learning via Efficient Prototype Replay and Calibration.通过高效原型重放和校准实现少样本类别增量学习
Entropy (Basel). 2023 May 10;25(5):776. doi: 10.3390/e25050776.
3
Continuous diagnosis and prognosis by controlling the update process of deep neural networks.通过控制深度神经网络的更新过程进行连续诊断和预后评估。
Patterns (N Y). 2023 Feb 3;4(2):100687. doi: 10.1016/j.patter.2023.100687. eCollection 2023 Feb 10.
4
Rethinking exemplars for continual semantic segmentation in endoscopy scenes: Entropy-based mini-batch pseudo-replay.重新思考内窥镜场景中持续语义分割的范例:基于熵的小批量伪重放。
Comput Biol Med. 2023 Oct;165:107412. doi: 10.1016/j.compbiomed.2023.107412. Epub 2023 Aug 30.
5
Few-Shot Class-Incremental Learning for Medical Time Series Classification.用于医学时间序列分类的少样本类别增量学习
IEEE J Biomed Health Inform. 2023 Feb 22;PP. doi: 10.1109/JBHI.2023.3247861.
6
Privacy-preserving continual learning methods for medical image classification: a comparative analysis.用于医学图像分类的隐私保护持续学习方法:比较分析
Front Med (Lausanne). 2023 Aug 14;10:1227515. doi: 10.3389/fmed.2023.1227515. eCollection 2023.
7
Learnable Distribution Calibration for Few-Shot Class-Incremental Learning.用于少样本类别增量学习的可学习分布校准
IEEE Trans Pattern Anal Mach Intell. 2023 Oct;45(10):12699-12706. doi: 10.1109/TPAMI.2023.3273291. Epub 2023 Sep 5.
8
A survey on few-shot class-incremental learning.基于小样本的类增量学习研究综述。
Neural Netw. 2024 Jan;169:307-324. doi: 10.1016/j.neunet.2023.10.039. Epub 2023 Oct 31.
9
Hashing for Adaptive Real-Time Graph Stream Classification With Concept Drifts.基于概念漂移的自适应实时图流分类哈希。
IEEE Trans Cybern. 2018 May;48(5):1591-1604. doi: 10.1109/TCYB.2017.2708979. Epub 2017 Aug 25.
10
FSCC: Few-Shot Learning for Macromolecule Classification Based on Contrastive Learning and Distribution Calibration in Cryo-Electron Tomography.FSCC:基于冷冻电子断层扫描中对比学习和分布校准的大分子分类少样本学习
Front Mol Biosci. 2022 Jul 5;9:931949. doi: 10.3389/fmolb.2022.931949. eCollection 2022.

本文引用的文献

1
Continuous diagnosis and prognosis by controlling the update process of deep neural networks.通过控制深度神经网络的更新过程进行连续诊断和预后评估。
Patterns (N Y). 2023 Feb 3;4(2):100687. doi: 10.1016/j.patter.2023.100687. eCollection 2023 Feb 10.
2
A clinical deep learning framework for continually learning from cardiac signals across diseases, time, modalities, and institutions.一种用于从跨疾病、时间、模态和机构的心脏信号中持续学习的临床深度学习框架。
Nat Commun. 2021 Jul 9;12(1):4221. doi: 10.1038/s41467-021-24483-0.
3
Predicting COVID-19 disease progression and patient outcomes based on temporal deep learning.
基于时间深度学习的 COVID-19 疾病进展和患者预后预测。
BMC Med Inform Decis Mak. 2021 Feb 8;21(1):45. doi: 10.1186/s12911-020-01359-9.
4
A Continual Learning Survey: Defying Forgetting in Classification Tasks.持续学习调查:在分类任务中对抗遗忘
IEEE Trans Pattern Anal Mach Intell. 2022 Jul;44(7):3366-3385. doi: 10.1109/TPAMI.2021.3057446. Epub 2022 Jun 3.
5
Early Prediction of Sepsis From Clinical Data: The PhysioNet/Computing in Cardiology Challenge 2019.从临床数据中早期预测脓毒症:PhysioNet/Computing in Cardiology 挑战赛 2019。
Crit Care Med. 2020 Feb;48(2):210-217. doi: 10.1097/CCM.0000000000004145.
6
Continual lifelong learning with neural networks: A review.神经网络的持续终身学习:综述。
Neural Netw. 2019 May;113:54-71. doi: 10.1016/j.neunet.2019.01.012. Epub 2019 Feb 6.
7
Early Classification of Time Series by Simultaneously Optimizing the Accuracy and Earliness.通过同时优化准确性和及时性实现时间序列的早期分类
IEEE Trans Neural Netw Learn Syst. 2018 Oct;29(10):4569-4578. doi: 10.1109/TNNLS.2017.2764939. Epub 2017 Nov 20.
8
Time to Treatment and Mortality during Mandated Emergency Care for Sepsis.脓毒症强制紧急治疗的治疗时间与死亡率
N Engl J Med. 2017 Jun 8;376(23):2235-2244. doi: 10.1056/NEJMoa1703058. Epub 2017 May 21.
9
Overcoming catastrophic forgetting in neural networks.克服神经网络中的灾难性遗忘。
Proc Natl Acad Sci U S A. 2017 Mar 28;114(13):3521-3526. doi: 10.1073/pnas.1611835114. Epub 2017 Mar 14.
10
Using recurrent neural network models for early detection of heart failure onset.使用循环神经网络模型进行心力衰竭发作的早期检测。
J Am Med Inform Assoc. 2017 Mar 1;24(2):361-370. doi: 10.1093/jamia/ocw112.