Sun Chenxi, Li Hongyan, Song Moxian, Cai Derun, Zhang Baofeng, Hong Shenda
School of Intelligence Science and Technology, Peking University, Beijing, China.
Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing, China.
Appl Intell (Dordr). 2023 Feb 11:1-19. doi: 10.1007/s10489-022-04433-z.
The classification of time series is essential in many real-world applications like healthcare. The class of a time series is usually labeled at the final time, but more and more time-sensitive applications require classifying time series continuously. For example, the outcome of a critical patient is only determined at the end, but he should be diagnosed at all times for timely treatment. For this demand, we propose a new concept, Continuous Classification of Time Series (CCTS). Different from the existing single-shot classification, the key of CCTS is to model multiple distributions simultaneously due to the dynamic evolution of time series. But the deep learning model will encounter intertwined problems of catastrophic forgetting and over-fitting when learning multi-distribution. In this work, we found that the well-designed distribution division and replay strategies in the model training process can help to solve the problems. We propose a novel Adaptive model training strategy for CCTS (ACCTS). Its adaptability represents two aspects: (1) Adaptive multi-distribution extraction policy. Instead of the fixed rules and the prior knowledge, ACCTS extracts data distributions adaptive to the time series evolution and the model change; (2) Adaptive importance-based replay policy. Instead of reviewing all old distributions, ACCTS only replays important samples adaptive to their contribution to the model. Experiments on four real-world datasets show that our method outperforms all baselines.
时间序列分类在医疗保健等许多实际应用中至关重要。时间序列的类别通常在最后时刻标记,但越来越多对时间敏感的应用需要对时间序列进行连续分类。例如,危急患者的结果仅在最后确定,但为了及时治疗,应随时对其进行诊断。针对这一需求,我们提出了一个新概念,即时间序列连续分类(CCTS)。与现有的单次分类不同,CCTS的关键在于由于时间序列的动态演变而同时对多个分布进行建模。但是深度学习模型在学习多分布时会遇到灾难性遗忘和过拟合的交织问题。在这项工作中,我们发现模型训练过程中精心设计的分布划分和重放策略有助于解决这些问题。我们提出了一种用于CCTS的新颖自适应模型训练策略(ACCTS)。其适应性体现在两个方面:(1)自适应多分布提取策略。ACCTS不是采用固定规则和先验知识,而是提取适应时间序列演变和模型变化的数据分布;(2)基于重要性的自适应重放策略。ACCTS不是回顾所有旧分布,而是仅重放对模型贡献具有适应性的重要样本。在四个真实世界数据集上的实验表明,我们的方法优于所有基线。