Yan Jiahe, Li Honghui, Bai Yanhui, Liu Jie, Lv Hairui, Bai Yang
School of Computer Science and Technology, Beijing Jiaotong University, Beijing 100044, China.
Inner Mongolia High Tech Holdings Co., Ltd., Ordos 017000, China.
Sensors (Basel). 2025 Jul 24;25(15):4590. doi: 10.3390/s25154590.
Accurate time-series forecasting plays a vital role in sensor-driven applications such as energy monitoring, traffic flow prediction, and environmental sensing. While most existing approaches focus on extracting local patterns from historical observations, they often overlook the global temporal information embedded in timestamps. However, this information represents a valuable yet underutilized aspect of sensor-based data that can significantly enhance forecasting performance. In this paper, we propose a novel timestamp-guided knowledge distillation framework (TKDF), which integrates both historical and timestamp information through mutual learning between heterogeneous prediction branches to improve forecasting robustness. The framework comprises two complementary branches: a Backbone Model that captures local dependencies from historical sequences, and a Timestamp Mapper that learns global temporal patterns encoded in timestamp features. To enhance information transfer and reduce representational redundancy, a self-distillation mechanism is introduced within the Timestamp Mapper. Extensive experiments on multiple real-world sensor datasets-covering electricity consumption, traffic flow, and meteorological measurements-demonstrate that the TKDF consistently improves the performance of mainstream forecasting models.
准确的时间序列预测在诸如能源监测、交通流量预测和环境传感等传感器驱动的应用中起着至关重要的作用。虽然大多数现有方法专注于从历史观测中提取局部模式,但它们往往忽略了时间戳中嵌入的全局时间信息。然而,这些信息代表了基于传感器的数据中一个有价值但未被充分利用的方面,它可以显著提高预测性能。在本文中,我们提出了一种新颖的时间戳引导知识蒸馏框架(TKDF),该框架通过异构预测分支之间的相互学习来整合历史信息和时间戳信息,以提高预测的鲁棒性。该框架包括两个互补的分支:一个主干模型,用于从历史序列中捕捉局部依赖性;一个时间戳映射器,用于学习时间戳特征中编码的全局时间模式。为了增强信息传递并减少表示冗余,在时间戳映射器中引入了一种自蒸馏机制。在多个真实世界传感器数据集上进行的广泛实验——涵盖电力消耗、交通流量和气象测量——表明,TKDF持续提高了主流预测模型的性能。