The School of Computer Science, University of South China, Hengyang 421001, China.
Sensors (Basel). 2023 Nov 30;23(23):9529. doi: 10.3390/s23239529.
Human Activity Recognition (HAR) systems have made significant progress in recognizing and classifying human activities using sensor data from a variety of sensors. Nevertheless, they have struggled to automatically discover novel activity classes within massive amounts of unlabeled sensor data without external supervision. This restricts their ability to classify new activities of unlabeled sensor data in real-world deployments where fully supervised settings are not applicable. To address this limitation, this paper presents the Novel Class Discovery (NCD) problem, which aims to classify new class activities of unlabeled sensor data by fully utilizing existing activities of labeled data. To address this problem, we propose a new end-to-end framework called More Reliable Neighborhood Contrastive Learning (MRNCL), which is a variant of the Neighborhood Contrastive Learning (NCL) framework commonly used in visual domain. Compared to NCL, our proposed MRNCL framework is more lightweight and introduces an effective similarity measure that can find more reliable -nearest neighbors of an unlabeled query sample in the embedding space. These neighbors contribute to contrastive learning to facilitate the model. Extensive experiments on three public sensor datasets demonstrate that the proposed model outperforms existing methods in the NCD task in sensor-based HAR, as indicated by the fact that our model performs better in clustering performance of new activity class instances.
人体活动识别 (HAR) 系统在使用来自各种传感器的传感器数据识别和分类人体活动方面取得了重大进展。然而,它们在没有外部监督的情况下,很难在大量未标记的传感器数据中自动发现新的活动类别。这限制了它们在无法应用完全监督设置的现实部署中对未标记传感器数据的新活动进行分类的能力。为了解决这个限制,本文提出了新类发现 (NCD) 问题,该问题旨在通过充分利用已标记数据中的现有活动来对未标记传感器数据中的新类活动进行分类。为了解决这个问题,我们提出了一个名为更可靠邻域对比学习 (MRNCL) 的端到端新框架,它是通常用于视觉领域的邻域对比学习 (NCL) 框架的变体。与 NCL 相比,我们提出的 MRNCL 框架更轻量级,并引入了一种有效的相似性度量,可以在嵌入空间中找到未标记查询样本的更可靠的近邻。这些邻居有助于对比学习,从而促进模型的发展。在三个公共传感器数据集上的广泛实验表明,所提出的模型在基于传感器的 HAR 中的 NCD 任务中优于现有方法,这表明我们的模型在新活动类实例的聚类性能方面表现更好。