School of Electrical Engineering and Computer Science, Washington State University, Pullman, WA 99164, USA.
College of Health Solutions, Arizona State University, Phoenix, AZ 85004, USA.
Sensors (Basel). 2023 Jul 12;23(14):6337. doi: 10.3390/s23146337.
Activity recognition using data collected with smart devices such as mobile and wearable sensors has become a critical component of many emerging applications ranging from behavioral medicine to gaming. However, an unprecedented increase in the diversity of smart devices in the internet-of-things era has limited the adoption of activity recognition models for use across different devices. This lack of cross-domain adaptation is particularly notable across sensors of different modalities where the mapping of the sensor data in the traditional feature level is highly challenging. To address this challenge, we propose , a combinatorial framework that learns structural similarities among the events that occur in a target domain and those of a source domain and identifies an optimal mapping between the two domains at their structural level. The structural similarities are captured through a graph model, referred to as the , which abstracts details of activity patterns in low-level signal and feature space. The activity labels are then autonomously learned in the target domain by finding an optimal tiered mapping between the dependency graphs. We carry out an extensive set of experiments on three large datasets collected with wearable sensors involving human subjects. The results demonstrate the superiority of ActiLabel over state-of-the-art transfer learning and deep learning methods. In particular, ActiLabel outperforms such algorithms by average F1-scores of 36.3%, 32.7%, and 9.1% for cross-modality, cross-location, and cross-subject activity recognition, respectively.
使用智能设备(如移动和可穿戴传感器)收集的数据进行活动识别已成为许多新兴应用(从行为医学到游戏)的关键组成部分。然而,物联网时代智能设备的多样性空前增加,限制了跨设备使用活动识别模型的采用。这种跨领域适应的缺乏在不同模式的传感器中尤为明显,在传统特征级别对传感器数据进行映射极具挑战性。为了解决这一挑战,我们提出了一种组合框架 ,该框架学习目标域和源域中发生的事件之间的结构相似性,并在结构级别识别两个域之间的最佳映射。结构相似性通过称为 的图模型捕获,该模型抽象了低级信号和特征空间中活动模式的细节。然后通过在依赖图之间找到最佳分层映射,在目标域中自主学习活动标签。我们在涉及人体受试者的三个大型可穿戴传感器数据集上进行了广泛的实验。结果表明,ActiLabel 优于最先进的迁移学习和深度学习方法。特别是,ActiLabel 在跨模态、跨位置和跨主体活动识别方面的平均 F1 分数分别优于这些算法 36.3%、32.7%和 9.1%。