Ghent University, IDLab - imec, 9000, Ghent, Belgium.
Sci Rep. 2022 May 6;12(1):7436. doi: 10.1038/s41598-022-08240-x.
Radar systems can be used to perform human activity recognition in a privacy preserving manner. This can be achieved by using Deep Neural Networks, which are able to effectively process the complex radar data. Often these networks are large and do not scale well when processing a large amount of radar streams at once, for example when monitoring multiple rooms in a hospital. This work presents a framework that splits the processing of data in two parts. First, a forward Recurrent Neural Network (RNN) calculation is performed on an on-premise device (usually close to the radar sensor) which already gives a prediction of what activity is performed, and can be used for time-sensitive use-cases. Next, a part of the calculation and the prediction is sent to a more capable off-premise machine (most likely in the cloud or a data center) where a backward RNN calculation is performed that improves the previous prediction sent by the on-premise device. This enables fast notifications to staff if troublesome activities occur (such as falling) by the on-premise device, while the off-premise device captures activities missed or misclassified by the on-premise device.
雷达系统可以用于以保护隐私的方式进行人体活动识别。这可以通过使用深度神经网络来实现,深度神经网络能够有效地处理复杂的雷达数据。通常这些网络很大,并且在同时处理大量雷达流时,例如在医院监测多个房间时,不能很好地扩展。这项工作提出了一个框架,将数据处理分为两部分。首先,在现场设备(通常靠近雷达传感器)上执行前向递归神经网络(RNN)计算,该计算已经对执行的活动进行了预测,并且可以用于对时间敏感的用例。接下来,将计算和预测的一部分发送到更强大的场外机器(最有可能在云端或数据中心),在那里执行后向 RNN 计算,以改进现场设备发送的先前预测。这使得现场设备能够快速通知工作人员是否发生麻烦的活动(例如跌倒),而场外设备则可以捕获现场设备错过或分类错误的活动。