Center for Applied Intelligent Systems, Halmstad University, Kristian IV:s väg 3, 301 18 Halmstad, Sweden.
Toyota Material Handling Manufacturing Sweden AB, Svarvargatan 8, 595 35 Mjolby, Sweden.
Sensors (Basel). 2022 May 30;22(11):4170. doi: 10.3390/s22114170.
Machine Activity Recognition (MAR) can be used to monitor manufacturing processes and find bottlenecks and potential for improvement in production. Several interesting results on MAR techniques have been produced in the last decade, but mostly on construction equipment. Forklift trucks, which are ubiquitous and highly important industrial machines, have been missing from the MAR research. This paper presents a data-driven method for forklift activity recognition that uses Controller Area Network (CAN) signals and semi-supervised learning (SSL). The SSL enables the utilization of large quantities of unlabeled operation data to build better classifiers; after a two-step post-processing, the recognition results achieve balanced accuracy of 88% for driving activities and 95% for load-handling activities on a hold-out data set. In terms of the Matthews correlation coefficient for five activity classes, the final score is 0.82, which is equal to the recognition results of two non-domain experts who use videos of the activities. A particular success is that context can be used to capture the transport of small weight loads that are not detected by the forklift's built-in weight sensor.
机器活动识别 (MAR) 可用于监控制造过程,发现生产中的瓶颈和改进潜力。在过去十年中,已经产生了一些关于 MAR 技术的有趣结果,但主要是针对建筑设备。叉车作为无处不在且非常重要的工业机器,在 MAR 研究中却一直没有涉及。本文提出了一种基于控制器局域网 (CAN) 信号和半监督学习 (SSL) 的叉车活动识别数据驱动方法。SSL 能够利用大量未标记的操作数据来构建更好的分类器;经过两步后处理,在保留数据集中,驾驶活动的识别准确率达到 88%,装卸活动的识别准确率达到 95%。就五个活动类别的 Matthews 相关系数而言,最终得分为 0.82,与两名使用活动视频的非领域专家的识别结果相当。一个特别成功的地方是可以利用上下文来捕捉小型重量负载的运输,而这些负载是叉车内置重量传感器无法检测到的。