Key Laboratory of Advanced Manufacturing Technology, Ministry of Education, Guizhou University, Guiyang 550025, Guizhou, China.
Key Laboratory of Advanced Manufacturing Technology, Ministry of Education, Guizhou University, Guiyang 550025, Guizhou, China; Chongqing Vocational and Technical University of Mechatronics, Chongqing 400036, China.
Comput Methods Programs Biomed. 2022 Jun;221:106888. doi: 10.1016/j.cmpb.2022.106888. Epub 2022 May 13.
At present, the COVID-19 epidemic is still spreading worldwide and wearing a mask in public areas is an effective way to prevent the spread of the respiratory virus. Although there are many deep learning methods used for detecting the face masks, there are few lightweight detectors having a good effect on small or medium-size face masks detection in the complicated environments.
In this work we propose an efficient and lightweight detection method based on YOLOv4-tiny, and a face mask detection and monitoring system for mask wearing status. Two feasible improvement strategies, network structure optimization and K-means++ clustering algorithm, are utilized for improving the detection accuracy on the premise of ensuring the real-time face masks recognition. Particularly, the improved residual module and cross fusion module are designed to aim at extracting the features of small or medium-size targets effectively. Moreover, the enhanced dual attention mechanism and the improved spatial pyramid pooling module are employed for merging sufficiently the deep and shallow semantic information and expanding the receptive field. Afterwards, the detection accuracy is compensated through the combination of activation functions. Finally, the depthwise separable convolution module is used to reduce the quantity of parameters and improve the detection efficiency. Our proposed detector is evaluated on a public face mask dataset, and an ablation experiment is also provided to verify the effectiveness of our proposed model, which is compared with the state-of-the-art (SOTA) models as well.
Our proposed detector increases the AP (average precision) values in each category of the public face mask dataset compared with the original YOLOv4-tiny. The mAP (mean average precision) is improved by 4.56% and the speed reaches 92.81 FPS. Meanwhile, the quantity of parameters and the FLOPs (floating-point operations) are reduced by 1/3, 16.48%, respectively.
The proposed detector achieves better overall detection performance compared with other SOTA detectors for real-time mask detection, demonstrated the superiority with both theoretical value and practical significance. The developed system also brings greater flexibility to the application of face mask detection in hospitals, campuses, communities, etc.
目前,COVID-19 疫情仍在全球范围内传播,在公共场所佩戴口罩是预防呼吸道病毒传播的有效方法。虽然有许多深度学习方法用于检测口罩,但在复杂环境中,对于中小尺寸口罩的检测,很少有轻量级探测器具有良好的效果。
在这项工作中,我们提出了一种基于 YOLOv4-tiny 的高效轻量级检测方法,并开发了一个口罩佩戴状态检测和监测系统。我们利用了两种可行的改进策略,即网络结构优化和 K-means++聚类算法,在保证实时口罩识别的前提下,提高检测精度。具体来说,设计了改进的残差模块和交叉融合模块,旨在有效地提取中小尺寸目标的特征。此外,采用了增强型双注意力机制和改进的空间金字塔池化模块,以充分融合深度和浅层语义信息并扩大感受野。之后,通过激活函数的组合来补偿检测精度。最后,使用深度可分离卷积模块减少参数数量并提高检测效率。我们的探测器在一个公共口罩数据集上进行了评估,并进行了消融实验来验证所提出模型的有效性,同时与最先进的(SOTA)模型进行了比较。
与原始的 YOLOv4-tiny 相比,我们提出的探测器在公共口罩数据集中的每个类别中都提高了 AP(平均精度)值。mAP(平均平均精度)提高了 4.56%,速度达到 92.81 FPS。同时,参数数量和 FLOPs(浮点运算)分别减少了 1/3 和 16.48%。
与其他 SOTA 探测器相比,所提出的探测器在实时口罩检测方面具有更好的整体检测性能,具有理论价值和实际意义。所开发的系统还为医院、校园、社区等场所的口罩检测应用带来了更大的灵活性。