Jia Kunming, Niu Qunfeng, Wang Li, Niu Yang, Ma Wentao
College of Electrical Engineering, Henan University of Technology, Zhengzhou 450000, China.
Sensors (Basel). 2023 Oct 11;23(20):8380. doi: 10.3390/s23208380.
Detection of the four tobacco shred varieties and the subsequent unbroken tobacco shred rate are the primary tasks in cigarette inspection lines. It is especially critical to identify both single and overlapped tobacco shreds at one time, that is, fast blended tobacco shred detection based on multiple targets. However, it is difficult to classify tiny single tobacco shreds with complex morphological characteristics, not to mention classifying tobacco shreds with 24 types of overlap, posing significant difficulties for machine vision-based blended tobacco shred multi-object detection and unbroken tobacco shred rate calculation tasks. This study focuses on the two challenges of identifying blended tobacco shreds and calculating the unbroken tobacco shred rate. In this paper, a new multi-object detection model is developed for blended tobacco shred images based on an improved YOLOv7-tiny model. YOLOv7-tiny is used as the multi-object detection network's mainframe. A lightweight Resnet19 is used as the model backbone. The original SPPCSPC and coupled detection head are replaced with a new spatial pyramid SPPFCSPC and a decoupled joint detection head, respectively. An algorithm for two-dimensional size calculation of blended tobacco shreds (LWC) is also proposed, which is applied to blended tobacco shred object detection images to obtain independent tobacco shred objects and calculate the unbroken tobacco shred rate. The experimental results showed that the final detection precision, mAP@.5, mAP@.5:.95, and testing time were 0.883, 0.932, 0.795, and 4.12 ms, respectively. The average length and width detection accuracy of the blended tobacco shred samples were -1.7% and 13.2%, respectively. The model achieved high multi-object detection accuracy and 2D size calculation accuracy, which also conformed to the manual inspection process in the field. This study provides a new efficient implementation method for multi-object detection and size calculation of blended tobacco shreds in cigarette quality inspection lines and a new approach for other similar blended image multi-object detection tasks.
检测四种烟丝品种以及后续的完整烟丝率是香烟检测线上的主要任务。一次性识别单个和重叠烟丝尤为关键,即基于多目标的快速混合烟丝检测。然而,对形态特征复杂的微小单个烟丝进行分类很困难,更不用说对具有24种重叠类型的烟丝进行分类了,这给基于机器视觉的混合烟丝多目标检测和完整烟丝率计算任务带来了重大困难。本研究聚焦于识别混合烟丝和计算完整烟丝率这两个挑战。本文基于改进的YOLOv7-tiny模型,为混合烟丝图像开发了一种新的多目标检测模型。YOLOv7-tiny用作多目标检测网络的主体。使用轻量级的Resnet19作为模型骨干。分别用新的空间金字塔SPPFCSPC和解耦联合检测头替换原来的SPPCSPC和耦合检测头。还提出了一种混合烟丝二维尺寸计算算法(LWC),将其应用于混合烟丝目标检测图像,以获得独立的烟丝目标并计算完整烟丝率。实验结果表明,最终检测精度、mAP@.5、mAP@.5:.95和测试时间分别为0.883、0.932、0.795和4.12毫秒。混合烟丝样本的平均长度和宽度检测准确率分别为-1.7%和13.2%。该模型实现了较高的多目标检测准确率和二维尺寸计算准确率,也符合现场人工检验流程。本研究为香烟质量检测线上混合烟丝多目标检测和尺寸计算提供了一种新的高效实现方法,也为其他类似混合图像多目标检测任务提供了新途径。