Chin Shuang Yee, Dong Jian, Hasikin Khairunnisa, Ngui Romano, Lai Khin Wee, Yeoh Pauline Shan Qing, Wu Xiang
Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia.
China Electronics Standardization Institute, Beijing, China.
PeerJ Comput Sci. 2024 Aug 8;10:e2180. doi: 10.7717/peerj-cs.2180. eCollection 2024.
Bacterial image analysis plays a vital role in various fields, providing valuable information and insights for studying bacterial structural biology, diagnosing and treating infectious diseases caused by pathogenic bacteria, discovering and developing drugs that can combat bacterial infections, . As a result, it has prompted efforts to automate bacterial image analysis tasks. By automating analysis tasks and leveraging more advanced computational techniques, such as deep learning (DL) algorithms, bacterial image analysis can contribute to rapid, more accurate, efficient, reliable, and standardised analysis, leading to enhanced understanding, diagnosis, and control of bacterial-related phenomena.
Three object detection networks of DL algorithms, namely SSD-MobileNetV2, EfficientDet, and YOLOv4, were developed to automatically detect () bacteria from microscopic images. The multi-task DL framework is developed to classify the bacteria according to their respective growth stages, which include rod-shaped cells, dividing cells, and microcolonies. Data preprocessing steps were carried out before training the object detection models, including image augmentation, image annotation, and data splitting. The performance of the DL techniques is evaluated using the quantitative assessment method based on mean average precision (mAP), precision, recall, and F1-score. The performance metrics of the models were compared and analysed. The best DL model was then selected to perform multi-task object detections in identifying rod-shaped cells, dividing cells, and microcolonies.
The output of the test images generated from the three proposed DL models displayed high detection accuracy, with YOLOv4 achieving the highest confidence score range of detection and being able to create different coloured bounding boxes for different growth stages of bacteria. In terms of statistical analysis, among the three proposed models, YOLOv4 demonstrates superior performance, achieving the highest mAP of 98% with the highest precision, recall, and F1-score of 86%, 97%, and 91%, respectively.
This study has demonstrated the effectiveness, potential, and applicability of DL approaches in multi-task bacterial image analysis, focusing on automating the detection and classification of bacteria from microscopic images. The proposed models can output images with bounding boxes surrounding each detected bacteria, labelled with their growth stage and confidence level of detection. All proposed object detection models have achieved promising results, with YOLOv4 outperforming the other models.
细菌图像分析在各个领域都发挥着至关重要的作用,为研究细菌结构生物学、诊断和治疗由病原菌引起的传染病、发现和开发能够对抗细菌感染的药物等提供了有价值的信息和见解。因此,人们努力实现细菌图像分析任务的自动化。通过自动化分析任务并利用更先进的计算技术,如深度学习(DL)算法,细菌图像分析有助于实现快速、更准确、高效、可靠和标准化的分析,从而加深对细菌相关现象的理解、诊断和控制。
开发了三种DL算法的目标检测网络,即SSD-MobileNetV2、EfficientDet和YOLOv4,用于从显微镜图像中自动检测()细菌。开发了多任务DL框架,根据细菌各自的生长阶段对其进行分类,这些生长阶段包括杆状细胞、分裂细胞和微菌落。在训练目标检测模型之前进行了数据预处理步骤,包括图像增强、图像标注和数据分割。使用基于平均精度均值(mAP)、精确率、召回率和F1分数的定量评估方法来评估DL技术的性能。对模型的性能指标进行了比较和分析。然后选择最佳的DL模型在识别杆状细胞、分裂细胞和微菌落时执行多任务目标检测。
由所提出的三种DL模型生成的测试图像输出显示出高检测精度,YOLOv4实现了最高的检测置信度分数范围,并且能够为细菌的不同生长阶段创建不同颜色的边界框。在统计分析方面,在所提出的三种模型中,YOLOv4表现出卓越的性能,实现了最高的mAP为98%,精确率、召回率和F1分数分别为最高的86%、97%和91%。
本研究证明了DL方法在多任务细菌图像分析中的有效性、潜力和适用性,重点是实现从显微镜图像中自动检测和分类细菌。所提出的模型可以输出带有围绕每个检测到的细菌的边界框的图像,并标记有它们的生长阶段和检测置信度水平。所有提出的目标检测模型都取得了有希望的结果,其中YOLOv4优于其他模型。