Gohe Anna Katharina, Kottek Marius Johann, Buettner Ricardo, Penava Pascal
Chair of Hybrid Intelligence, Helmut-Schmidt-University / University of the Federal Armes Forces Hamburg, Hamburg, Germany.
PLoS One. 2024 Dec 5;19(12):e0314533. doi: 10.1371/journal.pone.0314533. eCollection 2024.
Forensic entomology can help estimate the postmortem interval in criminal investigations. In particular, forensically important fly species that can be found on a body and in its environment at various times after death provide valuable information. However, the current method for identifying fly species is labor intensive, expensive, and may become more serious in view of a shortage of specialists. In this paper, we propose the use of computer vision and deep learning to classify adult flies according to three different families, Calliphoridae, Sarcophagidae, Rhiniidae, and their corresponding genera Chrysomya, Lucilia, Sarcophaga, Rhiniinae, and Stomorhina, which can lead to efficient and accurate estimation of time of death, for example, with the use of camera-equipped drones. The development of such a deep learning model for adult flies may be particularly useful in crisis situations, such as natural disasters and wars, when people disappear. In these cases drones can be used for searching large areas. In this study, two models were evaluated using transfer learning with MobileNetV3-Large and VGG19. Both models achieved a very high accuracy of 99.39% and 99.79%. In terms of inference time, the MobileNetV3-Large model was faster with an average time per step of 1.036 seconds than the VGG19 model, which took 2.066 seconds per step. Overall, the results highlight the potential of deep learning models for the classification of fly species in forensic entomology and search and rescue operations.
法医昆虫学有助于在刑事调查中估计死后间隔时间。特别是,在尸体及其周围环境中,在死亡后的不同时间可以发现的具有法医重要性的蝇类物种提供了有价值的信息。然而,目前鉴定蝇类物种的方法劳动强度大、成本高,而且鉴于专家短缺,情况可能会变得更加严峻。在本文中,我们提出使用计算机视觉和深度学习,根据丽蝇科、麻蝇科、鼻蝇科三个不同科及其相应的属,如 Chrysomya、Lucilia、Sarcophaga、Rhiniinae 和 Stomorhina,对成年蝇进行分类,这可以高效准确地估计死亡时间,例如,使用配备摄像头的无人机。对于成年蝇的这种深度学习模型的开发,在自然灾害和战争等危机情况下,当人员失踪时可能特别有用。在这些情况下,无人机可用于大面积搜索。在本研究中,使用 MobileNetV3-Large 和 VGG19 通过迁移学习评估了两个模型。两个模型都达到了非常高的准确率,分别为 99.39% 和 99.79%。在推理时间方面,MobileNetV3-Large 模型更快,每步平均时间为 1.036 秒,而 VGG19 模型每步需要 2.066 秒。总体而言,结果突出了深度学习模型在法医昆虫学以及搜索和救援行动中对蝇类物种进行分类的潜力。