Alsaaran Norah, Soudani Adel
Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia.
Sensors (Basel). 2025 Sep 2;25(17):5406. doi: 10.3390/s25175406.
Unmanned Aerial Vehicles (UAVs) integrated with lightweight deep learning models represent an effective solution for image-based rapid post-earthquake damage assessment. UAVs, equipped with cameras, capture high-resolution aerial imagery of disaster-stricken areas, providing essential data for evaluating structural damage. When paired with light eight Convolutional Neural Network (CNN) models, these UAVs can process the captured images onboard, enabling real-time, accurate damage level predictions that might with potential interest to orient efficiently the efforts of the Search and Rescue (SAR) teams. This study investigates the use of the MobileNetV3-Small lightweight CNN model for real-time post-earthquake damage level prediction using UAV-captured imagery. The model is trained to classify three levels of post-earthquake damage, ranging from no damage to severe damage. Experimental results show that the adapted MobileNetV3-Small model achieves the lowest FLOPs, with a significant reduction of 58.8% compared to the ShuffleNetv2 model. Fine-tuning the last five layers resulted in a slight increase of approximately 0.2% in FLOPs, but significantly improved accuracy and robustness, yielding a 4.5% performance boost over the baseline. The model achieved a weighted average F-score of 0.93 on a merged dataset composed of three post-earthquake damage level datasets. It was successfully deployed and tested on a Raspberry Pi 5, demonstrating its feasibility for edge-device applications. This deployment highlighted the model's efficiency and real-time performance in resource-constrained environments.
集成轻量级深度学习模型的无人机是基于图像的地震后快速损失评估的有效解决方案。配备摄像头的无人机可捕捉受灾地区的高分辨率航空图像,为评估结构损坏提供关键数据。当与轻量级卷积神经网络(CNN)模型配合使用时,这些无人机能够在机载设备上处理所捕捉的图像,实现实时、准确的损坏程度预测,这可能对高效引导搜救(SAR)团队的工作具有潜在意义。本研究探讨了使用MobileNetV3 - Small轻量级CNN模型,利用无人机捕捉的图像进行地震后实时损坏程度预测。该模型经过训练,可对地震后的三个损坏级别进行分类,范围从无损坏到严重损坏。实验结果表明,经过调整的MobileNetV3 - Small模型实现了最低的浮点运算次数(FLOPs),与ShuffleNetv2模型相比显著降低了58.8%。对最后五层进行微调导致FLOPs略有增加,约为0.2%,但显著提高了准确性和鲁棒性,相较于基线性能提升了4.5%。该模型在由三个地震后损坏级别数据集组成的合并数据集上实现了0.93的加权平均F分数。它已成功部署并在树莓派5上进行了测试,证明了其在边缘设备应用中的可行性。这种部署突出了该模型在资源受限环境中的效率和实时性能。