Hung Kuo-Feng, Lin Kang-Ping
Electrical Engineering Department, Chung Yuan Christian University, Taoyuan City 320314, Taiwan.
Biomimetics (Basel). 2024 Mar 3;9(3):158. doi: 10.3390/biomimetics9030158.
Nighttime object detection is challenging due to dim, uneven lighting. The IIHS research conducted in 2022 shows that pedestrian anti-collision systems are less effective at night. Common solutions utilize costly sensors, such as thermal imaging and LiDAR, aiming for highly accurate detection. Conversely, this study employs a low-cost 2D image approach to address the problem by drawing inspiration from biological dark adaptation mechanisms, simulating functions like pupils and photoreceptor cells. Instead of relying on extensive machine learning with day-to-night image conversions, it focuses on image fusion and gamma correction to train deep neural networks for dark adaptation. This research also involves creating a simulated environment ranging from 0 lux to high brightness, testing the limits of object detection, and offering a high dynamic range testing method. Results indicate that the dark adaptation model developed in this study improves the mean average precision (mAP) by 1.5-6% compared to traditional models. Our model is capable of functioning in both twilight and night, showcasing academic novelty. Future developments could include using virtual light in specific image areas or integrating with smart car lighting to enhance detection accuracy, thereby improving safety for pedestrians and drivers.
由于光线昏暗且不均匀,夜间目标检测具有挑战性。美国公路安全保险协会(IIHS)在2022年进行的研究表明,行人防撞系统在夜间的效果较差。常见的解决方案使用昂贵的传感器,如热成像和激光雷达,旨在实现高精度检测。相反,本研究采用低成本的二维图像方法,通过借鉴生物暗适应机制,模拟瞳孔和光感受器细胞等功能来解决该问题。它不是依靠大量的日夜图像转换机器学习,而是专注于图像融合和伽马校正来训练用于暗适应的深度神经网络。本研究还涉及创建一个从0勒克斯到高亮度的模拟环境,测试目标检测的极限,并提供一种高动态范围测试方法。结果表明,本研究开发的暗适应模型与传统模型相比,平均精度均值(mAP)提高了1.5%-6%。我们的模型能够在黄昏和夜间运行,展现出学术创新性。未来的发展可能包括在特定图像区域使用虚拟光或与智能汽车照明集成,以提高检测精度,从而提高行人和驾驶员的安全性。