Zhou Mingyuan, Lin Haiting, Young S Susan, Yu Jingyi
Appl Opt. 2018 Jan 1;57(1):69-78. doi: 10.1364/AO.57.000069.
The capability to track, detect, and identify human targets in highly cluttered scenes under extreme conditions, such as in complete darkness or on the battlefield, has been one of the primary tactical advantages in military operations. In this paper, we propose a new collaborative, multi-spectrum sensing method to achieve face detection and registration under low-light and unconstrained conditions. We design and prototype a novel type of hybrid sensor by combining a pair of near-infrared (NIR) cameras and a thermal camera (a long-wave infrared camera). We strategically surround each NIR sensor with a ring of LED IR flashes to capture the "red-eye," or more precisely, the "bright-eye" effect of the target. The "bright-eyes" are used to localize the 3D position of eyes and face. The recovered 3D information is further used to warp the thermal face imagery to a frontal-parallel pose so that additional tasks, such as face recognition, can be reliably conducted, especially with the assistance of accurate eye locations. Experiments on real face images are provided to demonstrate the merit of our method.
在诸如完全黑暗环境或战场等极端条件下，在高度复杂的场景中跟踪、检测和识别人类目标的能力，一直是军事行动中的主要战术优势之一。在本文中，我们提出了一种新的协作式多光谱传感方法，以在低光照和无约束条件下实现面部检测和配准。我们通过结合一对近红外（NIR）相机和一个热成像相机（长波红外相机），设计并制作了一种新型混合传感器的原型。我们在每个近红外传感器周围策略性地布置一圈LED红外闪光灯，以捕捉目标的“红眼”，或者更准确地说，“亮眼”效应。利用“亮眼”来定位眼睛和面部的三维位置。恢复的三维信息进一步用于将热成像面部图像扭曲到正脸平行姿态，以便能够可靠地执行诸如人脸识别等其他任务，特别是在准确的眼睛位置的辅助下。提供了对真实面部图像的实验，以证明我们方法的优点。
