Gao Zhixiang, Ju Xin, Yu Huabin, Chen Wei, Liu Xin, Luo Yuanmin, Kang Yang, Luo Dongyang, Yao JiKai, Gu Wengang, Memon Muhammad Hunain, Yan Yong, Sun Haiding
iGaN Laboratory, School of Microelectronics, University of Science and Technology of China, Hefei, 230029, People's Republic of China.
Institute of Materials Research and Engineering, 2 Fusionopolis Way, #08-03Agency for Science Technology and Research, Singapore, 138634, Singapore.
Nanomicro Lett. 2025 Sep 1;18(1):54. doi: 10.1007/s40820-025-01888-w.
Human action recognition (HAR) is crucial for the development of efficient computer vision, where bioinspired neuromorphic perception visual systems have emerged as a vital solution to address transmission bottlenecks across sensor-processor interfaces. However, the absence of interactions among versatile biomimicking functionalities within a single device, which was developed for specific vision tasks, restricts the computational capacity, practicality, and scalability of in-sensor vision computing. Here, we propose a bioinspired vision sensor composed of a GaN/AlN-based ultrathin quantum-disks-in-nanowires (QD-NWs) array to mimic not only Parvo cells for high-contrast vision and Magno cells for dynamic vision in the human retina but also the synergistic activity between the two cells for in-sensor vision computing. By simply tuning the applied bias voltage on each QD-NW-array-based pixel, we achieve two biosimilar photoresponse characteristics with slow and fast reactions to light stimuli that enhance the in-sensor image quality and HAR efficiency, respectively. Strikingly, the interplay and synergistic interaction of the two photoresponse modes within a single device markedly increased the HAR recognition accuracy from 51.4% to 81.4% owing to the integrated artificial vision system. The demonstration of an intelligent vision sensor offers a promising device platform for the development of highly efficient HAR systems and future smart optoelectronics.
人类行为识别(HAR)对于高效计算机视觉的发展至关重要,在这一领域,受生物启发的神经形态感知视觉系统已成为解决传感器 - 处理器接口传输瓶颈的关键解决方案。然而,为特定视觉任务开发的单一设备中缺乏多种仿生功能之间的相互作用,这限制了传感器内视觉计算的计算能力、实用性和可扩展性。在此,我们提出一种受生物启发的视觉传感器,它由基于GaN/AlN的纳米线中的超薄量子盘(QD - NWs)阵列组成,不仅可以模拟人类视网膜中用于高对比度视觉的小细胞和用于动态视觉的大细胞,还可以模拟这两种细胞之间的协同活动以进行传感器内视觉计算。通过简单地调整基于每个QD - NW阵列的像素上施加的偏置电压,我们实现了两种类似生物的光响应特性,分别对光刺激具有缓慢和快速反应,从而分别提高了传感器内图像质量和HAR效率。引人注目的是,由于集成了人工视觉系统,单个设备内两种光响应模式的相互作用和协同作用显著提高了HAR识别准确率,从51.4%提高到了81.4%。这种智能视觉传感器的展示为高效HAR系统和未来智能光电子学的发展提供了一个有前景的设备平台。