Zhang Tian, Guo Xin, Wang Pan, Fan Xinyi, Wang Zichen, Tong Yan, Wang Decheng, Tong Limin, Li Linjun
State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027, China.
Intelligent Optics and Photonics Research Center, Jiaxing Institute Zhejiang University, Jiaxing, China.
Nat Commun. 2024 Mar 19;15(1):2471. doi: 10.1038/s41467-024-46867-8.
The development of neuromorphic visual systems has recently gained momentum due to their potential in areas such as autonomous vehicles and robotics. However, current machine visual systems based on silicon technology usually contain photosensor arrays, format conversion, memory and processing modules. As a result, the redundant data shuttling between each unit, resulting in large latency and high-power consumption, seriously limits the performance of neuromorphic vision chips. Here, we demonstrate an artificial neural network (ANN) architecture based on an integrated 2D MoS/Ag nanograting phototransistor array, which can simultaneously sense, pre-process and recognize optical images without latency. The pre-processing function of the device under photoelectric synergy ensures considerable improvement of efficiency and accuracy of subsequent image recognition. The comprehensive performance of the proof-of-concept device demonstrates great potential for machine vision applications in terms of large dynamic range (180 dB), high speed (500 ns) and low energy consumption per spike (2.4 × 10J).
由于神经形态视觉系统在自动驾驶汽车和机器人技术等领域的潜力,其发展最近获得了动力。然而,当前基于硅技术的机器视觉系统通常包含光电传感器阵列、格式转换、内存和处理模块。结果,每个单元之间冗余的数据传输导致了大延迟和高功耗,严重限制了神经形态视觉芯片的性能。在此,我们展示了一种基于集成二维MoS/Ag纳米光栅光电晶体管阵列的人工神经网络(ANN)架构,该架构可以同时无延迟地感知、预处理和识别光学图像。该器件在光电协同作用下的预处理功能确保了后续图像识别的效率和准确性有相当大的提高。该概念验证器件的综合性能在大动态范围(180 dB)、高速(500 ns)和每脉冲低能耗(2.4×10J)方面展示了机器视觉应用的巨大潜力。