Lao Jie, Yan Mengge, Tian Bobo, Jiang Chunli, Luo Chunhua, Xie Zhuozhuang, Zhu Qiuxiang, Bao Zhiqiang, Zhong Ni, Tang Xiaodong, Sun Linfeng, Wu Guangjian, Wang Jianlu, Peng Hui, Chu Junhao, Duan Chungang
Key Laboratory of Polar Materials and Devices (MOE), Ministry of Education, Department of Electronics, East China Normal University, Shanghai, 200241, China.
Zhejiang Lab, Hangzhou, 310000, China.
Adv Sci (Weinh). 2022 May;9(15):e2106092. doi: 10.1002/advs.202106092. Epub 2022 Mar 13.
A neuromorphic visual system integrating optoelectronic synapses to perform the in-sensor computing is triggering a revolution due to the reduction of latency and energy consumption. Here it is demonstrated that the dwell time of photon-generated carriers in the space-charge region can be effectively extended by embedding a potential well on the shoulder of Schottky energy barrier. It permits the nonlinear interaction of photocurrents stimulated by spatiotemporal optical signals, which is necessary for in-sensor reservoir computing (RC). The machine vision with the sensor reservoir constituted by designed self-powered Au/P(VDF-TrFE)/Cs AgBiBr /ITO devices is competent for both static and dynamic vision tasks. It shows an accuracy of 99.97% for face classification and 100% for dynamic vehicle flow recognition. The in-sensor RC system takes advantage of near-zero energy consumption in the reservoir, resulting in decades-time lower training costs than a conventional neural network. This work paves the way for ultralow-power machine vision using photonic devices.
一种集成光电突触以执行传感器内计算的神经形态视觉系统,正因其延迟和能耗的降低而引发一场革命。在此表明,通过在肖特基能垒的肩部嵌入一个势阱,可以有效地延长光生载流子在空间电荷区的停留时间。这使得时空光信号激发的光电流能够进行非线性相互作用,这对于传感器内的储层计算(RC)是必要的。由设计的自供电Au/P(VDF-TrFE)/Cs AgBiBr /ITO器件构成的带有传感器储层的机器视觉,能够胜任静态和动态视觉任务。它在面部分类方面的准确率为99.97%,在动态车辆流识别方面的准确率为100%。传感器内的RC系统利用了储层中近乎零能耗的优势,与传统神经网络相比,训练成本降低了数十倍。这项工作为使用光子器件的超低功耗机器视觉铺平了道路。