Chen Jiewei, Zhou Zheng, Kim Beom Jin, Zhou Yue, Wang Zhaoqing, Wan Tianqing, Yan Jianmin, Kang Jinfeng, Ahn Jong-Hyun, Chai Yang
Department of Applied Physics, The Hong Kong Polytechnic University, Hong Kong, China.
Shenzhen Research Institute, The Hong Kong Polytechnic University, Shenzhen, China.
Nat Nanotechnol. 2023 Aug;18(8):882-888. doi: 10.1038/s41565-023-01379-2. Epub 2023 Apr 20.
Motion processing has proven to be a computational challenge and demands considerable computational resources. Contrast this with the fact that flying insects can agilely perceive real-world motion with their tiny vision system. Here we show that phototransistor arrays can directly perceive different types of motion at sensory terminals, emulating the non-spiking graded neurons of insect vision systems. The charge dynamics of the shallow trapping centres in MoS phototransistors mimic the characteristics of graded neurons, showing an information transmission rate of 1,200 bit s and effectively encoding temporal light information. We used a 20 × 20 photosensor array to detect trajectories in the visual field, allowing the efficient perception of the direction and vision saliency of moving objects and achieving 99.2% recognition accuracy with a four-layer neural network. By modulating the charge dynamics of the shallow trapping centres of MoS, the sensor array can recognize motion with a temporal resolution ranging from 10 to 10 ms.
运动处理已被证明是一项计算挑战,需要大量的计算资源。相比之下,飞行昆虫能够用它们微小的视觉系统敏捷地感知现实世界中的运动。在这里,我们展示了光电晶体管阵列可以在感觉终端直接感知不同类型的运动,模拟昆虫视觉系统中的非尖峰分级神经元。二硫化钼光电晶体管中浅俘获中心的电荷动力学模仿了分级神经元的特性,显示出1200比特每秒的信息传输速率,并有效地编码了时间光信息。我们使用一个20×20的光电传感器阵列来检测视野中的轨迹,从而能够高效地感知移动物体的方向和视觉显著性,并通过一个四层神经网络实现了99.2%的识别准确率。通过调制二硫化钼浅俘获中心的电荷动力学,该传感器阵列能够以10到10毫秒的时间分辨率识别运动。