School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon34141, Republic of Korea.
Department of Electronic Engineering, Hanbat National University, 125 Dongseo-daero, Yuseong-gu, Daejeon34158, Republic of Korea.
ACS Appl Mater Interfaces. 2023 Feb 1;15(4):5449-5455. doi: 10.1021/acsami.2c19208. Epub 2023 Jan 20.
An artificial multisensory device applicable to in-sensor computing is demonstrated with a single-transistor neuron (1T-neuron) for multimodal perception. It simultaneously receives two sensing signals from visual and thermal stimuli. The 1T-neuron transforms these signals into electrical signals in the form of spiking and then fires them for a spiking neural network at the same time. This feature makes it feasible to realize input neurons for multimodal sensing. Visual and thermal sensing is achieved due to the inherent optical and thermal behaviors of the 1T-neuron. To demonstrate a neuromorphic multimodal sensing system with the artificial multisensory 1T-neuron, fingerprint recognition, widely used for biometric security, is implemented. Owing to the simultaneous sensing of heat as well as light, the proposed fingerprint recognition system composed of multisensory 1T-neurons not only identifies a genuine pattern but also judges whether or not it is forged.
本文展示了一种适用于传感器内计算的人工多感觉设备，该设备使用单个晶体管神经元（1T-神经元）进行多模态感知。它可以同时从视觉和热刺激中接收两个传感信号。1T-神经元将这些信号转换为电信号，以尖峰的形式发出，并同时为尖峰神经网络发射它们。这一特性使得实现多模态传感的输入神经元成为可能。由于 1T-神经元固有的光学和热学行为，实现了视觉和热感。为了演示具有人工多感觉 1T-神经元的神经形态多模态传感系统，实现了广泛用于生物特征安全的指纹识别。由于同时感测热和光，由多感觉 1T-神经元组成的所提出的指纹识别系统不仅可以识别真实图案，还可以判断其是否为伪造。
