Choi Changsoon, Hinton Henry, Seung Hyojin, Chang Sehui, Kim Ji Su, You Woosang, Kim Min Sung, Hong Jung Pyo, Lim Jung Ah, Hwang Do Kyung, Lee Gil Ju, Jang Houk, Song Young Min, Kim Dae-Hyeong, Ham Donhee
John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, 02138, USA.
Center for Opto-Electronic Materials and Devices, Post-silicon Semiconductor Institute, Korea Institute of Science and Technology (KIST), Seoul, 02792, Republic of Korea.
Nat Commun. 2024 Jul 17;15(1):6021. doi: 10.1038/s41467-024-50271-7.
The bioinspired camera, comprising a single lens and a curved image sensor-a photodiode array on a curved surface-, was born of flexible electronics. Its economical build lends itself well to space-constrained machine vision applications. The curved sensor, much akin to the retina, helps image focusing, but the curvature also creates a problem of image distortion, which can undermine machine vision tasks such as object recognition. Here we report an anti-distortion single-lens camera, where 4096 silicon photodiodes arrayed on a curved surface in a nonuniform pattern assimilated to the distorting optics are the key to anti-distortion engineering. That is, the photo-pixel distribution pattern itself is warped in the same manner as images are warped, which correctively reverses distortion. Acquired images feature no appreciable distortion across a 120° horizontal view, as confirmed by their neural-network recognition accuracies. This distortion correction via photo-pixel array reconfiguration is a form of in-sensor computing.
这种受生物启发的相机由一个单镜头和一个曲面图像传感器(曲面上的光电二极管阵列)组成,它源自柔性电子技术。其经济的构造非常适合空间受限的机器视觉应用。这种曲面传感器与视网膜非常相似,有助于图像聚焦,但曲率也会产生图像失真问题,这可能会破坏诸如物体识别等机器视觉任务。在此,我们报告一种抗失真单镜头相机,其中以不均匀模式排列在曲面上的4096个硅光电二极管,模拟了失真光学器件,是抗失真工程的关键。也就是说,光像素分布模式本身以与图像扭曲相同的方式扭曲,从而校正性地反转失真。通过神经网络识别准确率证实,获取的图像在120°水平视野范围内没有明显失真。这种通过光像素阵列重新配置进行的失真校正属于传感器内计算的一种形式。