Song Alexander, Murty Kottapalli Sai Nikhilesh, Goyal Rahul, Schölkopf Bernhard, Fischer Peer
Max Planck Institute for Medical Research, Heidelberg, Germany.
Institute for Molecular Systems Engineering and Advanced Materials, Universität Heidelberg, Heidelberg, Germany.
Nat Commun. 2024 Dec 18;15(1):10692. doi: 10.1038/s41467-024-55139-4.
Optical approaches have made great strides towards the goal of high-speed, energy-efficient computing necessary for modern deep learning and AI applications. Read-in and read-out of data, however, limit the overall performance of existing approaches. This study introduces a multilayer optoelectronic computing framework that alternates between optical and optoelectronic layers to implement matrix-vector multiplications and rectified linear functions, respectively. Our framework is designed for real-time, parallelized operations, leveraging 2D arrays of LEDs and photodetectors connected via independent analog electronics. We experimentally demonstrate this approach using a system with a three-layer network with two hidden layers and operate it to recognize images from the MNIST database with a recognition accuracy of 92% and classify classes from a nonlinear spiral data with 86% accuracy. By implementing multiple layers of a deep neural network simultaneously, our approach significantly reduces the number of read-ins and read-outs required and paves the way for scalable optical accelerators requiring ultra low energy.
光学方法在实现现代深度学习和人工智能应用所需的高速、节能计算目标方面取得了长足进展。然而,数据的读入和读出限制了现有方法的整体性能。本研究介绍了一种多层光电计算框架,该框架在光学层和光电层之间交替,分别实现矩阵向量乘法和整流线性函数。我们的框架专为实时并行操作而设计,利用通过独立模拟电子设备连接的二维发光二极管(LED)阵列和光电探测器。我们通过一个具有两个隐藏层的三层网络系统对该方法进行了实验验证,并使用该系统识别MNIST数据库中的图像,识别准确率达到92%,对非线性螺旋数据的分类准确率达到86%。通过同时实现深度神经网络的多个层,我们的方法显著减少了所需的读入和读出次数,为超低能耗的可扩展光学加速器铺平了道路。