Alexander Song,1,2 Sai Nikhilesh Murty Kottapalli,1,2 Bernhard Schölkopf,3 Peer Fischer1,2
1Max-Planck-Institut für medizinische Forschung (Germany) 2Ruprecht-Karls-Univ. Heidelberg (Germany) 3Max Planck Institute for Intelligent Systems (Germany)
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
Convolutional layers are a critical feature of modern neural networks and require significant computational resources. Recently, researchers have developed optical accelerators as a low-energy, high-bandwidth approach for performing large-scale convolutions. Existing approaches perform convolutions on only one input channel to one or more output channels. Here we develop an optical convolution approach that simultaneously convolves multiple input channels each with their own set of convolutional kernels onto multiple output channels. Our approach uses a microlens array to redirect light from a 2D light emitter array through convolutional kernels encoded on an amplitude mask onto a camera. We experimentally test our multi-channel free space optical convolution approach and evaluate its performance using ray-tracing simulations. This work solves a major constraint of existing optical convolutional approaches, as modern convolutional networks use large numbers of input and output channels in convolutional layers.
Alexander Song,Sai Nikhilesh Murty Kottapalli,Bernhard Schölkopf, andPeer Fischer
"Multi-channel free space optical convolutions with incoherent light", Proc. SPIE PC12903, AI and Optical Data Sciences V, PC129030I (13 March 2024); https://doi.org/10.1117/12.2692291
ACCESS THE FULL ARTICLE
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
The alert did not successfully save. Please try again later.
Alexander Song, Sai Nikhilesh Murty Kottapalli, Bernhard Schölkopf, Peer Fischer, "Multi-channel free space optical convolutions with incoherent light," Proc. SPIE PC12903, AI and Optical Data Sciences V, PC129030I (13 March 2024); https://doi.org/10.1117/12.2692291