Image classification behind complex inhomogeneous media is a pervasive problem in computational optics. In recent years, optical neural networks have shown high accuracy and little computation costs in image classification. However, the improvements in scalability and complexity are still challenging. This paper presents an optronic speckle transformer (OPST) for image classification through scattering media. We utilize the optical self-attention mechanism to extract the speckle pattern’s local and global properties. We realize excellent speckle classification results with minimal computation costs based on OPST. The OPST improves the classification by more than 8% and reduces the network’s parameter by more than 30%, compared with optronic convolutional neural networks (OPCNN). Moreover, our OPST demonstrates high scalability with existing optical neural networks and is adaptive to more complex tasks. Our work paves the way to an all-optical approach with less computational costs for object classification through opaque media.
Object classification behind a complex inhomogenous medium remains a significant challenge in many fields. Valid information is hardly extracted from speckles owing to the distortion of scattering media. Recent years deep learning has shown powerful capability in classifying object from scattered speckle patterns. However, largescale computations and pure digital procedures set a challenging task for deep neural networks running in optics. Here, we present an optronic technique for object classification through random diffuser media. A group of Fourier lens and a programmable spatial light modulator, form an optronic convolutional neural networks(OPCNN) with optimized kernels. The CMOS camera not only works as an image detection sensor but a non-linear activation layer by the curve built-in. We demonstrated the technique classification result using the airy disk intensity of every candidate channel. The trained OPCNN shows high-quality object predictions on the speckle patterns. Our work paves the way to an all-optical approach for imaging through scattering media.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.