Imaging through scattering medium has wide applications across many areas. Here, we present a new deep learning framework for improving the robustness against physical perturbations of the scattering medium. The trained DNN can make high-quality predictions beyond the training range which is across 10X depth-of-field (DOF). We develop a new analysis framework based on dimensionality reduction for revealing the information contained in the speckle dataset, interpreting the mechanism of our DNN, and visualizing the generalizability of the DNN model. This allows us to further elucidate on the information encoded in both the raw speckle measurements and the working principle of our speckle-imaging deep learning model.
Standard immunofluorescence (IF) staining is labor-intensive, time-consuming and suffers from inflexibility and poor multiplicity. To overcome these limitations, we proposed a deep learning (DL) approach for virtual IF staining with high multiplicity and specificity from label-free reflectance microscopy. Our results show that DL-enabled label-free IF microscopy can predict characteristic subcellular features during different cell cycles and reveal cellular phenotypes with high accuracy.
We demonstrate a deep-learning(DL)-based computational microscopy for high-throughput phase imaging by taking multiplexed measurements and employing deep neural networks (DNNs) based reconstruction. In particular, we develop a Bayesian convolutional neural network (BNN) to quantify the uncertainties of the DL inference, providing a surrogate estimate of the true prediction errors. The framework is demonstrated on a high-speed computational phase microscopy technique. We show the BNN is able to not only predict high-resolution phase images and but also provide a pixel-wise credibility map that evaluates the imperfections in the datasets and training process。
Emerging deep learning based computational microscopy techniques promise novel imaging capabilities beyond traditional techniques. In this talk, I will discuss two microscopy applications.
First, high space-bandwidth product microscopy typically requires a large number of measurements. I will present a novel physics-assisted deep learning (DL) framework for large space-bandwidth product (SBP) phase imaging,1 enabling significant reduction of the required measurements, opening up real-time applications. In this technique, we design asymmetric coded illumination patterns to encode high-resolution phase information across a wide field-of-view. We then develop a matching DL algorithm to provide large-SBP phase estimation. We demonstrate this technique on both static and dynamic biological samples, and show that it can reliably achieve 5x resolution enhancement across 4x FOVs using only five multiplexed measurements. In addition, we develop an uncertainty learning framework to provide predictive assessment to the reliability of the DL prediction. We show that the predicted uncertainty maps can be used as a surrogate to the true error. We validate the robustness of our technique by analyzing the model uncertainty. We quantify the effect of noise, model errors, incomplete training data, and “out-of-distribution” testing data by assessing the data uncertainty. We further demonstrate that the predicted credibility maps allow identifying spatially and temporally rare biological events. Our technique enables scalable DL-augmented large-SBP phase imaging with reliable predictions.
Second, I will turn to the pervasive problem of imaging in scattering media. I will discuss a new deep learning- based technique that is highly generalizable and resilient to statistical variations of the scattering media.2 We develop a statistical ‘one-to-all’ deep learning technique that encapsulates a wide range of statistical variations for the model to be resilient to speckle decorrelations. Specifically, we develop a convolutional neural network (CNN) that is able to learn the statistical information contained in the speckle intensity patterns captured on a set of diffusers having the same macroscopic parameter. We then show that the trained CNN is able to generalize and make high-quality object predictions through an entirely different set of diffusers of the same class. Our work paves the way to a highly scalable deep learning approach for imaging through scattering media.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.