We introduce Chromatix: an easy to use, open-source, differentiable wave optics simulation library. Engineered to fully exploit parallelism, from single CPU and GPU workstations to servers with multiple GPUs, Chromatix removes the computational scaling barrier for differentiable wave optics simulations. Chromatix allows for designing and optimizing a wide range of optical systems (e.g., tomography, light field microscopy, and ptychography) as well as solving inverse problems. We expect Chromatix to democratize and power the exploration of a rich design space in computational optics.
KEYWORDS: Organisms, Microscopes, Tomography, Algorithm development, 3D modeling, Detection and tracking algorithms, 3D tracking, 3D image processing, Reconstruction algorithms, Muscles
It is challenging to study behavior of and track freely-moving model organisms using conventional 3D microscopy techniques. To overcome motion artifacts and prevent the organism from leaving the field of view (FOV), existing techniques require paralyzing or otherwise immobilizing the organism. Here, we demonstrate hemispheric Fourier light field tomography, featuring a parabolic objective that enables synchronized multi-view fluorescence imaging over ~2pi steradians at up to 120 fps and across multi-millimeter 3D FOVs. Our method is not only able to track the 6D pose of freely-moving zebrafish and fruit fly larvae, but also other properties such as heartbeat, fin motion, jaw motion, and muscle contractions. We also demonstrate simultaneous multi-organism imaging.
We introduce an innovative MCAM architecture using a 6x8 array of 48 lenses and sensors for simultaneous 0.624 gigapixel imaging within a few centimeters, delivering near-cellular resolution. This enables 3D video recording and radiometric fluorescence imaging of organisms using stereoscopic capture and appropriate filters. Such a feature proves advantageous when conducting combined investigations into organism behavior and functional fluorescence measurements. Moreover, the MCAM is equipped to perform birefringent imaging by incorporating suitable polarizers. We demonstrate the multimodal imaging capacity of this system using a variety of specimens, notably Drosophila, and zebrafish.
We report tensorial tomographic Fourier ptychography (T2oFu), a nonscanning label-free tomographic microscopy method for simultaneous imaging of quantitative phase and anisotropic specimen information in 3D. Built upon Fourier ptychography, a quantitative phase imaging technique, T2oFu additionally highlights the vectorial nature of light. The imaging setup consists of a standard microscope equipped with an LED matrix, a polarization generator, and a polarization-sensitive camera. Permittivity tensors of anisotropic samples are computationally recovered from polarized intensity measurements across three dimensions. We demonstrate T2oFu’s efficiency through volumetric reconstructions of refractive index, birefringence, and orientation for various validation samples, as well as tissue samples from muscle fibers and diseased heart tissue. Our reconstructions of healthy muscle fibers reveal their 3D fine-filament structures with consistent orientations. Additionally, we demonstrate reconstructions of a heart tissue sample that carries important polarization information for detecting cardiac amyloidosis.
“Anyone who uses a microscope has likely noticed the limitation of the trade-off between the field of view and the resolution”. To acquire highly resolved images at large fields of view, existing techniques typically record sequential images at different positions and then digitally stitch composite images. There are alternatives to this mechanical scanning procedure, such as structured illumination microscopy or Fourier ptychography that record sequential images at varying illuminations prevent mechanical scanning for high-resolution image composites. However, all of these approaches require sequential images and thus compromise speed, temporal resolution and experimental throughput. Here we present the Multi-Camera Array Microscope (MCAM), which is a microscope system that utilizes an array of many synchronized cameras, each with an individual imaging lens, for simultaneous image capture. The MCAM enables enhanced imaging capabilities and novel applications in various scientific and medical fields, by combining the images acquired from each individual camera-lens pair.
We present a high-throughput computational imaging system capable of performing dense, volumetric fluorescence imaging of freely moving organisms at up to 120 volumes per second. Our method, termed 2pi Fourier light field tomography (2pi-FLIFT), consists of a planar array of 54 cameras and a parabolic mirror serving as the primary objective that allows for synchronized multi-view video capture over ~2pi steradians. 2pi-FLIFT features a novel 3D reconstruction algorithm that recovers both the 3D fluorescence distribution and attenuation map of dynamic samples. We demonstrate 2pi-FLIFT on important, freely moving model organisms, such as zebrafish and fruit fly larvae.
Microscopic imaging of anisotropic samples has many important applications in cytopathology. The endogenous contrast from the polarization properties of a specimen, such as its birefringence, provides valuable diagnostic information for several deadly diseases, including cardiac amyloidosis and squamous cell carcinoma, for example. In the past, polarized light microscopy (PLM) has been widely used as a diagnostic tool during the clinical review. However, in analogy with the standard microscope, the PLM typically has a restricted spatial-bandwidth product (SBP). As a consequence, one can either image a large area with low resolution or see the details of a very small area of the sample at the resolutions required for accurate analysis. To address the SBP issue of the PLM, we propose a computational microscopy method, termed vectorial Fourier ptychography, to illuminate the specimen with polarized light from different angles and detects different polarization states of the diffracted light. By illuminating a specimen with plane waves from different angles, our vectorial Fourier ptychography method effectively modulates the high-spatial-frequency components of the specimen into lower frequencies that can be detected by the optical system. With a Jones calculus-based forward model and a second-order phase retrieval method, we can reconstruct high-resolution, wide field-of-view(FOV) amplitude, phase, birefringence, retardance, and diattenuation of the specimen. To assess the reconstruction accuracy of our method, we imaged polystyrene beads submerged in immersion oils of different refractive index, as well as monosodium urate crystals. Further, To validate the diattenuation reconstruction accuracy, we reconstruct a USAF resolution test chart with a half blocked by a linear polarizer. These experiments confirm quantitatively accurate reconstruction results with a 1.25 um full-pitch resolution over a FOV of 6.6 x 4.4 mm^2, which is 5 times higher than the native (brightfield) resolution of the non-computational optical system. Finally, we demonstrate our technique by producing high SBP polarization images of several anisotropic biologic samples, includes collagen tissue, congo red stained cardiac tissue, and a bean root sample.
We propose a new sensitive diffuse correlation spectroscopy(DCS) method that can probe and identify different decorrelation events happens in sub-second, by acquiring parallelized measurements from 12 fiber detectors placed at different positions on the tissue-phantom surface with a 32 ×32 SPAD array, and process the data with deep learning methods. Both experimental and simulation phantom studies are conducted to evaluate the performance of our system in classifying and imaging decorrelation patterns presented under a 5mm thick tissue phantom made with rapidly decorrelating scattering media.
We present a novel approach, based on the use of an array of cameras with custom optics, which can capture snapshot stereoscopic gigapixel images across 1cm2 area at 1-micrometer half-pitch resolution. Our system uses a large space-bandwidth product objective lens to form an intermediate image, which is captured by 96 micro-cameras arranged in a flat array. Each camera records a 10-megapixel image from a unique section of the sample, which are then stitched to produce the final composite. Our system is well suited for applications in digital pathology and in vitro cell-cultures imaging.
Recently developed Single-photon Avalanche Diode (SPAD) array cameras have single photon sensitivity and can provide time-of-flight information for LIDAR imaging. These SPAD cameras, however, have very few pixels and readout binary images, which are typically averaged to provide an image with sufficient dynamic range. Here, we propose to implement a modified version of Fourier ptychography (FP), a synthetic aperture technique, on SPAD cameras to reconstruct an image with much higher resolution and larger dynamic range from its binary measurements. We successfully validate this using simulated and experimental results to show its potential for recording LIDAR images at high resolution and speed.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.