Fluorescence microscopy point spread function model accounting for aberrations due to refractive index variability within a specimen

Sreya Ghosh; Chrysanthe Preza

doi:10.1117/1.JBO.20.7.075003

7 July 2015 Fluorescence microscopy point spread function model accounting for aberrations due to refractive index variability within a specimen

Sreya Ghosh, Chrysanthe Preza

Author Affiliations +

Journal of Biomedical Optics, Vol. 20, Issue 7, 075003 (July 2015). https://doi.org/10.1117/1.JBO.20.7.075003

Abstract

A three-dimensional (3-D) point spread function (PSF) model for wide-field fluorescence microscopy, suitable for imaging samples with variable refractive index (RI) in multilayered media, is presented. This PSF model is a key component for accurate 3-D image restoration of thick biological samples, such as lung tissue. Microscope- and specimen-derived parameters are combined with a rigorous vectorial formulation to obtain a new PSF model that accounts for additional aberrations due to specimen RI variability. Experimental evaluation and verification of the PSF model was accomplished using images from 175-nm fluorescent beads in a controlled test sample. Fundamental experimental validation of the advantage of using improved PSFs in depth-variant restoration was accomplished by restoring experimental data from beads (6 μm in diameter) mounted in a sample with RI variation. In the investigated study, improvement in restoration accuracy in the range of 18 to 35% was observed when PSFs from the proposed model were used over restoration using PSFs from an existing model. The new PSF model was further validated by showing that its prediction compares to an experimental PSF (determined from 175-nm beads located below a thick rat lung slice) with a 42% improved accuracy over the current PSF model prediction.

1. Introduction

The three-dimensional (3-D) image of a point is affected by the limiting aperture of the wide-field microscopy system, which prevents the formation of a perfect image. The aperture fails to collect all the light emitted by the point source and also introduces a diffraction pattern. Imaging through stratified media adds an additional challenge due to refraction at media interfaces.¹ The 3-D image formation process can be modeled as an integral operation of the true fluorescence distribution with the point spread functions (PSFs) of the system, which is the impulse response of the system.² Computational optical sectioning microscopy (COSM)³ algorithms restore the true object intensities from the acquired image using prior knowledge about the imaging conditions, including the PSF of the system.⁴ The accuracy of the restoration is contingent on the accuracy of the PSF model, which this study aims to improve by incorporating the impact of a specimen on the overall system response.

Biological specimens are thicker ( $> 5 μ m$ ) than the depth of field of a high numerical aperture (NA) lens ( $< 0.2 μ m$ ) and have a variable refractive index (RI), which is different from the RI of the immersion medium and of the coverslip. Spatial variability in the RI of samples is attributed to the variability of their cellular components.⁵ Lung tissue, for example, demonstrates RI variability because there is air ( $RI = 1.00$ ) in the alveoli, which are surrounded by cellular material with RI between 1.30 and 1.41.⁶^,⁷ 3-D imaging of such specimen with wide-field microscopy suffers from both defocus and spherical aberration (SA). 3-D imaging with confocal or structured illumination microscopy, although not affected by defocus, is still prone to SA.⁸^,⁹ Light emitted by points located deep in the specimen layer must pass through layers whose thicknesses and RI can vary significantly from the layers in the ideally designed system. Refraction between the nondesign layers affects the spherical wave-front of the propagated light resulting in a larger spread of the focus, thus reducing both resolution and peak intensity.¹⁰ This phenomenon poses a challenge to restoration algorithms in COSM, creating the need for a new paradigm.

The variability of the PSF due to change in SA throughout the specimen introduces the challenge of space-variant (SV) imaging. Depth-variant (DV) imaging, i.e., variance along $Z$ has been investigated by many researchers.¹¹^–¹³ Our work has been focused on developing solutions for the SV imaging problem based on integrating four on-going lines of investigation: (1) development of a methodology to derive the sample RI;¹⁴ (2) development of an accurate but practical PSF model (reported in this paper); (3) a block-based imaging model¹⁵^,¹⁶ that integrates multiple PSFs (computed with the model proposed here) to approximate the SV forward image; and (4) a restoration algorithm based on the block-based SV imaging model. The new PSF model presented here extends the mathematical formulation in existing models¹⁷^,¹⁸ and is a key component within our broader goal that aims to restore images of thick biological samples using practical model-based computational algorithms.

Experimental PSFs, obtained by imaging small point-like sources, such as subresolved fluorescent spheres within a specimen, can provide an accurate representation of the system’s response for specific imaging conditions.¹⁹ However, experimental PSFs are not easy to measure,²⁰ and they tend to have reduced signal-to-noise ratio and poor sampling due to the efficiency of the detector.²¹ Analytical PSFs, on the other hand, are limited by model assumptions based on our knowledge of the system and specimen. Improved theoretical PSF models contribute to the development of COSM by enabling computation of more accurate imaging models, and by avoiding the acquisition of multiple experimental PSFs for each restoration.

Initial models²^,²² developed for 3-D PSFs assumed that the specimen is thin with a uniform RI and that it is placed directly under the coverslip; none of these assumptions hold for most biological samples. Prevalent models¹⁷^,¹⁸ account for SA due to thickness, but the RI of the sample is assumed to be uniform throughout. In the study presented in this paper, a specimen is modeled to have multiple layers of variant RI, which is accounted within the mathematical formulation of the extended PSF model.

The widely used Gibson and Lanni (G&L) PSF model¹⁷ is optimized for a three-interface stratification assumed in microscopy systems, comprising the oil-immersion lens ( $RI = 1.512$ ), the coverslip ( $RI = 1.522$ ), and the specimen with an average RI close to water ( $RI = 1.33$ ). The use of design and actual imaging conditions and efficient calculations render the G&L model prevalent, but it is challenged for high-NA lenses because the extremal rays impinge with large angles of incidence at interfaces. This challenge can be overcome by a vectorial PSF model, such as the one proposed by Török and Varga.²³ The Török and Varga (T&V) model accounts for RI variance within the sample by extending the Born and Wolf model¹ of diffraction for a stratified medium by application of the Fresnel refraction law. The model is rigorous but uses parameters such as the initial aberration function, which cannot be directly determined from the microscope imaging conditions.

Haeberlé¹⁸ combined the optical path difference (OPD) described in the G&L model with the vectorial representation of the PSF provided by the T&V model, to give a more accurate PSF using the design and actual acquisition parameters. The Haeberlé representation of the PSF model has been proven effective in restoring microscope acquired images.²⁴^,²⁵ The PSF model discussed in this paper was developed using an approach similar to the one presented by Haeberlé, and it represents an extension of his model, which assumes that the sample has a uniform RI. The new PSF model presented here accounts for a spatially variant sample RI by assuming that different layers within the sample can have a different RI, thereby approximating the imaging conditions more accurately than previous models while keeping the computations tractable.

In our overall approach, the RI variability within the specimen is represented by a finite arrangement of nonoverlapping blocks [Fig. 1(a)], where the RI is assumed to be a constant within each block.¹⁵ The block size is determined by the smallest volume within the sample, where the RI can be assumed to be constant, since very small variations in RI do not appreciably affect the PSF. This approximation models specimen RI more accurately by allowing it to vary not only axially but also laterally. Light from a point source travels through all the blocks directly above it, and each interface between two blocks introduces a change in the optical path, influencing the formation of its PSF. The PSF model presented here is implemented on a stratified column formed by isolating a series of axially stacked blocks directly above the point source [Fig. 1(a)]. Each point source is associated with its own stratified column, which allows PSF computation using the new model. This arrangement is further elucidated in Fig. 1. In the rest of the paper, we refer to our proposed model as the $N$ -interface PSF model.

Fig. 1

An $N$ -interface point spread function (PSF) model: (a) specimen with space-variant refractive index (RI) divided into blocks with each block having a uniform RI. Light rays from a unique point source (indicated by the dot at the bottom of the axially stacked blocks) travel through blocks, with different RIs, directly above it. The axially stacked blocks (which look like a column) are isolated by the model to calculate the PSF. (b) Schematic diagram of the light path from a point source on the optical axis to the objective lens within a unique column. The light travels through the specimen with multiple layers of varying RIs in addition to the layer of the immersion medium and the coverglass. $n_{i}$ , $n_{g}$ , and $n_{sk}$ are the refractive indices of the immersion medium, coverglass, and sample, respectively, while, $t_{i}$ , $t_{g}$ , and $t_{sk}$ are their corresponding thicknesses. $h_{1}$ , $h_{2}$ , and $h_{N}$ are the locations of the interfaces. In the design system, the point source is located just under the coverslip at P, but for thicker samples, its location is at A, which is deeper within the sample. Variables marked with an asterisk “*” represent design parameters as opposed to the nondesign (actual) parameters. The design optical path is PQRS, while ABCD is the nondesign (actual) optical path through the stratified medium; their difference is the optical path difference.

The computation of the OPD in the imaging system using only three layers (i.e., the lens’ immersion medium, the coverslip, and the specimen) has been understood to be an approximation, which is not easy to relax because variability within the specimen is hard to model uniquely. Advances in understanding the properties of samples are currently being studied using quantitative phase microscopy approaches. Specimens have the property of changing the phase of light that passes through them due to spatial variations in their RI and thickness; this change can be exploited by specialized microscope setups to generate image intensity variations (contrast).¹⁴ 3-D RI maps of objects have been investigated using phase contrast microscopy²⁶ and tomographic phase microscopy.²⁷ The RI of lung cells has been studied using a combination of confocal and quantitative phase amplitude microscopy.⁵

Kam et al.²⁸ modeled the change in RI using specimen phase information and a ray tracing method to obtain the aberrant PSF. However, ray tracing based on ray optics is not computationally practical in iterative restoration algorithms because ray tracing attempts to restore one pixel at a time. Hiware et al.²⁹ extended the OPD of the G&L model to include the variation of turbulent but small RI variances (0.001 to 0.005) within the sample as suggested by Schmitt.²⁶ The Schmitt sample approximation is not suitable for specimens with large RI variances (1.00 to 1.49), such as those encountered in ex vivo lung tissue³⁰ (discussed previously). Our investigation with a 63x/1.4 NA oil-immersion lens has shown that for a watery sample (a common assumption for many biological samples), a 0.5% change in the RI (i.e., a change from 1.333 to 1.338) results in $> 1 %$ change in the PSF (quantified by a mean square error) at a 10 to $50 μ m$ depth range within the sample, which is negligible with respect to imaging and restoration. The proposed PSF model is not limited to such small RI variations.

The paper is organized as follows. Section 2 discusses the mathematical formulation of the $N$ -interface PSF model. The validity of the new PSF model for specimen with RI variance is investigated using experimental results and it is discussed in Sec. 3. The effect of RI variance within the specimen on the response of a typical system is studied using simulated $N$ -interface PSFs in Sec. 4. The use and advantage of $N$ -interface PSFs in the restoration of 3-D images of $6 - μ m$ -diameter beads is presented in Sec. 5. The model is further evaluated using images of point sources placed below rat lung slices in Sec. 6. A summary of the findings from this study and further developments are discussed in Sec. 7.

2. Mathematical Models

This section describes the mathematical formulation developed for the $N$ -interface PSF model. The new PSF model introduced in this paper accounts for RI variation within the specimen modeled over $N$ ( $\geq 3$ ) interfaces between layers, such as the lens’ immersion medium, the coverslip, and one or more interfaces within the specimen.

The PSF model presented here requires a 3-D sample RI map, $n (x, y, z)$ , for the determination of the optical path length (OPL). The OPL is the product of RI and the physical distance that light travels when it propagates through the sample. The determination of the sample RI map is a challenging problem that has been tackled by several groups⁵^,⁷^,²⁷ including ours.¹⁴ Our overarching method described in Sec. 1 utilizes an automated multimodal microscope capable of 3-D wide-field fluorescence microscopy and differential interference contrast (DIC) microscopy, which facilitates the determination of sample RI and thickness from quantitative phase derived from DIC images.¹⁴ In our formulation, the $N$ -interface PSF model assumes that a specimen 3-D RI map is available.

Our model assumes that the imaging system is comprised of $N - 1$ stratified layers with distinct RIs that would not cause total internal reflection or generation of evanescent waves, as presented in the T&V model.²³ OPD is the change in the OPL between corresponding rays from the design and nondesign system that pass through the same point in the back focal plane as defined in Ref. 17. The OPD used in the G&L model¹⁷ is modified here to account for a stratified specimen with variable RI, to consequently model the influence of the sample on the amount of SA more accurately.

The OPD (Fig. 1) is based on Snell’s law of refraction and the Abbe sine condition³¹ as

Eq. (1)

OPD = {OPD}_{i} + {OPD}_{g} + \sum_{k = 1}^{K} {OPD}_{s_{k}} = ABCD - PQRS,

where

{OPD}_{i}

is the OPD introduced by the immersion medium,

{OPD}_{g}

is the OPD introduced by the coverglass, and

\sum_{k = 1}^{K} {OPD}_{s_{k}}

is the sum of all the OPDs introduced by the

K

layers within the specimen. Equation (1) based on derivations elaborated in Ref. 17 can be rewritten as

Eq. (2)

OPD \approx n_{i} Δ z \sqrt{1 - {(\frac{NA ρ}{n_{i}})}^{2}} + n_{g} t_{g} [\sqrt{1 - {(\frac{NA ρ}{n_{g}})}^{2}} - {(\frac{n_{i}}{n_{g}})}^{2} \sqrt{1 - {(\frac{NA ρ}{n_{i}})}^{2}}] - n_{g}^{*} t_{g}^{*} [\sqrt{1 - {(\frac{NA ρ}{n_{g}^{*}})}^{2}} - {(\frac{n_{i}}{n_{g}^{*}})}^{2} \sqrt{1 - {(\frac{NA ρ}{n_{i}})}^{2}}] - n_{i}^{*} t_{i}^{*} [\sqrt{1 - {(\frac{NA ρ}{n_{i}^{*}})}^{2}} - {(\frac{n_{i}}{n_{i}^{*}})}^{2} \sqrt{1 - {(\frac{N A ρ}{n_{i}})}^{2}}] + \sum_{k = 1}^{K} n_{s_{k}} t_{s_{k}} [\sqrt{1 - {(\frac{NA ρ}{n_{s_{k}}})}^{2}} - {(\frac{n_{i}}{n_{s_{k}}})}^{2} \sqrt{1 - {(\frac{NA ρ}{n_{i}})}^{2}}],

where

n_{i}

,

n_{g}

, and

n_{s_{k}}

are the RI of the immersion medium, coverglass, and sample, accordingly, while

t_{i}

,

t_{g}

, and

t_{s_{k}}

are their corresponding thicknesses, and

K

is the number of specimen layers. The overall system has

N

(

N = K + 2

) layers with the additional layers belonging to the immersion medium and coverglass. Terms with an asterisk “*” indicate objective lens design conditions.

θ

is the angle both rays (ABCD and PQRS in Fig. 1) entering the frontal lens of the objective make with the horizontal axis. As assumed in the G&L model, the normalized radius in the back focal plane (where

ρ = 0

at the optical axis and

ρ = 1

at the edge of the projection of the microscope’s limiting aperture onto the back focal plane) can be expressed as

ρ \approx n_{a} \sin θ_{a} / NA

, where NA is the numerical aperture of the objective lens, while the origin of the (

x, y, z

) coordinate system is at the Gaussian focus point, and thus,

Δ z

is the defocus of the system.

θ_{a}

is the angle the ray makes with the horizontal axis when entering in the

a

th layer (i.e., the angle of incidence), and

n_{a}

is the corresponding RI, where (

a = 1, \dots, N

).

In the following equations, we show that the OPD in Eq. (1) and the aberration function ( $ψ$ ) in Ref. 23 are approximately equivalent, justifying the use of the OPD in the vectorial model proposed by Török and Varga.²³

The entire system is assumed to be composed of individual interfaces of the $N$ stratified layers, which are located axially at $z = - h_{1}, - h_{2}, \dots, - h_{N - 1}$ as defined in Ref. 23. The layers are assumed to be separate regions of homogenous and isotropic material, with RI of $n_{1}, n_{2}, \dots, n_{N}$ , correspondingly. The angle of incidence at the first interface is denoted by $θ_{1}$ and the angle in the $N$ th medium by $θ_{N}$ . The aberration function [Eq. (28) from Ref. 23] can be written as

Eq. (3)

ψ = - h_{1} n_{1} \cos θ_{1} + (h_{3} - h_{2}) n_{2} \cos θ_{2} + h_{N - 1} n_{N} \cos θ_{N} + \sum_{l = 3}^{N - 1} (h_{l - 1} - h_{l}) n_{l} \cos θ_{l} .

In Eq. (4), we map the notation of the modified G&L OPD parameters [Eq. (2)] to the notation of the terms in Eq. (3). The specimen is comprised of $K$ stratified layers as indicated above, with each layer having RI $n_{s_{k}} = n_{l}$ , where ( $k = 1,2, \dots, K$ and $l = 3, \dots, N$ ). The RIs of the immersion medium and coverglass are defined as $n_{i} = n_{1}$ and $n_{g} = n_{2}$ , respectively. The thickness of the immersion medium and the coverglass are defined as $t_{i}$ and $t_{g} = h_{3} - h_{2}$ , respectively. The thickness of the $K$ th (where the point source is located) layer is defined as $t_{s_{K}} = h_{N - 1}$ , while the thickness of all the other specimen layers are defined as $t_{s_{k}} = h_{l - 1} - h_{l}$ , where ( $k = 1,2, \dots, K - 1$ ; $l = 3,4, \dots, N - 1$ ). The normalized radius ( $ρ$ ) in the back focal plane can be used to determine the terms $\cos θ_{m} = \sqrt{1 - \sin^{2} θ_{m}} \approx \sqrt{1 - {(ρ NA / n_{m})}^{2}}$ for $m = 1,2, \dots, N$ .

Modern objective lenses are compensated for design parameters like the RI and thickness of the coverslip and the immersion medium, which are not present in the T&V PSF model.²³ Like Haeberlé,¹⁸ we borrow the compensation terms $t_{i}^{*}$ and $t_{g}^{*}$ for the design thickness of the immersion medium and coverglass, respectively, and $n_{i}^{*}$ and $n_{g}^{*}$ for their corresponding RIs, from the G&L model. These compensation factors are subtracted from the aberration function ( $ψ$ ) defined in Eq. (3) and are the fourth and fifth terms in Eq. (4). The second and last terms in Eq. (3) are combined to form the third term in Eq. (4), which together describe the properties of the specimen. Replacing the variables in the aberration function ( $ψ$ ) with notations from the G&L model and adding the compensation terms, we can update Eq. (3) to generate Eq. (4).

Eq. (4)

ψ \approx - h_{1} n_{i} \sqrt{1 - {(\frac{NA ρ}{n_{i}})}^{2}} + t_{g} n_{g} \sqrt{1 - {(\frac{NA ρ}{n_{g}})}^{2}} + \sum_{k = 1}^{K} t_{s_{k}} n_{s_{k}} \sqrt{1 - {(\frac{NA ρ}{n_{s_{k}}})}^{2}} - n_{i}^{*} t_{i}^{*} \sqrt{1 - {(\frac{NA ρ}{n_{i}^{*}})}^{2}} - n_{g}^{*} t_{g}^{*} \sqrt{1 - {(\frac{NA ρ}{n_{g}^{*}})}^{2} .}

In Eq. (4), all the parameters can be determined from the microscope apart from $h_{1}$ , which varies as the position of the lens varies when it is focused deeper within the sample. We use Fig. 1 to rewrite $h_{1}$ in terms of the other described variables such that the mathematical formulation is independent of it. It can be written as

Eq. (5)

h_{1} = n_{i} (\frac{Δ z}{n_{i}} + \frac{t_{g}}{n_{g}} - \frac{t_{g}^{*}}{n_{g}^{*}} - \frac{t_{i}^{*}}{n_{i}^{*}} + \sum_{k = 1}^{K} \frac{t_{s_{k}}}{n_{s_{k}}}) .

Hence, the first term in Eq. (4) can be written as

Eq. (6)

h_{1} n_{1} \cos θ_{1} = n_{i}^{2} (\frac{Δ z}{n_{i}} + \frac{t_{g}}{n_{g}} - \frac{t_{g}^{*}}{n_{g}^{*}} - \frac{t_{i}^{*}}{n_{i}^{*}} + \sum_{k = 1}^{K} \frac{t_{s_{k}}}{n_{s_{k}}}) \sqrt{1 - {(\frac{NA ρ}{n_{i}})}^{2}} .

Replacing $h_{1}$ [Eq. (5)] in Eq. (4), we observe that all the terms in Eq. (2) are present in Eq. (4). This substitution allows us to show that $OPD \approx ψ$ for a system with RI variability within the specimen.

For completion, we rewrite the PSF using the OPD in Eq. (2). The PSF at any arbitrary point $(x, y, z)$ is calculated from the electrical field $E$ as in Ref. 23.

Eq. (7)

PSF = {| E_{N x} + E_{N y} + E_{N z} |}^{2} E_{N x} = - i (I_{0}^{(N)} + I_{2}^{(N)} \cos 2 ϕ); E_{N y} = - i (I_{2}^{(N)} \sin 2 ϕ); E_{N z} = - 2 I_{1}^{(N)} \cos ϕ,

where

E_{N x}

,

E_{N y}

, and

E_{N z}

are the directional electric fields (with

ϕ

in spherical polar coordinates) of a typical ray in the

N

th medium. The illumination integrals

I_{0}^{(N)}

,

I_{1}^{(N)}

, and

I_{2}^{(N)}

of the electrical fields are

Eq. (8)

I_{0}^{(N)} = \int_{0}^{\infty} \sqrt{\cos θ_{1}} \sin θ_{1} J_{0} (k_{1} \sqrt{x^{2} + y^{2}} \sin θ_{1}) \times (T_{s}^{(N - 1)} + T_{p}^{(N - 1)} \cos θ_{N}) \exp (i k_{0} OPD) \times \exp (i k_{N} z \cos θ_{N}) d θ_{1} I_{1}^{(N)} = \int_{0}^{\infty} \sqrt{\cos θ_{1}} \sin θ_{1} J_{1} (k_{1} \sqrt{x^{2} + y^{2}} \sin θ_{1}) \times (T_{p}^{(N - 1)} \sin θ_{N}) \exp (i k_{0} OPD) \times \exp (i k_{N} z \cos θ_{N}) d θ_{1} I_{2}^{(N)} = \int_{0}^{\infty} \sqrt{\cos θ_{1}} \sin θ_{1} J_{2} (k_{1} \sqrt{x^{2} + y^{2}} \sin θ_{1}) \times (T_{s}^{(N - 1)} - T_{p}^{(N - 1)} \cos θ_{N}) \exp (i k_{0} OPD) \times \exp (i k_{N} z \cos θ_{N}) d θ_{1},

where

J_{n}

is the Bessel function of the first kind and of order

n

, and

k_{N}

is the wavenumber in the

N

th medium.

T_{m}^{(N - 1)}

is the transmission coefficient of the stratified layers, where

m = s

,

p

indicates the directionality of the polarized light traversing through the (

N - 1

)th medium. The derivation of Eq. (7) and further explanation of all the parameters are described in detail in Ref. 23.

This $N$ -interface PSF model is a reformulation of the T&V model²³ using easily accessible parameters as in the G&L model¹⁷ for specimens with nonuniform RI. The new $N$ -interface PSF model was implemented in MATLAB by extending the code originally developed for the Haeberlé PSF model.³² The experimental evaluation of the $N$ -interface model and its use in restoration is demonstrated in the next sections.

3. Evaluation of the $N$ -Interface PSF Model

To establish the accuracy of the theoretical model developed in Sec. 2, PSFs experimentally acquired from spatially variant samples are compared to simulated $N$ -interface PSFs. This section discusses the details for acquiring experimental PSFs (Sec. 3.1) and simulating corresponding theoretical PSFs (Sec. 3.2), and provides results from a comparison between theoretical and experimental PSFs (Sec. 3.3).

3.1.

Experimental Acquisition of PSFs from Test Samples with Depth-Variant Refractive Index

Experimental PSFs were imaged from samples with subresolved beads using a Zeiss Axio Imager (Carl Zeiss Microscopy GmbH, Germany) with optical sectioning capability and an AxioCam MRm camera.

Molecular Probes FluoSpheres, $0.175 μ m$ in diameter stained with Alexa Fluor, were dried on a microscope slide and sealed with UV-cured optical cement with $RI = 1.56$ [Norland Optical Adhesive 63 (NOA63), Norland Products, New Jersey] . Another layer of FluoSpheres, stained with 4', 6-diamidino-2-phenylindole (DAPI), was dried on top the cured optical cement. This preparation was submerged in ProLong Gold antifade reagent ( $RI = 1.46$ ) (a mountant used extensively in fluorescence microscopy to prevent photo-bleaching and preserve the fluorescence labeling for long-term storage and analysis). A layer of Rhodamine dyed FluoSpheres was dried on the coverslip, which was carefully placed onto the sample and sealed.

The distance between the best focus of the different color beads present at each layer of the test sample was used to obtain the thickness of each layer. This method has been proven effective to obtain the approximate depth of the sample²⁴ and has also been verified using guides etched on the coverslip.³³ A schematic diagram of this system is shown in Fig. 2(a). The distance between the coverslip–mountant interface and the mountant–optical cement interface was determined to be $\sim 45 μ m$ , while the distance from the mountant–optical cement interface to the bead was determined to be $\sim 43 μ m$ [Fig. 2(a)]. A $63× / 1.4 NA$ oil lens was used for imaging. The captured 3-D images have a cubic voxel with size of $0.10 μ m$ in $X$ , $Y$ , and $Z$ directions.

Fig. 2

Experimental verification of the $N$ -interface PSF model. (a) Schematic of imaging layers in the experimental setup and test sample. $X Z$ section images from (b) the experimentally acquired PSF; (c) the simulated PSF of a matched $N$ -interface system, assuming that the specimen medium closer to the coverglass is ProLong Gold ( $RI = 1.46$ and thickness $45 μ m$ ), while the specimen medium closer to the glass slide is optical cement [Norland Optical Adhesive 63 (NOA63), $RI = 1.56$ and thickness $43 μ m$ ). $X Z$ section images from the simulated PSF of a three-interface system assuming a uniform specimen medium with thickness equal to $88 μ m$ and RI equal to (d) 1.46 (ProLong Gold); (e) 1.56 (optical cement, NOA63); and (f) 1.51 [ ${RI}_{avg}$ using Eq. (9)]. (g) Axial intensity profiles through the center of (b), (c), and (f). Imaging parameters: $63× / 1.4$ NA oil lens ( $RI = 1.512$ ); grid size $100 \times 100 \times 300$ ; wavelength 535 nm; axial and lateral $spacing = 0.1 μ m$ . Scale bar: $2.6 μ m$ . PSF intensities were normalized from 0 to 1.

3.2.

Simulation of $N$ -Interface PSFs for Comparison with Experimental Data

To establish the validity of the new $N$ -interface PSF model introduced in Sec. 2, theoretical PSFs were computed with parameters from the experimental setup described in Sec. 3.1. PSFs from the existing Haeberlé model¹⁸ were calculated for comparison assuming that the specimen has a uniform RI, because the model cannot account for RI variance within the sample. A common practice is to compute an average RI from the different sample constituents. A weighted average RI for a stratified sample can be determined by

Eq. (9)

{RI}_{avg} = \frac{\sum_{k = 1}^{K} t_{s_{k}} n_{s_{k}}}{t_{tot}},

where

t_{tot}

is the total thickness of the specimen, while

t_{s_{k}}

and

n_{s_{k}}

are the thickness and RI of the

k

th sample layer, respectively.

For this study, four PSFs were generated as follows: (1) an $N$ -interface PSF using the exact sample parameters of the experimental system, i.e., a specimen with two different layers of media [ $RI = 1.46$ with thickness of $45 μ m$ and $RI = 1.56$ with thickness $43 μ m$ as in Fig. 2(a)]; and (2) three PSFs using the existing Haeberlé model assuming specimens with total thickness of $88 (= 45 + 43) μ m$ and a uniform RI equal to: $RI = 1.56$ (for optical cement NOA63), $RI = 1.46$ (for mountant ProLong^® Gold antifade reagent) and ${RI}_{avg} = 1.51$ [calculated using Eq. (9) and the experimental information].

The numerical PSFs were convolved with a simulated 175-nm-diameter sphere to accurately represent the experimentally determined PSF. The values of the simulated PSFs were scaled by $10^{4}$ AU to match the intensity range of the experimental data for faithful normalization. The intensity values of the PSFs were normalized between 0 and 1, and the peaks were aligned for comparison with the experimental data. Simulated and experimental PSFs were compared to evaluate the accuracy of the new PSF model and its accuracy over the existing model. The results are presented in Sec. 3.3.

3.3.

Evaluation of the Theoretical $N$ -Interface PSF Model Using Experimental Data

In this section, simulated PSFs (discussed in Sec. 3.2) generated from the $N$ -interface PSF model are compared to experimental PSFs discussed in Sec. 3.1 for model evaluation and also to simulated PSFs generated using the existing Haeberlé PSF model to highlight differences between the new and existing PSF model.

The experimental PSF image acquired using the conditions described in Sec. 3.1 is shown in Fig. 2(b). Figure 2(c) shows the $X Z$ cross-section of the simulated PSF computed using the $N$ -interface model for a four-layer system with parameters that match the experimental system. Qualitative comparison shows that the PSFs in Figs. 2(b) and 2(c) are similar, especially with respect to the direction of the PSF side lobes. PSFs computed using the Haeberlé PSF model for specimen RI equal to that of ProLong Gold [Fig. 2(d)], optical cement [Fig. 2(e)], and averaged RI [Fig. 2(f)] deviate from the experimental PSF [Fig. 2(b)]. In Fig. 2(c), light experiences negative SA (Ref. 34) because it travels from a lower to a higher RI medium ( $1.46 < 1.512$ ), while in Fig. 2(e), light experiences positive SA because it travels from a higher RI (1.56) to a lower one.

Quantitative comparison using axial profiles through the PSFs [Fig. 2(g)] shows that the $N$ -interface-system PSF is in better agreement with the experimental data than the PSFs from the three-interface systems. The central lobes of the experimental and simulated PSF from the $N$ -interface system overlap. The location of the secondary maximum and minimum also colocalize indicating agreement between the experiment and simulation. The axial profile through Fig. 2(f) has the same direction of aberration, but the secondary lobes do not localize with the four-interface PSF [Fig. 2(c)] and are also higher in intensity, indicating that it experiences less SA. To quantify the deviation of the different theoretical PSFs from the experimental PSF, a normalized mean square error (NMSE) metric³⁵ was computed using the experimental PSF as a reference. The calculated NMSE values are 0.13 for the $N$ -interface PSF and 0.41, 0.57, and 0.23 for the PSFs predicted by the existing model assuming specimen $RI = 1.46$ , $RI = 1.56$ , and $RI = 1.51$ , respectively. The NMSE reinforces the fact that the PSF generated using the $N$ -interface PSF is closest to the experimental PSF.

The accuracy of the $N$ -interface model PSFs for a specimen with variable RI was shown in this section. The mismatch in PSFs caused by assuming the specimen has uniform RI is also highlighted here.

4. Effect of Sample Refractive Index Variance on the $N$ -Interface PSF

To further demonstrate the need of an $N$ -interface PSF model, simulations were performed to observe and quantify the effect of RI variance within a specimen on the imaging PSF. PSFs were simulated for typical systems with a different number of interfaces and RI values along the imaging depth encountered by the light emitted from a point source (Sec. 4.1). Section 4.2 studies and quantifies the impact of RI variance on the shape of the PSF.

4.1.

$N$ -Interface PSFs Computed for Different Sample Conditions

For comparison, two sets of theoretically predicted PSFs were computed and investigated assuming that the point light source is in (1) a specimen with a uniform RI and (2) a specimen that has two or three different layered RIs. The RIs used in the simulation were chosen to be similar to RIs of materials commonly found in microscopy systems, such as air ( $RI = 1.00$ ), water ( $RI = 1.33$ ), and glycerol ( $RI = 1.47$ ).

Simulations were carried out on a $256 \times 256 \times 256$ grid with a cubic voxel of size $0.1 \times 0.1 \times 0.1 μ m$ . The emission wavelength was set to 488 nm and a $63× / 1.4 NA$ oil-immersion lens ( $RI = 1.512$ ) was used. Five PSFs were generated assuming that the point source of light is at a depth of $10 μ m$ below the coverslip within different specimens (Fig. 3). In the five cases presented here, the specimen is comprised of

1. a single medium with $RI = 1.47$ with thickness $10 μ m$ [Fig. 3(b)],
2. two different media, one with $RI = 1.33$ and the other with $RI = 1.47$ , where each layer is $5 μ m$ thick [Fig. 3(c)],
3. two different media, one with $RI = 1.00$ and the other with $RI = 1.47$ , where each layer is $5 μ m$ thick [Fig. 3(d)],
4. three different media, with RIs of 1.00, 1.33, and 1.47, correspondingly, where each layer is $3.5 μ m$ thick [Fig. 3(e)],
5. three different media as in specimen 4 above, but approximated by a single ${RI}_{avg} = 1.27$ [Eq. (9)] and a single layer of thickness $10 μ m$ [Fig. 3(f)].

Fig. 3

Change in PSF due to RI variability within the specimen. (a) Schematic of imaging layers of the system and in the simulated specimen for the $N$ -interface PSF model evaluation. Left to right: schematic diagram indicating the layers through which the light from a point light source, located at a depth $10 μ m$ below the coverslip, propagates before encountering the coverslip. Five different specimen cases were considered: case 1—a single layer with $RI = 1.47$ ; case 2—two layers (each $5 μ m$ thick), where layer 1 has $RI = 1.47$ and layer 2 has $RI = 1.33$ ; case 3—two layers (each $5 μ m$ thick), where layer 1 has $RI = 1.47$ and layer 2 has $RI = 1.00$ ; case 4—three layers, where layer 1 ( $3.5 μ m$ thick) has $RI = 1.47$ , layer 2 ( $3.5 μ m$ thick) has $RI = 1.00$ , and layer 3 ( $3.0 μ m$ thick) has $RI = 1.33$ ; and case 5: a single layer with $RI = 1.27$ , which is the average of the RIs in case 4 computed using Eq. (9). (b) A three-interface model PSF for case 1. (c) A four-interface model PSF for case 2. (d) A four-interface model PSF for case 3. (e) A five-interface model PSF for case 4. (f) A three-interface model PSF for case 5. (g) Axial intensity profile through the center of the multi-interface PSFs shown in (b)–(f). The change between the PSFs due to the different imaging conditions is quantified by the normalized mean square error computed with respect to the PSF in (b), which was chosen as the reference for this comparison because it affected by the least amount of spherical aberration. Lens: $63× / 1.4 NA$ oil immersion ( $RI = 1.512$ ). Wavelength: 488 nm. Three-dimensional (3-D) grid size: $256 \times 256 \times 256$ . Axial and lateral spacing: $0.1 μ m$ . Image intensities are displayed using a nonlinear scale to facilitate visualization of small values.

To quantify the deviation of the different theoretical PSFs from a reference PSF, an NMSE metric³⁵ was computed. PSF comparison and discussion of the variability of the PSF with the RI change within the specimen is summarized in the next section.

4.2.

Quantification of PSF Change with Depth-Variant RI Within the Specimen

The $N$ -interface PSF model was used to generate PSFs for point sources of light located under layers of different RI within different numerical samples, while keeping other imaging conditions constant (including the overall sample thickness) as described in Sec. 4.1.

Figures 3(b)–3(f) show the $X Z$ cross-sections of PSFs described in Sec. 4.1. Figure 3(g) quantifies the change in the axial intensity of the PSFs [Figs. 3(b)–3(f)] due to SA. As evident from the figure, the PSFs experience different amounts of SA. The observed effects of SA are lowest for the three-interface PSF for specimen case 1 [Fig. 3(b)] indicated by the highest peak intensity and lowest secondary lobe intensities. The highest amount of SA is experienced by the PSF for specimen case 3 [Fig. 3(d)] due to the highest RI mismatch with the immersion medium. The PSF from specimen case 4 [Fig. 3(e)] experiences different amount of SA than the PSF computed using an averaged RI [Fig. 3(f)] of the layers of specimen case 4. This demonstrates that using a single RI based on an average of specimen RI can lead to PSF errors (consistent with the result in Fig. 2). The change in the PSFs is also quantified using the NMSE calculated with respect to Fig. 3(b), which was chosen as the reference because it experiences the lowest SA. The NMSE is equal to 0.43 for the PSF from specimen case 2 [Fig. 3(c)], 1.02 for specimen case 3 [Fig. 3(d)], 0.89 for specimen case 4 [Fig. 3(e)], and 0.92 for specimen case 5 [Fig. 3(f)]. The NMSE values corroborate with the inference from the intensity plots in Fig. 3(g). These results highlight the PSF variation due to SA at a fixed depth of 10 μm below the coverglass.

The SA in this study is only due to the depth variability of the RI within the specimen. Thus, the study demonstrates the impact of RI variability on the PSF and that averaging the RI is not an acceptable solution to address specimen variability, underlining the need for appropriate PSF modeling. This section emphasizes the need to account for specimen properties in order to obtain a more accurate PSF of the imaging conditions.

5. Restoration of Experimental and Simulated Images of Samples with Nonuniform RI Using $N$ -Interface PSFs

An important role of the $N$ -interface PSF model is its use in restoring images of samples with nonuniform RI. This section provides results from a restoration study using the proposed PSF. Data acquisition from a controlled sample with RI variance is first described in Sec. 5.1. Simulation of the experimental system to serve as a control set is discussed next in Sec. 5.2. The restoration results obtained from the experimental and simulated data are discussed in detail in Sec. 5.3 to highlight the advantage of using $N$ -interface PSFs for spatially variant samples.

5.1.

Experimental Data Acquisition from a Sample with Variable RI

FocalCheck microspheres, 6 μm in diameter labeled with DAPI throughout and a 1 μm fluorescent outer shell labeled with Alexa Fluor, were imaged with a $63× / 1.4 NA$ oil-immersion lens ( $RI = 1.515$ ) using a Zeiss Axio Imager. The microspheres were air-dried on the glass slide, and then they were sealed with UV-cured optical cement (NOA63, $RI = 1.56$ ). A drop of mountant [ProLong Gold antifade reagent cured for 24 h ( $RI = 1.42$ )] was placed on top of the optical cement layer to introduce RI variability within the specimen. A layer of FluoSpheres ( $0.175 μ m$ in diameter), dyed with Rhodamine, was air-dried on top of the cured layer to demarcate the interface between the optical cement and ProLong Gold. A layer of FluoSpheres dyed with DAPI was air-dried on the coverslip to locate the exact location of the coverslip. A $256 \times 256 \times 300$ size image with a cubic voxel size equal to $0.10 μ m$ in the $X$ , $Y$ , and $Z$ directions was acquired.

The location of the microscope stage recorded at the best focus of the various beads in the sample was used to obtain the thickness of each layer. In future studies, the accurate thickness and RI of the specimen will be derived using phase-microscopy-based methods, described in Sec. 1. The distance from the coverslip–mountant interface to the glycerol–mountant interface was determined to be $\sim 44.5 μ m$ using the DAPI- and Rhodamine-stained marker beads. The distance from the Rhodamine-stained marker beads to the $6 - μ m$ microspheres was found to be equal to $\sim 73 μ m$ [Fig. 4(a)].

Fig. 4

Restoration of a $6 - μ m$ -diameter spherical shell in a specimen with RI variability. (a) Schematic of imaging layers in the experimental setup and specimen used for data acquisition. (b) Numerical object used in simulations. (c) Axial cross-section of the experimentally acquired image. Axial cross-section of restored object from (c) using (d) a set of four-interface PSFs with model parameters matched to the experimental conditions (set A described in the text); (e) set B of the three-interface PSFs for a specimen consisting of ProLong Gold mountant only; (f) set C of the three-interface PSFs with the specimen consisting of optical cement (NOA63) only; and (g) set D of the three-interface PSFs with the specimen assumed to have a single $RI = 1.50$ , averaged from the experimental conditions. (h) Axial intensity profile through the center of restored images [(d) and (g)] and the simulated numerical shell (b). (i) Axial cross-section of the simulated image of the numerical object assuming imaging conditions as in (a). Axial cross-section of restored object from simulated image (i) using PSFs’ from: (j) set A; (k) set B; (l) set C; and (m) set D. Grid size: $256 \times 256 \times 300$ . Scale bar: $6.4 μ m$ . Pixel size: $0.1 \times 0.1 \times 0.1 μ m$ . Lens parameters: $63× / 1.4 NA$ oil lens ( $RI = 1.512$ ). All images are normalized and displayed on the same intensity scale.

The FocalCheck microsphere test sample was also imaged using the Zeiss ApoTome structured illumination attachment to assess more information about the underlying sample needed to generate a numerical object that resembles the sample accurately. The generation of simulated images comparable to the experimental image is discussed in the next section.

5.2.

Simulation of Images from a Sample with Variable RI

Simulated images were computed based on a strata approximation model that accounts for SA introduced due to changes in imaging depth within the sample.¹¹^,³⁶ PSFs were computed using the N-interface model ( $N = 4$ ) for a point light source in a specimen with two different RIs equal to 1.42 and 1.56. The thickness of the mountant layer ( $RI = 1.42$ ) was set to $44.5 μ m$ and the thickness of the optical cement ( $RI = 1.56$ ) was assumed to be between depths of 70 and $76 μ m$ , respectively, covering the diameter of the $6 - μ m$ bead. This simulated system was completely matched to the experimental system.

The numerical object used in the simulations was generated on a $256 \times 256 \times 300$ grid and a high intensity ( $10^{4}$ AU) shell with an outer diameter of $6 μ m$ and inner diameter of $4 μ m$ . The same simulated image was restored using four different sets of PSFs (A to D, described in Sec. 5.3) to evaluate the effect of PSF model mismatch on the restoration result. Noise was not introduced in the simulated data to isolate the effect of the PSF variability on the restoration. The restored images computed from the experimental and simulated data were studied and compared to demonstrate the effect of the $N$ -interface PSF on the restoration.

5.3.

Comparison of Restoration Results from Experimental and Simulated Images

The use of $N$ -interface PSFs for restoration of experimental and simulated data (presented in Secs. 5.1 and 5.2) is discussed in this section. The restoration results were obtained after 1000 iterations (a number determined experimentally to yield acceptable results in practice) of the DV expectation maximization algorithm¹¹ implemented in the COSMOS software.³⁷

For the restoration, four different sets of DV PSFs were used. Each set consisted of seven DV PSFs each computed at different depths ( $1 μ m$ apart) covering a range of $6 μ m$ within the bead, using the following PSF models and assumptions:

A. The $N$ -interface model ( $N = 4$ ) for a point light source in a specimen with two different RIs equal to 1.42 and 1.56. The thickness of the mountant layer ( $RI = 1.42$ ) was set to $44.5 μ m$ , while the thickness of the optical cement ( $RI = 1.56$ ) was set between depths 70 and $76 μ m$ , covering the diameter of the $6 - μ m$ bead. The total thickness of the specimen, composed of two distinct layers, was $\sim 117 (= 44.5 + 73) μ m$ . This simulated system was completely matched to the experimental system (Secs. 5.1 and 5.2).
B. The existing PSF model¹⁸ for a point light source in a specimen with uniform RI equal to 1.56. For this case, it was assumed that the axial extent of the specimen (composed only of optical cement) was $117 μ m$ , while the PSF depths were taken in the range of 114 to $120 μ m$ .
C. The existing PSF model¹⁸ for a point light source in a specimen with uniform $RI = 1.42$ for a thickness of $117 μ m$ . PSF depths were set as in B.
D. The existing PSF model for a point light source in the specimen described in A approximated by a single averaged $RI = 1.50$ , calculated using the experimental conditions and Eq. (9), for the same thickness range and PSF depths as in B.

Experimental images are degraded by aberrations other than depth-induced SA, which could introduce restoration artifacts. Because these aberrations are not accounted by the PSF models, in order to show how the restoration deteriorates due to SA, a simulated image of a numerical spherical shell was also computed and restored with the same PSFs used in processing the experimental data. Comparison of simulated and experimental results shows a similar trend in restoration artifacts and validates that the artifacts observed in the restorations of the experimental data could be attributed to changes in the PSFs used for the restoration.

Restorations with these PSFs are summarized in Fig. 4. The experimentally acquired image [Fig. 4(c)] of a $6 - μ m$ spherical shell exhibits spreading of intensities and loss of structural integrity, which is typical of wide-field images experiencing SA. The axial asymmetry of the intensity and the direction of the spread indicate the presence of positive SA. The experimental image restored with the PSF computed from the $N$ -interface PSF model [Fig. 4(d)] appears qualitatively to be the closest to a spherical shell, when compared to the restored objects obtained with PSFs based on a model that assumes the specimen has uniform RI [Figs. 4(e), 4(f), and 4(g) for the mountant, the optical cement, and the averaged RI, respectively]. Figures 4(e), 4(f), and 4(g) show artifacts because the PSFs used in each case for the restoration do not account for the RI variability within the sample. Figure 4(g) shows improved restoration when compared to Figs. 4(e) and 4(f), but it shows more artifacts compared to Fig. 4(d), indicating the need to account for specimen variability in the PSF.

Results from simulation (bottom row of Fig. 4) show consistency with restoration results from the experimental data (top row of Fig. 4) in terms of accuracy and nature of artifacts. The simulated image [Fig. 4(i)] agrees qualitatively with the experimentally acquired image [Fig. 4(c)] with respect to spreading and elongation of the spherical ring structure. The simulated image was restored using the matched $N$ -interface PSFs, which were also used to generate the image (hence, there is no PSF mismatch in the restoration of the simulated image in [Fig. 4(j)], and consequently, the restored object [Fig. 4(j)] converges to the true object. The artifacts observed in the restored object when the three-interface PSFs from the existing model are used instead [Figs. 4(k), 4(l), and 4(m), respectively] follow the trend of the artifacts observed in the reconstruction of the experimental data [Figs. 4(e), 4(f), and 4(g)]. The difference in the experimental restoration [Fig. 4(d)] from the ideal simulated result [Fig. 4(j)] suggests a residual model mismatch that could be attributed to inaccuracies in the experimental parameters used for the computation of the four-interface PSFs or the presence of aberrations (other than depth-induced SA) not accounted in the PSF model.

To emphasize the advantage of using the $N$ -interface PSF model in restoration over the existing three-interface PSF model, intensity profiles from the restoration results with different PSFs are compared in Fig. 4(h). The profile through the restored object computed with the $N$ -interface PSF [Fig. 4(d)] is not only different from the restoration with the averaged RI [Fig. 4(g)], but it also comes closer to the numerical object [Fig. 4(b)], which approximates the actual spherical shell. This result highlights that accounting the effect of sample properties in the PSF model results in improved restoration of the sample’s fluorescence intensity.

To further quantify the quality of restoration, NMSE results are reported, which were computed using the numerical object as the reference. For the restorations obtained from the experimental data using the four different PSFs considered, the NMSE value is as follows: 1.80 with the PSF set A [Fig. 4(d)]; 2.63 with the PSF set B [Fig. 4(e)]; 2.79 with the PSF set C [Fig. 4(f)]; and 2.19 with the PSF set D [Fig. 4(g)]. The smallest NMSE value is exhibited by the restoration with the PSF set A, from the new $N$ -interface model [Fig. 4(d)], indicating that the restored object is closest to the simulated object. The discussion in this section allows us to conclude that the $N$ -interface PSF model is advantageous for the restoration of samples with variable RI.

6. $N$ -Interface PSF Model Evaluation Using a Biological Test Sample

In this section, experimental PSFs imaged from a biological test sample were compared to simulated PSFs using the $N$ -interface model to evaluate the effectiveness of the model to predict PSF changes due to a biological sample.

6.1.

Experimental PSF Acquisition from a Lung-Tissue Slice Test Sample

In this experiment, PSFs were acquired from images of $0.175 - μ m$ -diameter microspheres, dyed with Alexa Fluor, placed below a rat lung slice dyed with calcein, and prepared to observe the effect of methacholine. For this purpose, a catheter was used to insert agarose in the tracheae and the sample was sectioned using the Vibratome into $\sim 150 - μ m$ sections. Because the air tubules were filled with agarose, the RI of the lung slice was approximated by an average $RI = 1.336$ . This value was derived from available information about the lung tissue ( $RI = 1.342$ )³⁸ and agarose ( $RI = 1.33$ ). The lung slice submerged in ProLong Gold antifade reagent ( $RI = 1.46$ ) introduced additional RI variability within the sample.

A layer of FluoSpheres ( $0.175 μ m$ in diameter), dyed with Rhodamine, was air-dried on the coverslip to locate it. FluoSpheres, dyed with Alexa Fluor, were air-dried on the glass slide and the rat lung slice was carefully placed on top and left overnight in a cool and dark location. The top of the lung slice was demarcated using FluoSpheres, dyed with DAPI. The mountant was then placed on the lung slice along with the coverslip and was left to cure for two days allowing the mountant’s RI to stabilize to 1.46.

The sample was imaged with a $40× / 1.3 NA$ oil-immersion lens ( $RI = 1.515$ ) using a Zeiss Axio Imager. A $677 \times 765 \times 300$ size image with a voxel size equal to $0.16 \times 0.16 \times 0.1 {μ m}^{3}$ in the $X$ , $Y$ , and $Z$ directions was acquired. The location of the microscope stage recorded at the best focus of the various beads was used to obtain the thickness of each layer (as described Sec. 3.1). The thickness of the mountant and the lung slice was derived to be 69 and $160 μ m$ , respectively [Fig. 5(a)]. From this information, the depth of the FluoSpheres below the coverslip was determined to be $229 μ m$ . Four bright beads were chosen for the study [shown enclosed by the red box in Fig. 5(b)]. The averaged intensity distribution of the four beads was used to represent a single experimental PSF [Fig. 5(c)].

Fig. 5

Experimental evaluation of the $N$ -interface PSF model using a biological test sample. (a) Schematic of imaging layers in the experimental setup and specimen used for data acquisition. (b) $X Y$ cross-section from the wide-field image of a rat lung slice with bright fluorescing beads located below it; the red box encloses four bright FluoSpheres whose averaged intensity was used to obtain the experimental PSF (c). $X Z$ section image from simulated PSF computed using: (d) the $N$ -interface PSF model; and (e) the three-interface PSF model with an averaged $RI = 1.37$ [Eq. (9)]. (f) Axial intensity profiles through the center of (c), (d), and (e). Lens parameters: $40× / 1.3 NA$ oil immersion ( $RI = 1.512$ ); wavelength: 509 nm; 3-D grid size: $677 \times 765 \times 300$ ; axial and lateral spacing: $0.16 \times 0.16 \times 0.1 μ m$ . Image intensities were normalized in the range [0, 1] for display.

6.2.

Simulation of PSFs Matching Imaging Conditions of the Lung-Tissue Slice Sample

Simulated PSFs were calculated for two of the cases for comparison with the experimental PSF in Fig. 5(c). PSFs were generated as follows: (1) an $N$ -interface PSF based on the experimental imaging parameters, i.e., a specimen with two different layers of media (one with $RI = 1.46$ and thickness of $69 μ m$ and another with $RI = 1.336$ and thickness of $160 μ m$ ) and (2) a PSF using the existing Haeberlé model assuming a specimen with uniform $RI = 1.37$ [the RI average obtained using Eq. (9) of the two actual RIs in the sample] and thickness equal to $229 (= 69 + 160) μ m$ . Since the size of the FluoSpheres is greater than the pixel size, a 2-pixel-diameter sphere was convolved with all the simulated PSFs for an improved comparison with the experimental PSF.

6.3.

Comparison Between Experimental and Simulated PSFs

The experimental PSF image acquired using the conditions described in Sec. 6.2 is shown in Fig. 5(c), and the corresponding simulated PSF using the $N$ -interface model is shown in Fig. 5(d). For comparison, the simulated PSF using a uniform averaged $RI = 1.37$ is also shown in Fig. 5(e). Figure 5(f) compares axial intensity profiles through the simulated and experimental PSFs. There is better agreement between the simulated PSF generated using the $N$ -interface PSF model and the experimental PSF than between the simulated PSF, which assumes the entire sample has a uniform $RI = 1.37$ , and the experimental one. There is disagreement between the simulated and experimental PSFs beyond the secondary lobes, which can be possibly attributed to residual intensity from surrounding structures. PSF comparison is quantified by the NMSE computed between each simulated PSF and the experimental PSF (which was taken as the reference). The NMSE was found to have values equal to 0.0182 and 0.0312 for the $N$ -interface PSF and the existing model PSF (assuming specimen $RI = 1.37$ ), respectively. This section further validates that the $N$ -interface PSF model is able to predict PSF changes, due to thick biological sample imaging, more accurately than the existing three-interface PSF model.

7. Discussion and Conclusion

The new $N$ -interface model can be used to obtain PSFs for specimens with variable RI. The model allows the use of microscope-derived parameters in a high precision vectorial model to obtain a PSF that allows the existence of more than three interfaces within the system. Our results emphasize the need of a model that can account for sample variance (such as layers with variable RI), which changes the amount of SA experienced by the light traveling through it.

The $N$ -interface PSF model was experimentally verified for a four-interface system by the demonstrated agreement between simulated and experimental data. Its accuracy over PSFs from an existing model, which can only account for a three-layer stratification, was also highlighted. PSFs from the $N$ -interface model were also used to solve the inverse imaging problem using experimental data acquired from a bead test sample. The use of accurate PSFs generated using the $N$ -interface model in the restoration as opposed to the PSFs generated using the existing PSF model reduced the NMSE between a numerical object (that approximates the physical test object) and the restored object at least 18% and at most 35% for the cases compared, indicating a definite improvement in the restoration. In the experimental case, the PSF mismatch is not exactly the same to the one predicted by the simulated case; thereby, the restoration artifacts are not exactly alike either. However, the overall consistency between the simulated and experimental results is very promising, and it suggests that our PSF model is able to capture the main features of the experimental system to the extent that our model-based restoration method can produce an improved restoration. Experimental PSFs from point light sources below a thick lung-tissue slice were also imaged and their average was shown to be predicted well by the $N$ -interface PSF model, which represents the system better than the existing PSF model, quantified by a 42% reduction in the NMSE computed between the simulated and experimental PSF.

The proposed $N$ -interface PSF model requires information about the RI at different layers within the sample. In experimental samples discussed in this work, we used subresolved spheres as markers in between layered media with known RI and we assumed that the specimen can be modeled by stratified layers. In biological samples, the RI information varies spatially and different phase imaging techniques have been under development over the recent years to enable determination of this variability. The new PSF model presented here will be used in a block-based forward imaging model to ensure accurate representation of the sample. This representation of the sample will improve restoration of the image, allowing COSM algorithms to effectively restore thick biological data. Future studies involve integration of a biological sample RI map in PSF determination suitable for SV restoration fluorescence microscopy.

Acknowledgments

We thankfully acknowledge our collaborator Lutz Schaefer (Advanced Imaging Methodology Consultation, Canada) for allowing us to extend and use his MATLAB code for point-spread function computation in this study. We are also very grateful to Esra Roan and her student Adetoun Komolafe (University of Memphis) for providing the lung tissue sample. We would also like to thank Sharon V. King (University of Memphis) for her useful comments and suggestions during paper preparation. This work was supported by the National Science Foundation (NSF CAREER award DBI-0844682 and NSF IDBR awards DBI-0852847 and DBI-1353904; PI: C. Preza) and the University of Memphis.

References

1.

M. Born and E. Wolf, Principles of Optics: Electromagnetic Theory of Propagation, Interference and Diffraction of Light, Cambridge University Press, New York (1999). Google Scholar

2.

J. W. Goodman, Introduction to Fourier Optics, McGraw Hill, New York (1960). Google Scholar

3.

J. Conchello and J. W. Lichtman, “Optical sectioning microscopy,” Nat. Methods, 2 (12), 920 –931 (2005). http://dx.doi.org/10.1038/nmeth815 1548-7091 Google Scholar

4.

L. Schaefer, D. Schuster and H. Herz, “Generalized approach for accelerated maximum likelihood based image restoration applied to three dimensional fluorescence microscopy,” J. Microsc., 204 (2), 99 –107 (2001). http://dx.doi.org/10.1046/j.1365-2818.2001.00949.x JMICAR 0022-2720 Google Scholar

5.

C. L. Curl et al., “Refractive index measurement in viable cells using quantitative phase–amplitude microscopy and confocal microscopy,” Cytometry A, 65 (1), 88 –92 (2005). http://dx.doi.org/10.1002/(ISSN)1552-4930 1552-4922 Google Scholar

6.

F. P. Bolin et al., “Refractive index of some mammalian tissues using a fiber optic cladding method,” Appl. Opt., 28 (12), 2297 –2303 (1989). http://dx.doi.org/10.1364/AO.28.002297 APOPAI 0003-6935 Google Scholar

7.

A. Golabchi et al., “Refractive errors and corrections for OCT images in an inflated lung phantom,” Biomed. Opt. Express, 3 (5), 1101 –1109 (2012). http://dx.doi.org/10.1364/BOE.3.001101 BOEICL 2156-7085 Google Scholar

8.

A. J. North, “Seeing is believing? a beginners’ guide to practical pitfalls in image acquisition,” J. Cell Biol., 172 (1), 9 –18 (2006). http://dx.doi.org/10.1083/jcb.200507103 JCLBA3 0021-9525 Google Scholar

9.

C. Preza, “Simulating structured-illumination microscopy in the presence of spherical aberrations,” Proc. SPIE, 7904 79040D (2011). http://dx.doi.org/10.1117/12.874106 PSISDG 0277-786X Google Scholar

10.

W. C. Chew, Waves and Fields in Inhomogeneous Media, IEEE Press, New York (1995). Google Scholar

11.

C. Preza and J. Conchello, “Depth-variant maximum-likelihood restoration for three-dimensional fluorescence microscopy,” JOSA A, 21 (9), 1593 –1601 (2004). http://dx.doi.org/10.1364/JOSAA.21.001593 JOSAAH 0030-3941 Google Scholar

12.

S. Ben Hadj et al., “Blind restoration of confocal microscopy images in presence of a depth-variant blur and poisson noise,” in IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 915 –919 (2013). Google Scholar

13.

E. Maalouf, “Contribution to fluorescence microscopy, 3D thick samples deconvolution and depth-variant, PSF,” Université de Haute Alsace, (2010). Google Scholar

14.

M. S. Hossain, S. King and C. Preza, “An integrated approach to determine prior information for improved wide-field imaging models from computational interference microscopy,” Proc. SPIE, 9330 933014 (2015). http://dx.doi.org/10.1117/12.2077322 PSISDG 0277-786X Google Scholar

15.

S. Ghosh and C. Preza, “A block-based forward imaging model for improved sample volume representation in computational optical sectioning microscopy,” Proc. SPIE, 9330 93300T (2015). http://dx.doi.org/10.1117/12.2077001 PSISDG 0277-786X Google Scholar

16.

S. Ghosh and C. Preza, “Space-variant image formation for 3D fluorescence microscopy using a computationally efficient block-based model,” in Biomedical Imaging: From Nano to Macro (ISBI), 2015 IEEE International Symposium on, 789 –792 (2015). Google Scholar

17.

S. Frisken Gibson and F. Lanni, “Experimental test of an analytical model of aberration in an oil-immersion objective lens used in three-dimensional light microscopy,” JOSA A, 8 (10), 1601 –1613 (1991). http://dx.doi.org/10.1364/JOSAA.8.001601 JOSAAH 0030-3941 Google Scholar

18.

O. Haeberlé, “Focusing of light through a stratified medium: a practical approach for computing microscope point spread functions. Part I: conventional microscopy,” Opt. Commun., 216 (1), 55 –63 (2003). http://dx.doi.org/10.1016/S0030-4018(02)02282-4 OPCOB8 0030-4018 Google Scholar

19.

D. A. Agard et al., L. Taylor and Y.-L. Wang, “Flourescence microscopy in three dimensions,” Methods in Cell Biology, 30 353 Academic Press, Inc., Atlanta (1989). Google Scholar

20.

M. Arigovindan et al., “A parallel product-convolution approach for representing the depth varying point spread functions in 3D widefield microscopy based on principal component analysis,” Opt. Express, 18 (7), 6461 –6476 (2010). http://dx.doi.org/10.1364/OE.18.006461 OPEXFF 1094-4087 Google Scholar

21.

J. B. de Monvel et al., “Image-adaptive deconvolution for three-dimensional deep biological imaging,” Biophys. J., 85 (6), 3991 –4001 (2003). http://dx.doi.org/10.1016/S0006-3495(03)74813-9 BIOJAU 0006-3495 Google Scholar

22.

E. Wolf, “Electromagnetic diffraction in optical systems. I. An integral representation of the image field,” Proc. R. Soc. Lond. A Math. Phys. Sci., 253 (1274), 349 –357 (1959). http://dx.doi.org/10.1098/rspa.1959.0199 PRLAAZ 1364-5021 Google Scholar

23.

P. Török and P. Varga, “Electromagnetic diffraction of light focused through a stratified medium,” Appl. Opt., 36 (11), 2305 –2312 (1997). http://dx.doi.org/10.1364/AO.36.002305 APOPAI 0003-6935 Google Scholar

24.

S. Ghosh et al., “Further developments in addressing depth-variant 3D fluorescence microscopy imaging,” Proc. SPIE, 8949 89490Q (2014). http://dx.doi.org/10.1117/12.2045856 PSISDG 0277-786X Google Scholar

25.

M. M. Rahman et al., “Comparison of computational methods developed to address depth-variant imaging in fluorescence microscopy,” Proc. SPIE, 8589 85890A (2013). http://dx.doi.org/10.1117/12.2005227 PSISDG 0277-786X Google Scholar

26.

J. Schmitt and G. Kumar, “Turbulent nature of refractive-index variations in biological tissue,” Opt. Lett., 21 (16), 1310 –1312 (1996). http://dx.doi.org/10.1364/OL.21.001310 OPLEDP 0146-9592 Google Scholar

27.

W. Choi et al., “Tomographic phase microscopy,” Nat. Methods, 4 717 –719 (2007). http://dx.doi.org/10.1038/nmeth1078 1548-7091 Google Scholar

28.

Z. Kam et al., “Computational adaptive optics for live three-dimensional biological imaging,” Proc. Natl. Acad. Sci. U.S.A., 98 (7), 3790 –3795 (2001). http://dx.doi.org/10.1073/pnas.071275698 PNASA6 0027-8424 Google Scholar

29.

S. Hiware et al., “Modeling of PSF for refractive index variation in fluorescence microscopy,” in 18th IEEE Int. Conf. on Image Processing, 2037 –2040 (2011). Google Scholar

30.

C. E. Perlman and J. Bhattacharya, “Alveolar expansion imaged by optical sectioning microscopy,” J. Appl. Physiol.(1985), 103 (3), 1037 –1044 (2007). http://dx.doi.org/10.1152/japplphysiol.00160.2007 JAPHEV 8750-7587 Google Scholar

31.

C. A. DiMarzio, Optics for Engineers, CRC Press, Boca Raton, Florida (2011). Google Scholar

32.

L. Schaefer, 3D Wide-field Point Spread Function Generator, Personal Communication, (2012). Google Scholar

33.

N. Patwary and C. Preza, “Computationally tractable approach to PCA-based depth-variant PSF representation for 3D microscopy image restoration,” (2014). Google Scholar

34.

A. Egner and S. W. Hell, “Aberrations in confocal and multi-photon fluorescence microscopy induced by refractive index mismatch,” Handbook of Biological Confocal Microscopy, 404 –413 Springer, New York (2006). Google Scholar

35.

S. Yuan and C. Preza, “Point-spread function engineering to reduce the impact of spherical aberration on 3D computational fluorescence microscopy imaging,” Opt. Express, 19 (23), 23298 –23314 (2011). http://dx.doi.org/10.1364/OE.19.023298 OPEXFF 1094-4087 Google Scholar

36.

C. Preza and V. Myneni, “Quantitative depth-variant imaging for fluorescence microscopy using the COSMOS software package,” Proc. SPIE, 7570 757003 (2010). http://dx.doi.org/10.1117/12.840688 PSISDG 0277-786X Google Scholar

37.

S. Ghosh et al., “Computational Optical Sectioning Microscopy-Open Source (COSMOS) User Manual,” http://cirl.memphis.edu/cosmos.php Google Scholar

38.

R. Bacallao, K. Kiai and L. Jesaitis, “Guiding principles of specimen preservation for confocal fluorescence microscopy,” Handbook of Biological Confocal Microscopy, 311 –325 Springer, New York (1995). Google Scholar

Biography

Sreya Ghosh is expected to complete her PhD degree in computer engineering at the University of Memphis in August 2015. She received her MS degree in computer engineering from the University of Memphis in May 2011 and her BTech degree from the West Bengal University of Technology, India, in July 2009. She has been a graduate research assistant at the Computational Imaging Research Laboratory at the University of Memphis, working on computational imaging for microscopy.

Chrysanthe Preza has been an associate professor in the Department of Electrical and Computer Engineering at the University of Memphis since 2006. She received her DSc degree in electrical engineering from Washington University in St. Louis in 1998. She leads the research in the Computational Imaging Research Laboratory at the University of Memphis. Her research interests are imaging science and estimation theory with applications in computational optical sensing and imaging applied to multidimensional and multimodal light microscopy.

CC BY: © The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

Citation Download Citation

Sreya Ghosh and Chrysanthe Preza "Fluorescence microscopy point spread function model accounting for aberrations due to refractive index variability within a specimen," Journal of Biomedical Optics 20(7), 075003 (7 July 2015). https://doi.org/10.1117/1.JBO.20.7.075003

Published: 7 July 2015

Access the abstract

JOURNAL ARTICLE
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

CITATIONS

Cited by 19 scholarly publications.

Explore citations on Lens.org

KEYWORDS

Point spread functions

Statistical modeling

3D modeling

Microscopy

Imaging systems

Luminescence

Mathematical modeling

Show All Keywords

CHORUS Article. This article was made freely available starting 06 July 2016

1.

Introduction

Fig. 1

2.

Mathematical Models

Eq. (1)

Eq. (2)

Eq. (3)

Eq. (4)

Eq. (5)

Eq. (6)

Eq. (7)

Eq. (8)

3.

Evaluation of the N-Interface PSF Model

3.1.

Experimental Acquisition of PSFs from Test Samples with Depth-Variant Refractive Index

Fig. 2

3.2.

Simulation of N-Interface PSFs for Comparison with Experimental Data

Eq. (9)

3.3.

Evaluation of the Theoretical N-Interface PSF Model Using Experimental Data

4.

Effect of Sample Refractive Index Variance on the N-Interface PSF

4.1.

N-Interface PSFs Computed for Different Sample Conditions

Fig. 3

4.2.

Quantification of PSF Change with Depth-Variant RI Within the Specimen

5.

Restoration of Experimental and Simulated Images of Samples with Nonuniform RI Using N-Interface PSFs

5.1.

Experimental Data Acquisition from a Sample with Variable RI

Fig. 4

5.2.

Simulation of Images from a Sample with Variable RI

5.3.

Comparison of Restoration Results from Experimental and Simulated Images

6.

N-Interface PSF Model Evaluation Using a Biological Test Sample

6.1.

Experimental PSF Acquisition from a Lung-Tissue Slice Test Sample

Fig. 5

6.2.

Simulation of PSFs Matching Imaging Conditions of the Lung-Tissue Slice Sample

6.3.

Comparison Between Experimental and Simulated PSFs

7.

Discussion and Conclusion

Acknowledgments

References

Biography

Show All Keywords

Keywords/Phrases

Search In:

Publication Years

Evaluation of the $N$ -Interface PSF Model

Simulation of $N$ -Interface PSFs for Comparison with Experimental Data

Evaluation of the Theoretical $N$ -Interface PSF Model Using Experimental Data

Effect of Sample Refractive Index Variance on the $N$ -Interface PSF

$N$ -Interface PSFs Computed for Different Sample Conditions

Restoration of Experimental and Simulated Images of Samples with Nonuniform RI Using $N$ -Interface PSFs

$N$ -Interface PSF Model Evaluation Using a Biological Test Sample