|
1.IntroductionPrimary malignant cerebral glioma, which is classified as a high-grade glioma (HGG), is identified as the most common type of primary cerebral tumor and the most fatal. Despite aggressive cyto-reductive treatment, its prognosis is poor, with an overall median survival time of months irrespective of patient age and with of patients surviving longer than 5 years.1,2 A gross-total resection (GTR) means that the surgeon has removed all visible tumor at surgery, and no apparent tumor is identified on the postoperative MRI scans. Clinical studies have demonstrated that HGG patients who received a GTR show a significantly longer survival than those who had a subtotal resection (STR).3,4 For low-grade glioma (LGG) patients, GTR is also considered critical, with the five-year overall survival reported to have markedly increased from 50% to 70% in STR to 80% to 95%.3 Emerging intraoperative techniques have been developed and utilized in this scenario to achieve a better determination of the tumor margins. Modalities, such as intraoperative MRI,5 ultrasound,6 and optical coherence tomography (OCT),7 have been shown to provide structural information to differentiate brain tumor. Raman spectroscopy has been recently studied in patients during glioma resection surgery, providing spectral tissue characteristics in real time.8 Fluorescence imaging guidance involving 5-aminolevulinic acid-induced protoporphyrin IX (5-ALA-PpIX) as a fluorescent contrast agent has been demonstrated to provide from structural to cellular information when using camera-based wide-field imaging and probe-based laser confocal endomicroscopy (pCLE), respectively.9,10 The oral 5-aminolevulinic acid (5-ALA) is metabolized into fluorescence protoporphyrin IX (PpIX) molecules and preferably accumulated in glioma cells, with a ratio ranging from 10:1 to 50:1 between HGGs (grade III and grade IV) and normal brain tissue providing fluorescent contrast.11 Clinical studies have shown that 5-ALA-PpIX-guided excision of HGGs was capable of achieving improved complete resection rates with more than 50% GTR and prolonged patient survival compared with conventional white-light-guided resection.9,12,13 However, PpIX only emits very weak fluorescence at the infiltrated margins of HGGs,14 and similarly in LGGs,15 owing to the low PpIX concentration in these tissue.15 In these cases, it remains challenging to precisely delineate the tumor margins. Furthermore, current commercially available fluorescence imaging systems rely on visual assessment by the surgeon to distinguish fluorescence patterns, which makes the detection more subjective than necessary. It has been demonstrated that quantitative assessment of 5-ALA-PpIX fluorescence for glioma resection can be approached using fiber-optic spectroscopy measurements.16–18 Among them, Kim et al.19 developed an intraoperative contact optical probe and a computational light propagation model to extract the absolute concentration of the fluorophore PpIX in the examined tissue, providing neurosurgeons a rough estimation of the tumor pathological degree. Similar to other probe-based measurements, such as Raman spectroscopy and pCLE, their quantification method only determines the local tissue at the contact point of the probe.8,20 It is of great interest, yet it remains challenging to implement PpIX quantification for wide-field images. To this end, Valdés et al.21 reported their approach on the estimation of PpIX concentration of a wide-field imaging system. In the estimation paradigm, local PpIX concentration is calculated in a pixel-wise manner across the whole wide-field image, based on a correction algorithm that compensates for the distortion effect of the tissue optical attenuation. Their algorithm was developed initially for a probe-based system and then directly applied to the wide-field scenario where the lighting and detection geometry were neglected. Taniguchi et al.22 developed a computational model that was able to extract PpIX emission from RGB images that were acquired similarly in glioma resection surgery. In the model, lighting and imaging geometry, PpIX absorption and emission spectrum, and spectral sensitivities of the RGB camera were considered to reconstruct the PpIX emission region on the wide-field image. They used their model to assess quantitative PpIX concentration on a phantom study. No tissue study was performed to evaluate this approach. In addition, the impact of the tissue optical properties in terms of absorption and scattering on retrieving the quantitative PpIX concentration was not included in their study. In our work, we introduce a wide-field spectrally resolved quantitative fluorescence imaging modality with the objective of providing an effective computer-assisted surgical guidance for glioma resection. We adapt and expand the fluorescence model to the wide-field imaging to retrieve PpIX concentration from the emission spectrum. In our proposed approach, we calibrate the measured diffuse reflectance of the specimen to a reference diffuse reflectance where the lighting and detection geometry are specifically addressed. We deploy a high-sensitivity scientific CMOS camera to capture sufficient fluorescence signal at short exposure times, thus allowing the reduction of total data acquisition time. Furthermore, to reduce the impact of acquisition noise on the reconstructed concentration map, we apply isotropic total variation (TV) -norm regularized least-squares optimization to retrieve the PpIX concentration map over the wide-field images. The system, together with the reconstruction method, is validated in phantom experiments and in ex vivo human brain tumor studies. To the best of our knowledge, we performed the first qualitative and quantitative spatially localized comparison between the estimated PpIX concentration value over a wide-field image and whole-slide histopathology.11,23,24 The results reveal a linear correlation between our measurements and cellularity, suggesting that the proposed system is capable of quantitative delineation of tumor and could be implemented in clinical practice for assisting tumor resection. 2.Materials and Methods2.1.Wide-Field Spectrally Resolved Quantitative Fluorescence Imaging SystemThe system developed in this study consists of three main modules: (1) the light sources, which include a white-light LED (MCWHF1, Thorlabs) and a 405-nm LED (M405FP1, Thorlabs), (2) a liquid crystal tunable filter (LCTF) (VariSpec-VIS, PerkinElmer), and (3) a Generation II (Gen II) CMOS camera (ORCA-Flash4.0, Hamamatsu Photonics) [shown in Fig. 1(a)]. The 405-nm LED was chosen specifically for PpIX excitation, as the peak excitation wavelength of PpIX locates at around 405 nm [Fig. 1(b)]. The LCTF performs as a bandpass filter that controllably selects a single wavelength (with 20-nm full-width at half-maximum) of light to transmit into the camera with a maximum transmittance of 27.5% of randomly polarized or unpolarized light at 710 nm. It features a spectral range from 400 to 720 nm with a tuning accuracy of and a tuning response time of 50 ms. The highly sensitive scientific camera (Gen II CMOS) used has low read-out noise of 1.0 electron (median) and high speed read-out ( with a full pixel range of ) compared with the state-of-the-art cameras [scientific CMOS, electron-multiplying CCD (EMCCD)] that have been used in wide-field fluorescence imaging for glioma surgery.26,27 The wavelength-specific images were acquired using a custom LabView (National Instruments, Austin, Texas) program, which implements hardware control, data acquisition, data storage, and data processing. 2.2.Data AcquisitionFluorescence excitation is provided using a fiber-coupled 405-nm LED through a beam collimator, thus providing sufficient excitation power, whereas the diffuse reflectance excitation is implemented using a more powerful fiber-coupled white-light LED with a divergent beam. The power density of 405-nm light and broad spectrum white-light at the sample surface was measured as 1.45 and , respectively. For both excitation schemes, three-dimensional image cubes were produced from successive CMOS camera frames when scanning the tuning wavelength of the LCTF across its full spectral range (400 to 720 nm) with 10-nm incrementing steps, in a manner of one frame per tuning wavelength. The exposure time was set to 100 ms for all wavelengths under both excitation scenarios to achieve a sufficient signal-to-noise ratio (SNR), except when evaluating the system performance where the exposure time was set in different values (for details, see Sec. 2.6.2). binning was utilized to further enhance SNR, which generated images. An additional 650-ms waiting time per frame was required in our implementation to allow saving each frame file (5 Mb/frame) to a storage media via our Labview program. In this way, each image cube contained spectra-specific pixels, acquired and saved in 26.4 s. For each pixel in an image, the fluorescence spectrum responses using 405-nm excitation and diffuse reflectance spectrum using white-light excitation were acquired. 2.3.Qualitative RGB ImagesWe composed the wide-field white-light RGB images from the hyperspectral cubes by superimposing three distinct spectra images acquired under white-light illumination, including red 630 nm, green 540 nm, and blue 470 nm, whereas the corresponding UV light RGB images were created with spectra images that were obtained under UV illumination consisting of red 630 nm, green 540 nm, and blue 470 nm. 2.4.Fluorescence QuantificationIn biological tissue, the fluorescence emission spectrum is distorted due to tissue’s optical absorption and scattering.28 The measured fluorescence emission spectrum of PpIX in brain tissue is affected, indicating it does not trivially reflect the true concentration of the PpIX, which correlates to the cancerous cellular density. In the work of Valdés et al.,21 the measured fluorescence spectrum was corrected based on a diffuse reflectance mode.19 In their correction algorithm,21 fluorescence spectrum coming from the sample surface is assumed to be proportional to the diffuse reflectance over the PpIX emission band [Eq. (1)] where and are the diffuse reflectance at the excitation band and emission band, respectively, is the ground-truth PpIX emission spectra, and is the tissue absorption coefficient at the PpIX excitation band (405 nm). In practice, they correct the measured fluorescence spectrum with Eq. (2); the corrected fluorescence spectrum is then used in lieu of and is expressed as where and are the diffuse reflectance integrated over and , respectively, is the calibration factor determined empirically, and is neglected (e.g., set to 1) from Eq. (1).For precise and reliable quantitative fluorescence imaging, system calibration is an essential step. Typically, the calibration incorporates corrections of undesired background signals (e.g., camera read-out noise, stray light, and instrument offset), instrument spectral responses (camera and LCTF), illumination nonuniformity, etc.29,30 However, system calibration is not well-highlighted in the previous reports of using camera-based fluorescence imaging for PpIX assessment in glioma surgery.21,26 Therefore, in our model, we particularly calibrate the measurement and compensate for the lighting and collection geometry using normalized diffuse reflectance [ and ]. In detail, the measured diffuse reflectance and were first normalized to reference diffuse reflectance and , respectively. The reference diffuse reflectances are measured using a diffuse reflector (DG10-1500, Thorlabs) under the same excitation and measurement settings described previously. Specifically, the was determined under UV excitation, while the was taken under white-light excitation. The reference diffuse reflectance and were acquired under UV and white-light excitation for calibration of and , respectively. A measurement setup to illustrate how the was acquired, together with two representative reference diffuse reflectance images obtained from the diffuse reflector, is shown in Fig. 2. The two representative reference diffuse reflectance images clearly demonstrate the heterogenous distributions owing to the angular illumination and Gaussian profile light beams. For each pixel in the wide-field image, the measured fluorescence can be expressed as where is averaged over the normalized diffuse reflectance at and is the measurement noise.Since the optical absorption of tissue specimen cannot be accurately determined with this system setup and the of brain tissue and tumor tissue are in the same range from 9 to ,31 in practice, we neglect from the model. To retrieve the PpIX concentration, we assume that the fluorescence intensity is linearly proportional to the PpIX concentration; hence, the measured fluorescence can be expressed as where is the quantitative concentration of PpIX to be retrieved and is the emission spectrum of PpIX of unit concentration. () is introduced here as a calibration factor similar to the system correction factor that was described in the work of Valdés et al.21 This factor is empirically determined in the phantom study when the estimated concentration optimally correlated to the real concentration. Classically, the inverse problem Eq. (4) is solved using least-squares optimization In this way, we compute a PpIX concentration map over the full field of view of the imaging system.2.5.Total Variation RegularizationWhile the standard least-squares approach works well in the strong light illumination cases, when the measurement conditions are suboptimal (e.g., low exposure time and low fluorophore concentration), the reconstructed concentration map () becomes heavily corrupted with noise. To reduce the impact of acquisition noise on the reconstruction noise and thus improve image quality, we propose in this study a reconstruction method appropriate for this application and based on TV regularization. Equation (5) can be rewritten as with To decrease the influence of the acquisition noise, -norm TV regularization is now introduced where is the regularization parameter. Equation (8) can be seen as a TV denoising problem on the least-squares solution and can be solved using a dedicated solver such as the primal–dual algorithm of Chambolle and Pock.32 was chosen for minimizing the differences between the TV-reconstructed concentration map and the ground-truth concentration map; for details refer to Sec. 3.3.2.6.Phantom ExperimentsAqueous phantoms were prepared for evaluation of the imaging system and the reconstruction model, with various concentrations of intralipid (IL) (20% emulsion, Fresenius Kabi, UK) as the scatterer, hemoglobin (Hb) (H2500, Sigma) as the absorber, and PpIX disodium salt (258385, Sigma) as the fluorescent agent. 2.6.1.Evaluation of fluorescence modelTo investigate the influence of the tissue intrinsic optical properties over the PpIX fluorescence emission and assess the impact of absorption and scattering individually, we developed two sets of phantoms (denoted as set A and set B). There were four groups (denoted as A1 to A4 and B1 to B4) in each set, and every group included four phantoms with distinct PpIX concentrations (denoted as e.g., A1,1 to A1,4). Set A had a constant IL concentration of all four groups, while the Hb concentration varied across groups. Conversely, set B shown in Fig. 3 had the Hb concentration kept constant but using different IL concentrations. There were in total 32 phantoms; their composition specifications as well as the corresponding optical properties are shown in Table 1. Table 1Phantom compositions and the corresponding optical properties at λex=410 nm and λem=640 nm.
2.6.2.Evaluation of system performanceWe assessed the performance of the Gen II CMOS camera (ORCA-Flash 4.0) in regards to the sensitivity and accuracy in detecting fluorescence signal under different exposure times in tissue-mimicking optical phantoms. Nine sets of phantoms consisted of combinations of IL concentration of 1.0%, 1.5%, and 3.0% and Hb concentration of 1.0, 1.5, and . Each scattering-absorption combination was prepared in four different PpIX concentrations of 0.01, 0.05, 0.25, and , giving in total 36 phantoms. For each phantom, we measured the wide-field images with four different camera exposure times of 10, 20, 50, and 80 ms for each acquisition wavelength, while the other acquisition settings and theconcentration quantification method were kept consistent with the Sec. 2.2. 2.6.3.Evaluation of total variation regularizationTo evaluate the impact of TV regularization, a structured phantom incorporating a UCL logo-shaped fluorescent inclusion and nonfluorescent background was developed. The aqueous fluorescent inclusion consisted of 2.0% IL, Hb, and PpIX, simulating the optical and fluorescent properties of glioma tissue. For image acquisition, we used 20- and 200-ms exposure times to obtain two series of high- and low- noise acquisitions. A high-noise concentration map () and a low-noise concentration map considered as a ground truth () were reconstructed from 20- and 200-ms acquisitions, respectively. We then applied TV-based denoising to and compared the resulting regularized reconstruction map () with the ground truth (). The contrast-to-noise ratio (CNR) and root-mean-square error (RMSE) were determined to evaluate the improvement provided by TV regularization. The CNR is a quantitative measure of image quality, defined as where the region of interest (ROI) is a patch area of region of interest in the map, Background is a patch area at the background region of the map, denotes the mean, and denotes the standard deviation. A higher CNR indicates better image quality. RMSE is one of the most commonly used similarity measures that quantify the differences between two images ()33 where and are the width and height of the images in pixel, respectively. The smaller the , the more similar two images are.2.7.Excised Human Glioma StudiesThe use of human surgical tissue in this study was approved by University College London and Epilepsy Society Brain and Tissue Bank (12_SC_0669, ESBTB_MTA_17). Tumor specimens were sampled from patients undergoing 5-ALA-guided glioma resection surgery after obtaining consent, and all the experimental procedures were in accordance with the current UK Human Tissue Authority guidelines. The specimen used in this study was selected and aliquoted from the original excised tumor tissue by a neuropathologist. Immediately after the imaging experiment, the specimens were immersed in 10% paraformaldehyde for fixation and returned to the neuropathology lab for further standard histopathological procedures. 2.8.HistopathologyThe specimen was sliced at . The hematoxylin and eosin (H&E) staining was completed with an automated staining system (Leica ST5020); then the slides were cover-slipped on the Leica CV5030. 2.9.Quantitative CorrelationWe calculated the correlation coefficient () and its statistical significance ( value for testing the hypothesis of no correlation) to assess the correlation between the quantitative concentration of PpIX () and the quantitative tumor cellularity of the same region in the specimen. A patch (ROI) of (short axis × long axis) was extracted from the whole map; the was averaged over the short axis providing a concentration profile of the selected patch along the long axis. The cellularity was quantified in this study as nuclear–cytoplasmic ratio (NC ratio) in the H&E histology. For each specimen, the whole H&E-stained slide was scanned at and digitized (Leica SCN400 scanner, Leica Microsystem, UK). Microscopic images of magnification were used to extract the NC ratio. An ROI of (short axis × long axis) corresponding to the position and the size of the patch was cropped from the whole-slide image. The coregistration between the histology and the map was achieved by identifying some of the major anatomical landmarks, such as blood vessels and gray–white matter boundaries. The NC ratio was determined in a 0.05-mm window over the region’s long axis of 2.5 mm. The cell nuclei were automatically detected using color-based segmentation available in MATLAB®, which transformed the RGB histology images in the color space and classified violet-blue colored nuclei from the background pink-red color.34 3.Results3.1.Evaluation of Fluorescence ModelThe computational model was validated in optical phantoms that featured various scattering and absorption properties as well as different PpIX concentrations. The estimated PpIX concentration map was reconstructed using Eq. (4) with the measured (data driven) diffuse reflectance, and was averaged over a patch in the center of the . As shown in Figs. 4(a) and 4(e), the captured fluorescence emission spectra of phantoms composed of fixed PpIX concentrations but varying Hb (set A) or IL (set B) concentrations featured a notably diversified intensity range, resulting in variations in the estimated PpIX concentration [Figs. 4(c) and 4(g)]. Furthermore, the raw emission intensity at 640 nm was determined to be inversely proportional to the Hb concentration and proportional to the IL concentration [Figs. 4(a) and 4(e)]. The normalized root-mean-square deviations (NRMSD) of the raw peak emission intensity (640 nm) were 41.6% and 15.8% for Hb-variable phantom set A and IL-variable phantom set B, respectively. After applying the model Eq. (1), the emission spectra were equalized as shown in Figs. 4(b) and 4(f), corresponding to reduced NRMSD of 5.6% and 2.1%, respectively. For both phantom sets, the linear fits to the estimated PpIX concentrations that were derived from the equalized spectrum with Eq. (4) presented an improved coefficient of determination () from 0.85 to 0.97 and from 0.94 to 0.99, respectively [Figs. 4(c), 4(d), 4(g), and 4(h)]. 3.2.Evaluation of System PerformanceWe estimated the PpIX concentrations of the nine sets of tissue-mimicking optical phantoms under different camera exposure times, and the quantitative concentration values were averaged over a patch of in the center of the reconstructed concentration map over the wide-field image. For each exposure time, we plot the retrieved PpIX concentrations against the true PpIX concentrations in Figs. 5(a)–5(d), respectively. At all tested exposure times, the linearity between the estimation concentrations and the true concentration broke down at the lowest concentration of , which is indicated in red in the respective plots in Fig. 5. This indicates a PpIX detection limit at , which is sufficient for PpIX detection in LGGs.15 The coefficient of determination () of the linear fit was calculated over the concentration range from 0.05 to . This CMOS system demonstrated an improved sensitivity for PpIX fluorescence detection, with greater values for exposure times lower than 80 ms ranging from 0.77 to 0.93, compared with the state-of-the-art CMOS-based systems reported in the works of Valdés et al.26 and Jermyn et al.,27 where the corresponding values ranged from 0.69 to 0.92. The area of each pixel in the reported EMCCD27 is , which is 6 times larger than the used Gen II sCMOS (). Basically, the EMCCD compromises the spatial resolution, using larger pixel size to collect more photons per pixel, thereby yielding a high sensitivity. To provide a fair comparison based on the same total number of pixel, we evaluated the Gen II sCMOS camera’s sensitivity when using the binning configuration and calculated the respective values. When using a frame setting, the detection accuracy of our Gen II CMOS-based system is comparable to the high-sensitive EMCCD system27 for exposure times longer than 20 ms, where the values both ranged from 0.90 to 0.94 (Table 2). Table 2Comparison of R2 values across cameras used in quantitative fluorescence imaging systems.
This bold number represents the highest number among the number in this raw (exposure time 50 ms). 3.3.Evaluation of Total Variation RegularizationAs stated in Sec. 2.5, was chosen for minimizing the differences (RMSE) between the TV-reconstructed concentration map () and the ground-truth concentration map (). For example, for the tumor specimen [Fig. 6(g)], we computed the RMSE values using different ranging from 0.1 to 11.0, plotted in Fig. 7. Based on the RMSE- curve, we chose the regularization parameter , as it provided the minimum RMSE value (marked with a red cross in Fig. 7). Notably, the RMSE curve presents a flat shape while , suggesting that the regularization results are not highly sensitive to the exact choice of . Thus, we selected for measurements of all other tumor specimens. Likewise, was chosen for all phantom experiments. of phantom A and B and a tumor specimen was constructed from frames acquired in under 20 ms exposure time [Figs. 6(a), 6(d), and 6(g)]. Due to the low camera exposure time, acquired images are contaminated with noise. After processing with TV regularization, image quality was substantially improved by successfully removing noise while the edge features and the intensity level/PpIX concentration value are well preserved [Fig. 6(b), 6(e), and 6(h)]. This is further illustrated in the intensity profiles of each map [Figs. 6(j), 6(k), and 6(l)]. The intensity profile is taken from a straight line marked in gray across image’s x-axis [Figs. 6(a)–6(i)]. The profiles of the present prominent random fluctuations. The noisy fluctuations are favorably removed by TV-regularized reconstruction, whereby the concentration values remain comparable to . The CNR for each concentration map () is calculated between ROI (R) and background (BKG) marked with a red box, respectively. The CNR values are increased by twofold to threefold after TV regularization and are comparable to the ground truth (Table 3). RMSE between and is reduced compared with RMSE of and (Table 3), suggesting that the TV-regularized reconstruction is able to compensate for the loss of the image quality owing to the low exposure time. Table 3CNR and RMSE for evaluation of TV regularization.
Note: ls, least-squares; TV, TV- regularized; and gt, ground truth. 3.4.Ex vivo Human StudiesThe representative human tumor sample was excised from a glioblastoma multiform (GBM, WHO grade IV) patient and consisted of a large portion of neoplastic tumor tissue, an infiltrated margin, and a small fraction of relatively normal neocortical tissue. Figure 8 shows images of two representative areas, including white-light RGB images, qualitative PpIX fluorescence images, and the quantitative PpIX concentration maps. On the site of neoplastic tissue, strong visible PpIX fluorescence was observed as the vivid red color in the center of the illuminated area and red-violet color in the vicinity [Fig. 8(b)]. Quantitative PpIX concentration map displaying presented a heterogenous distribution across the area [Fig. 8(c)]. The was around for vivid red fluorescence, while the red-violet fluorescence corresponded to a value of . H&E histology pictures corresponding to three ROIs (), where the featured various different values, are shown in Figs. 8(d)–8(f). In addition to the pathologically increased NC ratio, the variable cellularity in the local area is another typical morphologic feature of GBM. This feature was also revealed in Fig. 8(d) as compact cellularity delineated by a dash line and low cellularity indicated by an arrow; it corresponded to the ROI 1 of which the showed a “patchy” pattern. Prominent cellularity and endothelial proliferation, both of which were essential microscopic characteristics of glioblastoma [indicated by arrows in Fig. 8(e)], were identified in ROI 2 giving a high value of averaged over the region, whereas low cellularity in ROI 3 [Fig. 8(f)] correlated to a moderate value of . In contrast, the other representative tissue site consisted of an infiltration margin and a healthy cortical zone [Fig. 8(g)]. Visible but vague fluorescence was detected in the infiltration region, and no visible fluorescence was observed in the healthy region, shown in Fig. 8(h). The estimated value over the infiltration margin ranged from 0.4 to , which was markedly lower compared with the tumor dominant area; while in the relatively healthy tissue region, the was determined to be around . Normal neurons were able to be identified in the microscopic pictures of ROI 4 [indicated by arrows in Fig. 8(j)], while the neoplastic characteristics became predominant across the tumor margin in ROI 5 and ROI 6 [Figs. 8(k) and 8(l)]. We are, to the best of our knowledge, the first to investigate the quantitative comparison between the NC ratio to the quantitative PpIX concentration map retrieved of a wide-field image, in addition to assessing the correlation between PpIX concentration and tumor pathological condition. We computed the over the short axis of the ROI as a function of the abscissa along the long axis, shown in Figs. 9(b) and 9(f). Similarly, a sliding window () was used to compute the NC ratio as a function of the abscissa along the long axis, shown in Figs. 9(d) and 9(h). The correlation coefficient () of two representative samples (ROI I and ROI II) demonstrated positive, statistically significant, correlations between and cellularity NC: ROI I (, , ROI II (, ). 4.Discussions and Conclusions4.1.System PerformancesThis reported wide-field quantitative fluorescence image system is capable of sensitively detecting PpIX fluorescence in turbid-media and reliably retrieving the truth quantitative PpIX concentration. Its sensitivity is proven to be comparable to the EMCCD-based system.27 In addition, the Gen II sCOMS camera features a faster acquisition speed of 200 fps in frame size of at 85-MHz read-out rate, compared with the reported EMCCD27 with the highest 63 fps in full frame () at 20-MHz read-out rate. In this study, the total acquisition and saving time is 26.4 s, which is dominated by data input/output latencies rather than acquisition throughput. We are aware that this is not ideal for implemention in a surgical scenario. However, we are confident that with better computing hardware (for instance using an SSD hard-drive, better CPUs or GPUs, and improved RAM), and with software optimization,30 this time can be significantly scaled down (without any compromise on the image quality, resolution, or field of view) to for acquisition and online processing. 4.2.Phantom StudiesThe performance of the model on reducing the influence of the tissue intrinsic optical properties on PpIX fluorescence emission was investigated in regards to absorption and scattering, respectively. In general, Hb dominated the absorption at the PpIX excitation band, giving rise to a diminished PpIX emission intensity while the Hb concentration increased [Fig. 4(a)]. Presumably, this was caused by an increased proportion of total incident photons that was absorbed by Hb of higher concentration, lessening the proportion of photons that was absorbed and thus fluoresced by PpIX. Whereas the IL contributes to the scattering across all emission band, IL scatterers also enhance the chances of re-emitted fluorescence photons getting diffusely reflected from the phantom surface and back to the detector [Fig. 4(e)]. Noticeably, the Hb demonstrated a larger influence on distortion of the fluorescence emission compared with IL, characterizing a factor of 3:1 in the NRMSD of peak emission from two representative phantom sets as shown in Figs. 4(a) and 4(e) ( for the Hb-variable set versus 15.8% for the IL-variable set). As shown in Fig. 11, the data-driven diffuse reflectance at both excitation and emission band corresponded to the model-driven group. However, at 410 nm, there were markedly higher data-driven reflectance intensities [Figs. 11(a) and 11(g)] compared with the simulations [Figs. 11(d) and 11(j)]. This discrepancy was presumably from the specular reflection of the excitation peak (408 nm) when under UV light excitation. 4.3.Ex vivo Human Tumor StudiesIn this work, we focused our tumor tissue imaging feasibility study on GBM: (i) GBM, as it name suggests, has a distinctive “multiform” feature in histopathology, which is expected to be distinguishable in the PpIX concentration map and (ii) the sample consisted of three different tissue regions with respect to pathological conditions (healthy, infiltration, and compact tumor site), which allowed us to make a comparison within one specimen. The specimen consisted of a large portion of white matter, and the tumor sites were primarily embedded in the white matter, whereas a small fraction of tumor tissue was gray matter found on the edge of the specimen. The reconstructed PpIX concentration map essentially indicated the fluorescence emission intensity over the UV-illuminated area. The map was able to reliably reveal the local histopathological grade in respect to the local NC ratio. Interestingly, some regions where the fluorescence emission did not present strong red color but corresponded to high were later confirmed in histopathology as tumor site with high cellularity and palisading structures (Fig. 10). As stated in the light propagation theory, the difference between white matter and gray matter with respect to the optical properties probably caused the modulation on the PpIX fluorescence emission. Furthermore, gray matter shows a notably lower optical scattering coefficient at the PpIX emission band compared with the white matter, whereas the absorption coefficients of the two at the PpIX absorption band are in the same range.35–37 Based on our findings in phantom studies, with identical PpIX concentration and absorption coefficient, the phantom that had a higher scattering coefficient illustrated stronger peak emission intensity. Presumably, the PpIX fluorescence emission would be diminished in a low-scattering medium and could be recovered to the quantitative PpIX concentration by applying the correction algorithm. It has been demonstrated that the exogenous 5-ALA causes the synthesis and accumulation of fluorescent PpIX in the mitochondria of epithelia and neoplastic cells.38 The PpIX concentration is believed to be proportional to the amount of tumor cells, thus being an indicative value of pathology grades. To date, a few groups have reported their studies on the correlation between PpIX visible fluorescence/concentration and histology/cellularity in brain tumor. Valdés et al.11 used PpIX fluorimetry to measure PpIX concentration () in the excised human glioma specimen and compared its histological score (nontumor, I, II, III, and IV), and they investigated correlations between obtained in vivo in patients using fiber-optic probe and spectrometer to five histopathological categories (control, low grade, high grade, meningioma, and metastasis).15 Stummer et al.23 correlated visible fluorescence qualities and spectrometric fluorescence to tumor cell density, respectively, where tumor cellularity was assessed using a semiquantitative scale incorporating five classes. Most recently, Lau et al.24 demonstrated that qualitative fluorescence intensity and cellularity grade (grades 1 to 4) had strong positive correlations for all tumor groups (glioblastoma, WHO Grade III, and recurrent), with an average Spearman’s correlation coefficient () value of 0.645. However, to the best of our knowledge, a direct, spatially localized, comparison between and quantitative tumor cellularity has not yet been reported. We believe that studying whether PpIX concentration spatially correlates to cellularity in brain tumors is of paramount importance for surgical guidance, and our findings would be interesting to readers in this field. In this study, we elaborated a sensitive quantitative wide-field spectrally resolved fluorescence imaging system and a computational model to retrieve the PpIX concentration from captured hyperspectra images. We evaluated our imaging system and algorithm in a phantom study and demonstrated an accurate estimation of the quantitative PpIX concentration. In an ex vivo human tumor study, the PpIX concentration was estimated for each pixel in the image frame and reconstructed as a quantitative map over the illuminated tissue area. We demonstrate that the TV regularization is capable of restoring noise-contaminated obtained under suboptimal exposure times, thus potentially reducing data acquisition time while keeping a reliable concentration estimation. The was corroborated to be linearly proportional to the NC ratio; accordingly, it quantitatively correlated to the tumor’s pathological grade. As this is a system development study, a limited number of human samples were included, which could be extended to a larger scale study including different glioma types and grades. To fit in the clinical workflow, instrument miniaturization as well as faster data acquisition would be the future focus. AppendicesAppendix:Model-Based Reflectance in Controlled Phantom StudiesSince the model corrects for tissue scattering and absorption based on the measured-then-normalized diffuse reflectance and (referred to as data-driven diffuse reflectance), it is essential to validate the proposed data-driven diffuse reflectance by comparing with a model-driven diffuse reflectance . We addressed this issue in the phantom study where the absorption coefficient and scattering coefficient can be calculated (see Sec. 2.6.1). The wavelength-dependent diffuse reflectance can in this context be modeled by the following equation,19 where dependence on has been omitted for simplicity reasons: where is the reduced albedo and is the internal reflection parameter that describes the refractive index mismatch between the tissue and external medium (air, in this study) where the can be empirically defined asAs introduced above, in the case of known optical coefficients, the model-driven diffuse reflectance can be determined using Eq. (12). For the phantoms used in this study, the reduced scattering coefficient contributed by IL can be approximated by39,40 The absorption coefficient dominated by Hb at given concentration can be modeled by41 where is the molar extinction coefficient.With known concentrations of IL and Hb, the reduced scattering coefficient () and the absorption coefficient () were determined by Eqs. (15) and (16), respectively. As such, the diffuse reflectance spectra were modeled by Eqs. (12)–(14) and compared with the measured diffuse reflectance spectra for evaluation. The data-driven diffuse reflectance at both the excitation band and the emission band corresponded to the model-driven diffuse reflectance as shown in Figs. 11(a), 11(b), 11(d), 11(e), 11(g), 11(h), 11(j), and 11(k). As a result, the PpIX concentrations reconstructed with the measured diffuse reflectance were consistent with the ones determined with the modeled diffuse reflectance, featuring a comparable coefficient of determination of the linear fits in Fig. 11(c), 11(f), 11(i), and 11(l). DisclosuresThe authors have no relevant financial interests in this article and no potential conflicts of interest to disclose. AcknowledgmentsThis study was funded by the Health Innovation Challenge Fund (Nos. HICF-T4-275 and WT 97914), a parallel funding partnership between the Department of Health and Wellcome Trust. This work was supported by Wellcome/Engineering and Physical Sciences Research Council (EPSRC) (Nos. 203145Z/16/Z and NS/A000050/1; Nos. WT101957 and NS/A000027/1), and EPSRC (Nos. EP/L016478/1 and EP/P511262/1). This work was undertaken at the University College London and University College London Hospitals, which received a proportion of funding from the Department of Health’s National Institute for Health Research, University College London Hospitals Biomedical Research Centre funding scheme. The Epilepsy Society Brain and Tissue Bank at University College London is funded by the Epilepsy Society. The views expressed in this publication are those of the author(s) and not necessarily those of the Department of Health or Wellcome Trust. ReferencesB. W. Pogue et al.,
“Review of neurosurgical fluorescence imaging methodologies,”
IEEE J. Sel. Top. Quantum Electron., 16
(3), 493
–505
(2010). http://dx.doi.org/10.1109/JSTQE.2009.2034541 IJSQEN 1077-260X Google Scholar
M. E. Oppenlander et al.,
“An extent of resection threshold for recurrent glioblastoma and its risk for neurological morbidity,”
J. Neurosurg., 120
(4), 846
–853
(2014). http://dx.doi.org/10.3171/2013.12.JNS13184 Google Scholar
D. A. Hardesty and N. Sanai,
“The value of glioma extent of resection in the modern neurosurgical era,”
Front. Neurol., 3 1
–8
(2012). https://doi.org/10.3389/fneur.2012.00140 Google Scholar
N. Sanai and M. S. Berger,
“Glioma extent of resection and its impact on patient outcome,”
Neurosurgery, 62
(4), 753
–766
(2008). https://doi.org/10.1227/01.neu.0000318159.21731.cf Google Scholar
C. Schulz, S. Waldeck and U. M. Mauer,
“Intraoperative image guidance in neurosurgery: development, current indications, and future trends,”
Radiol. Res. Pract., 2012 1
–9
(2012). http://dx.doi.org/10.1155/2012/197364 Google Scholar
J. Regelsberger et al.,
“Ultrasound-guided surgery of deep seated brain lesions,”
Eur. J. Ultrasound, 12 115
–121
(2000). http://dx.doi.org/10.1016/S0929-8266(00)00103-8 CECED9 Google Scholar
H. J. Böhringer et al.,
“Time-domain and spectral-domain optical coherence tomography in the analysis of brain tumor tissue,”
Lasers Surg. Med., 38
(6), 588
–597
(2006). http://dx.doi.org/10.1002/(ISSN)1096-9101 Google Scholar
M. Jermyn et al.,
“Intraoperative brain cancer detection with raman spectroscopy in humans,”
Sci. Transl. Med., 7 274ra19
–274ra19
(2015). http://dx.doi.org/10.1126/scitranslmed.aaa2384 Google Scholar
W. Stummer and M. A. Kamp,
“The importance of surgical resection in malignant glioma,”
Curr. Opin. Neurol., 22
(6), 645
–649
(2009). http://dx.doi.org/10.1097/WCO.0b013e3283320165 Google Scholar
V. Pavlov et al.,
“Intraoperative probe-based confocal laser endomicroscopy in surgery and stereotactic biopsy of low-grade and high-grade gliomas: a feasibility study in humans,”
Neurosurgery, 79
(4), 604
–612
(2016). http://dx.doi.org/10.1227/NEU.0000000000001365 NEQUEB Google Scholar
P. A. Valdés et al.,
“5-aminolevulinic acid-induced protoporphyrin IX concentration correlates with histopathologic markers of malignancy in human gliomas: the need for quantitative fluorescence-guided resection to identify regions of increasing malignancy,”
Neuro-Oncology, 13
(8), 846
–856
(2011). http://dx.doi.org/10.1093/neuonc/nor086 Google Scholar
A. D. Puppa et al.,
“5-aminolevulinic acid fluorescence in high grade glioma surgery: surgical outcome, intraoperative findings, and fluorescence patterns,”
BioMed. Res. Int., 2014 1
–8
(2014). http://dx.doi.org/10.1155/2014/232561 Google Scholar
P. Teixidor et al.,
“Safety and efficacy of 5-aminolevulinic acid for high grade glioma in usual clinical practice: a prospective cohort study,”
PLoS One, 11
(2), e0149244
(2016). http://dx.doi.org/10.1371/journal.pone.0149244 POLNCL 1932-6203 Google Scholar
G. Widhalm et al.,
“Strong 5-aminolevulinic acid-induced fluorescence is a novel intraoperative marker for representative tissue samples in stereotactic brain tumor biopsies,”
Neurosurg. Rev., 35
(3), 381
–391
(2012). http://dx.doi.org/10.1007/s10143-012-0374-5 Google Scholar
P. A. Valdés et al.,
“Quantitative fluorescence in intracranial tumor: implications for ALA-induced PpIX as an intraoperative biomarker,”
J. Neurosurg., 115 11
–17
(2011). http://dx.doi.org/10.3171/2011.2.JNS101451 Google Scholar
N. Haj-Hosseini et al.,
“Optical touch pointer for fluorescence guided glioblastoma resection using 5-aminolevulinic acid,”
Lasers Surg. Med., 42
(1), 9
–14
(2010). http://dx.doi.org/10.1002/lsm.v42:1 Google Scholar
P. A. Valdés et al.,
“A spectrally constrained dual-band normalization technique for protoporphyrin IX quantification in fluorescence-guided surgery,”
Opt. Lett., 37 1817
–1819
(2012). http://dx.doi.org/10.1364/OL.37.001817 Google Scholar
N. Haj-Hosseini et al.,
“Low dose 5-aminolevulinic acid: implications in spectroscopic measurements during brain tumor surgery,”
Photodiagn. Photodyn. Ther., 12
(2), 209
–214
(2015). http://dx.doi.org/10.1016/j.pdpdt.2015.03.004 Google Scholar
A. Kim et al.,
“Quantification of in vivo fluorescence decoupled from the effects of tissue optical properties using fiber-optic spectroscopy measurements,”
J. Biomed. Opt., 15
(6), 067006
(2010). http://dx.doi.org/10.1117/1.3523616 Google Scholar
P. Charalampaki et al.,
“Confocal laser endomicroscopy for real-time histomorphological diagnosis: our clinical experience with 150 brain and spinal tumor cases,”
Neurosurgery, 62
(Suppl. 1), 171
–176
(2015). http://dx.doi.org/10.1227/NEU.0000000000000805 NEQUEB Google Scholar
P. A. Valdés et al.,
“Quantitative, spectrally-resolved intraoperative fluorescence imaging,”
Sci. Rep., 2 798
(2012). http://dx.doi.org/10.1038/srep00798 SRCEC3 2045-2322 Google Scholar
H. Taniguchi et al.,
“Improving convenience and reliability of 5-ALA-induced fluorescent imaging for brain tumor surgery,”
209
–217 Munich, Germany
(2015). Google Scholar
W. Stummer et al.,
“5-Aminolevulinic acid-derived tumor fluorescence: the diagnostic accuracy of visible fluorescence qualities as corroborated by spectrometry and histology and postoperative imaging,”
Neurosurgery, 74
(3), 310
–320
(2014). http://dx.doi.org/10.1227/NEU.0000000000000267 NEQUEB Google Scholar
D. Lau et al.,
“A prospective phase II clinical trial of 5-aminolevulinic acid to assess the correlation of intraoperative fluorescence intensity and degree of histologic cellularity during resection of high-grade gliomas,”
J. Neurosurg., 124
(124), 1300
–1309
(2016). http://dx.doi.org/10.3171/2015.5.JNS1577 Google Scholar
J. M. Dixon, M. Taniguchi and J. S. Lindsey,
“Photochemcad 2. A refined program with accompanying spectral databases for photochemical calculations,”
Photochem. Photobiol., 81
(1), 212
–213
(2005). http://dx.doi.org/10.1562/2004-11-06-TSN-361.1 PHCBAP 0031-8655 Google Scholar
P. A. Valdés et al.,
“System and methods for wide-field quantitative fluorescence imaging during neurosurgery,”
Opt. Lett., 38 2786
–2788
(2013). http://dx.doi.org/10.1364/OL.38.002786 OPLEDP 0146-9592 Google Scholar
M. Jermyn et al.,
“Improved sensitivity to fluorescence for cancer detection in wide-field image-guided neurosurgery,”
Biomed. Opt. Express, 6 5063
–5074
(2015). http://dx.doi.org/10.1364/BOE.6.005063 BOEICL 2156-7085 Google Scholar
S. C. Gebhart, S. K. Majumder and A. Mahadevan-Jansen,
“Comparison of spectral variation from spectroscopy to spectral imaging,”
Appl. Opt., 46 1343
–1360
(2007). http://dx.doi.org/10.1364/AO.46.001343 APOPAI 0003-6935 Google Scholar
S. J. Leavesley et al.,
“Hyperspectral imaging microscopy for identification and quantitative analysis of fluorescently-labeled cells in highly autofluorescent tissue,”
J. Biophotonics, 5
(1), 67
–84
(2012). http://dx.doi.org/10.1002/jbio.v5.1 Google Scholar
D. Ravi et al.,
“Manifold embedding and semantic segmentation for intraoperative guidance with hyperspectral brain imaging,”
IEEE Trans. Med. Imaging, 36
(9), 1845
–1857
(2017). http://dx.doi.org/10.1109/TMI.2017.2695523 Google Scholar
S. C. Gebhart, R. C. Thompson and A. Mahadevan-Jansen,
“Liquid-crystal tunable filter spectral imaging for brain tumor demarcation,”
Appl. Opt., 46 1896
–1910
(2007). http://dx.doi.org/10.1364/AO.46.001896 APOPAI 0003-6935 Google Scholar
A. Chambolle and T. Pock,
“A first-order primal–dual algorithm for convex problems with applications to imaging,”
J. Math. Imaging Vision, 40
(1), 120
–145
(2011). http://dx.doi.org/10.1007/s10851-010-0251-1 JIMVEC 0924-9907 Google Scholar
P. Siarry, Optimisation in Signal and Image Processing, Wiley(2013). Google Scholar
V. S. Rathore, M. S. Kumar and A. Verma,
“Colour based image segmentation using l* a* b* colour space based on genetic algorithm,”
Int. J. Emerging Technol. Adv. Eng., 2
(6), 156
–162
(2012). Google Scholar
A. N. Yaroslavsky et al.,
“Optical properties of selected native and coagulated human brain tissues in vitro in the visible and near infrared spectral range,”
Phys. Med. Biol., 47
(12), 2059
–2073
(2002). http://dx.doi.org/10.1088/0031-9155/47/12/305 Google Scholar
S. C. Gebhart, W. C. Lin and A. Mahadevan-Jansen,
“In vitro determination of normal and neoplastic human brain tissue optical properties using inverse adding-doubling,”
Phys. Med. Biol., 51
(8), 2011
–2027
(2006). http://dx.doi.org/10.1088/0031-9155/51/8/004 Google Scholar
Y. Xie et al.,
“Coronal in vivo forward-imaging of rat brain morphology with an ultra-small optical coherence tomography fiber probe,”
Phys. Med. Biol., 58
(3), 555
–568
(2013). http://dx.doi.org/10.1088/0031-9155/58/3/555 Google Scholar
C. Krieg et al.,
“Metabolic characterization of tumor cell-specific protoporphyrin IX accumulation after exposure to 5-aminolevulinic acid in,”
Photochem. Photobiol., 76
(5), 518
–525
(2002). http://dx.doi.org/10.1562/0031-8655(2002)076<0518:MCOTCS>2.0.CO;2 PHCBAP 0031-8655 Google Scholar
H. J. van Staveren et al.,
“Light scattering in lntralipid-10% in the wavelength range of 400-1100 nm,”
Appl. Opt., 30 4507
–4514
(1991). http://dx.doi.org/10.1364/AO.30.004507 APOPAI 0003-6935 Google Scholar
S. Flock et al.,
“Optical properties of intralipid: a phantom medium for light propagation studies,”
Lasers Surg. Med., 12
(5), 510
–519
(1992). http://dx.doi.org/10.1002/(ISSN)1096-9101 Google Scholar
S. Prahl,
“Tabulated molar extinction coefficient for hemoglobin in water,”
Oreg. Med. Laser Cent.,
(1998) http://omlc.org/spectra/hemoglobin/index.html Google Scholar
|