1.IntroductionGastric cancer (GC) is a commonly diagnosed cancer worldwide and one of the leading causes of cancer-related mortality.1 Gastrectomy is a curative treatment for GC.2 The effect of gastric remnant volume on the postoperative quality of life and nutritional status has been recognized. Furthermore, organ-sparing surgery is increasingly preferred.3–5 Japanese GC treatment guidelines (5th edition) recommend a proximal resection margin of at least 3 cm for tumors in the case of an expansive growth pattern, whereas a proximal resection margin of at least 5 cm is required in the case of an infiltrative growth pattern.6 The large margin in the infiltrative growth patterns is attributed to the extensive submucosal or deeper layer invasions. Hence, if the extent of the non-exposed cancer invasion is identified, the stomach can be resected more appropriately. However, assessing the extent of the tumor and determining the appropriate resection margins during surgery remains difficult. Hence, several methods, including intraoperative endoscopy and endoscopic tattooing or clipping, that can identify the tumor extent and determine the appropriate surgical margins exist.7–10 However, the endoscopic determination of the extent of the GC that is not exposed to the mucosal surface remains difficult (e.g., the infiltrative growth pattern10). We previously reported that near-infrared (NIR) hyperspectral imaging (HSI) could be used to identify gastrointestinal stromal tumors in the muscular layer that was not exposed to the mucosa.11,12 Light in the NIR region, ranging from 800 to 2500 nm, is useful for probing deep parts of the tissues owing to its low absorption and scattering. The absorption spectra in the NIR region convey fingerprint data owing to the overtone or combined vibrations of the chemical bonds.13–15 This permits the investigation of the distribution of the chemical composition within a sample.16 Hyperspectral imaging provides a three-dimensional dataset (two spatial and one spectral) that allows a spectral curve at each pixel in the acquired images to be obtained.17 It uses a machine-learning algorithm to acquire spectral information from each pixel and extract critical imaging data from several hyperspectral images.18,19 Hyperspectral imaging has the potential for non-invasive, label-free diagnosis and surgical guidance. Hence, NIR-HSI can identify the extent of the GC that is not exposed to the mucosal surface. Studies have reported the identification of GC using NIR-HSI, although its characteristics have not been considered.19–21 In this study, we aim to explore whether NIR-HSI can identify the GC regions, including each exposed and unexposed area, using surgical specimens and investigate the characteristics of the identifiable GC region. 2.Materials and Methods2.1.Patients and Surgical SpecimenThis study included 10 patients with clinically diagnosed GC who underwent surgery between September 2020 and October 2021. The inclusion criteria were as follows: (i) clinical diagnosis of the GC, (ii) years, and (iii) written informed consent. The exclusion criteria were as follows: (i) history of prior chemotherapy and (ii) presence of the hepatitis B virus surface antigen or hepatitis C virus antibody. Ten patients who underwent gastrectomy during the study period were enrolled. Table 1 shows the characteristics of the patients and lesions. The median tumor size was 38 mm (range: 20 to 70 mm). The clinical T stage was T1 in 1 lesion, T2 in 3 lesions, and T3–4 in 6 lesions. The macroscopic type was 0-IIc in 1 lesion, T2 in 4 lesions, and T3 in 5 lesions. Table 1Patient and lesion characteristics.
Note: SM, submucosa; MP, muscularis propria; SS, subserosa; SE, serosa exposed; tub1, well differentiated adenocarcinoma; tub2, moderately differentiated adenocarcinoma; por, poorly differentiated adenocarcinoma; sig, signet-ring cell carcinoma. The indicators for the types of gastrectomy and a proximal resection margin were determined based on the preference of the surgeon and were primarily based on the Japanese GC treatment guidelines.6 All of the surgical specimens were fixed using formalin, cut into 5- or 10 mm-thick slices, stained with hematoxylin and eosin, and evaluated by experienced pathologists. Clinical and pathological outcomes included the Borrmann classification of the tumor, tumor size, depth of invasion, tumor thickness, and histology based on differentiation. The extent of the GC was evaluated separately for exposed and unexposed areas. The exposed area was defined as an area where the cancer itself was pathologically exposed on the surface and not covered by any normal tissue. The non-exposed area was defined as an area where the cancer was present although not exposed on the surface and the surface was covered by normal tissue. The normal areas were defined as areas where the cancer was not present, as shown in Fig. 1. This study was approved by the Institutional Review Board of the National Cancer Center, Japan (Approval No. 2015-339), which conformed to the provisions of the Declaration of Helsinki and Epidemiological Study Guidelines issued by the Japan Ministry of Health, Labor, and Welfare. All patients provided a written informed consent prior to their inclusion in the study. 2.2.Near-Infrared Hyperspectral Image Capture and Data PreprocessingAn imaging system with a high-speed NIR hyperspectral camera (CompoVision, CV-N800HS; Sumitomo Electric Industries, Ltd., Osaka, Japan) was used to obtain the NIR-HSI images (wavelength: 1000 to 2350 nm, wavelength resolution: 6.3 nm, and depth resolution: 14 bit). The detector (NIR spectroscopic camera) captured the data values for each wavelength band on each pixel per line of the image in one scan. Three-dimensional HSI images ( axes) were obtained by scanning multiple lines (by sliding the sample stage), thereby producing a virtual “data cube” for processing and analysis.17 Each fresh specimen that, prior to the formalin fixation was resected from the stomach, was placed on the sliding stage without trimming. Each NIR-HSI image was acquired once from the mucosal side under illumination from a halogen lamp (). To analyze the HSI data, it is necessary to calibrate the images using dark noise and a white standard for each . Each reflectance is expressed as follows: where is a row vector of the reflectance spectrum of the obtained image and , , and are the row vectors of raw, white standard, and dark noise data, respectively. Spectra with wavelengths were removed from the analysis because of the high absorption by the water in those bands and the lower sensitivity of the NIR camera, unlike the transmission spectroscopy.20 Additionally, the reflectance rates of more than 70% as highlights and below 10% as shadows were defined in the 1300-nm spectra. Further, the pixels of the necrosis were removed from the dataset and analysis. Normal, exposed, and unexposed GCs were marked by a pathologist to create three regions showing the pixels of the boundary lines. The 5-pixel margin around the boundary lines was excluded while extracting the spectra from each region because the boundary line was drawn freehand by the pathologist. Hence, it was susceptible to error.NIR spectral measurements reported the variance and the non-specific scattering at the surface of the sample.22 The standard normal variate (SNV) of absorbance was used for the baseline correction of the spectrum to reduce the variance and is as expressed as follows: where is a row vector of the absorbance spectrum, is a row vector containing the original spectrum, is the mean of , is the standard deviation of , and is the SNV-transformed spectrum.2.3.Spectral Data AnalysisA support vector machine (SVM) was used to perform a two-class classification of the normal tissues and entire GC lesions, excluding the 5-pixel margin of the boundary line and necrosis area [inside of the pink line in Fig. 3(B)]. During this process, the pixels to be trained were randomly extracted from a specimen to avoid overfitting. The number of pixels was aligned with normal 200 px and GC 200 px from the confirmed area by pathology. Further, leave-one-out cross-validation was employed, wherein a specimen is classified by a training dataset (each 200 px of normal and GC from nine specimens; total 3600 spectra) that excludes the specimen pixels because the procedure provides an approximately unbiased estimate of the generalization ability.23 This algorithm solves an optimization problem expressed as follows:24 where is a weight vector, is the cost, and is the slack variable. Further, the decision function is expressed asThe optimization problem was solved using the decomposition method.25 This study used , and the RBF kernel is expressed as where the optimal values of the hyperparameter are estimated as follows:The SNV-transformed spectra of the normal tissues, except for the test sample, were averaged. Further, the mean SNV-transformed spectra of the exposed and unexposed regions in the tumor of the test sample were calculated. Hence, the difference in the spectra was obtained by comparing the spectra of the normal and tumor tissues. 2.4.Calculation of Prediction AccuracyThe coordinates of the classification pixels were compared to the line drawing images by a pathologist to evaluate the classification accuracy. The area of analysis in this study was limited to the pathologically confirmed area (green area) because only the green area in Fig. 4 is the pathologically evaluated area. This is because the pathologically evaluated sites are the cancer and surrounding normal tissue. The pixels were classified into four groups: GC is predicted as GC [true positive (TP)], GC is predicted as normal [false negative (FN)], normal is predicted as GC [false positive (FP)], and normal is predicted as normal [true negative (TN)]. The false-positive rate and false-negative rate were calculated from the classified pixels. The specificity, sensitivity, and accuracy were expressed as follows: 2.5.Comparison of Histopathologic Tumor ThicknessHistopathological tumor thicknesses were compared to determine the factors that contributed to the identified areas (TP pixels) and unidentified areas (FN pixels) of the GC using NIR-HSI. The criteria for the identified and unidentified areas of each specimen were as follows. If the sensitivity was , the pathological sections in the identified areas could be accurately recognized, but the unidentified areas were difficult to recognize. Therefore, tumor thickness was measured only in the identified areas. However, when the sensitivity was , it was possible to recognize pathological sections in the identified and unidentified areas; therefore, tumor thickness was measured in the identified and unidentified areas. 3.Results3.1.Endoscopic ImagesThe endoscopic images of the lesions and pictures of the 10 excised specimens are shown in Figs. 2(A) and 2(B), respectively. Four specimens [d, e, g, and i in Fig. 2(B)] were exposed to the mucosal surface of all regions for cancer. Six specimens [a–c, f, h, and i in Fig. 2(B)] had unexposed cancer in some regions. Figure 3(A) shows the pictures of the 10 specimens captured using the NIR-HSI. The GC and normal regions in the NIR-HSI images were marked by a pathologist [Fig. 3(B)]. The white lines represent the extent of the GC, and the yellow ones represent the borderline between the exposed and unexposed areas of the GC. To visualize the trend of the spectral regions contributing to the cancer classification, the difference between the SNV-transformed spectra of the normal tissues (leave-one-out training data) and mean SNV-transformed spectra of the exposed and unexposed regions in the tumor of the test sample is shown in Fig. 3(C). The results showed that the absorbance difference in the wavelength range of 1050 to 1100 nm and 1380 to 1400 nm was negative and in the wavelength range of 1250 to 1350 nm was positive, except for the unexposed and exposed areas of the specimens (f and g, respectively). 3.2.Identification Results of Gastric Cancer and Normal Regions using NIR-HSIThe analysis of the spectra from the HSI images was performed based on the training data using the SVM algorithm. Further, the GC and normal regions were identified. The pixels that were predicted as GC were assigned a red color, and the normal tissues were assigned a green color. The color-coded pixels that were predicted as GC and normal tissues are shown in the upper images in Figs. 4(a)–4(j). The lower images in Figs. 4(a)–4(j) were merged to include the boundary line of the pathologist. Furthermore, the pixel areas used for calculating the prediction accuracy were also shown. The pixels (459,688 px) were classified as follows: TP: 160,693 px, FN: 35,517 px, FP: 55,567 px, and TN: 207,911 px. The specificity, sensitivity, and accuracy of 74.8%, 77.2%, and 79.7%, respectively, were evaluated from the classified pixels. Table 2 presents the results. The prediction results of the exposed area were classified as follows: TP: 138,545 px and FN: 27,971 px. The sensitivity of 79.7% was calculated from the classified pixels. Additionally, the prediction results for the unexposed area were classified as follows: TP: 22,148 px and FN: 7545 px. Furthermore, the sensitivity of 68.5% was calculated from the classified pixels. The complete results are presented in Table 3. Table 2Prediction results of the NIR-HSI analysis. The GC region [the inside of the white line of Fig 2(b)] was defined as “positive,” and the outside of the GC was defined “negative” in the pathologically confirmed area. The 5 px margin of the white line and necrosis area were excluded from the analysis.
Note: TP, true positive; FN, false negative; FP, false positive; and TN, true negative. Table 3Prediction results in the exposed and unexposed areas during the NIR-HSI analysis. Among the pixels analyzed in Table 2, the TP and FN of the area inside the yellow line in Fig. 3(B) were defined as “exposed,” and the TP and FN of the area between the white and yellow lines were defined as “unexposed”.
Note: TP, true positive; FN, false negative. 3.3.Relationship between Tumor Thickness and Identifiable Area using NIR-HSITable 4 shows the tumor thickness in the GC region. NIR hyperspectral imaging detected cancer areas with pathologic thicknesses of regardless of whether the cancer was exposed on the mucosal surface or not (Fig. 5). Table 4Relationship between the tumor thickness and identifiable area using NIR-HSI.
However, thin-tumor areas, including those exposed on the mucosal surface, were unidentified as cancerous (Fig. 6). Additionally, in the prediction results of the NIR-HSI analysis as shown in Table 3, specimens g and f had the lowest sensitivity in the exposed and unexposed regions, respectively. As shown in Fig. 3(C), the spectral trends of both specimens were different from those of the other highly sensitive specimens. This may be because the lesion tissue was thin (Table 4), whereas the molecular structures of the samples were different from those of the other samples. 4.DiscussionThis study evaluated the extent of the GC, including the unexposed areas that were difficult to recognize under white light or by machine learning using the NIR-HSI data. The findings of this study are novel because previous NIR-HSI studies on GC did not discuss the identification of cancerous areas under normal mucosa. This study identified the exposed area of the GC as cancerous with high sensitivity, that is, with 79.7% and 68.5% sensitivities in the exposed and unexposed areas, respectively. However, the overall sensitivity was lower in the unexposed area than in the exposed area. Further, several FPs were detected in thin cancerous areas, which is possibly owing to the characteristics of the NIR absorption spectroscopy that uses reflected light: (i) the thicker the normal mucosa covering cancer, the more attenuated the characteristic absorption spectrum of cancer and (ii) the thinner the cancer, the sparser the information in the absorption spectrum. As shown in Fig. 3(C), the absorbance difference between the normal area spectra in the training data and that of the unexposed area was smaller than that of the exposed area. Areas with tumor thicknesses of were identified using the NIR-HSI, even in unexposed areas (Table 4). However, areas with thin tumors remained unidentified in either the exposed or unexposed areas. This study shows that NIR-HSI can be used to accurately recognize unexposed areas that are difficult to recognize under white light when the thickness is 2 mm or more. This study was limited by the small number of specimens. However, it classified NIR-HSI-captured pixels (total pixel: 459,688 px) using the leave-one-out cross-validation procedure. Hence, the sample size was sufficient, and its generalizability was demonstrated. The results for shallow-depth areas were inadequate because numerous specimens in the study had advanced cancer, and sufficient data on the areas with shallow depths of cancer invasion were lacking. Gathering more data on shallow lesions was necessary, as represented by the specimen in Fig. 2(B) [case (g)]. Hence, the shallow lesions were unidentified as cancers. The optimization of the measurement conditions, such as changes in the illumination method of the NIR-HSI system, specimen placement, and design focal length, improved the detection performance. Additionally, although an SVM was adopted as a machine learning method in this study, other methods such as neural network and principal correlation analysis have been proposed to identify lesions. The identification accuracy may be improved by investigating the optimal algorithm and parameter. Moreover, significantly increasing the number of specimens would broaden the range of options for popular deep learning techniques and allow for the exploration of more robust classifiers. However, imaging conditions in the stomach using an endoscope with NIR-HSI differed from those of our study. For example, the postoperative specimen was imaged from the front in this study, though it may not be possible in the case of an endoscope in the stomach. Additionally, the absorption spectra may change before gastrectomy because of the blood flow and other factors. Hence, the NIR-HSI devices for endoscopic use must be developed, and the optimization of the measurement conditions must be considered in the future. Our group is currently developing an NIR-HSI device that can be used with endoscopes. We expect to perform an endoscopic NIR-HSI analysis in the near future. If this technology is used with an endoscope, it may be possible to intraoperatively or preoperatively identify the extent of the unexposed area and define a more appropriate line for the resection of the stomach. DisclosuresThe authors have no relevant financial interests in the manuscript and no other potential conflicts of interest to disclose. Data availabilityThe datasets generated and analyzed during the current study are not publicly available owing to containing personal patient information but are available from the corresponding author on reasonable request. AcknowledgmentsThe authors would like to thank the investigators and patients for their participation in the study. This study was supported by the Japan Society for the Promotion of Science KAKENHI (Grant No. 21H038440) and National Cancer Center Research and Development Fund (Grant No. 31-A-11). ReferencesH. Sung et al.,
“Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries,”
CA Cancer J. Clin., 71
(3), 209
–249 https://doi.org/10.3322/caac.21660 CAMCAM 0007-9235
(2021).
Google Scholar
R. Glynne-Jones et al.,
“Anal cancer: ESMO-ESSO-ESTRO clinical practice guidelines for diagnosis, treatment and follow-up,”
Radiother. Oncol., 111
(3), 330
–339 https://doi.org/10.1016/j.radonc.2014.04.013 RAONDT 0167-8140
(2014).
Google Scholar
H. J. F. Brenkman et al.,
“Factors influencing health-related quality of life after gastrectomy for cancer,”
Gastric Cancer, 21 524
–532 https://doi.org/10.1007/s10120-017-0771-0
(2018).
Google Scholar
M. Takahashi et al.,
“Quality of life after total vs distal gastrectomy with Roux-en-Y reconstruction: use of the Postgastrectomy Syndrome Assessment Scale-45,”
World J. Gastroenterol., 23
(11), 2068
–2076 https://doi.org/10.3748/wjg.v23.i11.2068
(2017).
Google Scholar
R. Rosania et al.,
“Nutrition in patients with gastric cancer: an update,”
Gastrointest. Tumors, 2
(4), 178
–187 https://doi.org/10.1159/000445188
(2016).
Google Scholar
Japanese Gastric Cancer Association,
“Japanese gastric cancer treatment guidelines 2018 (5th edition),”
Gastric Cancer, 24 1
–21 https://doi.org/10.1007/s10120-020-01042-y
(2021).
Google Scholar
D. J. Park et al.,
“Intraoperative gastroscopy for gastric surgery,”
Surg. Endosc., 19 1358
–1361 https://doi.org/10.1007/s00464-004-2217-0
(2005).
Google Scholar
H. Matsui et al.,
“Endoscopy-assisted gastric resection: a safe and reliable procedure for tumor clearance during laparoscopic high distal or proximal gastrectomy,”
Surg. Endosc., 23 1146
–1149 https://doi.org/10.1007/s00464-009-0354-1
(2009).
Google Scholar
R. I. Beretvas and J. Ponsky,
“Endoscopic marking: an adjunct to laparoscopic gastrointestinal surgery,”
Surg. Endosc., 15 1202
–1203 https://doi.org/10.1007/s004640000304
(2001).
Google Scholar
S. Kawakatsu et al.,
“Use of endoscopy to determine the resection margin during laparoscopic gastrectomy for cancer,”
Br. J. Surg., 104
(13), 1829
–1836 https://doi.org/10.1002/bjs.10618
(2017).
Google Scholar
D. Sato et al.,
“Distinction of surgically resected gastrointestinal stromal tumor by near-infrared hyperspectral imaging,”
Sci. Rep., 10 21852 https://doi.org/10.1038/s41598-020-79021-7 SRCEC3 2045-2322
(2020).
Google Scholar
K. Akimoto et al.,
“Wavelength bands reduction method in near-infrared hyperspectral image based on deep neural network for tumor lesion classification,”
AIVP, 9
(1), 273
–281 https://doi.org/10.14738/aivp.91.9475
(2021).
Google Scholar
R. R. Anderson and J. A. Parrish,
“The optics of human skin,”
J. Invest. Dermatol., 77
(1), 13
–19 https://doi.org/10.1111/1523-1747.ep12479191 JIDEAE 0022-202X
(1981).
Google Scholar
K. Okubo et al.,
“Visualization of quantitative lipid distribution in mouse liver through near-infrared hyperspectral imaging,”
Biomed. Opt. Express, 12
(2), 823
–835 https://doi.org/10.1364/BOE.413712 BOEICL 2156-7085
(2021).
Google Scholar
T. Takamatsu et al.,
“Over 1000 nm near-infrared multispectral imaging system for laparoscopic in vivo imaging,”
Sensors, 21
(8), 2649 https://doi.org/10.3390/s21082649 SNSRES 0746-9462
(2021).
Google Scholar
A. M. Smith, M. C. Mancini and S. Nie,
“Second window for in vivo imaging,”
Nat. Nanotechnol., 4 710
–711 https://doi.org/10.1038/nnano.2009.326 NNAABX 1748-3387
(2009).
Google Scholar
Q. Li et al.,
“Review of spectral imaging technology in biomedical engineering: achievements and challenges,”
J. Biomed. Opt., 18
(10), 100901 https://doi.org/10.1117/1.JBO.18.10.100901 JBOPFO 1083-3668
(2013).
Google Scholar
Z. Liu, H. Wang and Q. Li,
“Tongue tumor detection in medical hyperspectral images,”
Sensors, 12
(1), 162
–174 https://doi.org/10.3390/s120100162 SNSRES 0746-9462
(2012).
Google Scholar
H. Akbari et al.,
“Cancer detection using infrared hyperspectral imaging,”
Cancer Sci., 102
(4), 852
–857 https://doi.org/10.1111/j.1349-7006.2011.01849.x
(2011).
Google Scholar
A. Yahata et al.,
“Wavelength selection of near-infrared hyperspectral imaging for gastric cancer detection,”
in 6th Int. Conf. Intell. Inf. and Biomed. Sci. (ICIIBMS),
219
–223
(2021). Google Scholar
N. Liu et al.,
“Gastric cancer diagnosis using hyperspectral imaging with principal component analysis and spectral angle mapper,”
J. Biomed. Opt., 25
(6), 066005 https://doi.org/10.1117/1.JBO.25.6.066005 JBOPFO 1083-3668
(2020).
Google Scholar
Q. Guo, W. Wu and D. L. Massart,
“The robust normal variate transform for pattern recognition with near-infrared data,”
Anal. Chim. Acta, 382
(1–2), 87
–103 https://doi.org/10.1016/S0003-2670(98)00737-5 ACACAM 0003-2670
(1999).
Google Scholar
G. C. Cawley and N. L. C. Talbot,
“Fast exact leave-one-out cross-validation of sparse least-squares support vector machines,”
Neural Networks, 17
(10), 1467
–1475 https://doi.org/10.1016/j.neunet.2004.07.002 NNETEB 0893-6080
(2004).
Google Scholar
A. Karatzoglou et al.,
“kernlab—an S4 package for kernel methods in R,”
J. Stat. Software, 11
(9), 1
–20 https://doi.org/10.18637/jss.v011.i09
(2004).
Google Scholar
C. W. Hsu and C. J. Lin,
“A simple decomposition method for support vector machines,”
Mach. Learn., 46 291
–314 https://doi.org/10.1023/A:1012427100071 MALEEZ 0885-6125
(2002).
Google Scholar
BiographyToshihiro Takamatsu is an associate professor at Tokyo University of Science, Chiba, Japan, and a researcher at the National Cancer Center, Chiba, Japan. He received his BS degree in physics from Tokyo University of Science in 2010 and his MS degree and PhD in engineering from Tokyo Institute of Technology, Yokohama, Japan, in 2011 and 2014, respectively. He was a postdoctoral researcher at Kobe University, Hyogo, Japan, from 2014 to 2018. |
Cancer
Tumors
Tissues
Hyperspectral imaging
Near infrared
Resection
Endoscopy