Organelle-based breast cancer cell classification with deep learning and visual explanations

Harrison Yee; Kailie Matteson; Joshua Goldwag; John M. Lamar; Margarida Barroso; Xavier Intes; Uwe Kruger

doi:10.1117/12.3002655

12 March 2024 Organelle-based breast cancer cell classification with deep learning and visual explanations

Harrison Yee, Kailie Matteson, Joshua Goldwag, John M. Lamar, Margarida Barroso, Xavier Intes, Uwe Kruger

Proceedings Volume 12846, Imaging, Manipulation, and Analysis of Biomolecules, Cells, and Tissues XXII; 1284604 (2024) https://doi.org/10.1117/12.3002655
Event: SPIE BiOS, 2024, San Francisco, California, United States

Abstract

Breast cancer cell analysis has traditionally focused on cell and intracellular organelle morphology. Recent research has demonstrated that organelle topology-based cancer cell classification is considerably more accurate when using handcrafted feature extraction and machine learning-based classifiers on fluorescent confocal microscopy images. However, feature extraction and classification through this methodology requires manual segmentation and computational organelle rendering. Herein, we employ convolutional neural networks (CNN) and Gradient-weighted Class Activation Mapping (GradCAM) for fast end-to-end classification and visual interpretation of confocal fluorescent microscopy images based on spatial organelle features. First, raw 3D images are filtered and preprocessed into 2D image patches for the CNN. To replicate feature analysis of the surface-surface contact area, marginal intermediate fusion CNN is implemented to classify each patch. GradCAM is then used post hoc to generate a representative heatmap of important areas used for classification. All relevant heatmap patches are then reconstructed based on the extraction of their respective patches to obtain an overall heatmap of the entire microscopy image. Furthermore, finer-grained heatmaps were obtained through the use of patch overlap and weighting during initial patch preprocessing. On a dataset consisting of 6 different breast cancer cell lines, this methodology resulted in a classification accuracy of 95.7% while also providing visualization of areas indicative of certain cancer cell lines. These findings demonstrate the efficacy of using deep learning and GradCAM for fast and interpretable organelle-based cancer cell classification.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Harrison Yee, Kailie Matteson, Joshua Goldwag, John M. Lamar, Margarida Barroso, Xavier Intes, and Uwe Kruger "Organelle-based breast cancer cell classification with deep learning and visual explanations", Proc. SPIE 12846, Imaging, Manipulation, and Analysis of Biomolecules, Cells, and Tissues XXII, 1284604 (12 March 2024); https://doi.org/10.1117/12.3002655

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available