Fusion of multiple deep convolutional neural networks (DCNNs) for improved segmentation of lung nodules in CT images

Yifan Wang; Chuan Zhou; Heang-Ping Chan; Lubomir M. Hadjiiski; Aamer Chughtai

doi:10.1117/12.2612360

4 April 2022 Fusion of multiple deep convolutional neural networks (DCNNs) for improved segmentation of lung nodules in CT images

Yifan Wang, Chuan Zhou, Heang-Ping Chan, Lubomir M. Hadjiiski, Aamer Chughtai

Author Affiliations +

Proceedings Volume 12033, Medical Imaging 2022: Computer-Aided Diagnosis; 1203329 (2022) https://doi.org/10.1117/12.2612360
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Abstract

We are developing DCNN-based methods for the segmentation of lung nodules of a wide variety of sizes, shapes, and margins. In this study, we developed several fusion methods for hybridizing multiple DCNNs with different structures to improve segmentation accuracy. Two groups of fusion methods that combined the output information from our previously designed shallow and deep U-shape based deep learning models (U-DL) were compared. Group-1 denotes the late fusion (LF) methods that concatenated the feature maps output from the last layers (before a sigmoid activation layer) of the two U-DLs. Group-2 denotes early fusion (EF) methods that combined multi-scale output information from the encoders and decoders, or decoders alone, of the two U-DLs. A set of 883 cases from the LIDC-IDRI database which contained lung nodules manually marked by at least two radiologists was selected for this study. We split the data into 683 training and validation and 200 independent test cases. The multiple DCNNs with the fusion method were trained simultaneously and end-to-end. The baseline LF-1 method using pre-defined thresholds achieved an average DICE coefficient of 0.718±0.159. The newly developed LF method using Squeeze and Excitation Attention Block (SEAB) followed by a sigmoid activation layer (LF-4), and two Convolutional Block Attention Modules (CBAM) based EF methods that combined multiscale information from the decoders alone (EF-2) or from both the encoders and decoders (EF-3) of the two U-DLs, achieved significantly (p<0.05) better performance with average DICE coefficients of 0.745±0.135, 0.745±0.142, and 0.747±0.142, respectively.

Citation Download Citation

Yifan Wang, Chuan Zhou, Heang-Ping Chan, Lubomir M. Hadjiiski, and Aamer Chughtai "Fusion of multiple deep convolutional neural networks (DCNNs) for improved segmentation of lung nodules in CT images", Proc. SPIE 12033, Medical Imaging 2022: Computer-Aided Diagnosis, 1203329 (4 April 2022); https://doi.org/10.1117/12.2612360

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
4 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image segmentation

Lung

Computed tomography

Image fusion

Lung cancer

Computer programming

Convolutional neural networks

Show All Keywords

Keywords/Phrases

Search In:

Publication Years