A novel deep learning data structure for multispectral remote sensing images

Luca Bergamasco; Francesca Bovolo; Lorenzo Bruzzone

doi:10.1117/12.2571643

21 September 2020 A novel deep learning data structure for multispectral remote sensing images

Luca Bergamasco, Francesca Bovolo, Lorenzo Bruzzone

Proceedings Volume 11533, Image and Signal Processing for Remote Sensing XXVI; 115330N (2020) https://doi.org/10.1117/12.2571643
Event: SPIE Remote Sensing, 2020, Online Only

Abstract

Standard deep-learning (DL) architectures do not optimize the use of the spatial and spectral information in the multi-spectral images but often consider only one of the two components. Two-stream DL architectures split and process them separately. However, the fusing of the output of the two streams is a challenging task. 3D-CNN processes spatial and spectral information together at the cost of a large number of parameters. To overcome these limitations, we propose a novel DL data structure that re-organizes the spectral and spatial information in remote-sensing (RS) images and process them together. Representing a RS image I as a data cube, we handle the spatial and spectral information by reducing the spectral bands from N to M, where M can drop out to one. The spectral information is projected in the spatial dimensions and re-organized in 2-dimensional B blocks. The proposed approach analyzes the spectral information of each block by using 2-dimensional convolutional kernels of appropriate size and stride. The output represents the relationship between the spectral bands of the input image and preserves the spatial relationship between its neighboring pixels. The spatial relationships are analyzed by processing the output of the previous layer with standard 2D-CNNs. Experiments by using images acquired by Sentinel-2 and Landsat-8 data and the labels of the LUCAS database released in 2018 provide promising results.

Conference Presentation

Citation Download Citation

Luca Bergamasco, Francesca Bovolo, and Lorenzo Bruzzone "A novel deep learning data structure for multispectral remote sensing images", Proc. SPIE 11533, Image and Signal Processing for Remote Sensing XXVI, 115330N (21 September 2020); https://doi.org/10.1117/12.2571643

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available