Infrared-visible image fusion based on regional attention auto-encoder

Peng Wang; Sheng Huang; Huimin Liu; Peng Tian

doi:10.1117/12.2690400

6 November 2023 Infrared-visible image fusion based on regional attention auto-encoder

Peng Wang, Sheng Huang, Huimin Liu, Peng Tian

Proceedings Volume 12921, Third International Computing Imaging Conference (CITA 2023); 129212F (2023) https://doi.org/10.1117/12.2690400
Event: Third International Computing Imaging Conference (CITA 2023), 2023, Sydney, Australia

Abstract

The images captured by a single sensor are often limited. How to use multi-sensor images has important value. For example, the imaging conditions of visible camera are relatively harsh, while the infrared camera can operate in all-day and all-weather and has longer visual distance. For better visual presentation and subsequent perception tasks, we focused on the infrared and visible image fusion based on auto-encoder. Specifically, we proposed a fusion strategy based on regional attention and a multi-scale convolution layer. The fusion strategy based on regional attention divides a image into several regions and adopts different fusion strategy for different regions. Multi-scale convolution layer is to capture the features of different receptive fields and improve the semantic representation ability of the encoder. From detailed experimental results, we can see that the optimized fusion algorithm is more robust, reduces the sensitivity to the classifier, and keeps more textures of background.

Citation Download Citation

Peng Wang, Sheng Huang, Huimin Liu, and Peng Tian "Infrared-visible image fusion based on regional attention auto-encoder", Proc. SPIE 12921, Third International Computing Imaging Conference (CITA 2023), 129212F (6 November 2023); https://doi.org/10.1117/12.2690400

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available