Infrared and visible images fusion method based on unsupervised learning

Depeng Zhu; Weida Zhan; Yichung Jiang; Xiaoyu Xu; Renzhong Guo; Yu Chen

doi:10.1117/12.2644227

12 October 2022 Infrared and visible images fusion method based on unsupervised learning

Depeng Zhu, Weida Zhan, Yichung Jiang, Xiaoyu Xu, Renzhong Guo, Yu Chen

Proceedings Volume 12342, Fourteenth International Conference on Digital Image Processing (ICDIP 2022); 123422I (2022) https://doi.org/10.1117/12.2644227
Event: Fourteenth International Conference on Digital Image Processing (ICDIP 2022), 2022, Wuhan, China

Abstract

Aiming at the problem that the current infrared and visible image fusion based on deep learning has no labels, this paper proposes an infrared and visible image fusion algorithm based on unsupervised learning. This method utilizes the characteristics of unsupervised learning, and introduces infrared image information with high gray value into the visible image to obtain the fusion image. The deep learning network proposed in this paper is composed of 6 layers of convolution blocks, and a dual attention module is also designed to make the fusion image pay more attention to the high gray value area in the infrared image. By introducing skip connections, the shallow features are fused with the deep features, so that the details of the entire fused image are richer and the appearance of halos is reduced. A large number of experimental results show that the fusion method proposed in this paper can accurately highlight the target object while maintaining the visible texture details, enhance the visual effect of the human eye, and improve the target recognition. At the same time, the quantitative experimental results show that the fusion algorithm proposed in this paper has obvious advantages in multiple indicators.

Citation Download Citation

Depeng Zhu, Weida Zhan, Yichung Jiang, Xiaoyu Xu, Renzhong Guo, and Yu Chen "Infrared and visible images fusion method based on unsupervised learning", Proc. SPIE 12342, Fourteenth International Conference on Digital Image Processing (ICDIP 2022), 123422I (12 October 2022); https://doi.org/10.1117/12.2644227

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image fusion

Infrared imaging

Infrared radiation

Visible radiation

Machine learning

Image processing

Convolution

Show All Keywords

Keywords/Phrases

Search In:

Publication Years