PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
Convolutional neural network is widely used in image fusion. However, the deep learning framework is only applied in some part of the fusion process in most existing methods. To generate a full end-to-end image fusion pipeline, a Yshaped Generator model based on Generative Adversarial Network for infrared and visible image fusion is proposed. The idea of this method is to establish an adversarial game between the generator and the discriminator. The generator consisting of two Pyramid networks and three convolutional layers works as an autoencoder to improve the characteristic information of the fused images. As for the discriminator, it adopts a network structure similar to the Visual Geometry Group (VGG) network. The loss function uses the ratio loss to control the trade-off among generation loss and reconstruction loss. Results on publicly available datasets demonstrate that our method can improve the quality of detail information and sharpen the edge of infrared targets.
Zhiqiang Yao,Huinan Guo, andLong Ren
"An improved fusion method of infrared and visible images based on FusionGAN", Proc. SPIE 11878, Thirteenth International Conference on Digital Image Processing (ICDIP 2021), 118781H (30 June 2021); https://doi.org/10.1117/12.2599559
ACCESS THE FULL ARTICLE
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
The alert did not successfully save. Please try again later.
Zhiqiang Yao, Huinan Guo, Long Ren, "An improved fusion method of infrared and visible images based on FusionGAN," Proc. SPIE 11878, Thirteenth International Conference on Digital Image Processing (ICDIP 2021), 118781H (30 June 2021); https://doi.org/10.1117/12.2599559