Paper
13 December 2024 Deep learning-based multispectral fusion for low-light color imaging
Dongliang Chen, Hongxing Cai, Yu Ren, Tingting Wang, Dongliang Li, Jianwei Zhou, Yangyang Hua
Author Affiliations +
Proceedings Volume 13502, AOPC 2024: AI in Optics and Photonics; 135020I (2024) https://doi.org/10.1117/12.3047671
Event: Applied Optics and Photonics China 2024 (AOPC2024), 2024, Beijing, China
Abstract
In low light conditions, color (RGB) images taken by cameras contain a lot of noise and loss of detail and color. However, multispectral images can provide spectral information, which can be fused by neural network models . In this paper, an improved U-Net model is proposed for multi-spectral image fusion to achieve color imaging in low illumination environment. The U-Net model is a symmetric convolutional neural network that helps extract and combine features at various image scales. Our improved U-Net model integrates residual blocks and attention mechanisms, utilizing multilevel feature extraction and contextual information fusion to significantly enhance imaging quality. To meet the requirements of low-light conditions, the model design incorporates a multi-scale feature fusion strategy, bolstering robustness against weak light and noise. We conducted multiple experiments at different light levels to validate the effectiveness of the model. The quality of the fused color images was evaluated with objective assessment metrics such as peak signal-to-noise ratio (PSNR), structural similarity index (SSIM) and chromatic aberration (ΔE). The experimental results demonstrated the effectiveness of the proposed method, which can generate color images with high color reproduction and rich detail under low light conditions. Compared to traditional methods, our approach shows substantial improvements in image clarity, noise suppression, and color authenticity, indicating significant practical value. In summary, this study combines deep learning with multispectral image fusion to propose an effective method for low-light color imaging. It offers new insights and technical solutions for addressing low-light imaging challenges in practical applications.
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Dongliang Chen, Hongxing Cai, Yu Ren, Tingting Wang, Dongliang Li, Jianwei Zhou, and Yangyang Hua "Deep learning-based multispectral fusion for low-light color imaging", Proc. SPIE 13502, AOPC 2024: AI in Optics and Photonics, 135020I (13 December 2024); https://doi.org/10.1117/12.3047671
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image fusion

Multispectral imaging

RGB color model

Color imaging

Image quality

Light sources and illumination

Color difference

Back to Top