Multi-spectral fusion network for full-time robust pedestrian detection

PengLiang Wang; LeJie Zhou; MingJian Xiao; Pu Zhang

doi:10.1117/12.2624749

13 December 2021 Multi-spectral fusion network for full-time robust pedestrian detection

PengLiang Wang, LeJie Zhou, MingJian Xiao, Pu Zhang

Proceedings Volume 12087, International Conference on Electronic Information Engineering and Computer Technology (EIECT 2021); 120870N (2021) https://doi.org/10.1117/12.2624749
Event: International Conference on Electronic Information Engineering and Computer Technology (EIECT 2021), 2021, Kunming, China

Abstract

An enhanced YOLOv4 multi-spectral fusion pedestrian detection approach is proposed to address the problem of fusion network robustness in pedestrian detection. This method can effectively and accurately complete pedestrian detection. First, the feature extraction backbone is upgraded, and channel attention Module CAM and spatial attention Module SAM are added to the feature extraction backbone to allow for adaptive feature layer adjustment. Fusion processing based on channel and pixel direction is performed on the altered feature layer, and then the fusion layer is anticipated. The experiment is performed on the KAIST Dataset, and the capacity to generalize was assessed using the OTCBVS Benchmark Dataset. The proposed multi-spectral fusion detection approach is effective, according to the experimental results. The log-average miss rate (MR) reaches 11.03 and 8.79 throughout the full day and night when the false positive per image (FPPI) is 10-2~100 , and it also achieves good detection performance during the day. The proposed multi-spectral fusion detection approach is universal in various data sets, according to the generalization ability analysis experiment. Pedestrian detection accuracy may be accomplished adaptively regardless of whether it is daytime or nighttime detection, and speed is substantially enhanced.

Citation Download Citation

PengLiang Wang, LeJie Zhou, MingJian Xiao, and Pu Zhang "Multi-spectral fusion network for full-time robust pedestrian detection", Proc. SPIE 12087, International Conference on Electronic Information Engineering and Computer Technology (EIECT 2021), 120870N (13 December 2021); https://doi.org/10.1117/12.2624749

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available