The development of a multi-band handheld fusion camera

Duncan L. Hickman

doi:10.1117/12.2533044

9 October 2019 The development of a multi-band handheld fusion camera

Duncan L. Hickman

Proceedings Volume 11159, Electro-Optical and Infrared Systems: Technology and Applications XVI; 111590D (2019) https://doi.org/10.1117/12.2533044
Event: SPIE Security + Defence, 2019, Strasbourg, France

Abstract

A longwave infrared (LWIR) handheld surveillance camera has been modified through the addition of a second sensor which provides both visible (RGB) and near-infrared (NIR) image streams. The challenges and constraints imposed on the development process of this Handheld Fusion Camera (HHFC) are described, and the approach to the dual and tri-band image fusion processing schemes is presented. The physical characteristics of the existing camera acted as a major constraint on the HHFC design with the Size, Weight, and Power (SWaP) requirements restricting the choice of both the additional sensor as well as the processor engine available within the camera. The primary use of the HHFC is in groundbased security and surveillance operations which is challenging in terms of variability in the scene content. Establishing an effective processing architecture is critical to both image interpretability by the user, and operational effectiveness. The HHFC allows the user to view different image streams including enhanced single-band image data as well as both dual and tri-band fused imagery. Such flexibility allows the user to select the best imagery for their immediate requirements. Power consumption and latency figures have been minimised by the use of relatively simple arithmetical fusion algorithms combined with an Adaptive Weight Map (AWM) for regional-based optimisation. In practice, the potential performance gain achieved is necessarily limited by the required performance robustness, and this trade-off was critical to the HHFC design and the final image processing solution.

Conference Presentation

Citation Download Citation

Duncan L. Hickman "The development of a multi-band handheld fusion camera", Proc. SPIE 11159, Electro-Optical and Infrared Systems: Technology and Applications XVI, 111590D (9 October 2019); https://doi.org/10.1117/12.2533044

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available