HODET: Hybrid object detection and tracking using mmWave radar and visual sensors

Joseph St. Cyr; Joshua Vanderpool; Yu Chen; Xiaohua Li

doi:10.1117/12.2558272

22 April 2020 HODET: Hybrid object detection and tracking using mmWave radar and visual sensors

Joseph St. Cyr, Joshua Vanderpool, Yu Chen, Xiaohua Li

Proceedings Volume 11422, Sensors and Systems for Space Applications XIII; 114220I (2020) https://doi.org/10.1117/12.2558272
Event: SPIE Defense + Commercial Sensing, 2020, Online Only

Abstract

Image sensors have been explored heavily in automotive applications for collision avoidance and varying levels of autonomy. It requires a degree of brightness, therefore, the use of an image sensor in nighttime operation or dark conditions can be problematic along with challenging weather such as fog. Radar sensors have been employed to help cover the various environmental challenges with visible spectrum cameras. Edge computing technology has the potential to address a number of issues such as real-time processing requirements, off-loading of processing from congested servers, and size, weight, power, and cost (SWaP-C) constraints. This paper proposes a novel Hybrid Object DEtection and Tracking (HODET) using mmWave Radar and Visual Sensors at the edge. The HODET is a computing application of low SWaP-C electronics performing object detection, tracking and identification algorithms with the simultaneous use of image and radar sensors. While the machine vision camera alone could estimate the distance of an object, the radar sensor will provide an accurate distance and vector of movement. This additional data accuracy can be leveraged to further discriminate a detected object to protect against spoofing attacks. A real-world smart community public safety monitoring scenario is selected to verify the effectiveness of HODET, which detects, tracks objects of interests and identify suspicious activities. The experimental results demonstrate the feasibility of the approach.

Conference Presentation

Citation Download Citation

Joseph St. Cyr, Joshua Vanderpool, Yu Chen, and Xiaohua Li "HODET: Hybrid object detection and tracking using mmWave radar and visual sensors", Proc. SPIE 11422, Sensors and Systems for Space Applications XIII, 114220I (22 April 2020); https://doi.org/10.1117/12.2558272

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available