Feedback strategy on real-time multiple target tracking in cognitive vision system

Jie Shao; Zhen Jia; Jianwei Zhao; Pei-Yuan Peng; Zhipeng Li; Fuqiang Liu

doi:10.1117/1.3630224

1 October 2011 Feedback strategy on real-time multiple target tracking in cognitive vision system

Jie Shao, Zhen Jia, Jianwei Zhao, Pei-Yuan Peng, Zhipeng Li, Fuqiang Liu

Author Affiliations +

Funded by: International Cooperation Project of Shanghai Science and Technology Committee, Science and Technology Department

Optical Engineering, Vol. 50, Issue 10, 107201 (October 2011). https://doi.org/10.1117/1.3630224

Abstract

Under pedestrian and vehicle mixed traffic conditions, the potential accident rate is high due to a complex traffic environment. In order to solve this problem, we present a real-time cognitive vision system. In the scene-capture level, foreground objects are extracted based on the combination of spatial and temporal information. Then, a coarse-to-fine algorithm is employed in tracking. After filtering-based normal tracking, problems of the target blob missing, merging, and splitting are resolved by the adaptive tracking modification method in fine tracking. For greater robustness, the key idea of our approach is adaptively adjusting the classification sensibility of each pixel by employing tracking results as feedback cues for target detection in the next frame. On the basis of the target trajectories, behavior models are evaluated according to a decision logic table in the behavior-evaluation level. The decision logic table is set based on rules of real scenes. The resulting system interprets different kinds of traffic behavior and warns in advance. Experiments show robust and accurate results of abnormality detection and forewarning under different conditions. All the experimental results run at real-time frame rates (⩾25 fps) on standard hardware. Therefore, the system is suitable for actual Intelligent Traffic System applications.

©(2011) Society of Photo-Optical Instrumentation Engineers (SPIE)

Citation Download Citation

Jie Shao, Zhen Jia, Jianwei Zhao, Pei-Yuan Peng, Zhipeng Li, and Fuqiang Liu "Feedback strategy on real-time multiple target tracking in cognitive vision system," Optical Engineering 50(10), 107201 (1 October 2011). https://doi.org/10.1117/1.3630224

Published: 1 October 2011

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE