Exploring inter-frame correlation analysis and wavelet-domain modeling for real-time caption detection in streaming video

Jia Li; Yonghong Tian; Wen Gao

doi:10.1117/12.759571

28 January 2008 Exploring inter-frame correlation analysis and wavelet-domain modeling for real-time caption detection in streaming video

Jia Li, Yonghong Tian, Wen Gao

Author Affiliations +

Proceedings Volume 6822, Visual Communications and Image Processing 2008; 68220F (2008) https://doi.org/10.1117/12.759571
Event: Electronic Imaging, 2008, San Jose, California, United States

Abstract

In recent years, the amount of streaming video has grown rapidly on the Web. Often, retrieving these streaming videos offers the challenge of indexing and analyzing the media in real time because the streams must be treated as effectively infinite in length, thus precluding offline processing. Generally speaking, captions are important semantic clues for video indexing and retrieval. However, existing caption detection methods often have difficulties to make real-time detection for streaming video, and few of them concern on the differentiation of captions from scene texts and scrolling texts. In general, these texts have different roles in streaming video retrieval. To overcome these difficulties, this paper proposes a novel approach which explores the inter-frame correlation analysis and wavelet-domain modeling for real-time caption detection in streaming video. In our approach, the inter-frame correlation information is used to distinguish caption texts from scene texts and scrolling texts. Moreover, wavelet-domain Generalized Gaussian Models (GGMs) are utilized to automatically remove non-text regions from each frame and only keep caption regions for further processing. Experiment results show that our approach is able to offer real-time caption detection with high recall and low false alarm rate, and also can effectively discern caption texts from the other texts even in low resolutions.

Citation Download Citation

Jia Li, Yonghong Tian, and Wen Gao "Exploring inter-frame correlation analysis and wavelet-domain modeling for real-time caption detection in streaming video", Proc. SPIE 6822, Visual Communications and Image Processing 2008, 68220F (28 January 2008); https://doi.org/10.1117/12.759571

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available