Research on real-time video key frame extraction technology based on clustering

Nan Lin; Chang Xu; Yinan Xu; Jianhong Ma; Yangjie Cao; Jie Li

doi:10.1117/12.2624849

13 December 2021 Research on real-time video key frame extraction technology based on clustering

Nan Lin, Chang Xu, Yinan Xu, Jianhong Ma, Yangjie Cao, Jie Li

Proceedings Volume 12087, International Conference on Electronic Information Engineering and Computer Technology (EIECT 2021); 120872A (2021) https://doi.org/10.1117/12.2624849
Event: International Conference on Electronic Information Engineering and Computer Technology (EIECT 2021), 2021, Kunming, China

Abstract

A keyframe is a crucial image frame used to describe a shot, and the use of keyframe technology can significantly reduce the amount of data for video retrieval. For example,video-on-demand, face recognition under the camera, key lens retrieval of medical images, etc. Aiming at the problems in the current video keyframe extraction process that the extraction accuracy is low and cannot meet the real-time performance, this paper proposes a real-time video keyframe extraction algorithm CTM-NN based on the inter-frame difference method combined with clustering and neural network. The algorithm uses the inter-frame difference method based on the set threshold, HOG plus HSV first-order moment feature extraction algorithm, and uses the K-means++ clustering algorithm to finally train its own ResNet-50 model, aiming to accurately and efficiently extract real-time video Keyframes. In order to verify the algorithm proposed in this paper, experiments were carried out in the finished news video, landscape video, and real-time concrete mixing video. The experimental results show that the method proposed in this paper can meet the extraction accuracy and meet the keyframe extraction speed of the real-time video so that it can save the keyframes, automatically label while maintaining the time sequence. All in all, the CTM-NN algorithm proposed in this paper has achieved good results in the extraction and storage of real-time video keyframes

Citation Download Citation

Nan Lin, Chang Xu, Yinan Xu, Jianhong Ma, Yangjie Cao, and Jie Li "Research on real-time video key frame extraction technology based on clustering", Proc. SPIE 12087, International Conference on Electronic Information Engineering and Computer Technology (EIECT 2021), 120872A (13 December 2021); https://doi.org/10.1117/12.2624849

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available