Video-based violence detection by human action analysis with neural network

Yunqing Zhao; Wilton W. T. Fok; C. W. Chan

doi:10.1117/12.2543564

27 November 2019 Video-based violence detection by human action analysis with neural network

Yunqing Zhao, Wilton W. T. Fok, C. W. Chan

Proceedings Volume 11321, 2019 International Conference on Image and Video Processing, and Artificial Intelligence; 113212N (2019) https://doi.org/10.1117/12.2543564
Event: The Second International Conference on Image, Video Processing and Artifical Intelligence, 2019, Shanghai, China

Abstract

In recent years, human action analysis is a focal point in video processing, especially on action recognition and safety surveillance. It always performs as an auxiliary tool to minimize the manpower-resource on special tasks. This paper explores the human action analysis in a specified situation, based on the human posture extraction by pose-estimation algorithm. Deep neural network (DNN) methods was used, composed of residual learning blocks for feature extraction and recurrent neural network for time-series data learning. All these modules can be applied on real-time videos, classifying different security levels of actions between two people, with 91.8% accuracy on test set. Meanwhile, some other classical network structures were compared as baselines. After forward inference process of the neural network model, a logic enhancement algorithm was raised and applied in this paper, due to the prediction error between two classes. Experiments were conducted on real-time videos, achieving satisfying performance.

Citation Download Citation

Yunqing Zhao, Wilton W. T. Fok, and C. W. Chan "Video-based violence detection by human action analysis with neural network", Proc. SPIE 11321, 2019 International Conference on Image and Video Processing, and Artificial Intelligence, 113212N (27 November 2019); https://doi.org/10.1117/12.2543564

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available