Improved YOLOv5 for skeleton-based classroom behavior recognition

Wentian Niu; Xin Sun; Kaixiang Yi

doi:10.1117/12.2655940

12 January 2023 Improved YOLOv5 for skeleton-based classroom behavior recognition

Wentian Niu, Xin Sun, Kaixiang Yi

Proceedings Volume 12509, Third International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI 2022); 125090I (2023) https://doi.org/10.1117/12.2655940
Event: Third International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI 2022), 2022, Guangzhou, China

Abstract

Classroom behavior is an important criterion for evaluating instructional efficacy. In comparison to other behaviors, the challenge of classroom behavior detection is primarily influenced by ambient light variables and the presence of too many targets to recognize, resulting in missed detection. Recent research has demonstrated that information about the human skeleton can be used to identify classroom conduct. As a result, we present an enhanced yolov5-based skeletal recognition system for detecting classroom behavior in this paper. First, the YOLOv5 detection algorithm is improved to extract target prospects for the problem of missed detection; then, the human skeleton information is obtained using the Alphapose framework; finally, the skeletal data is sent into a two-stream adaptive graph convolution network to allow for the accurate recognition of various classroom behaviors. According to extensive tests, the detection algorithm based on bone recognition improves detection accuracy and lowers the false detection rate.

Citation Download Citation

Wentian Niu, Xin Sun, and Kaixiang Yi "Improved YOLOv5 for skeleton-based classroom behavior recognition", Proc. SPIE 12509, Third International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI 2022), 125090I (12 January 2023); https://doi.org/10.1117/12.2655940

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available