Skeleton-based baseball pitch classification on broadcast videos

Sergio Huesca-Flores; Gibran Benitez-Garcia; Mariko Nakano-Miyatake; Hiroki Takahashi

doi:10.1117/12.3057901

5 February 2025 Skeleton-based baseball pitch classification on broadcast videos

Sergio Huesca-Flores, Gibran Benitez-Garcia, Mariko Nakano-Miyatake, Hiroki Takahashi

Author Affiliations +

Proceedings Volume 13510, International Workshop on Advanced Imaging Technology (IWAIT) 2025; 135100T (2025) https://doi.org/10.1117/12.3057901
Event: International Workshop on Advanced Imaging Technology (IWAIT) 2025, 2025, Douliu City, Taiwan

Abstract

In baseball, accurate pitch type classification is essential for strategic decision-making by teams and analysts. Traditional methods rely heavily on ball trajectory tracking using radar and high-speed cameras, which are costly and accessible only in professional leagues. In contrast, this paper presents a skeleton-based approach to classify pitch types using pose estimation and spatial-temporal modeling. We extract key joint coordinates of the pitcher using OpenPose and model their body movements over time using a Spatial-Temporal Graph Convolutional Network (ST-GCN). Our method is evaluated on the publicly available MLB-YouTube dataset, achieving 68.2% accuracy in classifying six pitch types, and outperforming state-of-the-art methods that rely on full-frame data with 3D CNNs. By focusing exclusively on pitcher’s skeletal information through graph-based modeling, our approach improves classification performance, while showing robustness in binary tasks, reaching 85.7% accuracy for fastball detection and 80.8% distinguishing fast versus slow pitches. Our method’s performance underscores the effectiveness of relying on body mechanics for pitch classification, demonstrating that accurate results can be achieved without the need for costly ball trajectory data.

(2025) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Sergio Huesca-Flores, Gibran Benitez-Garcia, Mariko Nakano-Miyatake, and Hiroki Takahashi "Skeleton-based baseball pitch classification on broadcast videos", Proc. SPIE 13510, International Workshop on Advanced Imaging Technology (IWAIT) 2025, 135100T (5 February 2025); https://doi.org/10.1117/12.3057901

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Mechanics

Video

Matrices

Pose estimation

Convolution

Modeling

Motion analysis

Show All Keywords

Keywords/Phrases

Search In:

Publication Years