Multimodal information fusion of manufacturing digital industrial scene based on federated learning optimization algorithm

Jiao Han; Xiandong Meng; Tong Liu

doi:10.1117/12.3050123

11 December 2024 Multimodal information fusion of manufacturing digital industrial scene based on federated learning optimization algorithm

Jiao Han, Xiandong Meng, Tong Liu

Author Affiliations +

Proceedings Volume 13441, International Conference on Cloud Computing and Communication Engineering (CCCE 2024); 1344105 (2024) https://doi.org/10.1117/12.3050123
Event: International Conference on Cloud Computing and Communication Engineering (CCCE 2024), 2024, Nanjing, China

Abstract

The volume of data generated by the manufacturing industry has exploded at an exponential rate in structured, semi-structured and unstructured forms, increasing the risk of errors in the multi-modal data fusion process. To address this challenge, this study proposes an innovative multimodal information fusion strategy aimed at improving data processing capabilities in manufacturing digital industrial scenarios by integrating federated learning optimization algorithms. The multi-modal data in the digital industrial scene of manufacturing industry is collected and redundant components are eliminated. The feature information is extracted from the dimensionally reduced data and input into a multi-modal data fusion framework optimized by federated learning to generate a tensor integrating three key features. The fuzzy set theory is used to guide the local decision process of each module in the framework, and the fuzzy membership degree corresponding to the multi-modal information is calculated to realize the multi-modal information fusion effectively. The experimental results show that the information fusion degree of this method is not less than 0.35, and the fused information has high integrity and consistency. In most cases, the fusion error can be significantly reduced.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Jiao Han, Xiandong Meng, and Tong Liu "Multimodal information fusion of manufacturing digital industrial scene based on federated learning optimization algorithm", Proc. SPIE 13441, International Conference on Cloud Computing and Communication Engineering (CCCE 2024), 1344105 (11 December 2024); https://doi.org/10.1117/12.3050123

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Information fusion

Manufacturing

Data fusion

Industry

Mathematical optimization

Feature extraction

Data processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years