A big data storage technology based on domestic autonomous controllable characteristics

Xiangzhen Li; Ping Huang; Zehao Wang; Qiujie Zhang; Kan Zhou; Peng Zhang

doi:10.1117/12.3047783

13 December 2024 A big data storage technology based on domestic autonomous controllable characteristics

Xiangzhen Li, Ping Huang, Zehao Wang, Qiujie Zhang, Kan Zhou, Peng Zhang

Proceedings Volume 13499, AOPC 2024: Optical Devices and Integration; 134990N (2024) https://doi.org/10.1117/12.3047783
Event: Applied Optics and Photonics China 2024 (AOPC2024), 2024, Beijing, China

Abstract

In view of the characteristics of the target product, such as diverse feature data types, huge capacity, and large number of unstructured and semi-structured data, based on the domestic autonomous controllable platform, we adopt the hybrid storage architecture of massive feature data files combining relational database and Hadoop, and use relational database to store structured feature data. The Hadoop cluster is used to store semi-/ unstructured data, make up for the shortcomings of relational databases in mass data processing and storage, and achieve high concurrent access to big data of target products and scalability of heterogeneous data.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Xiangzhen Li, Ping Huang, Zehao Wang, Qiujie Zhang, Kan Zhou, and Peng Zhang "A big data storage technology based on domestic autonomous controllable characteristics", Proc. SPIE 13499, AOPC 2024: Optical Devices and Integration, 134990N (13 December 2024); https://doi.org/10.1117/12.3047783

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available