Design and implementation of a distributed timing task scheduling system based on loosely coupled architecture

Peng Liu; Chunyu Deng; Dazhong Wang

doi:10.1117/12.2685361

21 July 2023 Design and implementation of a distributed timing task scheduling system based on loosely coupled architecture

Peng Liu, Chunyu Deng, Dazhong Wang

Author Affiliations +

Proceedings Volume 12717, 3rd International Conference on Artificial Intelligence, Automation, and High-Performance Computing (AIAHPC 2023); 1271729 (2023) https://doi.org/10.1117/12.2685361
Event: 3rd International Conference on Artificial Intelligence, Automation, and High-Performance Computing (AIAHPC 2023), 2023, Wuhan, China

Abstract

This paper implements Timing-Go, a distributed timed task scheduling system based on a loosely coupled architecture, which solves the problems of poor manageability, poor parallel processing capability, poor task scheduling capability and poor availability of existing timed task scheduling schemes. The system implements the automatic task registration mechanism through Java annotation technology, designs the task visualization management platform, and improves the efficiency of task management; proposes a timing task scheduling trigger scheme based on Quartz core elements, realizes the decoupling of scheduling process and execution process, and improves the performance of timing task scheduling; extends the functions of Quartz scheduling framework, introduces the workflow hierarchical processing mechanism of DAG model and the large task parallel processing mechanism based on consistency Hash algorithm, and improves the execution efficiency of timing tasks. Meanwhile, this paper also proposes a distributed synchronization control mechanism and a series of compensation mechanisms to guarantee the high availability of system operation and task execution. The Timing-Go system implemented in this paper has good performance and scalability, and its effectiveness has been verified by testing.

Citation Download Citation

Peng Liu, Chunyu Deng, and Dazhong Wang "Design and implementation of a distributed timing task scheduling system based on loosely coupled architecture", Proc. SPIE 12717, 3rd International Conference on Artificial Intelligence, Automation, and High-Performance Computing (AIAHPC 2023), 1271729 (21 July 2023); https://doi.org/10.1117/12.2685361

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available