An improved deep reinforcement learning for robot navigation

Qifeng Zheng; Xiaogang Huang; Chen Dong; Yuting Liu; Dong Chen

doi:10.1117/12.2675144

25 May 2023 An improved deep reinforcement learning for robot navigation

Qifeng Zheng, Xiaogang Huang, Chen Dong, Yuting Liu, Dong Chen

Proceedings Volume 12636, Third International Conference on Machine Learning and Computer Application (ICMLCA 2022); 126360Q (2023) https://doi.org/10.1117/12.2675144
Event: Third International Conference on Machine Learning and Computer Application (ICMLCA 2022), 2022, Shenyang, China

Abstract

Collision-free navigation is an important research direction for multi-robot systems, in which the two core problems are navigating to the target point and avoiding other robots. Many researchers use deep reinforcement learning as navigation strategy to realize multi-robot collision avoidance navigation. However, most of them use raw sensor information or global state information of the agent as the neural network input, which is not conducive to extending the navigation strategy to a larger space. This paper proposes an improved deep reinforcement learning navigation strategy, which enables robots to learn navigation and collision avoidance strategies more accurately. This strategy converts the interactive environment state from the global coordinate representation to the relative vector representation, and attenuates the influence of the rear irrelevant agents on the collision avoidance strategy. Experimental results show that the proposed method outperforms existing learning-based methods in three indicators: success rate, additional time to reach the target, and model convergence speed.

Citation Download Citation

Qifeng Zheng, Xiaogang Huang, Chen Dong, Yuting Liu, and Dong Chen "An improved deep reinforcement learning for robot navigation", Proc. SPIE 12636, Third International Conference on Machine Learning and Computer Application (ICMLCA 2022), 126360Q (25 May 2023); https://doi.org/10.1117/12.2675144

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available