Bending obstacles when moving a mobile robot
https://doi.org/10.21122/2309-4923-2023-1-4-9
Abstract
The issues of modeling when navigating around obstacles of a mobile robot using machine learning methods are considered: Q-learning, SARSA algorithm, deep Q-learning and double deep Q-learning. The developed software includes the Mobile Robotics Simulation Toolbox, Reinforcement Learning Toolbox, and the Gazebo visualization package for environment simulation. The results of the computational experiment show that for a simulated environment with a size of 17 by 17 cells and an obstacle 12 cells long, training using the SARSA algorithm occurs with better performance than for the others.
An algorithm for avoiding obstacles without the use of machine learning is proposed, and it was shown that the speed of avoiding obstacles using this algorithm is higher than the learning speed using deep Q-learning and double deep Q-learning, but lower than using the SARSA and Q-learning algorithms. . For the proposed algorithm, a numerical experiment was carried out using the robot movement simulation environment in Gazebo 11 and it was shown that cubic obstacles are being avoided faster than cylindrical ones.
About the Authors
A. V. Sidorenko
Belarusian State University
Belarus
Minsk
Belarus
Minsk
N. A. Saladukha
Belarusian State University
Belarus
Minsk
Belarus
Minsk
References
1. Nazarova, A.V. Methods and algorithms for multi-agent control of robotic system / A.V. Nazarova, T.P. Ryzhova // Vestnik MGTU im. N.E. Baumana. Ser. Priborostroenie. ‒ 2012. ‒ Spec. iss. 6 : Robototekhnicheskie sistemy. ‒ P. 93-105.
2. Fu Yiuwi. Neural Network-Based Learning from Demonstration of an Autonomous Ground Robot / Yiuwi Fu [et al.] // Machines. ‒ 2019. ‒ Vol. 7, № 2. ‒ P. 1-14.
3. Altuntas N. Reinforcement learning based mobile robot navigation / N. Altuntas [et al.] // Turkish Journal of electrical engineering & Computer sciences. ‒ 2016. ‒ Vol. 24, № 3. ‒ P. 1747-1767.
4. Sidorenko, A.V. Machine learning in mobile robot movement / A.V. Sidorenko, M.A. Saladukha // Computer technology and data analysis (CTDA’2022) : materials of III Intern. sci.-pract. conf., Minsk, 21–22 apr. 2022 y. / Belarusian state university; ed.: V.V. Skakun (main ed.) [et al.]. – Minsk : RIVSH, 2022. – P. 68-72.
5. Description of Reinforcement Learning Toolbox [Electronic resourse]. – Access: https://www.mathworks.com/help/reinforcement-learning/index.html?s_tid=CRUX_lftnav – Access date: 11.03.2023.
6. Description of Mobile Robotics Simulation Toolbox [Electronic resourse]. – Access: https://www.mathworks.com/matlabcentral/fileexchange/66586-mobile-robotics-simulation-toolbox – Access date: 11.03.2023.
7. Description of ROS Toolbox [Electronic resourse]. – Access: https://www.mathworks.com/products/ros.html – Access date: 11.03.2023.
8. GitHub [Electronic resourse]. – Access: https://github.com/MikitaSaladukha/ROSproject – Access date: 11.03.2023.
Review
For citations:
Sidorenko A.V., Saladukha N.A. Bending obstacles when moving a mobile robot. «System analysis and applied information science». 2023;(1):4-9. (In Russ.) https://doi.org/10.21122/2309-4923-2023-1-4-9
Views:
331
Email this article 