Abstract
In this paper, reinforcement learning (RL) with PID control is used to design the balance and self-control system to verify the feasibility of RL technology in this field. We can use straight line command and turn command via WiFi interface to control the robot. Thus the robot acts according to the received command.
The system is divided into three parts: sensing module, learning control module and motor drive module. A Q-Learning algorithm is implemented by learning control module using ARM A8 embedded platform. The sensing module contains an accelerometer (ADXL345) and a gyroscope (L3G4200D) that senses the current tilt angle and angular velocity of robot. Rely on the Q-learning algorithm which based on the input data from sensing module, an optimal response control is derived in motor driving control. The realization results shown that the two-wheel robot can back to balance within 2 ms once it goes to unbalance state.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction, pp. 340. MIT Press, Cambridge, September 1998
Thao, N.G.M., Nghia, D.H., Phuc, N.H.: A PID backstepping controller for two-wheeled self-balancing robot. In: International Forum on Strategic Technology 2010, pp. 76–81, October 2010
Wu, J., Zhang, W.: Design of fuzzy logic controller for two-wheeled self-balancing robot. In: Proceedings of 2011 6th International Forum on Strategic Technology, pp. 1266–1270, August 2011
Ruan, X., Cai, J., Chen, J.: Learning to control two-wheeled self-balancing robot using reinforcement learning rules and fuzzy neural networks. In: Fourth International Conference on Natural Computation, ICNC 2008, pp. 395–398, October 2008
Chang, C.L., Chang, S.Y.: Using reinforcement learning to achieve two wheeled self balancing control. In: International Computer Symposium (ICS), pp. 104–107, 20 February 2017
Pratama, D, Binugroho, E.H., Ardilla, F.: Movement control of two wheels balancing robot using cascaded PID controller. In: International Electronics Symposium (IES), pp. 94–99, September 2015
Ciężkowski, M., Pawłuszewicz, E.: Determination of interactions between two-wheeled self-balancing vehicle and its rider. In: 20th International Conference on Methods and Models in Automation and Robotics (MMAR), pp. 851–855, August 2015
Tseng, S.P., Li, W.L., Sheng, C.Y., Hsu, J.W., Chen, C.S.: Motion and attitude estimation using inertial measurements with complementary filter. In: Control Conference (ASCC), May 2011
Colton, S.: The Balance Filter. Massachusetts Institute of Technology, Technical Report (2007)
Xie, R., Cao, J.: Accelerometer-Based hand gesture recognition by neural network and similarity matching. IEEE Sens. J., 4537–4545, March 2016
ReinforcementLearning. https://en.wikipedia.org/wiki/Reinforcement_learning
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Chang, CL., Liou, KH. (2019). Reinforcement Learning-Based Two-Wheel Robot Control. In: Pan, JS., Ito, A., Tsai, PW., Jain, L. (eds) Recent Advances in Intelligent Information Hiding and Multimedia Signal Processing. IIH-MSP 2018. Smart Innovation, Systems and Technologies, vol 110. Springer, Cham. https://doi.org/10.1007/978-3-030-03748-2_40
Download citation
DOI: https://doi.org/10.1007/978-3-030-03748-2_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-03747-5
Online ISBN: 978-3-030-03748-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)