Abstract
The supervisory control of multi-DOF robots by humans is a demanding application. If a single operator is tasked with direct control of a humanoid robot, performing coordinated tasks becomes non-intuitive and corresponds to unsustainable mental loads even for the most skilled operators. In this paper we use reinforcement learning to adaptively change the interface mapping from the operator user interface to the robot in such a way as to reduce the associated operator mental load. Based on the results of the interaction with the robot, we change the dynamical map describing the relationship between user commands and robot actions. The contribution of this paper is the adaptation of the interface map using reinforcement learning with reward functions associated with quantitative performance metrics. We present promising experimental results showing that the use of the proposed scheme can result in an easier to use interface map for a multi-DOF assistive robot controlled via a brain activity sensor.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Steinfeld, A., Fong, T., Kaber, D., Lewis, M., Scholtz, J., Schultz, A., Goodrich, M.: Common metrics for human-robot interaction. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction, HRI 2006, pp. 33–40. ACM, New York (2006)
Drury, J., Scholtz, J., Yanco, H.: Awareness in human-robot interactions. In: IEEE International Conference on Systems, Man and Cybernetics, vol. 1, pp. 912–918 (October 2003)
Donmez, B., Pina, P.E., Cummings, M.L.: Evaluation criteria for human-automation performance metrics. In: Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems, PerMIS 2008, pp. 77–82. ACM, New York (2008)
Bechar, A., Edan, Y., Meyer, J.: An objective function for performance measurement of human-robot target recognition systems in unstructured environments. In: 2004 IEEE International Conference on Systems, Man and Cybernetics, vol. 1, pp. 118–123 (October 2004)
Maida, J.C., Bowen, C.K., Pace, J.: Improving robotic operator performance using augmented reality. In: Human Factors and Ergonomics Society Annual Meeting Proceedings, September 1, vol. 51, pp. 1635–1639(5) (2007)
Goodrich, M., Olsen Jr., D.R.: Seven principles of efficient human robot interaction. In: IEEE International Conference on Systems, Man and Cybernetics, vol. 4, pp. 3942–3948 (October 2003)
Saleh, J., Karray, F.: Towards generalized performance metrics for human-robot interaction. In: 2010 International Conference on Autonomous and Intelligent Systems (AIS), pp. 1–6 (June 2010)
Itoh, K., Miwa, H., Nukariya, Y., Zecca, M., Takanobu, H., Roccella, S., Carrozza, M., Dario, P., Takanishi, A.: Development of a bioinstrumentation system in the interaction between a human and a robot. In: 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2620–2625 (October 2006)
Iturrate, I., Montesano, L., Minguez, J.: Robot reinforcement learning using eeg-based reward signals. In: 2010 IEEE International Conference on Robotics and Automation (ICRA), pp. 4822–4829 (May 2010)
Theodorou, E., Buchli, J., Schaal, S.: Reinforcement learning of motor skills in high dimensions: A path integral approach. In: 2010 IEEE International Conference on Robotics and Automation (ICRA), pp. 2397–2403 (May 2010)
Hester, T., Quinlan, M., Stone, P.: Generalized model learning for reinforcement learning on a humanoid robot. In: 2010 IEEE International Conference on Robotics and Automation (ICRA), pp. 2369–2374 (May 2010)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction, 1st edn. MIT Press, Cambridge (1998)
Kanajar, P., Ranatunga, I., Rajruangrabin, J., Popa, D.O., Makedon, F.: Neptune: assistive robotic system for children with motor impairments. In: Proceedings of the 4th International Conference on PErvasive Technologies Related to Assistive Environments, PETRA 2011, pp. 59:1–59:6. ACM, New York (2011)
Rajruangrabin, J., Popa, D.: Robot head motion control with an emphasis on realism of neck-eye coordination during object tracking. Journal of Intelligent & Robotic Systems 63, 163–190 (2011), 10.1007/s10846-010-9468-x
Setz, C., Arnrich, B., Schumm, J., La Marca, R., Troster, G., Ehlert, U.: Discriminating stress from cognitive load using a wearable eda device. IEEE Transactions on Information Technology in Biomedicine 14(2), 410–417 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rajruangrabin, J., Ranatunga, I., Popa, D.O. (2012). Adaptive Interface Mapping for Intuitive Teleoperation of Multi-DOF Robots. In: Herrmann, G., et al. Advances in Autonomous Robotics. TAROS 2012. Lecture Notes in Computer Science(), vol 7429. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32527-4_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-32527-4_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32526-7
Online ISBN: 978-3-642-32527-4
eBook Packages: Computer ScienceComputer Science (R0)