Abstract
Regardless of the application area, one of the common problems tackled in humanoid robotics is the investigation towards understanding of human-like information processing and the underlying mechanisms of the human brain in dealing with the real world. Therefore, we are building humanoid robots with complex and rich sensorimotor capabilities as the most suitable experimental platform for studying cognitive information processing. The target system is supposed to interact and function together with humans. It is meant to be able to cooperate and to enter a dialogue with them. Therefore it needs to understand both what it perceives and what it does. To achieve this goal we are following a holistic approach and investigating how different partial results, achieved in sub-disciplines related to the development of humanoids, fit together to achieve complete processing models and integrative system architectures, and how to evaluate results at system level rather than focusing on the performance of component algorithms. In this paper we present our recent and current progress in this direction. For doing so, we present our work on the development of humanoid platforms, the programming of grasping and manipulation tasks, the multi-sensory object exploration as well as the learning of motor knowledge from human observation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Albers, A., Brudniok, S., Burger, W.: Design and development process of a humanoid robot upper body through experimentation. In: IEEE/RAS International Conference on Humanoid Robots, pp. 77–92 (2004)
Asfour, T., Azad, P., Gyarfas, F., Dillmann, R.: Imitation Learning of Dual-Arm Manipulation Tasks in Humanoid Robots. International Journal of Humanoid Robotics 5(2), 183–202 (2008)
Asfour, T., Regenstein, K., Azad, P., Schröder, J., Vahrenkamp, N., Dillmann, R.: ARMAR-III: An Integrated Humanoid Platform for Sensory-Motor Control. In: IEEE/RAS International Conference on Humanoid Robots (2006)
Asfour, T., Welke, K., Azad, P., Ude, A., Dillmann, R.: The Karlsruhe Humanoid Head. In: IEEE/RAS International Conference on Humanoid Robots, Daejeon, Korea, December 2008, pp. 447–453 (2008)
Azad, P.: Visual Perception for Manipulation and Imitation in Humanoid Robots. PhD thesis, Universität Karlsruhe (TH), Karlsruhe, Germany (2008)
Azad, P., Asfour, T., Dillmann, R.: Robust Real-time Stereo-based Markerless Human Motion Capture. In: IEEE/RAS International Conference on Humanoid Robots, Daejeon, Korea, December 2008, pp. 700–707 (2008)
Azad, P., Asfour, T., Dillmann, R.: Accurate Shape-based 6-DoF Pose Estimation of Single-colored Objects. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, USA (2009)
Azad, P., Asfour, T., Dillmann, R.: Combining Harris Interest Points and the SIFT Descriptor for Fast Scale-Invariant Object Recognition. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, USA (2009)
Azad, P., Asfour, T., Dillmann, R.: Stereo-based vs. Monocular 6-DoF Pose Estimation using Point Features: A Quantitative Comparison. In: Autonome Mobile Systeme (AMS), Karlsruhe, Germany (2009)
Azad, P., Ude, A., Asfour, T., Dillmann, R.: Stereo-based Markerless Human Motion Capture for Humanoid Robot Systems. In: IEEE International Conference on Robotics and Automation, Rome, Italy, April 2007, pp. 3951–3956 (2007)
Bay, H., Tuytelaars, T., Gool, L.V.: SURF: Speeded Up Robust Features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)
Bierbaum, A., Rambow, M., Asfour, T., Dillmann, R.: A potential field approach to dexterous tactile exploration. In: International Conference on Humanoid Robots 2008, Daejeon, Korea (2008)
Bierbaum, A., Rambow, M., Asfour, T., Dillmann, R.: Grasp affordances from multi-fingered tactile exploration using dynamic potential fields. In: IEEE/RAS International Conference on Humanoid Robots (2009) (accepted to)
de Leva, P.: Adjustments to zatsiorsky-seluyanov’s segment inertia parameters. Journal of Biomechanics 29(9), 1223–1230 (1996)
Deutscher, J., Blake, A., Reid, I.: Articulated Body Motion Capture by Annealed Particle Filtering. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Hilton Head, USA, pp. 2126–2133 (2000)
Do, M., Azad, P., Asfour, T., Dillmann, R.: Imitation of human motion on a humanoid robot using nonlinear optimization. In: International Conference on Humanoid Robots, Humanoids 2008 (2008)
Chaumette, F., Hutchinson, S.: Visual servo control, part I: Basic approaches. IEEE Robotics and Automation Magazine 13(4), 82–90 (2006)
Geib, C., Mourao, K., Petrick, R., Pugeault, N., Steedman, M., Krüger, N., Wörgötter, F.: Object action complexes as an interface for planning and robot control. In: Workshop: Toward Cognitive Humanoid Robots. IEEE-RAS International Conference on Humanoid Robots (December 2006)
Göger, D., Weiß, K., Burghart, K., Wörn, H.: Sensistive skin for a humanoid robot. In: International Workshop on Human-Centered Robotic Systems, (HCRS 2006), Munich (2006)
Harris, C., Stephens, M.: A Combined Corner and Edge Detector. In: Alvey Vision Conference, Manchester, UK, pp. 147–151 (1988)
Ijspeert, A.J., Nakanishi, J., Schaal, S.: Movement imitation with nonlinear dynamical systems in humanoid robots. In: Proceedings of the IEEE International Conference on Robotics and Automation (2002)
Krüger, N., Piater, Wörgötter, F., Geib, C., Petrick, R., Steedman, M., Ude, A., Asfour, T., Kraft, D., Omrcen, D.D., Hommel, B., Agostino, A., Kragic, D., Eklundh, J., Kruger, V., Dillmann, R.: A formal definition of object action complexes and examples at different levels of the process hierarchy. Technical report (2009)
Kuffner, J., LaValle, S.: RRT-connect: An efficient approach to single-query path planning. In: IEEE International Conference on Robotics and Automation (April 2000)
LaValle, S., Kuffner, J.: Randomized kinodynamic planning. Internation Journal of Robotics Research 20 (June 2001)
Lowe, D.G.: Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision (IJCV) 60(2), 91–110 (2004)
PACO-PLUS. Perception, action and cognition through learning of object-action complexes, http://www.paco-plus.org
Pastor, P., Hoffmann, H., Asfour, T., Schaal, S.: Learning and generalization of motor skills by learning from demonstration. In: Proceedings of the IEEE International Conference on Robotics and Automation, Kobe, Japan (2009)
Schulz, S., Pylatiuk, C., Kargov, A., Oberle, R., Bretthauer, G.: Progress in the development of anthropomorphic fluidic hands for a humanoid robot. In: IEEE/RAS International Conference on Humanoid Robots, Los Angeles (November 2004)
Ude, A., Atkeson, C.G., Riley, M.: Programming Full-Body Movements for Humanoid Robots by Observation. Robotics and Autonomous Systems 47(2-3), 93–108 (2004)
Vahrenkamp, N., Barski, A., Asfour, T., Dillmann, R.: Planning and execution of grasping motions on a humanoid robot. In: 9th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2009(December 2009)
Vahrenkamp, N., Berenson, D., Asfour, T., Kuffner, J., Dillmann, R.: Humanoid motion planning for dual-arm manipulation and re-grasping tasks. In: Intelligent Robots and Systems, IROS (October 2009)
Vahrenkamp, N., Böge, C., Welke, K., Asfour, T., Walter, J., Dillmann, R.: Visual servoing for dual arm motions on a humanoid robot. In: 9th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2009 (December 2009)
Vahrenkamp, N., Wieland, S., Azad, P., Gonzalez, D., Asfour, T., Dillmann, R.: Visual servoing for humanoid grasping and manipulation tasks. In: 8th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2008, pp. 406–412 (December 2008)
Weghe, M.V., Ferguson, D., Srinivasa, S.: Randomized path planning for redundant manipulators without inverse kinematics. In: IEEE-RAS International Conference on Humanoid Robots (November 2007)
Weiss, L., Sanderson, A.C., Neuman, C.P.: Dynamic sensor-based control of robots with visual feedback. IEEE Journalon Robotics and Automation RA-3(5) (October 1987)
Welke, K., Asfour, T., Dillmann, R.: Active multi-view object search on a humanoid head. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2009), pp. 417–423 (2009)
Welke, K., Issac, J., Schiebener, D., Asfour, T., Dillmann, R.: Autonomous acquisition of visual multi-view object representations for object recognition on a humanoid robot. In: Proceedings of the IEEE International Conference on Robotics and Automation, ICRA 2010 (2010) (submitted to)
Welke, K., Oztop, E., Cheng, G., Dillmann, R.: Exploiting similarities for robot perception. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3237–3242 (2007)
Wilson, G.b.W.J., Williams Hulls, C.C.: Relative end-effector control using cartesian position based visual servoing. IEEE Transactions on Robotics and Automation 12, 684–696 (1996)
Wörgötter, F., Agostini, A., Krüger, N., Shylo, N., Porr, B.: Cognitive agents – a procedural perspective relying on the predictability of Object-Action-Complexes (OACs). Robotics and Autonomous Systems 57, 420–432 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Asfour, T. et al. (2011). From Sensorimotor Primitives to Manipulation and Imitation Strategies in Humanoid Robots. In: Pradalier, C., Siegwart, R., Hirzinger, G. (eds) Robotics Research. Springer Tracts in Advanced Robotics, vol 70. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19457-3_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-19457-3_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19456-6
Online ISBN: 978-3-642-19457-3
eBook Packages: EngineeringEngineering (R0)