Abstract
We consider the problem of estimating an object’s pose in the absence of visual feedback after contact with robotic fingers during grasping has been made. Information about the object’s pose facilitates precise placement of the object after a successful grasp. If the grasp fails, then knowing the pose of the object after the grasping attempt is made can also help re-grasp the object. We develop a data-driven approach using tactile data that computes the object pose in a self-supervised manner after the object-finger contact is established. Additionally, we evaluate the effects of various feature representations, machine learning algorithms, and object properties on the pose estimation accuracy. Unlike other existing approaches, our method does not require any prior knowledge about the object and does not make any assumptions about grasp stability. In experiments, we show that our approach can estimate object poses with at least 2 cm translational and \(20^{\circ }\) rotational accuracy despite changed object properties and unsuccessful grasps.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Calandra, R., Owens, A., Upadhyaya, M., Yuan, W., Lin, J., Adelson, E.H., Levine, S.: The feeling of success: does touch sensing help predict grasp outcomes? IEEE Robot. Autom. Lett. (RA-L) 3(4), 3300–3307 (2017)
Liarokapis, M.V., Calli, B., Spiers, A.J., Dollar, A.M.: Unplanned, model-free, single grasp object classification with underactuated hands and force sensors. In: IEEE International Conference on Intelligent Robots and Systems (IROS), vol. 2015, pp. 5073–5080. Institute of Electrical and Electronics Engineers Inc. (2015)
Kwiatkowski, J., Lavertu, J.S., Gourrat, C., Duchaine, V.: Determining object properties from tactile events during grasp failure. In: IEEE International Conference on Automation Science and Engineering (CASE), vol. 2019, pp. 1692–1698 (2019)
Chebotar, Y., Hausman, K., Su, Z., Sukhatme, G.S., Schaal, S.: Self-supervised regrasping using spatio-temporal tactile features and reinforcement learning. In: IEEE International Conference on Intelligent Robots and Systems (IROS), pp. 1960–1966 (2016)
Liarokapis, M., Dollar, A.M.: Learning the post-contact reconfiguration of the hand object system for adaptive grasping mechanisms. In: IEEE International Conference on Intelligent Robots and Systems (IROS), pp. 293–299 (2017)
Bütepage, J., Cruciani, S., Kokic, M., Welle, M., Kragic, D.: From visual understanding to complex object manipulation. Ann. Rev. Control Robot. Auton. Syst. 2(1), 161–179 (2019)
Okamura, A., Smaby, N., Cutkosky, M.: An overview of dexterous manipulation. In: IEEE International Conference on Robotics and Automation (ICRA), vol. 1, pp. 255–262. IEEE (2000)
Bimbo, J., Kormushev, P., Althoefer, K., Liu, H.: Global estimation of an objects pose using tactile sensing. Adv. Robot. 29(5), 363–374 (2015)
Corcoran, C., Platt, R.: A measurement model for tracking hand-object state during dexterous manipulation. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 4302–4308 (2010)
Klaas, G., Bruyninckx, H.: Markov techniques for object localization with force-controlled robots. In: International Conference on Advanced Robotics (ICAR), pp. 91–96 (2001)
Schaeffer, M.A., Okamura, A.M.: Methods for intelligent localization and mapping during haptic exploration. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (SMC), vol. 4, pp. 3438–3445 (2003)
Romero-Ramirez, F.J., Muñoz-Salinas, R., Medina-Carnicer, R.: Speeded up detection of squared fiducial markers. Image Vis. Comput. 76, 38–47 (2018)
Laaksonen, J., Kyrki, V., Kragic, D.: Evaluation of feature representation and machine learning methods in grasp stability learning. In: IEEE-RAS International Conference on Humanoid Robots, Humanoids, pp. 112–117 (2010)
Acknowledgment
This research is funded by the Netherlands Organization for Scientific Research project Cognitive Robots for Flexible Agro-Food Technology, grant P17-01.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kulkarni, P., Kober, J., Babuska, R. (2021). Tactile-Based Self-supervised Pose Estimation for Robust Grasping. In: Siciliano, B., Laschi, C., Khatib, O. (eds) Experimental Robotics. ISER 2020. Springer Proceedings in Advanced Robotics, vol 19. Springer, Cham. https://doi.org/10.1007/978-3-030-71151-1_25
Download citation
DOI: https://doi.org/10.1007/978-3-030-71151-1_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-71150-4
Online ISBN: 978-3-030-71151-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)