Skip to main content
SpringerLink
Log in

An Accurate Positioning Method for Robotic Manipulation Based on Vision and Tactile Sensors

  • Conference paper
  • First Online:
Cognitive Systems and Signal Processing (ICCSIP 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1397))

Included in the following conference series:

  • 1514 Accesses

Abstract

To improve the positioning accuracy of the robotic system, a novel positioning method based on vision and tactile sensors is proposed for robotic manipulation which consists of two stages: the vision-based positioning stage and the tactile-based positioning stage. The tactile sensor used in the paper and the proposed methodology are introduced in detail. Furthermore, experiments have been performed in the real platform to verify the effectiveness of the proposed method. The results show that the positioning accuracy has been largely improved with the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Gan, Y., Dai, X.: Base frame calibration for coordinated industrial robots. Robot. Auton. Syst. 59(7), 563–570 (2011)

    Article  Google Scholar 

  2. Argall, B., Chernova, S., Veloso, M., Browning, B.: A survey of robot learning from demonstration. Robot. Auton. Syst. 57(5), 469–483 (2009)

    Article  Google Scholar 

  3. Lars, K., Nick, H., Tom, D., Marc, H., Tomas, K.: Artificial intelligence for long-term robot autonomy: a survey. IEEE Robot. Autom. Lett. 3, 4023–4030 (2018)

    Article  Google Scholar 

  4. Zhao, D., Bi, Y., Ke, Y.: An efficient error compensation method for coordinated CNC five-axis machine tools. Int. J. Mach. Tools Manuf. 123, 105–115 (2017)

    Article  Google Scholar 

  5. Li, R., Qu, X.: Study on calibration uncertainty of industrial robot kinematic parameters. Yi Qi Yi Biao Xue Bao/Chin. J. Sci. Instrum. 35(10), 2192–2199 (2014)

    Google Scholar 

  6. Zhao, D., Bi, Y., Ke, Y.: Kinematic modeling and base frame calibration of a dual-machine-based drilling and riveting system for aircraft panel assembly. Int. J. Adv. Manuf. Technol. 94(5–8), 1873–1884 (2018)

    Article  Google Scholar 

  7. Oh, S., Orin, D., Bach, M.: An inverse kinematic solution for kinematically redundant robot manipulators. J. Robot. Syst. 1(3), 235–249 (2010)

    Article  Google Scholar 

  8. Chen, W., Jiang, M., Wang, H., Liu, Y.: Visual servoing of robots with uncalibrated robot and camera parameters. Mechatron. Sci. Intell. Mach. 22(6), 661–668 (2012)

    Google Scholar 

  9. Nubiola, A., Bonev, I.: Absolute calibration of an ABB IRB 1600 robot using a laser tracker. Robot. Comput. Integr. Manuf. 29(1), 236–245 (2013)

    Article  Google Scholar 

  10. Liu, H., Zhu, W., Ke, Y.: Pose alignment of aircraft structures with distance sensors and CCD cameras. Robot. Comput. Integr. Manuf. 48, 30–38 (2017)

    Article  Google Scholar 

  11. Liu, H., Zhu, W., Dong, H., Ke, Y.: An adaptive ball-head positioning visual servoing method for aircraft digital assembly. Assembly Autom. 39(2), 287–296 (2019)

    Article  Google Scholar 

  12. Zhu, W., Mei, B., Yan, G., Ke, Y.: Measurement error analysis and accuracy enhancement of 2D vision system for robotic drilling. Robot. Comput. Integr. Manuf. 30(2), 160–171 (2014)

    Article  Google Scholar 

  13. Du, G., Wang, K., Lian, S., Zhao, K.: Vision-based robotic grasping from object localization, object pose estimation to grasp estimation for parallel grippers: a review. Artif. Intell. Rev. 54, 1677–1734 (2021)

    Article  Google Scholar 

  14. Liu, H., Guo, D., Sun, F.: Object recognition using tactile measurements: kernel sparse coding methods. IEEE Trans. Instrum. Meas. 65(3), 656–665 (2016)

    Article  Google Scholar 

  15. Hogan, F., Ballester, J., Dong, S., Rodriguez, A.: Tactile dexterity: manipulation primitives with tactile feedback. In: 2020 IEEE International Conference on Robotics and Automation, pp. 1–7. IEEE, Paris, France (2020)

    Google Scholar 

  16. Dong, S., Rodriguez, A.: Tactile-based insertion for dense box-packing. In: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1–8. IEEE, Macau, China (2020)

    Google Scholar 

  17. Wang, Y., Li, Y., Zheng, J.: Camera calibration technique based on OpenCV. In: The 3rd International Conference on Information Sciences and Interaction Sciences, pp. 1–4. IEEE, Chengdu, China (2010)

    Google Scholar 

  18. Zhang, Z.: Flexible camera calibration by viewing a plane from unknown orientations. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, pp. 1–8. IEEE, Kerkyra, Greece (1999)

    Google Scholar 

  19. Poggi, M., Aleotti, F., Tosi, F., Mattoccia, S.: On the uncertainty of self-supervised monocular depth estimation. In: 2020 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–26. IEEE, China (2020)

    Google Scholar 

Download references

Acknowledgement

This research was sponsored by the Major Project of the New Generation of Artificial Intelligence (No. 2018AAA0102900) and the China Postdoctoral Science Foundation Grant (No. 2019TQ0170).

Author information

Authors and Affiliations

  1. Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, 100083, China

    Dan Zhao & Fuchun Sun

Authors
  1. Dan Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fuchun Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Tsinghua University, Beijing, China

    Fuchun Sun

  2. Tsinghua University, Beijing, China

    Huaping Liu

  3. Tsinghua University, Beijing, China

    Bin Fang

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhao, D., Sun, F. (2021). An Accurate Positioning Method for Robotic Manipulation Based on Vision and Tactile Sensors. In: Sun, F., Liu, H., Fang, B. (eds) Cognitive Systems and Signal Processing. ICCSIP 2020. Communications in Computer and Information Science, vol 1397. Springer, Singapore. https://doi.org/10.1007/978-981-16-2336-3_59

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-2336-3_59

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-2335-6

  • Online ISBN: 978-981-16-2336-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation