Abstract
This paper proposes recognition and grasping objects from 3D environment by combining depth and color stereo image in the mobile picking robot system. To do this task, the followings are done. Firstly, an image processing system including Kinect camera sensor is described. Secondly, RGB color map and new depth map for image inpainting are obtained using Kinect SDK mapping function to align RGB image with depth image. Thirdly, the new depth map are segmented to distinguish between the image background and the objects that should be recognized. The feature colours are generated based on colour histograms. Euclidean distance is used to measure the similarity between the feature vectors computed from the colour image and the feature vectors stored in a database. Fourthly, by converting RGB map and new depth map into 3D point clouds, an algorithm for localizing handle-like grasp affordances is proposed. The main idea is to search the point cloud for neighborhoods that satisfy handle-like grasp affordances and can be grasped by the end-effector of the manipulator. Finally, the effectiveness of the proposed algorithms is verified by using experiment. The experimental results show that the mobile picking robot successfully detects an object and finds its grasping points with an acceptable small error.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, W.T., Liu, W.C., Chen, M.S.: Adaptive color feature extraction based on image color distributions. IEEE Trans. Image Process. 19(8), 2005–2016 (2010)
Canny, J.F.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)
Verma, B., Kulkarni, S.: Texture feature extraction and classification. In: International Conference on Computer Analysis of Images and Patterns, pp. 228–235 (2001)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Nguyen, T.H., Jeong, S.K., Kim, H.K., Kim, S.B.: A method for localizing and grasping objects in a picking robot system using kinect camera. In: Proceedings of 2016 International Symposium on Advanced Mechanical and Power Engineering, ISAMPE, pp. 178–180 (2016)
Papazov, C., Haddadin, S., Parusel, S., Krieger, K., Burschka, D.: Rigid 3D geometry matching for grasping of known objects in cluttered scenes. Int. J. Robot. Res. 31(4), 538–553 (2012)
Bley, F., Schmirgel, V., Kraiss, K.F.: Mobile manipulation based on generic object knowledge. In: Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (2006)
Choi, C., Taguchi, Y., Tuzel, O., Liu, M.-Y., Ramalingam, S.: Votingbased pose estimation for robotic assembly using a 3D sensor. In: Proceedings of IEEE International Conference on Robotics and Automation (2012)
Acknowledgments
This work was supported by the Materials and Components Technology Development Program of MOTIE/KEIT. [10063273, Development of Picking Tool for Logistic Robots to Automate Picking Process of Atypical Parcels].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Nguyen, T.H., Oh, J.M., Kim, D.H., Jeong, S.K., Kim, H.K., Kim, S.B. (2018). Recognition and Grasping Objects from 3D Environment by Combining Depth and Color Stereo Image in the Mobile Picking Robot System. In: Duy, V., Dao, T., Zelinka, I., Kim, S., Phuong, T. (eds) AETA 2017 - Recent Advances in Electrical Engineering and Related Sciences: Theory and Application. AETA 2017. Lecture Notes in Electrical Engineering, vol 465. Springer, Cham. https://doi.org/10.1007/978-3-319-69814-4_34
Download citation
DOI: https://doi.org/10.1007/978-3-319-69814-4_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-69813-7
Online ISBN: 978-3-319-69814-4
eBook Packages: EngineeringEngineering (R0)