Skip to main content

Advertisement

SpringerLink
Log in

A 3D vision-based inspection method for pairwise comparison of locally deformable 3D models

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

In this work we present a pairwise 3D vision-based inspection method for comparing locally deformable 3D models which refers to models whose parts have undergone some local deformation or change while the rest of the parts remained rigid and intact. In general, local deformations result from two types of transformations: non-volume conservative transformations caused by either the inflation or the deflation of models’ parts and volume conservative transformations caused by bending, twisting, rotation or displacement of either internal or external parts of the model. The internal parts are the middle parts of an object, while the external parts are the parts on the extremity or the end of a part. We have experimented with different cases of deformations on man-made objects and mechanical parts for industrial inspection of possible defects, and for quality control purposes as well. We have also applied our pairwise comparison method on parts of the human body. Examples relevant to medical applications are the detection and inspection of a lesion which are also tested in this work. Our algorithm is not only successful for detecting local change but it also achieves high-accuracy results comparable to other well-known registration and industrial inspection techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

Notes

  1. http://www.3dreshaper.com/en1/En_Inspection2.html.

  2. http://www.innovmetric.com/polyworks/3D-scanners/home.aspx?lang=en.

  3. http://www.3dreshaper.com/en1/En_Inspection2.html.

  4. http://www.creaform3d.com/en/applications/aerospace/3d-modelling-phased-array-inspection.

  5. http://www.goscan3d.com/en.

  6. http://www.creaform3d.com/en/metrology-solutions/optical-3d-scanner-metrascan.

  7. http://www.artec3d.com/.

  8. http://sourceforge.net/projects/meshlab/files/meshlab/MeshLab%20v1.3.1/.

  9. http://www.mathworks.com/matlabcentral/fileexchange/36316-local-depth-sift-and-scale-invariant-spin-image-local-features-for-3d-meshes.

References

  1. Yu, M., Atmosukarto, I., Leow, W.K., Huang, Z., Xu, R.: 3D model retrieval with morphing-based geometric and topological feature maps. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 656–661 (2003)

  2. Sundar, H., Silver, D., Gagvani, N., Dickinson, S.: Skeleton based shape matching and retrieval. In: Proc. of the Conference on Shape Modeling International, pp. 130–139 (2003)

  3. Ankerst, M., Kastenmüller, G., Kriegel, H.P., Seidl, T., et al.: Nearest neighbor classification in 3D protein databases. In: Proc. of the Seventh International Conference on Intelligent Systems for Molecular Biology, pp. 34–43 (1999)

  4. Osada, R., Funkhouser, T.T., Chazelle, B., Dobkin, D.: Shape distributions. ACM Trans. Graph. 21, 807–832 (2002)

    Article  Google Scholar 

  5. Kazhdan, M., Funkhouser, T., Rusinkiewicz, S.: Rotation invariant spherical harmonic representation of 3D shape descriptors. In: Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, pp. 156–164 (2003)

  6. Laga, H., Takahashi, H., Nakajima, M.: Spherical wavelet descriptors for content-based 3D model retrieval. In: Proc. Of Shape Modelling and Applications, pp. 15–25 (2006)

  7. Johnson, A., Hebert, M.: Surface matching for object recognition in complex three-dimensional scenes. Image Vis. Comput. 16, 635–651 (1998)

    Article  Google Scholar 

  8. Besl, P.J., McKay, N.D.: A method for registration of 3D shapes. IEE PAMI 14(2), 239–256 (1992)

    Article  Google Scholar 

  9. Fitzgibbon, A.: Robust registration of 2D and 3D point sets. Image Vis. Comput. 21(13–14), 1145–1153 (2003)

    Article  Google Scholar 

  10. Salvi, J., Matabosch, C., Fofi, D., Forest, J.: A review of recent range image registration methods with accuracy evaluation. Image Vis. Comput. 25(5), 578–596 (2007)

    Article  Google Scholar 

  11. Nguyen, V.T., Tran, T.T., Cao, V.T., Laurendeau, D.: 3D Point Cloud Registration Based on the Vector Field Representation. ACPR, 491–495 (2013)

  12. Livesu, M., Scateni, R: Rigid registration of different poses of animated shape. J. WSCG (2013) (Czech Republic)

  13. Ali, S., Tran, T.T., Cao, V.T., Laurendeau, D.: An approach for local comparison of deformable 3D models. In: Proc. 2013 second IAPR Asian Conference on Pattern Recognition (2013)

  14. Myronenko, A., Song, X.: Point-set registration: coherent point drift. In: IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 32, No. 12, pp. 2262-2275 (2010)

  15. Allen, B., Curless, B., Popovic, Z.: The space of human body shapes: reconstruction and parametrisation from range scans. ACM Trans Graph, 22(3), 587–594 (2003)

  16. Brown, B., Rusinkiewicz, S.: Global non-rigid alignment of 3-d scans. In: ACM Transactions on Graphics (Proc. Siggraph 2007), vol. 26, No. 3 (2007)

  17. Chang, W., Zwicker, M.: Automatic registration for articulated shapes. In: Computer graphics forum (Proceedings of SGP 2008), vol. 27, No. 5 (2008)

  18. Tevs, A., Bokeloh, M., Wand, M., Schilling, A., Seidel, H.P.: Isometric registration of ambiguous and partial data. In: Proc. IEEE Conf. on Comp. Vision and Pattern Recognition (CVPR) (2009)

  19. Sumner, R., Schmid, J., Pauly, M.: Embedded deformation for shape manipulation. In: ACM Trans. Graph. Proc. SIGGRAPH (2007)

  20. Li, H., Adams, B., Guibas, L.J., Pauly, M.: Robust single-view geometry and motion reconstruction. In: ACM Trans. Graph, vol. 28, No. 5 (2009)

  21. Wuhre, S., Shu, C., Bose, P.: Posture invariant correspondence of triangular meshes in shape space. In: 3DIM (2009)

  22. Van Kaick, O., Zhang, H., Hamarneh, G., Cohen-Or, D.: A survey on shape correspondence. Eurographics State-of-the-Art report, pp. 61–82 (2010) (Extended version published in Computer Graphics Forum, vol. 30, no. 6, pp. 1681–1707, 2011)

  23. Cao, V.T., Nguyen, V.T., Tran, T.T., Ali, S., Laurendeau, D.: Non-rigid registration for deformable objects. GRAPP, 43–52 (2014)

  24. Toony, Z., Laurendeau, D., Giguère, P., Gagné, C.: 3D-NCuts, adapting normalized cuts to 3d triangulated surface segmentation. In: Proc. of the GRAPP conference (2014)

  25. Gal, R., Or Cohen, D.: Salient geometric features for partial shape matching and similarity. ACM Trans. Graph. 25(1), 130–150 (2006)

  26. Liu, Y., Zha, H., Qin, H.: Shape topics, “A compact Representation and new algorithms for 3D Partial Shape Retrieval”. In: Proc. CVPR 2006, vol. II, pp. 2025–2032 (2006)

  27. Shilane, P., Min, P., Kazhdan, M., Frunkhouser, T.: The Princeton shape benshmark. In: Proc. SMI ’04, pp. 167–178 (2004)

  28. Johnson, A.: Spin-images: a representation for 3-D surface matching, Ph.D. Dissertation, The Robotics Institute, Carnegie Mellon University (1997)

  29. Lowe, D.G.: Distinctive image features from scale-invariant key points. Int. J. Comput. Vis. 60(2), pp. 91–110 (2004)

  30. Zhang. J., Kaplow, R., Chen, R., Siddiqi, K.: The McGill shape benchmark. http://www.cim.mcgill.ca/shape/benchMark (2005)

  31. Mitra, N.J., Gelfand, N., Pottmann, H., Guibas, L.: Registration of point cloud data from a geometric optimization perspective. In: Proc. 2004 Eurographics/ACM SIGGRAPH symposium on Geometry (2004)

  32. Jones, M.W.: 3D distance from a Point to a Triangle, Department of Computer Science, University of Wales (1995)

  33. Pottmann, H., Hofer, M.: Geometry of the squared distance function to curves and surfaces. In: Visualization and mathematics III, pp. 221–242 (2003)

  34. Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Numerical geometry of non-rigid shapes. Springer, New York (2008)

    MATH  Google Scholar 

  35. Darom, T., Keller, Y.: Spectral analysis driven sparse matching of 3D shapes. In: Proceedings of the 5th Eurographics conference on 3D Object Retrieval (EG 3DOR’2012)

Download references

Acknowledgments

We would like to thank Suzette Ali and Peyman Hedayati for their pertinent ideas in suggesting ways of deforming the 3D models of our experiments. We would also like to thank Denis Ouellet for designing the CAD models to test the accuracy of our method. Access to the 3D printer used for building the models was gracefully Granted to us by Prof. Clément Gosselin at the Department of Mechanical Engineering at Laval University. We want to thank the reviewers for their valuable comments in improving this article. This work was supported by the NSERC/Creaform Industrial Research Chair on 3D scanning and by the FRQ-NT REPARTI research center Grant.

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, Laval University, Quebec, G1V 0A6, Canada

    Sarah Ali, Zahra Toony & Denis Laurendeau

Authors
  1. Sarah Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zahra Toony
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Denis Laurendeau
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sarah Ali.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ali, S., Toony, Z. & Laurendeau, D. A 3D vision-based inspection method for pairwise comparison of locally deformable 3D models. Machine Vision and Applications 26, 1061–1078 (2015). https://doi.org/10.1007/s00138-015-0711-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-015-0711-0

Keywords

Search

Navigation