Skip to main content

Image Surround: Automatic Projector Calibration for Indoor Adaptive Projection

  • Conference paper
Intelligent Technologies for Interactive Entertainment (INTETAIN 2013)

Abstract

In this paper, we present a system able to calibrate projectors, perform 3D reconstruction and project shadow and textures generated in real-time. The calibration algorithm is based on Heikkila’s camera calibration algorithm. It combines Gray coded structured light patterns projection and a RGBD camera. Any projection surface can be used. Intrinsic and extrinsic parameters are computed without a scale factor uncertainty and any prior knowledge about the projector and the projection surface. The projector calibration is used as a basis to augment the scene with information from the RGBD camera. Shadows are generated with lights. Their position is modified in real-time to follow a user position. The 3D reconstruction is based on the Kinect fusion algorithm. The model of scene is used to apply texture on the scene and to generate correct shadows.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ahn, S.H.: Opengl (2011) (last viewed February 1, 2013)

    Google Scholar 

  2. Audet, S., Okutomi, M.: A user-friendly method to geometrically calibrate projector-camera systems. In: Computer Vision and Pattern Recognition Workshop, pp. 47–54 (2009)

    Google Scholar 

  3. Madhkour, R.B., Mancas, M., Gosselin, B.: Automatic geometric projector calibration: Application to a 3d real-time visual feedback. In: Proceedings of the 8th International Conference on Computer Vision Theory and Apllications (VISIGRAPP 2013), pp. 420–424 (2013)

    Google Scholar 

  4. Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision with the OpenCV Library. O’Reilly (2008)

    Google Scholar 

  5. Harrison, C., Benko, H., Omnitouch, A.D.W.: wearable multitouch interaction everywhere. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST 2011), pp. 441–450. ACM (2011)

    Google Scholar 

  6. Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge University Press (2004)

    Google Scholar 

  7. Heikkila, J.: Geometric camera calibration using circular control points. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(10), 1066–1077 (2000)

    Article  MathSciNet  Google Scholar 

  8. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., Fitzgibbon, A.: Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST 2011), pp. 559–568. ACM (2011)

    Google Scholar 

  9. Kalal, Z., Matas, J., Mikolajczyk, K.: P-N Learning: Bootstrapping Binary Classifiers by Structural Constraints. In: Conference on Computer Vision and Pattern Recognition (2010)

    Google Scholar 

  10. Kimura, M., Mochimaru, M., Kanade, T.: Projector calibration using arbitrary planes and calibrated camera. In: Proceedings of the 2007 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2007), pp. 1–2. IEEE Computer Society (2007)

    Google Scholar 

  11. Marsh, D.: Applied Geometry for Computer Graphicsand CAD. Springer (2004)

    Google Scholar 

  12. OpenNI. Openni user guide (November 2010) (last viewed January 19, 2011)

    Google Scholar 

  13. Tardif, J.P., Roy, S., Trudeau, M.: Multi-projectors for arbitrary surfaces without explicit calibration nor reconstruction. In: Proceedings of the Fourth International Conference on 3-D Digital Imaging and Modeling (3DIM 2003), pp. 217–224 (2003)

    Google Scholar 

  14. Unity Technologies. Unity rendering engine (2013)

    Google Scholar 

  15. Matt Wright. Open sound protocol specification 1.0 (2002)

    Google Scholar 

  16. Yamazaki, S., Mochimaru, M., Kanade, T.: Simultaneous self-calibration of a projector and a camera using structured light. In: Proceedings of the 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2011) - Workshops (Procams 2011), pp. 67–74. IEEE Computer Society (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Ben Madhkour, R., Burczykowski, L., Mancaş, M., Gosselin, B. (2013). Image Surround: Automatic Projector Calibration for Indoor Adaptive Projection. In: Mancas, M., d’ Alessandro, N., Siebert, X., Gosselin, B., Valderrama, C., Dutoit, T. (eds) Intelligent Technologies for Interactive Entertainment. INTETAIN 2013. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 124. Springer, Cham. https://doi.org/10.1007/978-3-319-03892-6_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-03892-6_18

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-03891-9

  • Online ISBN: 978-3-319-03892-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics