Skip to main content
SpringerLink
Log in

Relighting for an Arbitrary Shape Object Under Unknown Illumination Environment

  • Conference paper
  • First Online:
Advances in Visual Computing (ISVC 2015)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9475))

Included in the following conference series:

  • 1862 Accesses

Abstract

Relighting techniques can achieve the photometric consistency in synthesizing a composite images. Relighting generally need the object’s shape and illumination environment. Recent research demonstrates possibilities of relighting for an unknown shape object or the relighting the object under unknown illumination environment. However, achieving both tasks are still challenging issue. In this paper, we propose a relighting method for an unknown shape object captured under unknown illumination environment by using an RGB-D camera. The relighted object can be rendered from pixel intensity, surface albedo and shape of the object and illumination environment. The pixel intensity and the shape of the object can simultaneously be obtained from an RGB-D camera. Then surface albedo and illumination environment are iteratively estimated from the pixel intensity and shape of the object. We demonstrate that our method can perform relighting for a dynamic shape object captured under unknown illumination using an RGB-D camera.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Debevec, P., Hawkins, T., Tchou, C., Duiker, H.P., Sarokin, W., Sagar, M.: Acquiring the reflectance field of a human face. In: ACM SIGGRAPH. ACM (2000)

    Google Scholar 

  2. Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., Debevec, P.: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. Graph. 24(3), 756–764 (2005)

    Article  Google Scholar 

  3. Zhen, W., Liu, Z., Huang, T.S.: Face relighting with radiance environment maps. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE (2003)

    Google Scholar 

  4. Aldrian, O., Smith, W.: Inverse rendering with a morphable model: A multilinear approach. In: Proceedings of the British Machine Vision Conference. BMVA Press (2011)

    Google Scholar 

  5. Wang, Y., Zhang, L., Liu, Z., Hua, G., Wen, Z., Zhang, Z., Samaras, D.: Face relighting from a single image under arbitrary unknown lighting conditions. IEEE Trans. Pattern Anal. Mach. Intell. 31, 1968–1984 (2009)

    Article  Google Scholar 

  6. Ramamoorthi, R., Hanrahan, P.: A signal-processing framework for inverse rendering. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. ACM (2001)

    Google Scholar 

  7. Matsumoto, K., Song, C., de Sorbier, F., Saito, H.: Joint upsampling and noise reduction for real-time depth map enhancement. In: Proceedings of IS&T/SPIE Electronic Imaging, SPIE (2014)

    Google Scholar 

  8. Holzer, S., Rusu, R.B., Dixon, M., Gedikli, S., Navab, N.: Adaptive neighborhood selection for real-time surface normal estimation from organized point cloud data using integral images. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE (2012)

    Google Scholar 

  9. Nowrouzezahrai, D., Simari, P., Fiume, E.: Sparse zonal harmonic factorization for efficient SH rotation. ACM Trans. Graph. 31, 23 (2012)

    Article  Google Scholar 

  10. Zou, X., Kittler, J., Hamouz, M., Tena, J.R.: Robust albedo estimation from face image under unknown illumination. In: SPIE Defense and Security Symposium, SPIE (2008)

    Google Scholar 

  11. Ramamoorthi, R., Hanrahan, P.: An efficient representation for irradiance environment maps. In: ACM SIGGRAPH. ACM (2001)

    Google Scholar 

  12. Gruber, L., Richter-Trummer, T., Schmalstieg, D.: Real-time photometric registration from arbitrary geometry. In: IEEE International Symposium on Mixed and Augmented Reality. IEEE (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Keio University, 3-14-1 Hiyoshi, Kohoku, Yokohama, Kanagawa, 223-8522, Japan

    Yohei Ogura & Hideo Saito

Authors
  1. Yohei Ogura
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hideo Saito
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yohei Ogura .

Editor information

Editors and Affiliations

  1. University of Nevada, Reno, Nevada, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, California, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, California, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, Nevada, USA

    Darko Koracin

  5. University of Houston, Houston, Texas, USA

    Ioannis Pavlidis

  6. IBM T.J. Watson Research Center, Yorktown Heights, New York, USA

    Rogerio Feris

  7. Purdue University, West Lafayette, Indiana, USA

    Tim McGraw

  8. Side Effects Software, Santa Monica, California, USA

    Mark Elendt

  9. The DiVE, Durham, North Carolina, USA

    Regis Kopper

  10. Texas A&M University, College Station, Texas, USA

    Eric Ragan

  11. Kent State University, Kent, Ohio, USA

    Zhao Ye

  12. Lawrence Berkeley National Laboratory, Berkeley, California, USA

    Gunther Weber

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Ogura, Y., Saito, H. (2015). Relighting for an Arbitrary Shape Object Under Unknown Illumination Environment. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2015. Lecture Notes in Computer Science(), vol 9475. Springer, Cham. https://doi.org/10.1007/978-3-319-27863-6_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27863-6_40

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27862-9

  • Online ISBN: 978-3-319-27863-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation