Abstract
This article describes a method to insert virtual objects into a real video stream based on feature tracking and camera pose estimation from a set of single-camera video frames. To insert or modify 3D shapes to target video frames, the transformation from the 3D objects to the projection of the objects onto the video frames should be revealed. It is shown that, without a camera calibration process, the 3D reconstruction is possible using multiple images from a single camera under the fixed internal camera parameters. The proposed approach is based on the simplification of the camera matrix of intrinsic parameters and the use of projective geometry. The method is particularly useful for augmented reality applications to insert or modify models to a real video stream. Several experimental results are presented on real-world video streams, demonstrating the usefulness of our method for the augmented reality applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cornelis, K., Pollefeys, M., Vergauwen, M., Van Gool, L.: Augmented reality using uncalibrated video sequences. In: Pollefeys, M., Van Gool, L., Zisserman, A., Fitzgibbon, A.W. (eds.) SMILE 2000. LNCS, vol. 2018, pp. 144–160. Springer, Heidelberg (2001)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd ed. Cambridge University Press, Cambridge (2003)
Chang, N.L., Zakhor, A.: View generation for three-dimensional scenes from video sequences. IEEE Trans. Image Processing 6(4), 584–598 (1997)
Azuma, R.T.: A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6, 355–385 (1997)
Kato, H., Poupyrev, M.B.I., Imamoto, K., Tachibana, K.: Virtual object manipulation on a table-top ar environment. In: proceedings of the International Symposium on Augmented Reality (ISAR 2000), Munich, Germany, pp. 111–119 (2000)
Kahl, F., Heyden, A.: Euclidean reconstruction and auto-calibration from continuous motion. In: Proc. 8th International Conference on Computer Vision, pp. 572–577 (2001)
Heyden, A., Huynh, D.: Auto-calibration via the absolute quadric and scene constraints. In: Proc. 16th International Conference on Pattern Recognition, pp. 631–634 (2002)
Zhang, Y., Xiao, J., Shah, M.: Region completion in a single image. In: EuroGraphics, Grenoble, France (2004)
Rehg, M., Kang, S.B., Cham, T.-J.: Video editing using figure tracking and image-based rendering. In: International Conference on Image Processing, pp. 17–20 (2000)
Fournier, A.: Illumination problems in computer augmented reality. Journee Analyse/Synthèse d’Images (JASI), 1–21 (1994)
Aguiar, P.M.Q., Moura, J.M.F.: Maximum likelihood estimation of the template of a rigid moving object. In: Figueiredo, M., Zerubia, J., Jain, A.K. (eds.) EMMCVPR 2001. LNCS, vol. 2134, pp. 34–49. Springer, Heidelberg (2001)
Huang, T., Netravali, A.: Motion and structure from feature correspondences: A review. Proceedings of IEEE 82(2), 252–268 (1994)
Armstrong, M., Zisserman, A., Beardsley, P.: Euclidean reconstruction from uncalibrated images. In: Proc. 5th British Machine Vision Conference, pp. 509–518 (1994)
Hartley, R., Hayman, E., de Agapito, L., Reid, I.: Camera calibration and the search for infinity. In: Proc. 7th International Conference on Computer Vision, pp. 510–517 (1999)
Pollefeys, M., Gool, L.: Stratified self-calibration with the modulus constraint. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(8), 707–724 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, JS., Sung, M.Y., Noh, SR. (2005). Virtual Object Placement in Video for Augmented Reality. In: Ho, YS., Kim, H.J. (eds) Advances in Multimedia Information Processing - PCM 2005. PCM 2005. Lecture Notes in Computer Science, vol 3767. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11581772_2
Download citation
DOI: https://doi.org/10.1007/11581772_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30027-4
Online ISBN: 978-3-540-32130-9
eBook Packages: Computer ScienceComputer Science (R0)