Abstract
A variable homography is presented which can improve mosaicing across image seams where parallax (i.e., depth variations) occur. Homographies are commonly used in image mosaicing, and are ideal when the acquiring camera has been rotated around its optical center, or when the scene being mosaiced is a plane. In most cases, however, objects in the overlapping areas of adjacent images have different depths and exhibit parallax, and so a single homography will not result in a good merge.To compensate for this, an algorithm is presented which can adjust the scale of the homography relating two views, based upon scene content. The images are first rectified so that their retinal planes are parallel. The scale of the homography is then estimated for each vertical position of a sliding window over the area of overlap, and the scaled homography is applied to this region. The scale is blended so that there are no abrupt changes across the homography field, and the images are finally stitched together. The algorithm has been implemented and tested, and has been found to be effective, fast, and robust.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of SIGGRAPH 2001, pp. 341–346 (2001)
Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., Cohen, M.: Interactive digital photomontage. In: ACM Transactions on Graphics (Proceedings of SIGGRAPH 2004), ACM Press, New York (2004)
Adelson, C.B., Anderson, E.H., Burt, J.: Pyramid method in image processing. In: RCA Engineer, pp. 33–41 (1984)
Krishnan, A., Ahuja, N.: Panoramic image acquisition. In: IEEE CVPR 1996, pp. 379–384. IEEE Computer Society Press, Los Alamitos (1996)
Levin, S.A., Zomet, A., Weiss, Y.: Seamless image stitching in the gradient domain. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3024, pp. 377–389. Springer, Heidelberg (2004)
Davis, J.: Mosaics of scenes with moving objects. In: CVPR 1998 (1998)
Capel, D., Zisserman, A.: Automated mosaicing with super-resolution zoom. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 885–891 (1998)
Fusiello, A., Trucco, E., Verri, A.: Rectification with unconstrained stereo geometry. In: Proc. Brit. Mach. Vis. Conf., September 1997, pp. 400–409 (1997)
Guerreiro, R.F.C., Aguiar, P.M.Q.: Global motion estimation: feature-based, featureless, or both?! In: Campilho, A., Kamel, M. (eds.) ICIAR 2006. LNCS, vol. 4141, pp. 721–730. Springer, Heidelberg (2006)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)
Sawhney, S.H., Gorkani, M.: Model-based 2d and 3d dominant motion estimation for mosaicing and video representation. In: Fifth International Conference on Computer Vision, pp. 583–590 (1995)
Shum, H., Szeliski, R.: Construction and refinedment of panoramic mosaics with global and local alignment. In: IEEE Int’l Conf. Computer Vision, pp. 953–958. IEEE Computer Society Press, Los Alamitos (1998)
Jia, J., Tang, C.: Eliminating structure and intensity misalignment in image stitching. In: Computer Vision, 2005. ICCV 2005. Tenth IEEE International Conference on, vol. 2, pp. 1651–1658. IEEE Computer Society Press, Los Alamitos (2005)
McMillan, L., Bishop, G.: Plenoptic modeling: An image-based rendering system. In: SIGGRAPH (1995)
Brown, M., Lowe, D.G.: Recognising panoramas. In: ICCV2003. Proceedings of the 9th International Conference on Computer Vision, pp. 1218–1225 (2003)
Hansen, M., Anandan, P., Dana, K., der Wal, G., Burt, P.: Real-time scene stabilization and mosaic construction. In: ARPA Image Understanding Workshop, pp. 457–465 (1994)
Irani, P.M., Hsu, S.: Mosaic based representative of video sequences and their applications. In: Proc. 5th Int’l Conf. on Computer Vision, Boston, pp. 605–611 (1995)
Uyttendaele, A.M., Szeliski, R.: Eliminating ghosting and exposure artifacts in image mosaics. In: CVPR 2001 (2001)
Pires, B.E., Aguiar, P.M.Q.: Registration of images with small overlap. In: MMSP 2004. IEEE Intl. Workshop Multimedia Signal Proc., IEEE Computer Society Press, Los Alamitos (2004)
Jaillon, P., Montanvert, A.: Image mosaicking applied to three-dimensional surfaces. In: 12th International Conference on Pattern Recognition, pp. 253–257 (1994)
Burt, P.J., Anandan, P.: Image stabilization by registration to a reference mosaic. In: ARPA Image Understanding Workshop, pp. 457–465 (1994)
Mann, S., Picard, R.: Virtual bellows: Constructing high quality stills from video. In: First IEEE International Conference on Image Processing, IEEE Computer Society Press, Los Alamitos (1995)
Peleg, S.: Elimination of seams from photomosaics. In: CGIP, vol. 16, pp. 90–94 (1981)
Peleg, S., Herman, J.: Panoramic mosaics by manifold projection. In: IEEE CVPR, 1997. Proceeding, pp. 338–343. IEEE Computer Society Press, Los Alamitos (1997)
Halfhill, T.R.: See you around. In: Byte Magazine, pp. 85–90 (1995)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, S., Greenspan, M. (2007). Variable Homography Compensation of Parallax Along Mosaic Seams. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2007. Lecture Notes in Computer Science, vol 4633. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74260-9_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-74260-9_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74258-6
Online ISBN: 978-3-540-74260-9
eBook Packages: Computer ScienceComputer Science (R0)