Abstract
We propose a novel image in-painting method composed of two parts: band matching and seamless cloning. In band matching, a band enclosing the boundary of a missing region is compared to those from the other parts of the image. The inner area of the minimum difference band is then copied to the missing region. Even though this band matching results in successful in-painting in many practical applications, brightness discontinuity (a seam) may appear between the filled missing region and its neighborhood. We apply seamless-cloning to remove such discontinuity between the two regions. Examples show that this two step approach can provide a very fast and effective image in-painting. However, since this basic method using one patch may not deal with cases where there are abrupt changes of color or brightness along the boundary, we furthermore devise one more step: target sub-division. The target area is subdivided into small sub-areas, and the band matching and seamless cloning is applied to each of them. This sub-division is done also when the missing region is too large or the user wants to see more candidates to choose a better one. The multiple results from the sub-division are then ordered according to in-painting quality, which is measured based the edge map or discontinuity map along the boundary band. Our algorithm is demonstrated with various experiments using real images.
Chapter PDF
Similar content being viewed by others
References
Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image Inpainting. In: Proc. ACM SIGGRAPH, New Orleans, Louisiana, USA, pp. 417–424 (2000)
BertalmÃo, M., Bertozzi, A., Sapiro, G.: Navier-Stokes, Fluid-Dynamics and Image and Video Inpainting. In: Proc. Conference on Computer Vision and Pattern Recognition, Hawaii, USA, pp. 355–362 (2001)
Chan, T., Shen, J.: Mathematical Models for Local Nontexture Inpaintings. SIAM Journal on Applied Mathematics, 1019–1043 (2002)
Criminisi, A., Perez, P., Toyama, K.: Object Removal By Exemplar-Based Inpainting. In: Proc. Conference on Computer Vision and Pattern Recognition, Wisconsin, USA, pp. 721–728 (2003)
Drori, I., Cohen-Or, D., Yeshurun, H.: Fragment-Based Image Completion. In: Proc. ACM Transactions on Graphics, SIGGRAPH, San Diego, California, USA, pp. 303–312 (2003)
Efros, A.A., Leung, T.K.: Texture Synthesis by Non-parametric Sampling. In: Proc. International Conference on Computer Vision, Kerkyra, Corfu, Greece, pp. 1033–1038 (1999)
Georgiev, T.: Covariant Derivatives and Vision. In: Proc. European Conference on Computer Vision, Graz, Austria, pp. 56–69 (2006)
Jia, J., Sun, J., Tang, C.K., Shum, H.Y.: Drag-and-Drop Pasting. In: Proc. ACM SIGGRAPH, Los Angeles, California, USA, pp. 631–637 (2005)
Komodakis, N., Tziritas, G.: Image Completion Using Global Optimization. In: Proc. Conference on Computer Vision and Pattern Recognition, New York, NY, USA, pp. 442–452 (2006)
Kwatra, V., Schodl, A., Essa, I., Turk, G., Bobick, A.: Graphcut Textures: Image and Video Synthesis Using Graph Cuts. In: Proc. ACM SIGGRAPH, San Diego, USA, pp. 277–286 (2003)
Perez, P., Gangnet, M., Blake, A.: PatchWorks: Example-Based Region Tiling for Image Editing, Technical Report MSR-TR-2004-04
Perez, P., Gangnet, M., Blake, A.: Poisson Image Editing. In: Proc. ACM SIGGRAPH, San Diego, California, USA, pp. 313–318 (2003)
Shen, J., Jin, X., Zhou, C., Wang, C.C.L.: Gradient Based Image Completion by Solving Poisson Equation. PCM, 257–268 (2005)
Sun, J., Yuan, L., Jia, J., Shum, H.Y.: Image Completion with Structure Propagation. In: Proc. ACM SIGGRAPH, Los Angeles, California, USA, pp. 861–868 (2005)
Wilczkowiak, M., Brostow, G.J., Tordoff, B., Cipolla, R.: Hole Filling Through Photomontage. In: British Machine Vision Conference, Oxford, UK, pp. 492–501 (2005)
Yamauchi, H., Harber, J., Seidel, H.P.: Image Restoration using Multiresolution Texture Synthesis and Image Inpainting. In: Proc. Computer Graphics International, Tokyo, Japan, pp. 120–125 (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, S., Seo, Y. (2007). Image In-painting by Band Matching, Seamless Cloning and Area Sub-division. In: Mery, D., Rueda, L. (eds) Advances in Image and Video Technology. PSIVT 2007. Lecture Notes in Computer Science, vol 4872. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77129-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-540-77129-6_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-77128-9
Online ISBN: 978-3-540-77129-6
eBook Packages: Computer ScienceComputer Science (R0)