Abstract
We present a content-aware image copy-and-paste technique which combines ideas from both matting and gradient-based methods. We modify the diffusion process used in the gradient-based approach to use the alpha matte for the cloned area as a weight function to control intensity interpolation. This ensures that the color style of the significant parts of the selected region is preserved when pasting. We use a framework based on mean-value coordinates to implement our approach, allowing us to provide a parallel implementation suitable for use on a GPU. Experimental results show the advantages of our method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Adobe. PhotoShop 7.0 User Guide (2003)
Boykov, Y.Y., Jolly, M.P.: Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images. In: ICCV, vol. 1, pp. 105–112 (2001)
Chen, T., Cheng, M.-M., Tan, P., Shamir, A., Hu, S.-M.: Sketch2photo: Internet image montage. In: ACM Trans. Graph. 28(5) (2009)
Chuang, Y.-Y., Curless, B., Salesin, D.H., Szeliski, R.: A bayesian approach to digital matting. In: Proceedings of IEEE CVPR 2001, vol. 2, pp. 264–271. IEEE Comput. Soc., Los Alamitos (2001)
Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., Lischinski, D.: Coordinates for instant image cloning. In: SIGGRAPH ’09: ACM SIGGRAPH 2009 papers, pp. 1–9. ACM, New York (2009)
Floater, M.S.: Mean value coordinates. Comput. Aided Geom. Des. 20, 2003 (2003)
Georgiev, T.: Photoshop healing brush: a tool for seamless cloning. In: Workshop on Applications of Computer Vision (ECCV 2004), pp. 1–8 (2004)
Jia, J., Sun, J., Tang, C.-K., Shum, H.-Y.: Drag-and-drop pasting. ACM Trans. Graph. 25(3), 631–637 (2006)
Lalonde, J.-F., Hoiem, D., Efros, A.A., Rother, C., Winn, J., Criminisi, A.: Photo clip art. ACM Trans. Graph. 26(3), 3 (2007)
Land, E.H., McCann, J.J.: Lightness and retinex theory. J. Opt. Soc. Am. 61, 1 (1971)
Levin, A., Lischinski, D., Weiss, Y.: A closed form solution to natural image matting. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Comput. Soc., Los Alamitos (2006)
Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 228–242 (2008)
Li, Y., Sun, J., Tang, C.-K., Shum, H.-Y.: Lazy snapping. In: SIGGRAPH ’04: ACM SIGGRAPH 2004 Papers, pp. 303–308. ACM, New York (2004)
Liu, J., Sun, J., Shum, H.-Y.: Paint selection. ACM Trans. Graph. 28(3), 1–7 (2009)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graph. 22(3), 313–318 (2003)
Rother, C., Kolmogorov, V., Blake, A.: “grabcut”: interactive foreground extraction using iterated graph cuts. In: SIGGRAPH ’04: ACM SIGGRAPH 2004 Papers, pp. 309–314. ACM, New York (2004)
Ruzon, M.A., Tomasi, C.: Alpha estimation in natural images. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2000, vol. 1, pp. 18–25 (2000)
Sun, J., Jia, J., Tang, C.-K., Shum, H.-Y.: Poisson matting. In: SIGGRAPH ’04: ACM SIGGRAPH 2004 Papers, pp. 315–321. ACM, New York (2004)
Wang, J., Cohen, M.F.: Optimized color sampling for robust matting. In: IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR ’07, pp. 1–8 (2007)
Wang, J., Cohen, M.F.: Image and video matting: a survey. Found. Trends. Comput. Graph. Vis. 3(2), 97–175 (2007)
Wang, J., Agrawala, M., Cohen, M.F.: Soft scissors: an interactive tool for realtime high quality matting. In: SIGGRAPH ’07: ACM SIGGRAPH 2007 papers, p. 9. ACM, New York (2007)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ding, M., Tong, RF. Content-aware copying and pasting in images. Vis Comput 26, 721–729 (2010). https://doi.org/10.1007/s00371-010-0448-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-010-0448-8