Abstract
In image and video denoising, a quantitative measure of genuine image content, noise, and blur is required to facilitate quality assessment, when the ground truth is not available. In this paper, we present a no-reference image quality assessment for denoising applications, which examines local image structure using orientation dominancy and patch sparsity. We propose a fast method to find the dominant orientation of image patches, which is used to decompose them into singular values. Combining singular values with the sparsity of the patch in the transform domain, we measure the possible image content and noise of the patches and of the whole image. We show that the proposed method is useful to select parameters of denoising algorithms automatically in different noise scenarios such as white Gaussian and processed noise. Our objective and subjective results confirm the correspondence between the measured quality and the ground truth. We show that the proposed method rivals related state-of-the-art no-reference quality assessment approaches.
Similar content being viewed by others
References
Chen, M., Bovik, A.: No-reference image blur assessment using multiscale gradient. In: International Workshop on Quality of Multimedia Experience, pp. 70–74 (2009)
Dabov, K., Foi, A., Egiazarian, K.: Video denoising by sparse 3D transform-domain collaborative filtering. In: Proceedings of 15th European Signal Processing Conference, vol. 1, p. 7 (2007)
Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)
Demmel, J., Kahan, W.: Accurate singular values of bidiagonal matrices. SIAM J. Sci. Stat. Comput. 11, 873–912 (1990)
Deng, C., Ma, L., Lin, W., Ngan, K.N.: Visual Signal Quality Assessment. Springer, Berlin (2016)
Elad, M., Aharon, M.: Image denoising via learned dictionaries and sparse representation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 895–900 (2006)
Feichtenhofer, C., Fassold, H., Schallauer, P.: A perceptual image sharpness metric based on local edge gradient analysis. Signal Process. Lett. IEEE 20(4), 379–382 (2013)
Feng, X., Milanfar, P.: Multiscale principal components analysis for image local orientation estimation. In: Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, vol. 1, pp. 478–482 (2002)
Ferzli, R., Karam, L.: A no-reference objective image sharpness metric based on the notion of just noticeable blur ( JNB). IEEE Trans. Image Process. 18(4), 717–728 (2009)
Gu, K., Wang, S., Zhai, G., Ma, S., Yang, X., Zhang, W.: Content-weighted mean-squared error for quality assessment of compressed images. Signal Image Video Process. 10(5), 803–810 (2016)
Gu, K., Zhai, G., Lin, W., Liu, M.: The analysis of image contrast: from quality assessment to automatic enhancement. IEEE Trans. Cybern. 46(1), 284–297 (2016). https://doi.org/10.1109/TCYB.2015.2401732
Gu, K., Zhai, G., Lin, W., Yang, X., Zhang, W.: No-reference image sharpness assessment in autoregressive parameter space. IEEE Trans on Image Process. 24(10), 3218–3231 (2015). https://doi.org/10.1109/TIP.2015.2439035
Gu, K., Zhai, G., Yang, X., Zhang, W.: Using free energy principle for blind image quality assessment. IEEE Trans. Multimed. 17(1), 50–63 (2015)
Gu, K., Zhai, G., Yang, X., Zhang, W., Chen, C.W.: Automatic contrast enhancement technology with saliency preservation. IEEE Trans. Circuits Syst. Video Technol. 25(9), 1480–1494 (2015). 10.1109/TCSVT.2014.2372392
Hassen, R., Wang, Z., Salama, M.: Image sharpness assessment based on local phase coherence. IEEE Trans. Image Process. 22(7), 2798–2810 (2013)
He, L., Gao, X., Lu, W., Li, X., Tao, D.: Image quality assessment based on s-cielab model. Signal Image Video Process. 5(3), 283–290 (2011)
Knaus, C., Zwicker, M.: Progressive image denoising. IEEE Trans. Image Process. 23(7), 3114–3125 (2014)
Mittal, A., Moorthy, A., Bovik, A.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)
Moorthy, A., Bovik, A.: A two-step framework for constructing blind image quality indices. Signal Process. Lett. IEEE 17(5), 513–516 (2010)
Narvekar, N., Karam, L.: A no-reference image blur metric based on the cumulative probability of blur detection ( CPBD). IEEE Trans. Image Process. 20(9), 2678–2683 (2011)
Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J., Vozel, B., Chehdi, K., Carli, M., Battisti, F., et al.: Image database TID2013: peculiarities, results and perspectives. Signal Process. Image Commun. 30, 57–77 (2015)
Press, W., Teukolsky, S., Vetterling, W., Flannery, B.: Numerical Recipes 3rd Edition: The Art of Scientific Computing, 3rd edn. Cambridge University Press, Cambridge (2007)
Ramani, S., Blu, T., Unser, M.: Monte-carlo SURE: a black-box optimization of regularization parameters for general denoising algorithms. IEEE Trans. Image Process. 17(9), 1540–1554 (2008)
Soundararajan, R., Bovik, A.C.: Survey of information theory in visual quality assessment. Signal Image Video Process. 7(3), 391–401 (2013)
Takeda, H., Farsiu, S., Milanfar, P.: Kernel regression for image processing and reconstruction. IEEE Trans. Image Process. 16(2), 349–366 (2007)
Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: Sixth International Conference on Computer Vision, pp. 839–846 (1998)
Vu, C., Phan, T., Chandler, D.: S3: a spectral and spatial measure of local perceived sharpness in natural images. IEEE Trans. Image Process. 21(3), 934–945 (2012)
Wang, Z., Bovik, A., Sheikh, H., Simoncelli, E.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Xue, W., Mou, X., Zhang, L., Bovik, A.C., Feng, X.: Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features. IEEE Trans. Image Process. 23(11), 4850–4862 (2014)
Zh, X., Milanfar, P.: IEEE Trans. Image Process. Automatic parameter selection for denoising algorithms using a no-reference measure of image content 19(12), 3116–3132 (2010)
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Rakhshanfar, M., Amer, M.A. Sparsity-based no-reference image quality assessment for automatic denoising. SIViP 12, 739–747 (2018). https://doi.org/10.1007/s11760-017-1215-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-017-1215-3