Abstract
This paper presents Local Log-Euclidean Covariance Matrix (L2ECM) to represent neighboring image properties by capturing correlation of various image cues. Our work is inspired by the structure tensor which computes the second-order moment of image gradients for representing local image properties, and the Diffusion Tensor Imaging which produces tensor-valued image characterizing the local tissue structure. Our approach begins with extraction of raw features consisting of multiple image cues. For each pixel we compute a covariance matrix in its neighboring region, producing a tensor-valued image. The covariance matrices are symmetric and positive-definite (SPD) which forms a Riemannian manifold. In the Log-Euclidean framework, the SPD matrices form a Lie group equipped with Euclidean space structure, which enables common Euclidean operations in the logarithm domain. Hence, we compute the covariance matrix logarithm, obtaining the pixel-wise symmetric matrix. After half-vectorization we obtain the vector-valued L2ECM image, which can be flexibly handled with Euclidean operations while preserving the geometric structure of SPD matrices. The L2ECM features can be used in diverse image or vision tasks. We demonstrate some applications of its statistical modeling by simple second-order central moment and achieve promising performance.
Chapter PDF
Similar content being viewed by others
Keywords
- Covariance Matrice
- Scale Invariant Feature Transform
- Human Detection
- Scale Invariant Feature Transform Descriptor
- Vector Space Structure
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)
Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., Van Gool, L.: A comparison of affine region detectors. Int. J. Comput. Vision 65(1/2), 43–72 (2005)
Liu, C., Yuen, J., Torralba, A.: SIFT flow: Dense correspondence across scenes and its applications. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 978–994 (2011)
Bosch, A., Zisserman, A., Muñoz, X.: Scene Classification via pLSA. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 517–530. Springer, Heidelberg (2006)
Knutsson, H.: Representing local structure using tensors. In: Proc. 6th Scandinavian Conf. on Image Analysis, pp. 244–251 (1989)
Weichert, J., Hagen, H. (eds.): Visualization and image processing of tensor fields. Springer, Heidelberg (2006)
Bihan, D.L., Mangin, J., Poupon, C., Clark, C., Pappata, S., Molko, N.: Diffusion tensor imaging: Concepts and applications. J. Magn. Reson. Imaging 66, 534–546 (2001)
Arsigny, V., Fillard, P., Pennec, X., Ayache, N.: Geometric means in a novel vector space structure on symmetric positive-definite matrices. SIAM J. Matrix Anal. Appl. (2006)
Tuzel, O., Porikli, F., Meer, P.: Region Covariance: A Fast Descriptor for Detection and Classification. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 589–600. Springer, Heidelberg (2006)
Pennec, X., Fillard, P., Ayache, N.: A Riemannian framework for tensor computing. Int. J. Comput. Vision, pp. 41–66 (2006)
Arsigny, V., Fillard, P., Pennec, X., Ayache, N.: Fast and Simple Calculus on Tensors in the Log-Euclidean Framework. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3749, pp. 115–122. Springer, Heidelberg (2005)
Yan, K., Sukthankar, R.: PCA-SIFT: a more distinctive representation for local image descriptors. In: Proc. Int. Conf. Comp. Vis. Patt. Recog., pp. 506–513 (2004)
Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 91–110 (2004)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proc. Int. Conf. Comp. Vis. Patt. Recog., pp. 886–893 (2005)
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110, 346–359 (2008)
Tola, E., Lepetit, V., Fua, P.: DAISY: An efficient dense descriptor applied to wide-baseline stereo. IEEE Trans. Pattern Anal. Mach. Intell. 32(5), 815–830 (2010)
Tuzel, O., Porikli, F., Meer, P.: Human detection via classification on Riemannian manifolds. In: Proc. Int. Conf. Comp. Vis. Patt. Recog., pp. 1–8 (2007)
Porikli, F., Tuzel, O., Meer, P.: Covariance tracking using model update based on lie algebra. In: Proc. Int. Conf. Comp. Vis. Patt. Recog., pp. 728–735 (2006)
Li, X., Hu, W., Zhang, Z., Zhang, X., Zhu, M., Cheng, J.: Visual tracking via incremental Log-Euclidean Riemannian subspace learning. In: Proc. Int. Conf. Comp. Vis. Patt. Recog., pp. 1–8 (2008)
Gong, L., Wang, T., Liu, F.: Shape of gaussians as feature descriptors. In: Proc. Int. Conf. Comp. Vis. Patt. Recog., pp. 2366–2371 (2009)
Nakayama, H., Harada, T., Kuniyoshi, Y.: Global gaussian approach for scene categorization using information geometry. In: Proc. Int. Conf. Comp. Vis. Patt. Recog., pp. 2336–2343 (2010)
Sivalingam, R., Boley, D., Morellas, V., Papanikolopoulos, N.: Tensor Sparse Coding for Region Covariances. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 722–735. Springer, Heidelberg (2010)
Fletcher, P.T., Joshi, S.: Principal Geodesic Analysis on Symmetric Spaces: Statistics of Diffusion Tensors. In: Sonka, M., Kakadiaris, I.A., Kybic, J. (eds.) CVAMIA/MMBIA 2004. LNCS, vol. 3117, pp. 87–98. Springer, Heidelberg (2004)
Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 564–575 (2003)
Wang, S., Lu, H., Yang, F., Yang, M.H.: Superpixel tracking. In: Int. Conf. on Comp. Vis., pp. 1323–1330 (2011)
de Luis García, R., Westin, C.F., Alberola-López, C.: Gaussian mixtures on tensor fields for segmentation: Applications to medical imaging. Comp. Med. Imag. and Graph. 35(1), 16–30 (2011)
Chang, C.C., Lin, C.J.: LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 27:1–27:27 (2011)
Hayman, E., Caputo, B., Fritz, M., Eklundh, J.-O.: On the Significance of Real-World Conditions for Material Classification. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004, Part IV. LNCS, vol. 3024, pp. 253–266. Springer, Heidelberg (2004)
Zhang, J., Marszalek, M., Lzaebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: A comprehensive study. Int. J. Comput. Vision 73, 213–238 (2007)
Lazebnik, S., Schmid, C., Ponce, J.: A sparse texture representation using local affine regions. IEEE Trans. Pattern Anal. Mach. Intell. 27, 1265–1278 (2005)
Varma, M., Zisserman, A.: Texture classification: Are filter banks necessary? In: Proc. Int. Conf. Comp. Vis. Patt. Recog. (2003)
Jalba, A., Roerdink, J., Wilkinson, M.: Morphological hat-transform scale spaces and their use in pattern classification. Pattern Recognition 37, 901–915 (2004)
Manjunath, B., Ma, W.: Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell., 837–842 (1996)
Ross, D., Lim, J., Yang, M.-H.: Adaptive Probabilistic Visual Tracking with Incremental Subspace Update. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004, Part II. LNCS, vol. 3022, pp. 470–482. Springer, Heidelberg (2004)
Leichter, I., Lindenbaum, M., Rivlin, E.: Tracking by affine kernel transformations using color and boundary cues. IEEE Trans. on Pattern Anal. Mach. Intell. 31(1), 164–171 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, P., Wang, Q. (2012). Local Log-Euclidean Covariance Matrix (L2ECM) for Image Representation and Its Applications. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7574. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33712-3_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-33712-3_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33711-6
Online ISBN: 978-3-642-33712-3
eBook Packages: Computer ScienceComputer Science (R0)