Abstract
We present the first framework for detecting, localizing and classifying visual traits of object classes, e.g. gender or age of human faces, from arbitrary viewpoints. We embed all three tasks in a viewpoint-invariant model derived from local scale-invariant features (e.g. SIFT), where features are probabilistically quantified in terms of their occurrence, appearance, geometry and relationship to visual traits of interest. An appearance model is first learned for the object class, after which a Bayesian classifier is trained to identify the model features indicative of visual traits. The advantage of our framework is that it can be applied and evaluated in realistic scenarios, unlike other trait classification techniques that assume data that is single-viewpoint, pre-aligned and cropped from background distraction. Experimentation on the standard color FERET database shows our approach can automatically identify the visual cues in face images linked to the trait of gender. Combined detection, localization and gender classification error rates are a) 15% over a 180-degree range of face viewpoint and b) 13% in frontal faces, lower than other reported results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Feret face database, http://www.itl.nist.gov/iad/humanid/colorferet
Baluja, S., Rowley, H.A.: Boosting sex identification performance. IJCV 71(1), 111–119 (2007)
Carneiro, G., Jepson, A.: Multi-scale phase-based local features. In: CVPR, vol. 1, pp. 736–743 (2003)
Carneiro, G., Lowe, D.G.: Sparse flexible models of local features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 29–43. Springer, Heidelberg (2006)
CMU Face Group. Frontal and profile face databases, http://vasc.ri.cmu.edu/idb/html/face/
Crandal, D., Felzenswalb, P., Huttenlocher, D.: Spatial priors for part-based recognition using statistical models. In: CVPR, vol. 1, pp. 10–17 (2005)
Dorko, G., Schmid, C.: Selection of scale-invariant parts for object class recognition. In: ICCV, pp. 634–640 (2003)
Fergus, R., Perona, P., Zisserman, A.: Weakly supervised scale-invariant learning of models for visual recognition. IJCV 71(3), 273–303 (2006)
Gutta, S., Wechsler, H., Phillips, P.: Gender and ethnic classification of human faces using hybrid classifiers. In: FGR, pp. 194–199 (1998)
Jain, A., Huang, J., Fang, S.: Gender identification using frontal facial images. In: ICME (2005)
Jaynes, E.: Prior probabilities. IEEE Transactions of systems, science, and cybernetics 4(3), 227–241 (1968)
Jordan, M.I.: An Introduction to Probabilistic Graphical Models (2003) (in preparation)
Kadir, T., Brady, M.: Saliency, scale and image description. IJCV 45(2), 83–105 (2001)
Kim, H.-C., Kim, D., Ghahramani, Z., Bang, S.Y.: Appearance-based gender classification with gaussian processes. PRL 27, 618–626 (2006)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. IJCV 60(2), 91–110 (2004)
Mikolajczyk, K., Schmid, C.: Indexing based on scale invariant interest points. In: ICCV, pp. I: 525–531 (2001)
Moghaddam, B., Yang, M.: Learning gender with support faces. PAMI 24(5), 707–711 (2002)
Shakhnarovich, G., Viola, P.A., Moghaddam, B.: A unified learning framework for real time face detection and classification. In: FGR (2002)
Sivic, J., Russell, B.C., Efros, A.A., Zisserman, A., Freeman, W.T.: Discovering objects and their localization in images. In: ICCV, pp. 370–377 (2005)
Thomas, A., Ferrari, V., Leibe, B., Tuytelaars, T., Schiele, B., Van Gool, L.: Towards multi-view object class detection. In: CVPR (2006)
Toews, M., Arbel, T.: Detection over viewpoint via the object class invariant. In: ICPR, pp. 765–768 (2006)
Turk, M., Pentland, A.P.: Eigenfaces for recognition. CogNeuro 3(1), 71–96 (1991)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: CVPR, vol. 1, pp. 511–518 (2001)
Weber, M., Welling, M., Perona, P.: Unsupervised learning of models for recognition. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1842, pp. 18–32. Springer, Heidelberg (2000)
Yang, Z., Li, M., Ai, H.: An experimental study on automatic face gender classification. In: ICPR, pp. 1099–1102 (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Toews, M., Arbel, T. (2007). Detecting, Localizing and Classifying Visual Traits from Arbitrary Viewpoints Using Probabilistic Local Feature Modeling. In: Zhou, S.K., Zhao, W., Tang, X., Gong, S. (eds) Analysis and Modeling of Faces and Gestures. AMFG 2007. Lecture Notes in Computer Science, vol 4778. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75690-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-75690-3_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75689-7
Online ISBN: 978-3-540-75690-3
eBook Packages: Computer ScienceComputer Science (R0)