Skip to main content
SpringerLink
Log in

Pervasive Retail Strategy Using a Low-Cost Free Gaze Estimation System

  • Conference paper
  • First Online:
Video Analytics for Audience Measurement (VAAM 2014)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8811))

Abstract

This paper proposes a pervasive retail architecture based on a free human gaze estimation system. The main aim of the paper is to investigate the possibility to automatically understand the behavior of the persons looking at a shop window: this is done by a gaze estimation technique that uses a RGB-D device in order to extract head pose information from which a fast geometric technique then evaluates the focus of attention of the persons in the scene (even more persons at the same time). The main contribution concerns with the application into this challenging research field of a gaze estimation working without any initial calibration and, in spite of this, able to properly deal with completely unaware persons moving in unconstrained environments. Preliminary experiments were conducted in our lab in order to quantitative validate the accuracy of the gaze estimation on different benchmarks of persons. Then the qualitative evaluation of the effectiveness of the proposed architecture was conducted in a real shop window demonstrating the ability to deal with real challenging environmental conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Apr 2014. http://msdn.microsoft.com/en-us/library/hh855347.aspx

  2. Ahlberg, J.: Candide-3-an updated parameterised face (2001)

    Google Scholar 

  3. Ba, S.O., Odobez, J.M.: Recognizing visual focus of attention from head pose in natural meetings. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 39(1), 16–33 (2009)

    Article  Google Scholar 

  4. Benfold, B., Reid, I.: Unsupervised learning of a scene-specific coarse gaze estimator. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2344–2351. IEEE (2011)

    Google Scholar 

  5. Besl, P., McKay, N.D.: A method for registration of 3-d shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)

    Article  Google Scholar 

  6. Brey, P.: Freedom and privacy in ambient intelligence. Ethics Inf. Technol. 7(3), 157–166 (2005)

    Article  Google Scholar 

  7. Brolly, X.L., Stratelos, C., Mulligan, J.B.: Model-based head pose estimation for air-traffic controllers. In: Proceedings of the 2003 International Conference on Image Processing, ICIP 2003, vol. 2, pp. II-113. IEEE (2003)

    Google Scholar 

  8. Chen, J., Ji, Q.: 3d gaze estimation with a single camera without ir illumination. In: 19th International Conference on Pattern Recognition, ICPR 2008, pp. 1–4. IEEE (2008)

    Google Scholar 

  9. van Doorn, M., van Loenen, E., de Vries, A.P.: Deconstructing ambient intelligence into ambient narratives: the intelligent shop window. In: Proceedings of the 1st International Conference on Ambient Media and Systems, p. 8. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering) (2008)

    Google Scholar 

  10. Doshi, A., Trivedi, M.M.: Attention estimation by simultaneous observation of viewer and view. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 21–27. IEEE (2010)

    Google Scholar 

  11. Funatsu, N., Takahashi, T., Deguchi, D., Ide, I., Murase, H.: A study on gaze estimation using head and body pose information. In: International Workshop on Advanced Image Technology (2013)

    Google Scholar 

  12. Funes Mora, K., Odobez, J.M.: Gaze estimation from multimodal kinect data. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 25–30. IEEE (2012)

    Google Scholar 

  13. Guestrin, E.D., Eizenman, M.: General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Trans. Biomed. Eng. 53(6), 1124–1133 (2006)

    Article  Google Scholar 

  14. Hansen, D., Ji, Q.: In the eye of the beholder: A survey of models for eyes and gaze. IEEE Trans. Pattern Anal. Mach. Intell. 32(3), 478–500 (2010)

    Article  Google Scholar 

  15. Ince, I.F., Kim, J.W.: A 2d eye gaze estimation system with low-resolution webcam images. EURASIP J. Adv. Signal Process. 2011(1), 1–11 (2011)

    Article  Google Scholar 

  16. Janko, Z., Hajder, L.: Improving human-computer interaction by gaze tracking. In: 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom), pp. 155–160. IEEE (2012)

    Google Scholar 

  17. Jellinger, K.: Cognitive processes in eye guidance. Eur. J. Neurol. 13(9), e9 (2006)

    Article  Google Scholar 

  18. Kohlbecher, S., Bardinst, S., Bartl, K., Schneider, E., Poitschke, T., Ablassmeier, M.: Calibration-free eye tracking by reconstruction of the pupil ellipse in 3d space. In: Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, pp. 135–138. ACM (2008)

    Google Scholar 

  19. Langheinrich, M.: Privacy by design – principles of privacy-aware ubiquitous systems. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201, pp. 273–291. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  20. Langton, S.R., Honeyman, H., Tessler, E.: The influence of head contour and nose angle on the perception of eye-gaze direction. Percept. Psychophysics 66(5), 752–771 (2004)

    Article  Google Scholar 

  21. Li, Z., Sastry, S.S., Murray, R.: A mathematical introduction to robotic manipulation (1994)

    Google Scholar 

  22. Mateo, J.C., San Agustin, J., Hansen, J.P.: Gaze beats mouse: hands-free selection by combining gaze and emg. In: CHI’08 Extended Abstracts on Human Factors in Computing Systems, pp. 3039–3044. ACM (2008)

    Google Scholar 

  23. Morimoto, C.H., Mimica, M.R.: Eye gaze tracking techniques for interactive applications. Comput. Vis. Image Underst. 98(1), 4–24 (2005)

    Article  Google Scholar 

  24. Nabati, M., Behrad, A.: Robust facial 2d motion model estimation for 3d head pose extraction and automatic camera mouse implementation. In: 2010 5th International Symposium on Telecommunications (IST), pp. 817–824. IEEE (2010)

    Google Scholar 

  25. Pieters, R.: A review of eye-tracking research in marketing. Rev. Mark. Res. 4, 123–147 (2008)

    Article  Google Scholar 

  26. Ravnik, R., Solina, F.: Audience measurement of digital signage: Quantitative study in real-world environment using computer vision. Interact. Comput. 25(3), 218–228 (2013)

    Article  Google Scholar 

  27. Robertson, N., Reid, I., Brady, J.: What are you looking at? gaze estimation in medium-scale images. In: Proceedings of the HAREM Workshop (in assoc. with BMVC) (2005)

    Google Scholar 

  28. Stiefelhagen, R., Zhu, J.: Head orientation and gaze direction in meetings. In: CHI’02 Extended Abstracts on Human Factors in Computing Systems, pp. 858–859. ACM (2002)

    Google Scholar 

  29. Tonkin, C., Ouzts, A.D., Duchowski, A.T.: Eye tracking within the packaging design workflow: interaction with physical and virtual shelves. In: Proceedings of the 1st Conference on Novel Gaze-Controlled Applications, p. 3. ACM (2011)

    Google Scholar 

  30. Valenti, R., Sebe, N., Gevers, T.: Combining head pose and eye location information for gaze estimation. IEEE Trans. Image Process. 21(2), 802–815 (2012)

    Article  MathSciNet  Google Scholar 

  31. Voit, M., Stiefelhagen, R.: 3d user-perspective, voxel-based estimation of visual focus of attention in dynamic meeting scenarios. In: International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, p. 51. ACM (2010)

    Google Scholar 

  32. Waizenegger, W., Atzpadin, N., Schreer, O., Feldmann, I., Eisert, P.: Model based 3d gaze estimation for provision of virtual eye contact. In: 2012 19th IEEE International Conference on Image Processing (ICIP), pp. 1973–1976. IEEE (2012)

    Google Scholar 

  33. Wetzel, P.A., Krueger-Anderson, G., Poprik, C., Bascom, P.: An eye tracking system for analysis of pilots’ scan paths. In: The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC), vol. 1996. NTSA (1996)

    Google Scholar 

  34. Xiao, J., Moriyama, T., Kanade, T., Cohn, J.F.: Robust full-motion recovery of head by dynamic templates and re-registration techniques. Int. J. Imaging Syst. Technol. 13(1), 85–94 (2003)

    Article  Google Scholar 

  35. Zhang, W.Z., Wang, Z.C., Xu, J.K., Cong, X.Y.: A method of gaze direction estimation considering head posture. Int. J. Signal Process. Image Process. Pattern Recogn. 6(2), 103–111 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National Research Council of Italy - Institute of Optics, Arnesano, LE, Italy

    Dario Cazzato, Marco Leo, Paolo Spagnolo & Cosimo Distante

Authors
  1. Dario Cazzato
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marco Leo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Paolo Spagnolo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cosimo Distante
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dario Cazzato .

Editor information

Editors and Affiliations

  1. National Research Council of Italy, Arnesano, Lecce, Italy

    Cosimo Distante

  2. Dipartimento di Matematica e Informatica, University of Catania IT, Catania, Catania, Italy

    Sebastiano Battiato

  3. Queen Mary University of London, London, United Kingdom

    Andrea Cavallaro

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Cazzato, D., Leo, M., Spagnolo, P., Distante, C. (2014). Pervasive Retail Strategy Using a Low-Cost Free Gaze Estimation System. In: Distante, C., Battiato, S., Cavallaro, A. (eds) Video Analytics for Audience Measurement. VAAM 2014. Lecture Notes in Computer Science(), vol 8811. Springer, Cham. https://doi.org/10.1007/978-3-319-12811-5_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12811-5_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12810-8

  • Online ISBN: 978-3-319-12811-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation