Skip to main content
SpringerLink
Log in

Exploring Pointer Assisted Reading (PAR): Using Mouse Movements to Analyze Web Users’ Reading Behaviors and Patterns

  • Conference paper
  • First Online:
HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12424))

Included in the following conference series:

Abstract

This paper explores Pointer Assisted Reading (PAR), a reading behavior consisting of moving the mouse cursor (also known as the pointer) along sentences to mark the reading position, similarly to finger-pointing when reading a book. The study shows that PAR is an uncommon reading technique and examines methods to extract and visualize the PAR activity of web users. An analysis shows that PAR data of real users reveal reading properties, such as speed, and reading patterns, such as skipping and rereading. Eye-tracking is usually used to analyze user reading behaviors. This paper advocates for considering PAR-tracking as a feasible alternative to eye-tracking on websites, as tracking the eye gaze of ordinary web users is usually impractical. PAR data might help in spotting quality issues in the textual content of a website, such as unclear text or content that might not interest the website users, based on analyzing reading properties and patterns (e.g. reading speed, skipping, and rereading). Accordingly, PAR-tracking may have various practical applications in a wide range of fields, and particularly in educational technology, e-learning, and web analytics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.objectdb.com/java/jpa.

References

  1. Asvestopoulou, T., Manousaki, V., Psistakis, A., Andreadakis, V., Aslanides, I., Papadopouli, M.: DysLexML: screening tool for dyslexia using machine learning, pp. 1–6. ArXiv abs/1903.06274, March 2019

    Google Scholar 

  2. Biedert, R., Hees, J., Dengel, A., Buscher, G.: A robust realtime reading-skimming classifier. In: Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA 2012, pp 123–130. Association for Computing Machinery, New York (2012). https://doi.org/10.1145/2168556.2168575

  3. Cepeda, C., et al.: Mouse tracking measures and movement patterns with application for online surveys. In: Holzinger, A., Kieseberg, P., Tjoa, A.M., Weippl, E. (eds.) CD-MAKE 2018. LNCS, vol. 11015, pp. 28–42. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99740-7_3

    Chapter  Google Scholar 

  4. Chen, M.C., Anderson, J.R., Sohn, M.H.: What can a mouse cursor tell us more? correlation of eye/mouse movements on web browsing. In: CHI 2001 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2001, pp. 281–282. Association for Computing Machinery, New York (2001)

    Google Scholar 

  5. Claypool, M., Le, P., Wased, M., Brown, D.: Implicit interest indicators. In: Proceedings of the 6th International Conference on Intelligent User Interfaces, IUI 2001, pp. 33–40. Association for Computing Machinery, New York (2001). https://doi.org/10.1145/359784.359836

  6. Conlen, M., Kale, A., Heer, J.: Capture & analysis of active reading behaviors for interactive articles on the web. Comput. Graph. Forum 38(3), 687–698 (2019). https://onlinelibrary.wiley.com/doi/abs/10.1111/cgf.13720https://doi.org/10.1111/cgf.13720

  7. Dirix, N., Vander Beken, H., De Bruyne, E., Brysbaert, M., Duyck, W.: Reading text when studying in a second language: an eye-tracking study. Read. Res. Q. (2019). https://doi.org/10.1002/rrq.277

  8. Eraslan, S., Yesilada, Y., Harper, S.: “The best of both worlds!”: integration of web page and eye tracking data driven approaches for automatic AOI detection. ACM Trans. Web 14(1), 1–31 (2020)

    Article  Google Scholar 

  9. Gilliam Haije, E.: Are session recording tools a risk to internet privacy (2018). https://mopinion.com/are-session-recording-tools-a-risk-to-internet-privacy/

  10. Guo, Q., Agichtein, E.: Exploring mouse movements for inferring query intent. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, pp. 707–708. Association for Computing Machinery, New York (2008). https://doi.org/10.1145/1390334.1390462

  11. Hernandez, M., Wang, Y., Sheng, H., Kalliny, M., Minor, M.: Escaping the corner of death? an eye-tracking study of reading direction influence on attention and memory. J. Consum. Mark. 34, 1–10 (2017). https://doi.org/10.1108/JCM-02-2016-1710

    Article  Google Scholar 

  12. Huang, J., White, R., Buscher, G.: User see, user point: gaze and cursor alignment in web search. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2012, pp. 1341–1350. Association for Computing Machinery, New York (2012)

    Google Scholar 

  13. Iqbal, S., Bailey, B.: Using eye gaze patterns to identify user tasks. In: The Grace Hopper Celebration of Women in Computing, vol. 04, January 2004

    Google Scholar 

  14. Jarodzka, H., Brand-Gruwel, S.: Tracking the reading eye: towards a model of real-world reading. J. Comput. Assist. Learn. 33(3), 193–201 (2017). https://onlinelibrary.wiley.com/doi/abs/10.1111/jcal.12189. https://doi.org/10.1111/jcal.12189

  15. Javed, Y., Shehab, M.: Look before you authorize: Using eye-tracking to enforce user attention towards application permissions. Proc. Priv. Enhancing Technol. 2017(2), 23–37 (2017). https://content.sciendo.com/view/journals/popets/2017/2/article-p23.xml

  16. Kirsh, I.: Directions and speeds of mouse movements on a website and reading patterns: a web usage mining case study. In: Proceedings of the 10th International Conference on Web Intelligence, Mining and Semantics (WIMS 2020), Biarritz, France, pp. 129–138. Association for Computing Machinery, New York, June 2020. https://doi.org/10.1145/3405962.3405982

  17. Kirsh, I., Joy, M.: A different web analytics perspective through copy to clipboard heatmaps. In: Bielikova, M., Mikkonen, T., Pautasso, C. (eds.) ICWE 2020. LNCS, vol. 12128, pp. 543–546. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50578-3_41

    Chapter  Google Scholar 

  18. Kirsh, I., Joy, M.: Splitting the web analytics atom: from page metrics and KPIs to sub-page metrics and KPIs. In: Proceedings of the 10th International Conference on Web Intelligence, Mining and Semantics (WIMS 2020), Biarritz, France, pp. 33–43. Association for Computing Machinery, New York, June 2020. https://doi.org/10.1145/3405962.3405984

  19. Kirsh, I., Joy, M., Kirsh, Y.: Horizontal mouse movements (HMMs) on web pages as indicators of user interest. In: Proceedings of the 22nd HCI International Conference (HCII 2020), Communications in Computer and Information Science. Springer, Cham, July 2020

    Google Scholar 

  20. Lamberti, F., Paravati, G., Gatteschi, V., Cannavò, A.: Supporting web analytics by aggregating user interaction data from heterogeneous devices using viewport-DOM-based heat maps. IEEE Trans. Industr. Inf. 13, 1989–1999 (2017)

    Article  Google Scholar 

  21. Lamberti, F., Paravati, G.: VDHM: viewport-DOM based heat maps as a tool for visually aggregating web users’ interaction data from mobile and heterogeneous devices. In: Proceedings of the 2015 IEEE International Conference on Mobile Services, MS 2015, USA, pp. 33–40. IEEE Computer Society (2015)

    Google Scholar 

  22. Lee, J., Ahn, J.H.: Attention to banner ads and their effectiveness: an eye-tracking approach. Int. J. Electron. Commer. 17(1), 119–137 (2012). https://doi.org/10.2753/JEC1086-4415170105

    Article  Google Scholar 

  23. Li, Y., Xu, P., Lagun, D., Navalpakkam, V.: Towards measuring and inferring user interest from gaze. In: Proceedings of the 26th International Conference on World Wide Web Companion, WWW 2017 Companion, International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, pp. 525–533 (2017). https://doi.org/10.1145/3041021.3054182

  24. Milisavljevic, A., Hamard, K., Petermann, C., Gosselin, B., Doré-Mazars, K., Mancas, M.: Eye and mouse coordination during task: from behaviour to prediction. In: International Conference on Human Computer Interaction Theory and Applications, Setúbal, Portugal, pp. 86–93. SciTePress, January 2018. https://doi.org/10.5220/0006618800860093

  25. Müller, A.M., Baumgartner, S.E., Kühne, R., Peter, J.: The effects of social information on the enjoyment of online videos: an eye tracking study on the role of attention. Media Psychol., 1–22 (2019). https://doi.org/10.1080/15213269.2019.1679647

  26. Navalpakkam, V., Jentzsch, L., Sayres, R., Ravi, S., Ahmed, A., Smola, A.: Measurement and modeling of eye-mouse behavior in the presence of nonlinear page layouts. In: Proceedings of the 22nd International Conference on World Wide Web, WWW 2013, New York, NY, US, pp. 953–964. Association for Computing Machinery (2013). https://doi.org/10.1145/2488388.2488471

  27. Pellicer-Sánchez, A.: Incidental vocabulary acquisition from and while reading: an eye-tracking study. Stud. Second Lang. Acquisition 36(1), 97–130 (2015)

    Article  Google Scholar 

  28. Rodden, K., Fu, X.: Exploring how mouse movements relate to eye movements on web search results pages. In: Proceedings of ACM SIGIR 2007 Workshop on Web Information Seeking and Interaction, pp. 29–32. Association for Computing Machinery, New York (2007). http://research.microsoft.com/~ryenw/proceedings/WISI2007.pdf

  29. Schneider, J., Weinmann, M., vom Brocke, J., Schneider, C.: Identifying preferences through mouse cursor movements - preliminary evidence. In: Proceedings of the 25th European Conference on Information Systems (ECIS), Guimarães, Portugal, pp. 2546–2556. Research-in-Progress Papers (2017)

    Google Scholar 

  30. Smadja, U., Grusky, M., Artzi, Y., Naaman, M.: Understanding reader backtracking behavior in online news articles. In: The World Wide Web Conference, pp. 3237–3243. WWW 2019. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3308558.3313571

  31. Strindberg, A.: Eye movements during reading and reading assessment in Swedish school children: a new window on reading difficulties. In: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications, ETRA 2019. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3314111.3322878

  32. Tzafilkou, K., Protogeros, N., Yakinthos, C.: Mouse tracking for web marketing: enhancing user experience in web application software by measuring self-efficacy and hesitation levels. Int. J. Strateg. Innov. Mark. 01 (2014). https://doi.org/10.15556/IJSIM.01.04.005

  33. Zahoor, S., Bedekar, M., Kosamkar, P.K.: User implicit interest indicators learned from the browser on the client side. In: Proceedings of the 2014 International Conference on Information and Communication Technology for Competitive Strategies, ICTCS 2014. Association for Computing Machinery, New York (2014)

    Google Scholar 

  34. Zhang, H., Miller, K., Cleveland, R., Cortina, K.: How listening to music affects reading: evidence from eye tracking. J. Exp. Psychol. Learn. Mem. Cogn. 44 (2018). https://doi.org/10.1037/xlm0000544

Download references

Author information

Authors and Affiliations

  1. The Academic College of Tel Aviv-Yaffo, Tel Aviv, Israel

    Ilan Kirsh

  2. University of Warwick, Coventry, UK

    Mike Joy

Authors
  1. Ilan Kirsh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mike Joy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ilan Kirsh .

Editor information

Editors and Affiliations

  1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

  3. Siemens Corporation, Princeton, NJ, USA

    Helmut Degen

  4. University of Central Florida, Orlando, FL, USA

    Lauren Reinerman-Jones

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kirsh, I., Joy, M. (2020). Exploring Pointer Assisted Reading (PAR): Using Mouse Movements to Analyze Web Users’ Reading Behaviors and Patterns. In: Stephanidis, C., Kurosu, M., Degen, H., Reinerman-Jones, L. (eds) HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence. HCII 2020. Lecture Notes in Computer Science(), vol 12424. Springer, Cham. https://doi.org/10.1007/978-3-030-60117-1_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-60117-1_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60116-4

  • Online ISBN: 978-3-030-60117-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation