Abstract
The immersion of virtual reality (VR) has transcended the existing experience of multimedia teaching. This paper aims to design a virtual reality eye tracker device to analyze the cognitive process of program debugging by adopting virtual reality technology to build a 3D code rendering system and, at the same time, using eye tracking technology to study visual attention as well as to analyze and compare the differences in internal behavioral cognition in terms of program debugging. This paper has 32 students as participants who have studied C++ programming language courses for more than one year in the department of computer science. With Unity 3D development tool, the experiment creates a virtual classroom scene and C++ programming language code. The participants’ eye movements are recorded by an eye tracker device integrated in a Head-Mounted Display (HMD). The eye movement defines the regions of interest (ROIs) according to the division of the program’s function, and the difference in visual attention between various ROIs in the code is discussed when the participant performs the program debugging task. The finding results are expected to improve the dilemma of the existing programming teaching, so that the instructors can provide appropriate teaching aids for students to achieve the purpose of programming teaching and improving the students’ programming competence.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Change history
18 November 2019
In Chapter “Visual Attention Analysis During Program Debugging Using Virtual Reality Eye Tracker”:
The original version of this chapter was revised. The affiliation of the authors listed the incorrect country. It was corrected to “Taiwan, Republic of China.”
In Chapter “A Systematic Literature Review of Qualitative Gamification Studies in Higher Education”:
The original version of this chapter was revised. Corrections, which were not incorporated during the proofing stage due to a technical error, were incorporated. These corrections affected citations, references, and an author’s affiliation. Typographical errors were also corrected and the email addresses of all authors were added.
References
Liaw, S.S., Huang, H.M., Lai, C.M.: A study of virtual reality and problem-based learning applied in mobile medical education. Chin. J. Sci. Educ. 19(3), 237–256 (2011)
Xu, S., Rajlich, V.: Cognitive process during program debugging. In: Proceedings of the 3rd International Conference on Cognitive Informatics (ICCE 2014), pp. 176–182 (2004)
Murphy, L., Lewandowski, G., McCauley, R., Simon, B., Thomas, L., Zander, C.: Debugging: the good, the bad, and the quirky—a qualitative analysis of novices’ strategies. ACM SIGCSE Bull. 40(1), 163–167 (2008)
Renumol, V.G., Janakiram, D., Jayaprakash, S.: Identification of cognitive processes of effective and ineffective students during computer programming. ACM Trans. Comput. Educ. 10(3), 1–21 (2010)
Benander, A.C., Benander, B.A.: An empirical analysis of debugging performance—differences between iterative and recursive constructs. Syst. Softw. 54, 17–28 (2000)
Wiedenbeck, S., Fix, V., Scholtz, J.: Characteristics of the mental representations of novice and expert programmers: an empirical study. Int. J. Man-Mach. Stud. 39(5), 793–812 (1993)
Sander, M.S., McCormick, E.J.: Human factors in engineering and design. McGraw-Hill, New York (1987)
Just, M.A., Carpenter, P.A.: Eye fixations and cognitive processes. Cogn. Psychol. 8, 441–480 (1976)
Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372 (1998)
Mayer, R.E.: Unique contributions of eye-tracking research to the study of learning with graphics. Learn. Instr. 20(2), 167–171 (2010)
Tsai, M.J., Hou, H.T., Lai, M.L., Liu, W.Y., Yang, F.Y.: Visual attention for solving multiple-choice science problem: an eye-tracking analysis. Comput. Educ. 58, 375–385 (2011)
Chen, H.C., Lai, H.D., Chiu, F.C.: Eye tracking technology for learning and education. Res. Educ. Sci. 4, 39–68 (2010)
Tsai, J.L., Yen, M.H., Wang, C.A.: Eye movement recording and the application in research of reading Chinese. Res. Appl. Psychol. 28, 91–104 (2005)
Temkin, B., Acosta, E., Hatfield, P., Onal, E., Tong, A.: Web-based three-dimensional virtual body structures: W3D-VBS. J. Am. Med. Inf. Assoc. 9(5), 425–436 (2002)
Hoffman, H., Murray, M., Curlee, R., Fritchle, A.: Anatomic visualizeR: teaching and learning anatomy with virtual reality. Inf. Technol. Med. 1, 205–218 (2001)
Brenton, H., Hernandez, J., Bello, F., Strutton, P., Purkayastha, S., Firth, T.: Using multimedia and Web3D to enhance anatomy teaching. Comput. Educ. 49(1), 32–53 (2007)
Crosby, M.E., Stelovsky, J.: How do we read algorithms? A case study. IEEE Comput. 23(1), 24–35 (1990)
Uwano, H., Nakamura, M., Monden, A., Matsumoto, K.I.: Analyzing individual performance of source code review using reviewers’ eye movement. In: Proceedings of ACM Symposium Eye Tracking Research & Applications, pp. 133–140 (2006)
Sharif, B., Falcone, M., Maletic, J.I.: An eye-tracking study on the role of scan time in finding source code defects. In: Proceedings of Symposium on Eye Tracking Research and Applications, pp. 381–384 (2012)
Chen, M., Lim, V.: Eye gaze and mouse cursor relationship in a debugging task. In: Stephanidis, C. (ed.) HCI 2013. CCIS, vol. 373, pp. 468–472. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39473-7_93
Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Program visualization: comparing eye-tracking patterns with comprehension summaries and performance. In: Proceedings of the 18th Annual Psychology of Programming Interest Group Workshop (PPIG’06), pp. 68–82 (2006)
Bednarik, R.: Expertise-dependent visual attention strategies develop over time during debugging with multiple code representations. Int. J. Hum Comput Stud. 70(2), 143–155 (2012)
Bednarik, R., Tukiainen, M.: Temporal eye-tracking data: evolution of debugging strategies with multiple representations. In: Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, pp. 26–28 (2008)
Lin, Y.T., Wu, C.C., Hou, T.Y., Lin, Y.C., Yang, F.Y., Chang, C.H.: Tracking students’ cognitive processes during program debugging—an eye-movement approach. IEEE Trans. Educ. 59(3), 175–186 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, CC., Hung, J.C., Wang, SC., Huang, YM. (2019). Visual Attention Analysis During Program Debugging Using Virtual Reality Eye Tracker. In: Rønningsbakk, L., Wu, TT., Sandnes, F., Huang, YM. (eds) Innovative Technologies and Learning. ICITL 2019. Lecture Notes in Computer Science(), vol 11937. Springer, Cham. https://doi.org/10.1007/978-3-030-35343-8_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-35343-8_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-35342-1
Online ISBN: 978-3-030-35343-8
eBook Packages: Computer ScienceComputer Science (R0)