Abstract
One of the strongest instructional interventions documented in educational literature is the use of feedback to influence learning outcomes. However, there is lack of empirical research specifically pertaining to the use of multimedia in the feedback message. The purpose of this research was to test whether organizational pictures and modality as a feedback strategy had an effect on learner comprehension and satisfaction. The research design was a 2 Multimedia (Picture Present vs. Picture Absent) × 2 Modality (Narration vs. On-screen Text) × Trial (Trial 1 vs. Trial 2) with Multimedia and Modality serving as between-subject conditions and Trial serving as a repeated measure. One-hundred fifteen university students participated in the study. Findings show statistically significant increases in comprehension scores from Trial 1 to Trial 2 assessments for all four treatment conditions. Learners in the Picture present conditions were statistically more satisfied with the learning experience. Additionally, we used eye-tracking to verify the extent to which the pictures were used in the feedback message. A discussion and recommendations for future research and feedback design are provided.
Similar content being viewed by others
References
Ainsworth, S., & Loizou, A. T. (2003). The effects of self-explaining when learning with text or diagrams. Cognitive Science, 27, 669–681.
Atkinson, R. K. (2002). Optimizing learning from examples using animated pedagogical agents. Journal of Educational Psychology, 94(2), 416.
Carney, R. N., & Levin, J. R. (2002). Pictorial illustrations still improve students’ learning from text. Educational psychology review, 14(1), 5–26.
Carpenter, P. A., & Shah, P. (1998). A model of the perceptual and conceptual processes in graph comprehension. Journal of Experimental Psychology: Applied, 4(2), 75–100.
Chandler, P., & Sweller, J. (1991). Cognitive load theory and format of instruction. Cognition and Instruction, 8(4), 293–332.
Cheon, J., Crooks, S., Inan, F., Flores, R., & Ari, F. (2011). Exploring the instructional conditions for a reverse modality effect in multimedia instruction. Journal of Educational Multimedia and Hypermedia, 20(2), 117–133.
Cohen, V. B. (1985). A reexamination of feedback in computer-based instruction: Implications for instructional design. Educational Technology, 25(1), 33–37.
Dwyer, F. M. (1965). An experimental evaluation of the relative effectiveness of selected visual illustrations in teaching science concepts to college freshmen. Unpublished Dissertation. The Pennsylvania State University, University Park, PA.
Dwyer, F. M. (1978). Strategies for improving visual learning. Learning Services, Box 784, State College, PA.
Dwyer, F. M., & Lamberski, R. (1983). The instructional effect of coding (color and black and white) in facilitating students’ information acquisition and retrieval. Educational Communication & Technology Journal, 31, 9–21.
Eitel, A., Scheiter, K., Schüler, A., Nyström, M., & Holmqvist, K. (2013). How a picture facilitates the process of learning from text: Evidence for scaffolding. Learning and Instruction, 28, 48–63.
Engle, R. W., & Roberts, J. S. (1982). How long does the modality effect persist? Bulletin of the Psychonomic Society, 19(6), 343–346.
Fiorella, L., Vogel-Walcutt, J., & Schatz, S. (2012). Applying the modality principle to real-time feedback and the acquisition of higher-order cognitive skills. Educational Technology Research and Development, 60(2), 223–238.
Gagne, R. (1985). The conditions of learning (4th ed.). New York: Holt, Rinehart & Winston.
Gagne, R., Briggs, L., & Wager, W. (1992). Principles of instructional design (4th ed.). Fort Worth, TX: HBJ College Publishers.
Hattie, J. (2008). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Abingdon: Routledge.
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of educational research, 77(1), 81–112.
Hegarty, M., & Just, M. A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language, 32(6), 717–742.
Henderson, J. M., Weeks, P. A., Jr., & Hollingworth, A. (1999). The effects of semantic consistency on eye movements during complex scene viewing. Journal of Experimental Psychology: Human Perception and Performance, 25(1), 210–228.
Herrlinger, S., Höffler, T. N., Opfermann, M., & Leutner, D. (2016). When do pictures help learning from expository text? Multimedia and modality effects in primary schools. Research in Science Education. https://doi.org/10.1007/s11165-016-9525-y.
Holsanova, J., Holmberg, N., & Holmqvist, K. (2009). Reading information graphics: The role of spatial contiguity and dual attentional guidance. Applied Cognitive Psychology, 23(9), 1215–1226.
Jarodzka, H., Scheiter, K., Gerjets, P., & Van Gog, T. (2010). In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction, 20(2), 146–154.
Johnson, C. I., & Mayer, R. E. (2012). An eye movement analysis of the spatial contiguity effect in multimedia learning. Journal of Experimental Psychology: Applied, 18(2), 178.
Johnson, C, & Priest, H. (2014). The feedback principle in multimedia learning. In The Cambridge handbook of multimedia learning (pp. 449–463). 2nd Edition. Cambridge: Cambridge University Press.
Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329–354.
Kealy, W. A., & Ritzhaupt, A. D. (2010). Assessment certitude as a feedback strategy for learners’ constructed responses. Journal of Educational Computing Research, 43(1), 25–45.
Kollöffel, B., & de Jong, T. (2015). Can performance feedback during instruction boost knowledge acquisition? Contrasting criterion-based and social comparison feedback. Interactive Learning Environments. https://doi.org/10.1080/10494820.2015.1016535.
Levin, J. R. (1981). On functions of pictures in prose. In F. J. Pirozzolo & M. C. Wittrock (Eds.), Neuropsychological and cognitive processes in reading (pp. 203–228). New York: Academic Press.
Levin, J. R., Anglin, G. J., & Carney, R. N. (1987). On empirically validating functions of pictures in prose. The Psychology of Illustration, 1, 51–85.
Mason, L., Tornatora, M. C., & Pluchino, P. (2013). Do fourth graders integrate text and picture in processing and learning from an illustrated science text? Evidence from eye-movement patterns. Computers & Education, 60(1), 95–109.
Mayer, R. E. (Ed.). (2005). The Cambridge handbook of multimedia learning. Cambridge: Cambridge University Press.
Mayer, R. E. (2009). Multimedia learning. New York: Cambridge University Press.
Mayer, R. E. (2010). Unique contributions of eye-tracking research to the study of learning with graphics. Learning and Instruction, 20(2), 167–171.
Mayer, R. E. (2014). The Cambridge handbook of multimedia learning. New York: Cambridge University Press.
Mayer, R. E., & Anderson, R. B. (1992). The instructive animation: Helping students build connections between words and pictures in multimedia learning. Journal of Educational Psychology, 84(4), 444.
Mayer, R., & Moreno, R. (1998). A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of Educational Psychology, 90(2), 312–320.
Mayer, R. E., & Moreno, R. (2002). Aids to computer-based multimedia learning. Learning and instruction, 12(1), 107–119.
Moreno, R. (2006). Does the modality principle hold for different media? A test of the method-affects-learning hypothesis. Journal of Computer Assisted Learning, 22(3), 149–158.
Moreno, R., & Mayer, R. E. (1999). Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology, 91(2), 358.
Moreno, R., & Valdez, A. (2005). Cognitive load and learning effects of having students organize pictures and words in multimedia environments: The role of student interactivity and feedback. Educational Technology Research and Development, 53(3), 35–45.
Morrison, G. R., Ross, S. M., Kemp, J. E., & Kalman, H. (2010). Designing effective instruction. Hoboken, NJ: Wiley.
Mory, E. H. (2004). Feedback research revisited. Handbook of Research on Educational Communications and Technology, 2, 745–783.
Narciss, S. (2008). Feedback strategies for interactive learning tasks. Handbook of Research on Educational Communications and Technology, 3, 125–144.
O’Neil, H. F., Chuang, S. H. S., & Baker, E. L. (2010). Computer-based feedback for computer-based collaborative problem solving. In Computer-based diagnostics and systematic analysis of knowledge (pp. 261–279). New York: Springer.
Ozcelik, E., Arslan-Ari, I., & Cagiltay, K. (2010). Why does signaling enhance multimedia learning? Evidence from eye movements. Computers in Human Behavior, 26(1), 110–117.
Paas, F., & Ayres, P. (2014). Cognitive load theory: A broader view on the role of memory in learning and education. Educational Psychology Review, 26(2), 191–195.
Paivio, A. (1991). Dual coding theory: Retrospect and current status. Journal of Psychology, 45(3), 255–287.
Pastore, R. S. (2010). The effects of diagrams and time-compressed instruction on learning and learners’ perceptions of cognitive load. Educational Technology Research and Development, 58(5), 485–505.
Pastore, R. (2012). The effects of time-compressed instruction and redundancy on learning and learners’ perceptions of cognitive load. Computers & Education, 58(1), 641–651.
Penney, C. G. (1989). Modality effects and the structure of short-term verbal memory. Memory and Cognition, 17(4), 398–422.
Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124(3), 372–422.
Ritzhaupt, A. D., & Barron, A. (2008). Effects of time-compressed narration and representational adjunct images on cued-recall, content recognition, and learner satisfaction. Journal of Educational Computing Research, 39(2), 161–184.
Ritzhaupt, A. D., Barron, A. E., & Kealy, W. A. (2011). Conjoint processing of time-compressed narration in multimedia instruction: The effects on recall, but not recognition. Journal of Educational Computing Research, 44(2), 203–217.
Ritzhaupt, A. D., & Kealy, W. A. (2015). On the utility of pictorial feedback in computer-based learning environments. Computers in Human Behavior, 48, 525–534.
Schallert, D. L. (1980). The role of illustrations in reading comprehension. In Theoretical issues in reading comprehension (pp. 503–524).
Scheiter, K., Gerjets, P., & Heise, E. (2014). Distraction during learning with hypermedia: Difficult tasks help to keep task goals on track. Frontiers in Psychology, 5, 268.
Schmidt-Weigand, F., Kohnert, A., & Glowalla, U. (2010). A closer look at split visual attention in system-and self-paced instruction in multimedia learning. Learning and Instruction, 20(2), 100–110.
Schneps, M. H., Thomson, J. M., Sonnert, G., Pomplun, M., Chen, C., & Heffner-Wong, A. (2013). Shorter lines facilitate reading in those who struggle. PLoS ONE. https://doi.org/10.1371/journal.pone.0071161.
Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189.
Stevens, J. (1990). Intermediate statistics: A modern approach. Hillsdale, NJ: Lawrence Erlbaum Associates Inc.
Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. New York, NY: Springer.
Van der Kleij, F. M., Feskens, R. C., & Eggen, T. J. (2015). Effects of feedback in a computer-based learning environment on students’ learning outcomes A meta-analysis. Review of Educational Research, 85(4), 475–511.
van Gog, T., & Scheiter, K. (2010). Eye tracking as a tool to study and enhance multimedia learning. Learning and Instruction, 20(2), 95–99.
Wager, W., & Wager, S. (1985). Presenting questions, processing responses, and providing feedback in CAI. Journal of Instructional Development, 8(4), 2–8.
Wang, J., & Antonenko, P. D. (2017). Instructor presence in instructional video: Effects on visual attention, recall, and perceived learning. Computers in Human Behavior, 71, 79–89.
Funding
This study was not funded by any grants or contracts.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
Ritzhaupt, A.D., Pastore, R., Wang, J. et al. Effects of organizational pictures and modality as a feedback strategy on learner comprehension and satisfaction. Education Tech Research Dev 66, 1069–1086 (2018). https://doi.org/10.1007/s11423-018-9575-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-018-9575-0