Abstract
In this paper, we present an adaptive feedback of Kit-Build concept map with confidence tagging (KB map-CT) for improving the understanding of learners in a reading situation. KB map-CT is a digital tool that supports the concept maps strategy where learners can construct concept maps for representing their understanding as learner maps and can identify their confidence in each proposition of the learner maps as a degree of their understanding. Kit-Build concept map (KB map) has been already realized the propositional level automatic diagnosis of the learner maps. Therefore, KB map-CT can utilize both correctness and confidence information for each proposition to design and distinguish feedback, that is, (1) correct and confident, (2) correct and unconfident, (3) incorrect and confident, and (4) incorrect and unconfident. An experiment was conducted to investigate the effectiveness of the adaptive feedback. The results suggest that learners can revise their maps after receiving feedback appropriately. In “correct and unconfident” case, adaptive feedback is useful to improve the confidence. In the case of “incorrect and confident,” improvement of the propositions was the same ratio with the case of “incorrect and unconfident.” The results of the delay test demonstrate that learners can retain their understanding and confidence one week later.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Jonassen, D.H., Grabowski, B.L.: Handbook of Individual Differences, Learning, and Instruction. Routledge, Hillsdale (1993)
Hunt, D.P.: The concept of knowledge and how to measure it. J. Intellect. Capital 4(1), 100–113 (2003)
Bruine de Bruin, W., Parker, A.M., Fischhoff, B.: Individual differences in adult decision-making competence. J. Pers. Soc. Psychol. 92(5), 938–956 (2007)
Kleitman, S., Moscrop, T.: Self-confidence and academic achievements in primary-school children: their relationships and links to parental bonds, intelligence, age, and gender. In: Efklides, A., Misailidi, P. (eds.) Trends and Prospects in Metacognition Research, pp. 293–326. Springer, Boston (2010). https://doi.org/10.1007/978-1-4419-6546-2_14
Kleitman, S., Stankov, L., Allwood, C.M., Young, S., Mak, K.K.L.: Metacognitive self-confidence in school-aged children. In: Self-directed Learning Oriented Assessments in the Asia-Pacific, pp. 139–153 (2012)
Stankov, L., Lee, J., Paek, I.: Realism of confidence judgments. Eur. J. Psychol. Assess. 25(2), 123–130 (2009)
Heron, G., Lerpiniere, J.: Re-engineering the multiple choice question exam for social work. Eur. J. Soc. Work 16(4), 521–535 (2013)
Cisar, S.M., Cisar, P., Pinter, R.: True/false questions analysis using computerized certainty-based marking tests. In: Proceedings of the 7th International Symposium on Intelligent Systems and Informatics SISY, Subotica, Serbia, pp. 171–174 (2009)
Hirashima, T., Yamasaki, K., Fukuda, H., Funaoi, H.: Framework of Kit-Build concept map for automatic diagnosis and its preliminary use. Res. Pract. Technol. Enhanced Learn. 10(1), 1–21 (2015)
Pailai, J., Wunnasri, W., Yoshida, K., Hayashi, Y., Hirashima, T.: Kit-build concept map with confidence tagging in practical uses for assessing the understanding of learners. Int. J. Adv. Comput. Sci. Appl. 9(1), 79–91 (2018)
Novak, J.D., Cañas, A.J.: The theory underlying concept maps and how to construct and use them. Technical Report IHMC CmapTools (2008)
Buldu, M., Buldu, N.: Concept mapping as a formative assessment in college classrooms: measuring usefulness and student satisfaction. Proc. Soc. Behav. Sci. 2(2), 2099–2104 (2010)
Schacter, J., Herl, H.E., Chung, G.K.W.K., Dennis, R.A., O’Neil Jr., H.F.: Computer-based performance assessments: a solution to the narrow measurement and reporting of problem-solving☆. Comput. Hum. Behav. 15(3–4), 403–418 (1999)
Hsieh, I.L.G., O’Neil Jr., H.F.: Types of feedback in a computer-based collaborative problem-solving group task. Comput. Hum. Behav. 18(6), 699–715 (2002)
Chiou, C.C.: The effect of concept mapping on students’ learning achievements and interests. Innov. Educ. Teach. Int. 45(4), 375–387 (2008)
Chularut, P., DeBacker, T.K.: The influence of concept mapping on achievement, self-regulation, and self-efficacy in students of English as a second language. Contemp. Educ. Psychol. 29(3), 248–263 (2004)
Gouli, E., Gogoulou, A., Papanikolaou, K., Grigoriadou, M.: COMPASS: an adaptive web-based concept map assessment tool. In: Concept Maps: Theory, Methodology, Technology. Proceedings of the First International Conference on Concept Mapping, Pamplona, Spain, pp. 295–302 (2004)
Gouli, E., Gogoulou, A., Papanikolaou, K., Grigoriadou, M.: Evaluating learner’s knowledge level on concept mapping tasks. In: Fifth IEEE International Conference on Advanced Learning Technologies, pp. 424–428 (2005)
Gouli, E., Gogoulou, A., Papanikolaou, K.A., Grigoriadou, M.: An adaptive feedback framework to support reflection, guiding and tutoring. In: Advances in Web-Based Education: Personalized Learning Environments, pp. 178–202 (2006)
Wu, P.H., Hwang, G.J., Milrad, M., Ke, H.R., Huang, Y.M.: An innovative concept map approach for improving students’ learning performance with an instant feedback mechanism. Brit. J. Educ. Technol. 43(2), 217–232 (2012)
Grundspenkis, J., Anohina, A.: Evolution of the concept map based adaptive knowledge assessment system: implementation and evaluation results. Sci. J. Riga Tech. Univ. Comput. Sci. 38(38), 13–24 (2009)
Lukasenko, R., Anohina-Naumeca, A., Vilkelis, M., Grundspenkis, J.: Feedback in the concept map based intelligent knowledge assessment system. Sci. J. Riga Tech. Univ. Comput. Sci. 41(1), 17–26 (2010)
Filiz, M., Trumpower, D.L., Ghani, S., Atas, S., Vanapalli, A.: The potential contributions of concept maps for learning website to assessment for learning practices. Knowl. Manag. E-Learn. 7(1), 134–148 (2015)
Yoshida, K., Sugihara, K., Nino, Y., Shida, M., Hirashima, T.: Practical use of kit-build concept map system for formative assessment of learners’ comprehension in a lecture. In: Proceedings of ICCE 2013, pp. 892–901 (2013)
Yoshida, K., Osada, T., Sugihara, K., Nino, Y., Shida, M., Hirashima, T.: Instantaneous assessment of learners’ comprehension for lecture by using kit-build concept map system. In: Yamamoto, S. (ed.) HIMI 2013. LNCS, vol. 8018, pp. 175–181. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39226-9_20
Pailai, J., Wunnasri, W., Yoshida, K., Hayashi, Y., Hirashima, T.: The practical use of Kit-Build concept map on formative assessment. Res. Pract. Technol. Enhanced Learn. 20(12), 1–23 (2017)
Wunnasri, W., Pailai, J., Hayashi, Y., Hirashima, T.: Reliability investigation of automatic assessment of learner-build concept map with Kit-Build method by comparing with manual methods. In: Proceeding of 18th International Conference on Artificial Intelligence in Education, Hubei, China, pp. 418–429 (2017)
Wunnasri, W., Pailai, J., Hayashi, Y., Hirashima, T.: Validity of kit-build method for assessment of learner-build map by comparing with manual methods. IEICE E-D 101(4), 1141–1150 (2018)
Acknowledgement
This work was supported by JSPS KAKENHI Grant Number 17H0183901.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Pailai, J., Wunnasri, W., Hayashi, Y., Hirashima, T. (2018). Correctness- and Confidence-Based Adaptive Feedback of Kit-Build Concept Map with Confidence Tagging. In: Penstein Rosé, C., et al. Artificial Intelligence in Education. AIED 2018. Lecture Notes in Computer Science(), vol 10947. Springer, Cham. https://doi.org/10.1007/978-3-319-93843-1_29
Download citation
DOI: https://doi.org/10.1007/978-3-319-93843-1_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-93842-4
Online ISBN: 978-3-319-93843-1
eBook Packages: Computer ScienceComputer Science (R0)