Abstract
In general terms, computer-supported collaborative learning (CSCL) is a new educational paradigm that includes the use of technology to support learning activities. These CSCL environments can be used in a number of subjects (e.g. science, mathematics, language). As CSCL not only involves the implementation of technology or the design of online educational content, researchers have proposed inclusive models which highlight different dimensions of CSCL as a process. These models can then guide CSCL educators and designers improve the design, the experience, the management, and the evaluation of CSCL. However, the use of these models still needs to enable different CSCL stakeholders reflect on the values, purposes and impacts of their efforts. This paper presents a systemic framework that facilitates exploration of the inter-connections between the different aspects of CSCL, and enables a preliminary evaluation of its impacts in a particular context of application. The framework is then used to evaluate a Colombian CSCL project in the area of mathematical problem-solving (MPS). We report on the achievements of this project and in future possibilities to improve CSCL efforts in Colombia and elsewhere. These suggestions can help educators and other CSCL stakeholders to be sensitive and to respond to particular contextual conditions which can contribute to the success of CSCL initiatives.
Similar content being viewed by others
Notes
Five schools of a low socio-economic level and 2 of a high socio-economic level: In Colombia the population is traditionally described to socio-economic levels where level 1 is the lowest and level 6 is the highest.
This topic was chosen basically for two reasons: A. At the beginning of the project the idea was to consider different topics to apply MPS however, this idea change after the third problem (November 2006) because of the low level of participation and low level of mathematics discussions regarding MPS skills students’ level. Hence, there was a need to limit the scope of the problems in one topic. B. This topic is included in the mathematics curriculum for students of 6th scholar year so, students of 10th and 11th years can find it familiar and easy to follow. This change was made according to discussions in one of the monthly meetings.
References
Ackoff R (1978) The art of problem solving: accompanied by Ackoff’s fables. Wiley, New York
Ackoff R (1981) Creating the corporate future: plan or to be planned for. Wiley, New York
Alexander PM (2006) Virtual teamwork in very large undergraduate classes. Comput Educ 47(2):127–147
Arbaugh JB, Godfrey MR, Johnson M, Pollack BL, Niendorf B, Wresch W (2009) Research in online and blended learning in the business disciplines: key findings and possible future directions. Internet High Educ 12:71–87
Artzt F, Armour-Thomas E, Curcio FR (2008) Becoming a reflective mathematics teacher: a guide for observations and self-assessment. Lawrence Erlbaum Associates, New York
Banathy B (1992) A systems view of education: concepts and principles for effective practice. Educational Technology, Englewood Cliffs
Barros R, Pinzón L, Zarama R (2008). Using collaborative work in virtual networks to improve mathematical problem solving skills: an exploratory Study. XXVIII international sunbelt social network conference, 22–27 Jan 2008, St. Petersburg, FL
Beer S (1985) Diagnosing the system for organizations. Wiley, Chichester
Bielaczyc K (2001) Designing social infrastructure: the challenge of building computer-supported learning communities. In: Dillenbourg P, Eurelings A, Hakkarainen K (eds) European perspectives on computer-supported collaborative learning. The proceedings of the first European conference on computer-supported collaborative learning. University of Maastricht, Germany, pp 106–114
Chang C-K, Chen G-D, Wang C-Y (2011) Statistical model for predicting roles and effects in learning community. Behav Inf Technol 30(1):101–111
Charles R, Lester F, O’Daffer P (1987) How to evaluate progress in problem solving. National Council of Teachers of Mathematics, Reston
Checkland P (1981) Systems thinking, systems practice. Wiley, New York
Cho H, Gay G, Davidson B, Ingraffea A (2007) Social networks, communication styles, and learning performance in a CSCL community. Comput Educ 49:309–329
Churchman CW (1971) The design of inquiring systems. Basic concepts of systems and organizations, basic books, New York
Daradoumis T, Martínez-Monés A, Xhafa F (2006) A layered framework for evaluating on-line collaborative learning interactions. Int J Hum-Comput Stud 64:622–635
De Laat M, Lally V (2005) Investigating group structure in CSCL: some new approaches. Inf Syst Front 7(1):13–25
Dillenbourg P (1999) What do you mean by collaborative learning? In: Dillenbourg P (ed) Collaborative-learning: cognitive and computational approaches. Elsevier, Oxford, pp 1–19
Dillenbourg P, Järvelä S, Fischer F (2009) The evolution of research on computer-supported collaborative learning: from design to orchestration. In: Balacheff N, Ludvigsen S, De Jong T, Lazonder A, Barnes S (eds) Technology-enhanced learning. Springer, Berlin, pp 3–19
Dossey JA, McCrone SA, O’Sullivan C (2006) Problem solving in the PISA and TIMSS 2003 assessments (NCES 2007-049). US Department of Education. National Center for Education Statistics, Washington, DC. http://nces.ed.gov/pubsearch. Accessed 12 Jan 2011
Hara N, Bonk C, Angeli C (2000) Content analysis of online discussion in an applied educational psychology course. Instr Sci 28:115–152
Helme S, Clarke D (2001) Cognitive engagement in the mathematics classroom. In: Clarke D (ed) Perspectives on practice and meaning in mathematics and science classrooms. Kluwer Academic, Dordrecht
Hurme T, Järvelä S (2005) Student’s activity in computer-supported collaborative problem solving in mathematics. Int J Comput Math Learn 10:49–73
ICFES (2009) Resultados de Colombia en TIMSS 2007. Resumen Ejecutivo. Ministerio de Educación Nacional, Colombia
Illeris K (2003) Towards a contemporary and comprehensive theory of learning. Int J Lifelong Educ 22:396–406
Jackson MC (2003) Creative holism: systems thinking for managers. Wiley, Chichester
Jarvela S, Jarvenoja H, Veermans M (2008) Understanding the dynamics of motivation in socially shared learning. Int J Educ Res 47(1):122–135
Kreijns K, Kirschner P, Jochems W, Van Buuren H (2004) Determining sociability, social space, and social presence in (a)synchronous collaborative groups. Cyberpsychol Behav 7(2):155–172
Laurillard D (2009) The pedagogical challenges to collaborative technologies. Comput-Support Collab Learn 4:5–20
Lehtinen E (2003) Computer-supported collaborative learning: an approach to powerful learning environments. In: De Corte E, Verschaffel L, Entwistle N, Van Merriëboer J (eds) Unravelling basic components and dimensions of powerful learning environments. Elsevier, Oxford
Levy P (2004) A methodological framework for practice-based research in networked learning. In: Goodyear P, Banks S, Hodgson W, McConnell D (eds) Advances in research in networked learning. computer-supported collaborative learning series (4). Kluwer, London, pp 43–65
Lipponen L (2002) Exploring foundations for computer-supported collaborative learning. In: Proceedings of the conference on computer support for collaborative learning, foundations for a CSCL community, Boulder, 7–11 Jan 2002
Lund K (2011) Analytical frameworks for group interactions in CSCL systems. In: Puntambekar S, Erkens G, Hmelo-Silver CE (eds) Analyzing interactions in CSCL: methods, approaches and issues. Springer, New York
Markauskaite, L. (2006). Towards an integrated analytical framework of information and communications technology literacy: from intended to implemented and achieved dimensions. Inf Res 11(3):paper 252. http://InformationR.net/ir/11-3/paper252.html. Accessed 10 Jan 2010
Maturana H, Varela FJ (1990) El árbol del conocimiento: las bases biológicas del conocimiento humano. Editorial Debate, Madrid
Midgley G (2000) Systemic intervention: philosophy, methodology and practice. Kluwer Academic/Plenum, New York
Ministerio de Educación Nacional—MEN (2010) Revolución Educativa: Acciones y Lecciones 2002–2010. Ministerio de Educación Nacional, República de Colombia
Ministry of Education (2009) The Singapore model method for learning mathematics. Curriculum planning and development division. EPB Pan Pacific, Singapore
Newman BM, Newman PR (2007) Theories of human development. Lawrence Erlbaum Associates, New Jersey
OECD. (2010). PISA 2009 Results: what students know and can do—student performance in reading, mathematics and science (volume I). http://dx.doi.org/10.1787/9789264091450-en. Accessed 11 Jan 2011
Salkind NJ (2004) An introduction to theories of human development. Sage, Thousand Oaks
Sarmiento J, Shumar W (2010) Boundaries and roles: positioning and social location in the virtual math teams (VMT) online community. Comput Hum Behav 26:524–532
Schoenfeld AH (1992) Learning to think mathematically: problem solving, metacognition, and sense-making in mathematics. In: Grouws D (ed) Handbook of research on mathematics teaching and learning. MacMillan, New York, pp 334–370
Sfard A (2003) Balancing the unbalanceable: the NCTM standards in light of theories of learning mathematics. In: Kilpatrick J, Martin WG, Schifter D (eds) A research companion to principles and standards for school mathematics. National Council of Teachers of Mathematics, Reston
Sharda R, Romano N, Lucca J, Weiser M, Scheets G, Chung J-M, Sleezer C (2004) Foundation for the study of computer-supported collaborative learning requiring immersive presence. J Manag Inf Syst 20(4):31–63
Sheremetov L, Guzmán A (2002) EVA: an interactive Web-based collaborative learning environment. Comput Educ 39:161–182
Stahl G (2010) Guiding group cognition in CSCL. Comput-Support Collab Learn 5:255–258
Stahl G, Koschmann T, Suthers D (2006) Computer-supported collaborative learning: an historical perspective. In: Sawyer RK (ed) Cambridge handbook of the learning sciences. Cambridge University Press, Cambridge, pp 409–426
Strijbos JW (2011) Assessment of (computer-supported) collaborative learning. IEEE Trans Learn Technol 4(1):59–73
Strijbos J, De Laat M (2010) Developing the role concept for computer-supported collaborative learning: an explorative synthesis. Comput Hum Behav 26:495–505
Strijbos J, Fischer F (2007) Methodological challenges for collaborative learning research. Learn Instr 17:389–393
Strijbos JW, Kirschner PA, Martens RL (2004a) What we know about CSCL… and what we do not (but we need to) know about CSCL. In: Strijbos JW, Kirschner PA, Martens RL (eds) What we know about CSCL. Kluwer Academic, The US
Strijbos JW, Martens R, Jochems W (2004b) Designing for interaction: six steps to designing computer-supported group-based learning. Comput Educ 42:403–424
Strijbos JW, Martens R, Prins F, Jochems W (2006) Content analysis: what are they talking about? Comput Educ 46:29–48
Suthers DD (2006) Technology affordances for inter-subjective meaning making: a research agenda for CSCL. Int J Compu-Support Collab Learn 1(3):315–337
Swan M (2006) Collaborative learning in mathematics: a challenge to our beliefs and practices. National Research and Development Centre for Adult Literacy and Numeracy (NRDC), London
Ulrich W (1983) Critical heuristics of social planning: a new approach to practical philosophy. Haupt, Berne
von Bertalanffy L (1968) General system theory: foundations, development, applications. George Braziller, New York
Wasserman S, Faust K (1994) Social network analysis: methods and applications. Cambridge University Press, Cambridge
Yuan Y, Gay G (2006) Homophily of network ties and bonding and bridging social capital in computer-mediated distributed teams. J Comput-Mediat Commun 11(4):1062–1084
Acknowledgments
We would like to thank both Universidad de los Andes and Royal Holloway, University of London for the support offered in undertaking the work reported in this paper. We also would like to thank all the colleagues whom have been working with us in this research project and all the teachers and students involved in it.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Barros-Castro, R.A., Córdoba-Pachón, J.R. & Pinzón-Salcedo, L.A. A Systemic Framework for Evaluating Computer-Supported Collaborative Learning—Mathematical Problem-solving (CSCL-MPS) Initiatives: Insights from a Colombian Case. Syst Pract Action Res 27, 265–285 (2014). https://doi.org/10.1007/s11213-013-9279-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11213-013-9279-7