Skip to main content
SpringerLink
Log in

Measuring the Effort Demanded by CSCL Design Processes Supporting a Consistent Artifact Flow

  • Conference paper
  • First Online:
Collaboration and Technology (CRIWG 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9334))

Included in the following conference series:

  • 887 Accesses

Abstract

Artifact flow represents an important aspect of teaching / learning processes, especially in CSCL situations in which complex relationships may be found. However, consistent modeling of CSCL processes with artifact flow may increase the cognitive load and associated effort of the teachers-designers and therefore decrease the efficiency of the design process. The empirical study, reported in this paper and grounded on mixed methods, provides evidence of the effort overload when teachers are involved in designing CSCL situations in a controlled environment. The results of the study illustrate the problem through the subjective perception of the participating teachers, complemented with objective parameters, such as time consumed or errors committed, and objective complexity metrics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The original questionnaires used in the study can be accessed at http://goo.gl/gS0Mxp [Q0] and http://goo.gl/vdOZCp [Q3].

References

  1. Ameri, F., Summers, J., Mocko, G., Porter, M.: Engineering design complexity: an investigation of methods and measures. Res. Eng. Des. 19(2–3), 161–179 (2008)

    Article  Google Scholar 

  2. Bordiés, O., Dimitriadis, Y.: Using objective metrics to measure the effort overload in CSCL design processes that support artifact flow. In: 2014 IEEE 14th International Conference on Advanced Learning Technologies (ICALT). IEEE, Athens, Greece (2014)

    Google Scholar 

  3. Bordiés, O., Papasalouros, A., Dimitriadis, Y.: Estimating the gap between informal descriptions and formal models of artifact flows in CSCL. In: de Freitas, S., Rensing, C., Ley, T., Muñoz-Merino, P.J. (eds.) EC-TEL 2014. LNCS, vol. 8719, pp. 554–555. Springer, Heidelberg (2014)

    Google Scholar 

  4. Braha, D., Maimon, O.: The measurement of a design structural and functional complexity. Syst. Man Cybern. Part A: Syst. Humans 28(4), 527–535 (1998)

    Article  Google Scholar 

  5. Cardoso, J.: Process control-flow complexity metric: an empirical validation. In: IEEE International Conference on Services Computing, 2006. SCC 2006, pp. 167–173. SCC 2006. IEEE Computer Society, Washington, DC, USA (2006)

    Google Scholar 

  6. Casey, J., Brosnan, K., Greller, W., Masson, A., MacNeill, A., Murphy, C.: Designing for change: visual design tools to support process change in education. Handbook of Visual Languages in Instructional Design: Theories and Practices, pp. 413–438 (2008)

    Google Scholar 

  7. Conole, G.: Designing for Learning in an Open World. Explorations in the Learning Sciences, Instructional Systems and Performance Technologies, vol. 4. Springer, New York (2012)

    Google Scholar 

  8. Creswell, J.W.: Research Design: Qualitative, Quantitative, and Mixed Methods approaches. Sage publications, Los Angeles (2013)

    Google Scholar 

  9. Derntl, M., Neumann, S., Griffiths, D., Oberhuemer, P.: The conceptual structure of ims learning design does not impede its use for authoring. IEEE Trans. Learn. Technol. 5(1), 74–86 (2012)

    Article  Google Scholar 

  10. Dillenbourg, P., Tchounikine, P.: Flexibility in macro-scripts for computer-supported collaborative learning. J. Comput. Assist. Learn. 23(1), 1–13 (2007)

    Article  Google Scholar 

  11. Dochy, F., Segers, M., Sluijsmans, D.: The use of self-, peer and co-assessment in higher education: a review. Stud. High. Educ. 24(3), 331–350 (1999)

    Article  Google Scholar 

  12. Hernández-Leo, D., Villasclaras-Fernandez, E., Asensio-Perez, J., Dimitriadis, Y., Retalis, S.: CSCL scripting patterns: hierarchical relationships and applicability. In: Sixth International Conference on Advanced Learning Technologies, 2006, pp. 388–392. ICALT 2006. IEEE Computer Society, Washington, DC, USA (2006)

    Google Scholar 

  13. Jung, J.Y., Chin, C.H., Cardoso, J.: An entropy-based uncertainty measure of process models. Inf. Process. Lett. 111(3), 135–141 (2011)

    Article  MATH  MathSciNet  Google Scholar 

  14. Karakostas, A., Demetriadis, S.: Adaptation patterns as a conceptual tool for designing the adaptive operation of CSCL systems. Educ. Technol. Res. Dev. 59(3), 327–349 (2011)

    Article  Google Scholar 

  15. Karakostas, A., Prieto, L.P., Dimitriadis, Y.: Opportunities and challenges for adaptive collaborative support in distributed learning environments: evaluating the GLUE! suite of tools. In: 2012 IEEE 12th International Conference on Advanced Learning Technologies (ICALT), pp. 446–450. IEEE (2012)

    Google Scholar 

  16. Malone, T.W., Crowston, K.: The interdisciplinary study of coordination. ACM Comput. Surv. 26(1), 87–119 (1994)

    Article  Google Scholar 

  17. McKenney, S., Kali, Y., Markauskaite, L., Voogt, J.: Teacher design knowledge for technology enhanced learning: an ecological framework for investigating assets and needs. Instr. Sci. 43(2), 181–202 (2015)

    Article  Google Scholar 

  18. Mendling, J.: Metrics for Process Models: Empirical Foundations of Verification, Error Prediction, and Guidelines for Correctness. Lectures Notes in Business Information Processing. Springer, Heidelberg (2008)

    Book  Google Scholar 

  19. Mendling, J.: Metrics for business process models. In: Aalst, W., Mylopoulos, J., Rosemann, M., Shaw, M.J., Szyperski, C. (eds.) Metrics for Process Models. Lecture Notes in Business Information Processing, vol. 6, pp. 103–133. Springer, Heidelberg (2009). Chapter 4

    Chapter  Google Scholar 

  20. Miao, Y., Burgos, D., Griffiths, D., Koper, R.: Representation of coordination mechanisms in IMS learning design to support group-based learning. In: Lockyer, L., Bennet, S., Agostinho, S., Harper, B. (eds.) Handbook of Research on Learning Design and Learning Objects: Issues, Applications and Technologies, pp. 330–351. IDEA group, Hershey (2008)

    Google Scholar 

  21. Muketha, G., Ghani, A., Selamat, M., Atan, R.: A survey of business process complexity metrics. Inf. Technol. J. 9(7), 1336–1344 (2010)

    Article  Google Scholar 

  22. Palomino-Ramírez, L., Bote-Lorenzo, M., Asensio-Pérez, J., de la Fuente-Valentín, L., Dimitriadis, Y.: The data flow problem in learning design: a case study. In: Proceedings of the 2008 8th International Conference on Networked Learning, NLC, pp. 285–292. NLC 2008 (2008)

    Google Scholar 

  23. Prieto, L.P., Tchounikine, P., Asensio-Pérez, J.I., Sobreira, P., Dimitriadis, Y.: Exploring teachers’ perceptions on different CSCL script editing tools. Comput. Educ. 78, 383–396 (2014)

    Article  Google Scholar 

  24. Rodríguez-Triana, M.J., Martínez-Monés, A., Asensio-Pérez, J.I., Dimitriadis, Y.: Towards a script-aware monitoring process of computer-supported collaborative learning scenarios. Int. J. Technol. Enhanced Learn. 5(2), 151–167 (2013)

    Article  Google Scholar 

  25. Sánchez-González, L., García, F., Ruiz, F., Velthuis, M.P.: Measurement in business processes: a systematic review. Bus. Process Manag. J. 16(1), 114–134 (2010)

    Article  Google Scholar 

  26. Sen, C., Ameri, F., Summers, J.D.: An entropic method for sequencing discrete design decisions. J. Mech. Des. 132(10), 1–11 (2010)

    Article  Google Scholar 

  27. Sobreira, P., Tchounikine, P.: A model for flexibly editing CSCL scripts. Int. J. Comput.-Support. Collaborative Learn. 7(4), 567–592 (2012)

    Article  Google Scholar 

  28. Summers, J.D., Shah, J.J.: Mechanical engineering design complexity metrics: size, coupling, and solvability. J. Mech. Des. 132(2), 021004-1–021004-11 (2010)

    Article  Google Scholar 

  29. Suthers, D.: Technology affordances for intersubjective meaning making: a research agenda for CSCL. Int. J. Comput.-Support. Collaborative Learn. 1(3), 315–337 (2006)

    Article  Google Scholar 

  30. Wu, Y., Hernandez, F., Ortega, F., Clarke, P.J., France, R.: Measuring the effort for creating and using domain-specific models. In: Proceedings of the 10th Workshop on Domain-Specific Modeling. pp. 14:1–14:6. DSM 2010. ACM, New York, NY, USA (2010)

    Google Scholar 

Download references

Acknowledgments

This research has been partially funded by the Autonomous Government of Castilla and León, Spain (ORDEN EDU/346/2013), the Spanish Ministry of Economy and Competitiveness (Project TIN2011-28308-C03-02) and the European Education, Audiovisual and Culture Executive Agency Project 531262-LLP-2012-ES-KA3-KA3MP. The authors would like to thank the rest of the GSIC/EMIC research team, for their effort and contributions to the ideas expressed in this paper.

Author information

Authors and Affiliations

  1. Universidad de Valladolid, 47011, Valladolid, Spain

    Osmel Bordiés & Yannis Dimitriadis

Authors
  1. Osmel Bordiés
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yannis Dimitriadis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Osmel Bordiés .

Editor information

Editors and Affiliations

  1. Universidad de Chile, Santiago, Chile

    Nelson Baloian

  2. SYNOPSIS, Santa Clara, USA

    Yervant Zorian

  3. American University of Armenia, Yerevan, Armenia

    Perouz Taslakian

  4. Yerevan State University, Yerevan, Armenia

    Samvel Shoukouryan

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Bordiés, O., Dimitriadis, Y. (2015). Measuring the Effort Demanded by CSCL Design Processes Supporting a Consistent Artifact Flow. In: Baloian, N., Zorian, Y., Taslakian, P., Shoukouryan, S. (eds) Collaboration and Technology. CRIWG 2015. Lecture Notes in Computer Science(), vol 9334. Springer, Cham. https://doi.org/10.1007/978-3-319-22747-4_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-22747-4_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-22746-7

  • Online ISBN: 978-3-319-22747-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation