Skip to main content
SpringerLink
Log in

SAFA: A System for Assisting Fair Assessments in Team Collaboration

  • Conference paper
  • First Online:
Cross-Cultural Design. Interaction Design Across Cultures (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13311))

Included in the following conference series:

  • 1052 Accesses

Abstract

In teamwork, assessments are applied to examine individuals’ contributions and team performance, helping them conduct self-reflection. Nowadays, leader assessments are commonly used in teams, but they are influenced by subjective factors of leaders. Fair assessments enhance team members’ enthusiasm for work and their belongings to the team. In this paper, we proposed an approach integrating self-assessments, peer assessments, and cross-team assessments to assist leaders in making fair and comprehensive assessments. We developed a prototype system, SAFA. To test the system's effectiveness, we conducted an experiment with 32 participants. The participants were divided into eight teams, with one leader and three members each. We gave each experiment team the same projects and asked team leaders and members to assess their jobs using our system. The analysis showed that the fairness of the assessments has been proved and recognized by team members. The system can be used in project-driven teams in colleges or companies to build an equal working environment and promote team performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Conway, R., Kember, D., Sivan, A., Wu, M.: Peer assessment of an individual’s contribution to a group project. Assess. Eval. High. Educ. 18, 45–56 (1993). https://doi.org/10.1080/0260293930180104

    Article  Google Scholar 

  2. Carvalho, A.: Students’ perceptions of fairness in peer assessment: evidence from a problem-based learning course. Teach. High. Educ. 18, 491–505 (2013). https://doi.org/10.1080/13562517.2012.753051

    Article  Google Scholar 

  3. Fellenz, M.R.: Toward fairness in assessing student groupwork: a protocol for peer evaluation of individual contributions. J. Manag. Educ. 30, 570–591 (2006). https://doi.org/10.1177/1052562906286713

    Article  Google Scholar 

  4. Panadero, E., Romero, M., Strijbos, J.W.: The impact of a rubric and friendship on peer assessment: effects on construct validity, performance, and perceptions of fairness and comfort. Stud. Educ. Eval. 39, 195–203 (2013). https://doi.org/10.1016/j.stueduc.2013.10.005

    Article  Google Scholar 

  5. Walker, A.: British psychology students’ perceptions of group-work and peer assessment. Psychol. Learn. Teach. 1, 28–36 (2001). https://doi.org/10.2304/plat.2001.1.1.28

    Article  Google Scholar 

  6. Freeman, M., Mckenzie, J.: SPARK, a confidential web-based template for self and peer assessment of student teamwork: benefits of evaluating across different subjects. Br. J. Educ. Technol. 33, 551–569 (2002)

    Article  Google Scholar 

  7. Vu, T.T., Dall’Alba, G.: Students’ experience of peer assessment in a professional course. Assess. Eval. High. Educ. 32, 541–556 (2007). https://doi.org/10.1080/02602930601116896

  8. Maiden, B., Perry, B.: Dealing with free-riders in assessed group work: results from a study at a UK university. Assess. Eval. High. Educ. 36, 451–464 (2011). https://doi.org/10.1080/02602930903429302

    Article  Google Scholar 

  9. Lou, Y., Liu, X., Chen, P., Zhang, K., Sun, L.: Gender bias in team-building activities in China. Gend. Manag. 36, 858–877 (2021). https://doi.org/10.1108/GM-04-2020-0116

    Article  Google Scholar 

  10. Lau, C.M., Wong, K.M., Eggleton, I.R.C.: Fairness of performance evaluation procedures and job satisfaction: the role of outcome-based and non-outcome-based effects. Account. Bus. Res. 38, 121–135 (2008). https://doi.org/10.1080/00014788.2008.9663325

    Article  Google Scholar 

  11. Erdem, F., Ozen, J., Atsan, N.: The relationship between trust and team performance. Work Study. 52, 337–340 (2003). https://doi.org/10.1108/00438020310502633

    Article  Google Scholar 

  12. Mach, M., Lvina, E.: When trust in the leader matters: the moderated-mediation model of team performance and trust. J. Appl. Sport Psychol. 29, 134–149 (2017). https://doi.org/10.1080/10413200.2016.1196765

    Article  Google Scholar 

  13. Dirks, K.T.: Trust in leadership and team performance: evidence from NCAA basketball. J. Appl. Psychol. 85, 1004–1012 (2000). https://doi.org/10.1037/0021-9010.85.6.1004

    Article  Google Scholar 

  14. Goodrich, T.J.: Strategies for dealing with the issue of subjectivity in evaluation. Eval. Q. 2, 631–645 (1978)

    Article  Google Scholar 

  15. Strom, P.S., Strom, R.D., Moore, E.G.: Peer and self-evaluation of teamwork skills. J. Adolesc. 22, 539–553 (1999). https://doi.org/10.1006/jado.1999.0247

    Article  Google Scholar 

  16. Chapman, K.J., Van Auken, S.: Creating positive group project experiences: an examination of the role of the instructor on students’ perceptions of group projects. J. Mark. Educ. 23, 117–127 (2001). https://doi.org/10.1177/0273475301232005

    Article  Google Scholar 

  17. Erez, A., LePine, J.A., Elms, H.: Effects of rotated leadership and peer evaluation on the functioning and effectiveness of self-managed teams: a quasi-experiment. Pers. Psychol. 55, 929–948 (2002). https://doi.org/10.1111/j.1744-6570.2002.tb00135.x

    Article  Google Scholar 

  18. Mueller, J., Abecassis-Moedas, C.: Factors influencing the integration of external evaluations in the open innovation process - a qualitative study in micro firms in the creative industries. J. Strateg. Manag. 10, 248–260 (2017). https://doi.org/10.1108/JSMA-08-2014-0073

    Article  Google Scholar 

  19. Canney, N.E., Bielefeldt, A.R.: Validity and reliability evidence of the engineering professional responsibility assessment tool. J. Eng. Educ. 105, 452–477 (2016). https://doi.org/10.1002/jee.20124

    Article  Google Scholar 

  20. Schroder, C., et al.: Development and pilot testing of the collaborative practice assessment tool. J. Interprof. Care. 25, 189–195 (2011). https://doi.org/10.3109/13561820.2010.532620

    Article  Google Scholar 

  21. Akimov, A., Malin, M.: When old becomes new: a case study of oral examination as an online assessment tool. Assess. Eval. High. Educ. 45, 1205–1221 (2020). https://doi.org/10.1080/02602938.2020.1730301

    Article  Google Scholar 

  22. Dochy, F., Segers, M., Sluijsmans, D.: The use of self-, peer and co-assessment in higher education: a review. Stud. High. Educ. 24, 331–350 (1999). https://doi.org/10.1080/03075079912331379935

    Article  Google Scholar 

  23. Boud, D.: Enhancing Learning Through Self-Assessment. Routledge (2013)

    Google Scholar 

  24. Brown, G.T.L., Harris, L.R.: Student self-assessment. In: McMillan, J.H. (ed.) Handbook of Research on Classroom Assessment, pp. 367–393. Sage, Thousand Oaks (2013)

    Chapter  Google Scholar 

  25. Hearn, J., McMillan, J.H.: Student self-assessment: the key to stronger student motivation and higher achievement. Educ. Horizons. 87, 40–49 (2008)

    Google Scholar 

  26. Roscoe, R.D., Chi, M.T.H.: Understanding tutor learning: knowledge-building and knowledge-telling in peer tutors’ explanations and questions. Rev. Educ. Res. 77, 534–574 (2007). https://doi.org/10.3102/0034654307309920

    Article  Google Scholar 

  27. Román-Calderón, J.P., Robledo-Ardila, C., Velez-Calle, A.: Global virtual teams in education: do peer assessments motivate student effort? Stud. Educ. Eval. 70, 101021 (2021). https://doi.org/10.1016/j.stueduc.2021.101021

    Article  Google Scholar 

  28. Orlikowski, W.J., Scott, S.V.: What happens when evaluation goes online? Exploring apparatuses of valuation in the travel sector. Organ. Sci. 25, 868–891 (2014). https://doi.org/10.1287/orsc.2013.0877

    Article  Google Scholar 

  29. Ishii, K., Kim, S.K., Fowler, W., Maeno, T.: Tools for project-based active learning of amorphous systems design: Scenario prototyping and cross team peer evaluation. In: Proceedings of the ASME 2009 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference IDETC/CIE 2009, pp. 1–11 (2009)

    Google Scholar 

  30. Murillo, F.J., Hidalgo, N.: Students’ conceptions about a fair assessment of their learning. Stud. Educ. Eval. 53, 10–16 (2017). https://doi.org/10.1016/j.stueduc.2017.01.001

    Article  Google Scholar 

  31. Reynolds, M., Trehan, K.: Assessment: a critical perspective. Stud. High. Educ. 25, 267–278 (2000). https://doi.org/10.1080/03075070050193406

    Article  Google Scholar 

  32. Lin, J.W., Tsai, C.W., Hsu, C.C., Chang, L.C.: Peer assessment with group awareness tools and effects on project-based learning. Interact. Learn. Environ. 29, 583–599 (2021). https://doi.org/10.1080/10494820.2019.1593198

    Article  Google Scholar 

  33. Shiba, Y., Sugawara, T.: Fair assessment of group work by mutual evaluation based on trust network. In: 2014 IEEE Frontiers in Education Conference (FIE) Proceedings, pp. 1–7. IEEE (2014)

    Google Scholar 

  34. Lazarinis, F., Green, S., Pearson, E.: Creating personalized assessments based on learner knowledge and objectives in a hypermedia Web testing application. Comput. Educ. 55, 1732–1743 (2010). https://doi.org/10.1016/j.compedu.2010.07.019

    Article  Google Scholar 

  35. Chhabria, K., Black, E., Giordano, C., Blue, A.: Measuring health professions students’ teamwork behavior using peer assessment: Validation of an online tool. J. Interprofessional Educ. Pract. 16, 100271 (2019). https://doi.org/10.1016/j.xjep.2019.100271

    Article  Google Scholar 

  36. Teo, T.S.H., Srivastava, S.C., Jiang, L.: Trust and electronic government success: an empirical study. J. Manag. Inf. Syst. 25, 99–131 (2008). https://doi.org/10.2753/MIS0742-1222250303

    Article  Google Scholar 

  37. Seddon, P.B., Kiew, M.-Y.: A partial test and development of DeLone and McLean’s model of IS success. Australas. J. Inf. Syst. 4 (1996). https://doi.org/10.3127/ajis.v24i0.2769

  38. McAllister, D.J., Bigley, G.A.: Work context and the definition of self: how organizational care influences organization-based self-esteem. Acad. Manag. J. 45, 894–904 (2002). https://doi.org/10.2307/3069320

    Article  Google Scholar 

  39. Tsui, A.S., Pearce, J.L., Porter, L.W., Tripoli, A.M.: Alternative approaches to the employee-organization relationship: does investment in employees pay off? Acad. Manag. 40, 1089–1121 (1997)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Alibaba-Zhejiang University Joint Institute of Frontier Technologies, Zhejiang University, Hangzhou, 310027, China

    Yun Lou, Kewei Guo, Xuanhui Liu, Pei Chen, Changyuan Yang & Lingyun Sun

  2. State Key Laboratory of CAD&CG at Zhejiang University, Hangzhou, 310027, China

    Lingyun Sun

  3. Alibaba Group, Hangzhou, 311121, China

    Changyuan Yang

Authors
  1. Yun Lou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kewei Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xuanhui Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pei Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Changyuan Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lingyun Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xuanhui Liu .

Editor information

Editors and Affiliations

  1. Tsinghua University, Beijing, China

    Pei-Luen Patrick Rau

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lou, Y., Guo, K., Liu, X., Chen, P., Yang, C., Sun, L. (2022). SAFA: A System for Assisting Fair Assessments in Team Collaboration. In: Rau, PL.P. (eds) Cross-Cultural Design. Interaction Design Across Cultures. HCII 2022. Lecture Notes in Computer Science, vol 13311. Springer, Cham. https://doi.org/10.1007/978-3-031-06038-0_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06038-0_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06037-3

  • Online ISBN: 978-3-031-06038-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation