Skip to main content

Outcomes of Group Model Building

  • Chapter
  • First Online:
Group Model Building

Part of the book series: SpringerBriefs in Operations Research ((BRIEFSOPERAT))

  • 493 Accesses

Abstract

Group model building describes a variety of methods for involving clients or stakeholders in the creation of a system dynamics model. It has been the subject of extensive empirical study since 1988 using a variety of research methods. These studies present strong evidence that group model building supports increases in consensus, insight, communication quality, commitment to conclusions, and process efficiency, compared with other tools. This chapter summarises this evidence and presents a possible research agenda for filling key gaps.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Ackermann F, Andersen DF, Eden C, Richardson GP (2010) Using a group decision support system to add value to group model building. Syst Dyn Rev 26(4):335–346

    Article  Google Scholar 

  • Ajzen I (1991) The theory of planned behavior. Organ Behav Human Decis Process 50(2):179–211

    Article  Google Scholar 

  • Allsop J, Taket A (2003) Evaluating user involvement in primary healthcare. Int J Healthc Technol Manage 5:34–44

    Article  Google Scholar 

  • Andersen DF, Maxwell TA, Richardson GP, Stewart TR (1994) Mental models and dynamic decision making in a simulation of welfare reform. In: Proceedings of the 1994 international system dynamics conference. Chestnut Hill, System Dynamics Society

    Google Scholar 

  • Andersen DF, Richardson GP, Vennix JAM (1997) Group model building: adding more science to the craft. Syst Dyn Rev 13(2):187–203

    Article  Google Scholar 

  • Andersen DF, Vennix JAM, Richardson GP, Rouwette EAJA (2007) Group model building: Problem structuring, policy simulation and decision support. J Oper Res Soc 58(5):691–694

    Article  Google Scholar 

  • Aronson E, Wilson TD, Brewer M (1998) Experimental methods. In: Gilbert D, Fiske S, Lindzey G (eds) The handbook of social psychology. Random House, New York, pp 99–142

    Google Scholar 

  • Baddeley A (1979) The limitations of human memory: Implications for the design of retrospective surveys. Recall Method Soc Surv 9:13–27

    Google Scholar 

  • Beall AM, Ford A (2010) Reports from the field: assessing the art and science of participatory environmental modelling. Int J Inf Syst Social Change 1(2):72–89

    Article  Google Scholar 

  • Berry H, Bowman SR, Hernandez R, Pratt C (2006) Evaluation tool for community development coalitions. J Extension 44. http://www.joe.org/joe/2006december/tt2.shtml. Accessed 24 May 2014

  • Black LJ, Andersen DF (2012) Using visual representations as boundary objects to resolve conflicts in collaborative model-building approaches. Syst. Res Behav Sci 29:194–208

    Article  Google Scholar 

  • Blaikie N (1993) Approaches to social enquiry. Polity, Cambridge

    Google Scholar 

  • Borštnar MK, Kljajić M, Škraba A, Kofjač D, Rajkovič V (2011) The relevance of facilitation in group decision making supported by a simulation model. Syst Dyn Rev 27(3):270–293

    Article  Google Scholar 

  • Bryant JW, Darwin JA (2004) Exploring inter-organisational relationships in the health service: an immersive drama approach. Eur J Oper Res 152:655–666

    Article  Google Scholar 

  • Capelo C, Dias JF (2009) A system dynamics-based simulation experiment for testing mental model and performance effects of using the balanced scorecard. Syst Dyn Rev 25:1–34

    Article  Google Scholar 

  • Cavaleri SA, Raphael, M, Filletti V (2002) Evaluating the performance efficacy of system thinking tools. In: Proceedings of the 2002 international system dynamics conference. System Dynamics Society, Albany

    Google Scholar 

  • Charnley S, Engelbert B (2005) Evaluating public participation in environmental decision-making: EPA’s superfund community involvement program. J Environ Manage 77:165–182

    Article  Google Scholar 

  • Cockerill K, Passell H, Tidwell V (2006) Cooperative modelling: building bridges between science and the public. J Am Water Resour Assoc 42(2):457–471

    Article  Google Scholar 

  • Cole M (2006) Evaluating the impact of community appraisals: some lessons from South-West England. Policy & Politics 34:51–68

    Article  Google Scholar 

  • Cook TD, Campbell DT (1979) Quasi-experimentation: design and analysis for field settings. The University of Chicago Press, Chicago

    Google Scholar 

  • Coyle RG (2000) Qualitative and quantitative modelling in system dynamics: some research questions. Syst Dyn Rev 16(3):225–244

    Article  Google Scholar 

  • Dwyer M, Stave K (2008) Group model building wins: the results of a comparative analysis. In: Proceedings of the 2012 international system dynamics conference. System Dynamics Society, Chestnut Hill

    Google Scholar 

  • Eskinasi M, Rouwette E, Vennix J (2009) Simulating urban transformation in Haaglanden, the Netherlands. Syst Dyn Rev 25(3):182–206

    Article  Google Scholar 

  • Fan S, Shen Q, Lin G (2007) Comparative study of idea generation between traditional value management workshops and GDSS-supported workshops. J Constr Eng Manage 133:816–825

    Article  Google Scholar 

  • Fjermestad J (2004) An analysis of communication mode in group support systems research. Decision Support Syst 37:239–263

    Article  Google Scholar 

  • Fokkinga B, Bleijenbergh I, Vennix JAM (2009) Group model building evaluation in single cases: a method to assess changes in mental models. In: Proceedings of the 2009 international system dynamics conference. System Dynamics Society, Chestnut Hill

    Google Scholar 

  • Franco LA (2007) Assessing the impact of problem structuring methods in multi-organizational settings: an empirical investigation. J Oper Res Soc 58:760–768

    Article  Google Scholar 

  • Franco LA, Rouwette EAJA (2011) Decision development in facilitated modelling workshops. Eur J Oper Res 212(1):164–178

    Article  Google Scholar 

  • Gary MS, Wood RE (2007) Testing the effects of a system dynamics decision aid on mental model accuracy and performance on dynamic decision making tasks. In: Proceedings of the 2007 international system dynamics conference. System Dynamics Society, Albany

    Google Scholar 

  • Gary MS, Wood RE (2011) Mental models, decision rules, and performance heterogeneity. Strateg Manage J 32:560–594

    Article  Google Scholar 

  • Halvorsen KE (2001) Assessing public participation techniques for comfort, convenience, satisfaction, and deliberation. Environ Manage 28:179–186

    Article  Google Scholar 

  • Happach RM, Veldhuis GA, Vennix JAM, Rouwette EAJA (2012) Group model validation. In: Proceedings of the 2012 international conference of the system dynamics society. System Dynamics Society, Albany

    Google Scholar 

  • Hovmand PS, Andersen DF, Rouwette EAJA, Richardson GP, Rux K, Calhoun A (2012) Group model building ‘scripts’ as a collaborative planning tool. Syst Res Behav Sci 29:179–193

    Article  Google Scholar 

  • Huz S (1999) Alignment from group model building for systems thinking: measurement and evaluation from a public policy setting. Ph.D. thesis. New York, State University New York

    Google Scholar 

  • Huz S, Andersen DF, Richardson GP, Boothroyd R (1997) A framework for evaluating systems thinking interventions: an experimental approach to mental health system change. Syst Dyn Rev 13(2):149–169

    Article  Google Scholar 

  • Jensen E (2005) Learning and transfer from a simple dynamic system. Scand J Psychol 46:119–131

    Article  Google Scholar 

  • Jick TD (1979) Mixing qualitative and quantitative methods: Triangulation in action. Adm Sci Q 23(4):602–611

    Article  Google Scholar 

  • Joldersma C, Roelofs E (2004) The impact of soft OR-methods on problem structuring. Eur J Oper Res 152:696–708

    Article  Google Scholar 

  • Kolfschoten GL, Rouwette EAJA (2006) Choice criteria for facilitation techniques. In: Briggs RO, Nunamaker JF (eds) Monograph of the HICSS-39 symposium on case and field studies of collaboration, pp 35–44. Hawaii International Conference of System Sciences, Hawaii

    Google Scholar 

  • Kopainsky B, Saldarriaga M (2012) Assessing understanding and learning about system dynamics. In: Proceedings of the 1993 international system dynamics conference. System Dynamics Society, Albany

    Google Scholar 

  • Kopainsky B, Sawicka A (2011) Simulator-supported descriptions of complex dynamic problems: experimental results on task performance and system understanding. Syst Dyn Rev 27(2):142–172

    Article  Google Scholar 

  • Kopainsky B, Alessi SM, Pedercini M, Davidsen PI (2009) Exploratory strategies for simulation-based learning about national development. In: Proceedings of the 2009 international system dynamics conference. System Dynamics Society, Albany

    Google Scholar 

  • Kopainsky B, Pedercini M, Davidsen PI, Alessi SM (2010a) A blend of planning and learning: simplifying a simulation model of national development. Simul Gaming 41:641–662

    Article  Google Scholar 

  • Kopainsky B, Pirnay-Dummer P, Alessi SM (2010b) Automated assessment of learners’ understanding in complex dynamic systems. In: Proceedings of the 2010 international system dynamics conference. System Dynamics Society, Albany

    Google Scholar 

  • Kopainsky B, Alessi SM, Davidsen PI (2011a) Measuring knowledge acquisition in dynamic decision making tasks. In: Proceedings of the 2011 international system dynamics conference. System Dynamics Society, Albany

    Google Scholar 

  • Kopainsky B, Alessi SM, Pirnay-Dummer P (2011b) Providing structural transparency when exploring a model’s behavior: effects on performance and knowledge acquisition. In: Proceedings of the 2011 international system dynamics conference. System Dynamics Society, Albany

    Google Scholar 

  • Kopainsky B, Pirnay-Dummer P, Alessi SM (2012) Automated assessment of learners’ understanding in complex dynamic systems. Syst Dyn Rev 28(2):131–156

    Article  Google Scholar 

  • Lane DC, Oliva R (1998) The greater whole: towards a synthesis of system dynamics and soft systems methodology. Eur J Oper Res 107(1):214–235

    Article  Google Scholar 

  • Langley PA, Morecroft JDW (2004) Performance and learning in a simulation of oil industry dynamics. Eur J Oper Res 155:715–732

    Article  Google Scholar 

  • Levine JM, Moreland RL (1990) Progress in small group research. Ann Rev Psychol 41(1):585–634

    Article  Google Scholar 

  • Maani KE, Cavana RY (2007) Systems thinking, system dynamics—managing change and complexity, 2nd edn. New Zealand, Pearson Education

    Google Scholar 

  • Maani KE, Maharaj V (2003) Links between systems thinking and complex decision making. Syst Dyn Rev 20(1):21–48

    Article  Google Scholar 

  • McCartt AT, Rohrbaugh J (1989) Evaluating group decision support effectiveness: a performance study of decision conferencing. Dec Support Systs 5(2):243–253

    Article  Google Scholar 

  • McCardle-Keurentjes MH, Rouwette EAJA, Vennix JAM (2008) Effectiveness of group model building in discovering hidden profiles in strategic decision-making. In: Proceedings of the 2008 international system dynamics conference. Chestnut Hill, System Dynamics Society

    Google Scholar 

  • McCardle-Keurentjes MH, Rouwette EAJA, Vennix JAM, Jacobs E (2009) Is group model building worthwhile? Considering the effectiveness of GMB. In: Proceedings of the 2009 international system dynamics conference. Chestnut Hill, System Dynamics Society

    Google Scholar 

  • McGurk B, Sinclair AJ, Diduck A (2006) An assessment of stakeholder advisory committees in forest management: case studies from Manitoba, Canada. Soc Nat Res 19:809–826

    Article  Google Scholar 

  • Mooy R, Rouwette EAJA, Valk G, Vennix JAM, Maas A (2001) Quantification and evaluation issues in group model building: An application to human resource management transition. In: Proceedings of the 2009 International Conference of the System Dynamics Society. System Dynamics Society, Chestnut Hill

    Google Scholar 

  • Moxnes E (2004) Misperceptions of basic dynamics: the case of renewable resource management. Syst Dyn Rev 20:139–162

    Article  Google Scholar 

  • Mulder YG, Lazonder AW, deJong T (2011) Comparing two types of model progression in an inquiry learning environment with modelling facilities. Learn Instr 21(5):614–624

    Article  Google Scholar 

  • Nisbett R, Wilson T (1977) Telling more than we can know: verbal reports on mental processes. Psychol Rev 84(3):231–259

    Article  Google Scholar 

  • Orne M (1962) On the social psychology of the psychology experiment. Am Psychol 17:776–783

    Article  Google Scholar 

  • Phahlamohlaka J, Friend J (2004) Community planning for rural education in South Africa. Eur J Oper Res 152:684–695

    Article  Google Scholar 

  • Plate R (2010) Assessing individuals’ understanding of nonlinear causal structures in complex systems. Syst Dyn Rev 26:19–33

    Article  Google Scholar 

  • Richardson GP, Andersen DF, Maxwell TA, Stewart TR (1994) Foundations of mental model research. In: Proceedings of the 1994 international system dynamics conference. System Dynamics Society, Chestnut Hill

    Google Scholar 

  • Rouwette EAJA (2003) Group model building as mutual persuasion. Wolf Legal Publishers, Nijmegen

    Google Scholar 

  • Rouwette EAJA (2011) Facilitated modelling in strategy development: measuring the impact on communication, consensus and commitment. J Oper Res Soc 62(5):879–887

    Article  Google Scholar 

  • Rouwette EAJA, Vennix JAM, van Mullekom T (2002) Group model building effectiveness: a review of assessment studies. Syst Dyn Rev 18(1):5–45

    Article  Google Scholar 

  • Rouwette EAJA, Vennix JAM, Felling A (2009) On evaluating the performance of problem structuring methods: An attempt at formulating a conceptual model. Group Dec Negot 18:567–587

    Article  Google Scholar 

  • Rouwette EAJA, Korzilius H, Vennix JAM, Jacobs E (2011a) Modelling as persuasion: the impact of group model building on attitudes and behaviour. Syst Dyn Rev 27(1):1–21

    Google Scholar 

  • Rouwette EAJA, Bastings I, Blokker H (2011b) A comparison of group model building and strategic options development and analysis. Group Decis Negot 20(6):781–803

    Article  Google Scholar 

  • Rowe G, Marsh R, Frewer LJ (2004) Evaluation of a deliberative conference. Sci Technol Human Values 29:88–121

    Article  Google Scholar 

  • Rowe G, Horlick-Jones T, Walls J, Pidgeon N (2005) Difficulties in evaluating public engagement initiatives: reflections on an evaluation of the UK public debate about transgenic crops. Public Underst Sci 14:331–352

    Article  Google Scholar 

  • Scott RJ, Cavana RY, Cameron D (2013a) Evaluating immediate and long-term impacts of qualitative group model building workshops on participants’ mental models. Syst Dyn Rev 29(4):216–236

    Article  Google Scholar 

  • Scott RJ, Cavana RY, Cameron D (2015) Group model building and strategy implementation. J Oper Res Soc 66(6):1023–1034

    Article  Google Scholar 

  • Shadish WR, Cook TD, Campbell DT (2001) Experimental and quasi-experimental designs for generalized causal inference, 2nd edn. Wadsworth, Cengage Learning

    Google Scholar 

  • Shaw D (2003) Evaluating electronic workshops through analysing the ‘brainstormed’ ideas. J Oper Res Soc 54:692–705

    Article  Google Scholar 

  • Shields M (2001) An experimental investigation comparing the effects of case study, management flight simulator and facilitation of these methods on mental model development in a group setting. In: Proceedings of the 2001 international conference of the system dynamics society. System Dynamics Society, Albany

    Google Scholar 

  • Shields M (2002) The role of group dynamics in mental model development. In: Proceedings of the 2002 international conference of the system dynamics society. System Dynamics Society, Albany

    Google Scholar 

  • Škraba A, Kljajić M, Leskovar R (2003) Group exploration of system dynamics models—is there a place for a feedback loop in the decision process? Syst Dyn Rev 19(3):243–263

    Article  Google Scholar 

  • Škraba A, Kljajić M, Borštnar MK (2007) The role of information feedback in the management group decision-making process applying system dynamics models. Group Dec Negot 16(1):77–95

    Article  Google Scholar 

  • Sørensen L, Vidal R, Engström E (2004) Using soft OR in a small company—the case of Kirby. Eur J Oper Res 152:555–570

    Article  Google Scholar 

  • Sterman JD (2000) Business dynamics: systems thinking and modelling for a complex world. McGraw-Hill, Boston

    Google Scholar 

  • Stouten H, Heeme A, Gellynck X, Polet H (2012) Learning from playing with microworlds in policy making: an experimental evaluation in fisheries management. Comput Human Behav 28:757–770

    Article  Google Scholar 

  • Tversky A, Kahneman D (1973) Availability: a heuristic for judging frequency and probability. Cogn psychol 5:207–232

    Article  Google Scholar 

  • van Nistelrooij LPJ, Rouwette EAJA, Vestijnen I, Vennix JAM (2012) Power-levelling as an effect of group model building. In: Proceedings of the 2012 international system dynamics conference. System Dynamics Society, Chestnut Hill

    Google Scholar 

  • Vennix JAM, Rouwette EAJA (2000) Group model building. What does the client think of it now? In: Proceedings of 2000 international system dynamics conference. System Dynamics Society, Chestnut Hill

    Google Scholar 

  • Vennix JAM, Scheper W, Willems R (1993) Group model building. What does the client think of it? In: Proceedings of the 1993 international system dynamics conference. System Dynamics Society, Chestnut Hill

    Google Scholar 

  • Videira N, Lopes R, Antunes P, Santos R, Casanova JL (2012) Mapping maritime sustainability issues with stakeholder groups. Syst Res Behav Sci 29(6):596–619

    Article  Google Scholar 

  • Yasarcan H (2010) Improving understanding, learning, and performances of novices in dynamic managerial simulation games. Complexity 15(4):31–42

    Google Scholar 

  • Zagonel AA (2002) Model conceptualization in group model building: a review of the literature exploring the tension between representing reality and negotiating a social order. In: Proceedings of the 2002 international system dynamics conference. System Dynamics Society, Chestnut Hill

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rodney Scott .

Rights and permissions

Reprints and permissions

Copyright information

© 2018 The Author(s)

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Scott, R. (2018). Outcomes of Group Model Building. In: Group Model Building. SpringerBriefs in Operations Research. Springer, Singapore. https://doi.org/10.1007/978-981-10-8959-6_4

Download citation

Publish with us

Policies and ethics