Abstract
Sustainability science research conducted with Indigenous collaborators must be Indigenous-led and achieve impacts that are grounded in local values and priorities, both for ethical reasons and to achieve more robust outcomes. However, there has been limited focus on determining how best to evaluate the way research is used, shared and created to adaptively solve complex sustainable issues facing Indigenous lands. In this paper, we outline a collaborative and adaptive approach for conducting Indigenous-led evaluations of sustainability research and show how this approach was applied to evaluate cross-cultural knowledge co-production practice and impact in Australia’s jointly managed and World Heritage-listed Kakadu National Park. As part of an Indigenous-led research project, indicators were co-developed by Indigenous and non-Indigenous research team members to monitor the health of the knowledge-sharing and co-production practices that underpinned the design, management and success of the project’s research activities. The evaluations focused on determining whether research activities were providing negotiated benefits for local Indigenous people; helping to restore and protect agreed values in priority areas; and supporting Indigenous-led collaborative knowledge sharing and research practices. In Kakadu, we show how the Indigenous-led design of the research evaluation empowered the usability and benefits of knowledge which was negotiated, shared and co-created. The approach shows how sustainability science can be evaluated by Indigenous leaders to test if and how research practice and impact is responding to their priorities for their traditional estates.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Agrawal A (2002) Indigenous knowledge and the politics of classification. Int Soc Sci J 54:287–297
Austin BJ, Robinson CJ, Fitzsimons JA, Sandford M, Ens EJ, Macdonald JM, Hockings M, Hinchley DG, McDonald FB, Corrigan C, Kennett R, Hunter-Xenie H, Garnett ST (2018) Integrated measures of Indigenous land and sea management effectiveness: challenges and opportunities for improved conservation partnerships in Australia. Conserv Soc 16:372–384. https://doi.org/10.4103/cs.cs_16_123
Austin BJ, Robinson CJ, Mathews D, Oades C, Wiggin A, Dobbs RJ, Lincoln G, Garnett ST (2019) An Indigenous-led approach for regional knowledge partnerships in the Kimberley region of Australia. Hum Ecol 47:577–588. https://doi.org/10.1007/s10745-019-00085-9
Barbour W, Schlesinger C (2012) Who’s the boss? Postcolonialism, ecological research and conservation management on Australian Indigenous lands. Ecol Manag Restor 13:36–41. https://doi.org/10.1111/j.1442-8903.2011.00632.x
Barelli M (2012) Free, prior and informed consent in the aftermath of the UN declaration on the rights of Indigenous peoples: developments and challenges ahead. Intern J Hum Rights 16:1–24. https://doi.org/10.1080/13642987.2011.597746
Baylis K, Honey-Rosés J, Börner J, Corbera E, Ezzine-de-Blas D, Ferraro PJ, Lapeyre R, Persson UM, Pfaff A, Wunder S (2016) Mainstreaming impact evaluation in nature conservation. Conserv Lett 9:58–64. https://doi.org/10.1111/conl.12180
Berkes F (2009) Evolution of co-management: role of knowledge generation, bridging organizations and social learning. J Environ Manag 90(5):1692–1702
Blackstock KL, Kelly GL, Horsey BL (2007) Developing and applying a framework to evaluate participatory research for sustainability. Ecol Econ 60(4):726–742. https://doi.org/10.1016/j.ecolecon.2006.05.014
Chilsa B (2019) Indigenous research methodologies. Sage Publications
Clark WC, van Kerkhoff L, Lebel L, Gallopin GC (2016) Crafting usable knowledge for sustainable development. Proc Natl Acad Sci 113:4570–4578. https://doi.org/10.1073/pnas.1601266113
Coombes B, Johnson JT, Howitt R (2014) Indigenous geographies III: methodological innovation and the unsettling of participatory research. Prog Hum Geogr 38:845–854. https://doi.org/10.1177/0309132513514723
Corrigan C, Robinson CJ, Burgess ND, Kingston N, Hockings M (2018) Global review of social indicators used in protected area management evaluation. Conserv Lett 11:1–9. https://doi.org/10.1111/conl.12397
Davies J, Hill R, Walsh FJ, Sandford M, Smyth D, Holmes MC (2013) Innovation in management plans for community conserved areas: experiences from Australian Indigenous protected areas. Ecol Soc 18:14. https://doi.org/10.5751/ES-05404-180214
Díaz-Reviriego I, Turnhout E, Beck S (2019) Participation and inclusiveness in the Intergovernmental Science–Policy Platform on Biodiversity and Ecosystem Services. Nat Sustain 2(6):457–464. https://doi.org/10.1038/s41893-019-0290-6
Duncan T, Villarreal-Rosas J, Carwardine J, Garnett ST, Robinson CJ (2018) Influence of environmental governance regimes on the capacity of Indigenous peoples to participate in conservation management. Parks 24:87–102. https://doi.org/10.2305/IUCN.CH.2018.PARKS-24-2TD.en
Garnett ST, Burgess ND, Fa JE, Fernández-Llamazares Á, Molnár Z, Robinson CJ, Watson JE, Zander KK, Austin B, Brondizio ES, Collier NF (2018) A spatial overview of the global importance of Indigenous lands for conservation. Nat Sustain 1:369–374. https://doi.org/10.1038/s41893-018-0100-6
Harfield S, Pearson O, Morey K, Kite E, Canuto K, Glover K, Gomersall JS, Carter D, Davy C, Aromataris E, Braunack-Mayer A (2020) Assessing the quality of health research from an Indigenous perspective: the Aboriginal and Torres Strait Islander quality appraisal tool. BMC Med Res Methodol 20:1–9. https://doi.org/10.1186/s12874-020-00959-3
Haynes C (2017) The value of work and ‘common discourse’ in the joint management of Kakadu National Park. Aust J Anthropol 28:72–87. https://doi.org/10.1111/taja.12169
Hill R, Grant C, George M, Robinson CJ, Jackson S, Abel N (2012) A typology of Indigenous engagement in Australian environmental management: implications for knowledge integration and social-ecological system sustainability. Ecol Soc 17:23. https://doi.org/10.5751/ES-04587-170123
Hudson M, Farrar D, McLean L (2016) Tribal data sovereignty: Whakatohea rights and interests. In: Kukutai T, Taylor J (eds) Indigenous data sovereignty: towards an agenda. ANU Press, Canberra, pp 157–178
IPBES (Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services) 2019 Global assessment report on biodiversity and ecosystem services. IPBES, Bonn. https://ipbes.net/global-assessment. Accessed 28 July 2021
Izurieta A, Sithole B, Stacey N, Hunter-Xenie H, Campbell B, Donohoe P, Brown J, Wilson L (2011) Developing indicators for monitoring and evaluating joint management effectiveness in protected areas in the Northern Territory. Aust Ecol Soc 16:9. https://doi.org/10.5751/ES-04274-160309
Jawoyn Association (2020) Jawoyn Association: Sharing our Country. https://www.jawoyn.org.au/. Accessed 28 July 2021
Johnson JT (2012) Place-based learning and knowing: critical pedagogies grounded in indigeneity. GeoJournal 77:829–836. https://doi.org/10.1007/s10708-010-9379-1
Johnson JT, Larsen SC (eds) (2013) A Deeper sense of place: stories and journeys of collaboration in Indigenous research. Oregon State University Press, Corvallis
Johnson JT, Howitt R, Cajete G, Berkes F, Louis RP, Kliskey A (2016) Weaving Indigenous and sustainability sciences to diversify our methods. Sustain Sci 11:1–11. https://doi.org/10.1007/s11625-015-0349-x
Kakadu Board of Management (2016a) Kakadu National Park Management Plan 2016–2026. Director of National Parks, Australian Government, Canberra
Kakadu Board of Management (2016b) Kakadu National Park Research Guidelines for collaboration between researchers and Bininj/Mungguy (Aboriginal people) of Kakadu National Park. http://www.environment.gov.au/resource/researchers.Accessed 09 Jan 2020
Katz I, Newton BJ, Bates S, Raven M (2016) Evaluation theories and approaches: relevance for Aboriginal contexts. Sydney: Social Policy Research Centre, UNSW Australia https://www.aboriginalaffairs.nsw.gov.au/pdfs/conversations/Evaluation%20theories%20and%20approaches%20-.%20relevance%20for%20Aboriginal%20contexts.pdf. Accessed 28 July 2021
Kealiikanakaoleohaililani K, Giardina CP (2016) Embracing the sacred: an Indigenous framework for tomorrow’s sustainability science. Sustain Sci 11:57–67. https://doi.org/10.1007/s11625-015-0343-3
Kwaymullina A (2016) Research, ethics and Indigenous peoples: an Australian Indigenous perspective on three threshold considerations for respectful engagement. Altern Intern J Indig Peoples 12:437–449. https://doi.org/10.20507/AlterNative.2016.12.4.8
Lyver PO, Tylianakis JM (2017) Indigenous peoples: conservation paradox. Science 357:142–143. https://doi.org/10.1126/science.aao0780
Macdonald JM, Robinsona CJ, Perry J, Lee M, Barrowei R, Coleman B, Ford H, Douglas J, Hunter J, Barrowei A, Markham J, Markham B, Gayoso E, Ahwon T, Cooper D, Setterfield S, Douglas M (In press) Indigenous-led responsible innovation: Lessons from co-developed protocols to guide the use of drones to monitor a biocultural landscape in Kakadu National Park, Australia. J Responsible Innov
Mistry J, Berardi A (2016) Bridging Indigenous and scientific knowledge. Science 352:1274–1275. https://doi.org/10.1126/science.aaf1160
Morton S (2015) Progressing research impact assessment: a ‘contributions’ approach. Res Eval 24(4):405–419. https://doi.org/10.1093/reseval/rvv016
NESP (2019a) Bininj/Mungguy Healthy Country Indicators. Northern Australia Environment Resources Hub, National Environmental Science Programme https://www.nespnorthern.edu.au/projects/nesp/healthy-country-indicators/.
NESP (2019b) Bininj/Mungguy healthy country indicators in Kakadu National Park. https://vimeo.com/333282498.Accessed 08 Jan 2020
NESP (2019c) Using technology to monitor country–Bininj/Mungguy healthy country indicators for Kakadu National Park. https://vimeo.com/359448474. Accessed 08 Jan 2020
NESP (2019d) Keeping country healthy in Kakadu National Park (impact video). https://www.nespnorthern.edu.au/publications/keeping-country-healthy-in-kakadu-national-park-impact-video/. Accessed 08 Jan 2020
NESP (2019e) Using Bininj knowledge to care for the Nardab Floodplain in Kakadu National Park. https://www.nespnorthern.edu.au/publications/using-bininj-mungguy-knowledge-to-care-for-nardab-video-nov-2020/. Accessed 08 Jan 2020
Norström AV, Cvitanovic C, Löf MF et al (2020) Principles for knowledge co-production in sustainability research. Nat Sustain 3:182–190. https://doi.org/10.1038/s41893-019-0448-2
Press T, Lea D, Webb A, Alistair G (1995) Kakadu natural and cultural heritage and management. North Australia Research Unit (NARU) Australian National University, Canberra
Robinson CJ, Wallington TJ (2012) Boundary work: engaging knowledge systems in co-management of feral animals on Indigenous lands. Ecol Soc 17:16. https://doi.org/10.5751/ES-04836-170216
Robinson CJ, Taylor B, Vella K, Wallington T (2014) Working knowledge for collaborative water planning in Australia’s wet tropics region. Intern J W Gov 2(1):43–59. https://doi.org/10.7564/13-IJWG4
Robinson CJ, Maclean K, Hill R, Bock E, Rist P (2016) Participatory mapping to negotiate Indigenous knowledge used to assess environmental risk. Sustain Sci 11:115–126. https://doi.org/10.1007/s11625-015-0292-x
Robinson CJ, Kong T, Coates R, Watson I, Stokes C, Pert P, McConnell A, Chen C (2021) Caring for Indigenous data to evaluate the benefits of Indigenous environmental programs. Environ Manag. https://doi.org/10.1007/s00267-021-01485-8
Smedstad JA, Gosnell H (2013) Do adaptive co-management processes lead to adaptive co-management outcomes? A multi-case study of long-term outcomes associated with the National Riparian Service Team’s place-based riparian assistance. Ecol Soc 18:8. https://doi.org/10.5751/ES-05793-180408
Somerville W, Turner B (2020) Engaging with Indigenous research methodologies: the centrality of country, positionality and community need. J Aust Stud 44:182–184. https://doi.org/10.1080/14443058.2020.1749869
Sterling EJ, Betley E, Sigouin A, Gomez A, Toomey A, Cullman G, Malone C, Pekor A, Arengo F, Blair M, Filardi C, Landrigan K, Porzecanski AL (2017) Assessing the evidence for stakeholder engagement in biodiversity conservation. Biol Cons 209:159–171. https://doi.org/10.1016/j.biocon.2017.02.008
Tengö M, Brondizio ES, Elmqvist T, Malmer P, Spierenburg M (2014) Connecting diverse knowledge systems for enhanced ecosystem governance: the multiple evidence base approach. AMBIO 43(5):579–591. https://doi.org/10.1007/s13280-014-0501-3
Thomas D, Mitchell T, Arseneau C (2016) Re-evaluating resilience: from individual vulnerabilities to the strength of cultures and collectivities among Indigenous communities. Resilience 4:116–129. https://doi.org/10.1080/21693293.2015.1094174
Thompson K, Reece N, Robinson N, Fisher H-J, Ban NC, Picard CR (2019) “We monitor by living here”: community-driven actualisation of a social-ecological monitoring program based in the knowledge of Indigenous harvesters. Facets 4:293–314. https://doi.org/10.1139/facets-2019-0006
Tobias JK, Richmond CAM, Luginaah I (2013) Community-based participatory research (CBPR) with Indigenous communities: producing respectful and reciprocal research. J Empir Res Hum Res Ethics 8:129–140. https://doi.org/10.1525/jer.2013.8.2.129
Trimble M, Plummer R (2019) Participatory evaluation for adaptive co-management of social–ecological systems: a transdisciplinary research approach. Sustain Sci 14:1091–1103. https://doi.org/10.1007/s11625-018-0602-1
Walter M, Lovett R, Maher B, Williamson B, Prehn J, Bodkin-Andrews G, Lee V (2020) Indigenous data sovereignty in the era of big data and open data. Aust J Soc Issues. https://doi.org/10.1002/ajs4.141
Winter KB, Vaughan MB, Kurashima N, Giardina C, Quiocho K, Chang K, Akutagawa M, Beamer K, Berkes F (2021) Empowering Indigenous agency through community-driven collaborative management to achieve effective conservation: Hawai‘i as an example. Pac Conserv Biol. https://doi.org/10.1071/PC20009
Woodward E, Hill R, Harkness P, Archer R (eds) (2020) Our knowledge our way in caring for country: Indigenous-led approaches to strengthening and sharing our knowledge for land and sea management. Best practice guidelines from Australian experiences. NAILSMA and CSIRO
Zanotti L, Palomino-Schalscha M (2016) Taking different ways of knowing seriously: cross-cultural work as translations and multiplicity. Sustain Sci 11:139–152. https://doi.org/10.1007/s11625-015-0312-x
Zurba M, Maclean K, Woodward E, Islam D (2019) Amplifying Indigenous community participation in place-based research through boundary work. Prog Hum Geogr 43:1020–1043. https://doi.org/10.1177/0309132518807758
Acknowledgements
The authors would like to acknowledge Bininj and Mungguy Traditional Owners of Kakadu National Park, our Bininj/Mungguy co-researchers, Kakadu National Park, Microsoft, CSIRO, the University of Western Australia and Charles Darwin University for supporting this research. The project received funding from the Australian Government’s National Environmental Science Program (NESP) Northern Australia Environmental Resources Hub and support from CSIRO’s Responsible Innovation Future Science Program (RI FSP). This research received human ethics clearance from CSIRO (050/18) and Charles Darwin University (H18055).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Handled by Kirsten Maclean, CSIRO, Australia.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Robinson, C.J., Macdonald, J.M., Douglas, M. et al. Using knowledge to care for country: Indigenous-led evaluations of research to adaptively co-manage Kakadu National Park, Australia. Sustain Sci 17, 377–390 (2022). https://doi.org/10.1007/s11625-021-01015-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11625-021-01015-9