Skip to main content
SpringerLink
Log in

Recent Research Evaluations in the UK and Portugal

Methodologies, Processes, Controversies and Consequences

  • Chapter
Global Challenges, National Initiatives, and Institutional Responses

Part of the book series: Higher Education Research in the 21st Century Series ((CHER))

Abstract

The chapter compares the methods, cultural and social processes, responses, controversies, ‘gaming’ and consequences for universities and higher education system of two recent European publicly-funded national research evaluations, one in the UK and the other in Portugal. The UK evaluation is run periodically by the UK Higher Education Funding Council for England (in 2008 it was called the Research Assessment Exercise and in 2014 the Research Excellence Framework) which provides research funding to successful higher education institutions, using performance-based data including research outputs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Referneces

  • Agência Lusa. (2014, July 25). Processo de avaliação da ciência é “enormíssimo erro de política pública” Reitor Lisboa. Retrieved August 11, 2015, from http://portocanal.sapo.pt/noticia/32971/

    Google Scholar 

  • Araujo, H., et al. (2015). Três factos “notáveis” sobre a atribuição de financiamento pela FCT. Retrieved August 12, 2015, from http://www.publico.pt/ciencia/noticia/tres-factos-notaveis-sobre-a-atribuicao-de-financiamento-pela-fct-1699838

    Google Scholar 

  • Barker, K. (2007). The UK research assessment exercise: The evolution of a national research evaluation system. Research Evaluation, 16(1), 3–12.

    Article  Google Scholar 

  • Bence, V., & Oppenheim, C. (2005). The evolution of the UK’s research assessment exercise: publications, performance and perceptions. Journal of Educational Administration and History, 37(2), 137–155.

    Article  Google Scholar 

  • Bourdieu, P. (1988). Homo academicus. Cambridge: Polity Press.

    Google Scholar 

  • Bruckman, S., & Carvalho, T. (2014). The reform process of Portuguese higher education institutions: From collegial to managerial governance. Tertiary Education and Management, 20(3), 193–206.

    Article  Google Scholar 

  • de Jong, S. P. L., van Arensbergen, P., Daemen. F., van der Meulen, B., & van den Besselaar, P. (2011). Evaluation of research in context: an approach and two cases. Research Evaluation, 20(1), 61–72.

    Article  Google Scholar 

  • Deem, R. (2011). Leadership, leadership development and markets in UK publicly funded higher education organisations – Global, national or European? In P. Teixeira & D. Dill (Eds.), Public vices, private virtues? Assessing the effects of marketization in higher education (pp. 159–176). Rotterdam: Sense Publishers.

    Chapter  Google Scholar 

  • Deem, R., Hillyard, S., & Reed, M. (2007). Knowledge, higher education and the new managerialism: The changing management of UK universities. Oxford: Oxford University Press.

    Book  Google Scholar 

  • Department for Business Innovation and Skills. (2015). Fulfilling our potential; Teaching excellence, social mobility and student choice (The Higher Education Green Paper). London: Her Majesty’s Stationery Office.

    Google Scholar 

  • Equality and Diversity Advisory Panel. (2014). Equality and diversity in the 2014 research excellence framework. Bristol: Higher Education Funding Council for England.

    Google Scholar 

  • European Science Foundation. (2015). ESF report on the Foundation for Science and Technology (FCT) evaluation of R&D Units 2013–2014. Strasbourg: European Science Foundation.

    Google Scholar 

  • European Science Foundation. (2015). Report on the Foundation for Science and Technology (FCT) evaluation of R&D Units 2013–2014. Strasbourg: European Science Foundation.

    Google Scholar 

  • Farla, K., & Simmonds, P. (2015). REF accountability review: Costs, benefits and burden. Brighton: Technopolis.

    Google Scholar 

  • Ferreira, N., & Firmino, T. (2015, July 30). FCT foi avaliada e Nuno Crato diz que resultados apoiam as suas política. Retrieved August 12 2015, from http://www.publico.pt/ciencia/noticia/a-fct-tambem-foi-avaliada-e-o-resultado-apoia-as-suas-politicas-1703572

  • Ferreira, N., & Firmino, T. (2015). Uma nova FCT?. Retrieved August, 2015, from http://www.publico.pt/ciencia/noticia/uma-fundacao-mais-autonoma-1703577

  • Firmino, T. (2014). O ano visto por Carlos Fiolhais: Uma pseudo-avaliação. Publico.pt. Retrieved ano nova from http://www.publico.pt/ciencia/noticia/o-ano-visto-por-carlos-fiolhais-o-abate-da-ciencia-numa-pseudoavaliacao-1680555

  • Heitor, M., et al. (2015). Livro negro da avaliação científica em Portugal [The Black Book of Scientific Evaluation in Portugal]. Retrieved March 2016, from http://www.lnavaliacao.pt/pdf/prefacio-LN-english-v08set.pdf; http://www.lnavaliacao.pt/pdf/Livro-negro-aval-v24ags2015.pdf

    Google Scholar 

  • Heitor, M., & Horta, H. (2012). Science and technology in Portugal: From late awakening to the challenge of knowledge-integrated communities. In G. Neave & A. Amaral (Eds.), Higher education in Portugal 1974–2009: A nation, a generation (pp. 179–226). Heidelberg, London, & New York, NY: Springer.

    Google Scholar 

  • Horta, H. (2010). The role of the state in the internationalization of universities in catching-up countries: An analysis of the Portuguese higher education system. Higher Education Policy, 23, 63–81.

    Article  Google Scholar 

  • Horta, H., & Hasanenfendic, S. (2015). Young doctorates in a fast-changing higher education system: The case of Portugal. In M. Yudkevich, P. G. Altbach, & L. E. Rumbley (Eds.), Young faculty in the twenty-first century: International perspectives (pp. 201–226). Albany, NY: State University of New York Press.

    Google Scholar 

  • Kratky, C., et al. (2015). Evaluation of the Portuguese foundation for science and technology. Lisbon, Ministerio da Educacao e Ciencia.

    Google Scholar 

  • Krücken, G. (2014). Higher education reforms and unintended consequences: A research agenda. Studies in Higher Education, 39(8), 1439–1450.

    Article  Google Scholar 

  • Lamont, M. (2009). How professors think: Inside the curious world of academic judgment. Harvard, MA: Harvard University Press.

    Book  Google Scholar 

  • Lamont, M. (2012). Toward a comparative sociology of valuation and evaluation. Annual Review of Sociology, 38(21), 1–21.

    Google Scholar 

  • Leisyte, L. (2007). University governance and academic research (Doctoral thesis). University of Twente, Twente, Netherlands.

    Google Scholar 

  • Leisyte, L., de Boer, H., & Enders, J. (2006). England: The prototype of the ‘Evaluative State’. In B. Kehm & U. Lanzendorf (Eds.), Reforming University Governance: changing conditions for research in four European countries (pp. 21–58). Bonn, Lemmens.

    Google Scholar 

  • Leisyte, L., Enders, J., & de Boer, H. (2008). The freedom to set research agendas—Illusion and reality of the research units in the Dutch Universities. Higher Education Policy, 21(3), 377–391.

    Article  Google Scholar 

  • Leydesdorff, L., & Bornmann, L. (2014). Scientometrics in a changing research landscape. Science and Society, 15, 1228–1232.

    Google Scholar 

  • Lucas, L. (2006). The research game in academic life. Maidenhead: Open University Press & the Society for Research into Higher Education.

    Google Scholar 

  • Margetts, H., 6, P., Hood, C. (Eds.). (2010). Paradoxes of modernization. Unintended consequences of public policy reform. Oxford, Oxford University Press.

    Google Scholar 

  • Martin, B., & Whitley, R. (2010). The UK research assessment exercise. In R. Whitley, J. Glaeser, & L. Engwall (Eds.), Reconfiguring knowledge production (pp. 51–80).. Oxford: Oxford University Press.

    Chapter  Google Scholar 

  • McNay, I. (2015). Learning from the UK Research Excellence Framework: Ends and means in research quality assessment, and the reliability of results in Education. Higher Education Review, 47(3), 24–47.

    Google Scholar 

  • Merton, R. K. (1936). The unanticipated consequences of purposive social action. American Sociological Review, 1(6), 894–904.

    Article  Google Scholar 

  • Moro Martin, A. (2014, October 8). A call to those who care about Europe’s science. Nature.

    Google Scholar 

  • Neave, G. (2012). The evaluative state, institutional autonomy and re-engineering higher education in Western Europe: The prince and his pleasure. Basingstoke: Palgrave Macmillan.

    Book  Google Scholar 

  • Neave, G., & Amaral, A. (Eds.). (2012). Higher education in Portugal 1974–2009: A nation, a generation. Dordrecht, Springer.

    Google Scholar 

  • Nurse, P. (2015). Ensuring a successful UK research endeavour: A review of the UK research councils (the Nurse Report). London: Department of Business, Innovation and Skills.

    Google Scholar 

  • Pruvot, E. B., & Estermann, T. (2014). DEFINE thematic report: Funding for excellence. Brussels: European University Association.

    Google Scholar 

  • Santiago, R., Carvalho, T., & Relva, R. (2008). Research and the universities’ image. European Journal of Education, 43(4), 495–511.

    Article  Google Scholar 

  • Sayer, D. (2014). Rank hypocrisies: The insult of the REF. London: Sage.

    Google Scholar 

  • Sayer, D. (2014b). Five reasons why the REF is not fit for purpose. Retrieved August 2015, from http://www.theguardian.com/higher-education-network/2014/dec/15/research-excellence-framework-five-reasons-not-fit-for-purpose

  • Sharp, S., & Coleman, S. (2005). Ratings in the research assessment exercise 2001 – the patterns of university status. Higher Education Quarterly, 59(2), 153–171.

    Article  Google Scholar 

  • Strathern, M. (2000). Audit cultures : Anthropological studies in accountability, ethics and the academy. London: Routledge.

    Book  Google Scholar 

  • Teixeira, P., & Amaral, A. (2007). Waiting for the tide to change? Strategies for survival of Portuguese Private HEIs. Higher Education Quarterly, 61(2), 208–222.

    Article  Google Scholar 

  • Upton, S., Vallance, P., & Goddard, J. (2014). From outcomes to process: Evidence for a new approach to research impact assessment. Research Evaluation, 24(2), 352–365.

    Article  Google Scholar 

  • Waring, M. (2010). Moments of vision: HRM and the individualisation of academic workers (unpublished PhD thesis). School of Management, University of Wales Institute Cardiff now Cardiff Metropolitan University, Cardiff.

    Google Scholar 

  • Watermeyer, R. (2012). Issues in the articulation of ‘impact’: The responses of UK academics to ‘impact’ as a new measure of research assessment. Studies in Higher Education, 39(2), 359–377.

    Article  Google Scholar 

  • Wilsdon, J. (2015). The metric tide: Report of the independent review of the role of metrics in research assessment and management. Bristol: Higher Education Funding Council for England.

    Google Scholar 

  • Worms, J.-C., & Swift, J. (2014). European science foundation: Stop the cuts, not the evaluations. Nature, 514(7523), 434. doi:10.1038/514434e

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Royal Holloway University of London, UK

    Rosemary Deem

Authors
  1. Rosemary Deem
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Porto, Portugal

    Cláudia Sarrico

  2. University of Porto, Portugal

    Pedro Teixeira

  3. University of Porto, Portugal

    António Magalhães

  4. University of Porto, Portugal

    Amélia Veiga

  5. University of Porto, Portugal

    Maria João Rosa

  6. University of Porto, Portugal

    Teresa Carvalho

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Sense Publishers

About this chapter

Cite this chapter

Deem, R. (2016). Recent Research Evaluations in the UK and Portugal. In: Sarrico, C., Teixeira, P., Magalhães, A., Veiga, A., Rosa, M.J., Carvalho, T. (eds) Global Challenges, National Initiatives, and Institutional Responses. Higher Education Research in the 21st Century Series. SensePublishers, Rotterdam. https://doi.org/10.1007/978-94-6300-675-0_9

Download citation

  • DOI: https://doi.org/10.1007/978-94-6300-675-0_9

  • Publisher Name: SensePublishers, Rotterdam

  • Online ISBN: 978-94-6300-675-0

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation