The Evaluation Game: How Publication Metrics Shape Scholarly Communication

by Emanuel Kulczycki

Overview

Scientific research is communicated, organized, financed, governed, and evaluated through the process of publication. The result of this process is a highly competitive academic environment that rewards researchers for high volume publication, preferably in high-impact journals, leading to the popularised expression 'publish or perish'. Universities and other scientific institutions are under similar pressure, with their aggregated research output being under constant scrutiny. This innovative text provides a detailed introduction to the origin and development of the scholarly metrics used to measure academic productivity, and the effect they have upon the quality and diversity of scientific research. With its careful attention to both the positive and negative outcomes of research evaluation and their distinct expressions around the globe, The Evaluation Game guides the way to a more grounded understanding of metrics, and the diverse academic cultures they give rise to.

Product Details

ISBN-13:	9781009351195
Publisher:	Cambridge University Press
Publication date:	04/27/2023
Pages:	238
Product dimensions:	6.77(w) x 9.61(h) x 0.55(d)

About the Author

Emanuel Kulczycki is Associate Professor at Adam Mickiewicz University, Poznań, and Head of the Scholarly Communication Research Group. From 2018 to 2020, he was the chair of the European Network for Research Evaluation in the Social Sciences and the Humanities, and in 2019 he co-founded the Helsinki Initiative on Multilingualism in Scholarly Communication. He has been a policy advisor for the Ministry of Science and Higher Education in Poland since 2013. He co-edited the Handbook on Research Assessment in the Social Sciences (2022, Edward Elgar Publishing).

Table of Contents

Introduction; 1. Evaluation as power; 2. Economization and metricization; 3. Untold histories of research evaluation; 4. The diversity of evaluative powers; 5. Players and the stakes; 6. Playing the evaluation game; Conclusions; Acknowledgements; References; Index.

Editorial Reviews

‘Research evaluation has taken very different forms under different bureaucracies and political systems. Kulczycki makes a unique contribution by explaining some ‘untold histories of research evaluation’ from Eastern Europe and comparing metric-based evaluation models under socialist and neoliberal regimes.’ Ismael Rafols, Centre for Science and Technology Studies (CWTS), Leiden

‘Emanuel Kulczycki is uniquely positioned to provide this highly insightful critique of the relationship between academia and the state in research evaluation systems. In this book, evaluation is not merely an event of which researchers are the sole object or beneficiary but a process that is inextricably tied to issues of trust, communication, discipline diversity and the power of the state. Only by reconciling these relationships can we move to more responsible research evaluation and address academic resistance.’ Gemma Derrick, Centre for Higher Education Transformations, University of Bristol

‘The author uses the metaphor in the title to emphasize the competitive environment in which scientific research takes place. He shows the extent to which research evaluation originates (also) from the government. In this context, he points out a remarkable difference between the West (USA and Western Europe) and the former Eastern Bloc. In the West, researchers have more confidence in colleagues, via peer review, while in the former East Bloc, there is a historic distrust in authorities (experts), and hence a preference for bibliometric indicators. The book draws attention to power relations in science and as such is a useful read, not only for information scientists but also for sociologists and political scientists who want to take a glonacal (global-national-local) perspective.’ Ronald Rousseau, KU Leuven and University of Antwerp

‘… an excellent overview of the operation of state, academic institution and publisher-led systems of research publication evaluation.’ Huw Morris, Educational Review

‘… a valuable and exciting contribution.’ Alessia Lo Porto Lefébure, Questions de communication

From the Publisher