The SAGE International Handbook of Educational Evaluation / Edition 1

by Katherine E. Ryan, J. Bradley Cousins

Overview

Bringing together the expertise of top evaluation leaders from around the world, The SAGE International Handbook of Educational Evaluation addresses methods and applications in the field, particularly as they relate to policy- and decision-making in an era of globalization. The comprehensive collection of articles in the Handbook compels readers to consider globalization influences on educational evaluation within distinct genres or families of evaluation approaches.

Key Features

Discusses substantive issues surrounding globalization, and its implication for educational policy and practice and ultimately evaluation;

Includes state-of-the-art theory chapters and method chapters within scientific, accountability-oriented, learning-oriented, and political genres of evaluation approaches;

Provides real-world case exemplar chapters to illustrate core concepts within genres;

Extends dialogue on controversial topics and contemporary educational evaluation tensions in the context of globalization;

Summarizes, by means of an integration chapter, the issues, tensions and dilemmas confronting educational evaluators in an era of globalization.

Serving as a state-of-the-art resource on educational evaluation, this volume is designed for graduate students, evaluation scholars and researchers and professional evaluation practitioners with an interest in educational program and policy evaluation.

Product Details

ISBN-13:	9781412940689
Publisher:	SAGE Publications
Publication date:	07/15/2009
Edition description:	New Edition
Pages:	608
Product dimensions:	7.00(w) x 10.00(h) x 1.50(d)

About the Author

Katherine Ryan (B.S., Psychology, M.Ed., Special Education, Ph.D., Educational Psychology, University of Illinois - Urbana) is Associate Professor of Educational Psychology in the College of Education at UIUC. Her areas of specialization include Educational Measurement, Program Evaluation, and Applied Statistics, and she is currently Head of Measurement and Evaluation in the College of Education. Her research interests include assessment validation issues, particularly the evaluation of validity evidence based on response processes and consequences of assessments. Other interests include differential item/test functioning, and issues in program evaluation theory and practice. She teaches Descriptive and Inferential Statistics, Classroom Assessment, Introduction to Measurement, Introduction to Program Evaluation Theory, and Introduction to Evaluation Methods. She has edited two volumes of New Directions in Evaluation for the American Evaluation Association (AEA), one on evaluation as a democratic process, and the other on teaching evaluation in higher education.

J. Bradley Cousins is professor of Evaluation at the Faculty of Education, University of Ottawa. Cousins’ main interests are in program evaluation including participatory and collaborative approaches, use, and capacity building. He received his Ph D in Educational Measurement and Evaluation from the University of Toronto in 1988. Throughout his career he has received several awards for his work in evaluation including the Contribution to Evaluation in Canada award (CES, 1999), the Paul F. Lazarsfeld Award for Theory in Evaluation (AEA, 2008) and the AERA Research on Evaluation Distinguished Scholar Award (2011). He has published many articles and books on evaluation and was editor of the Canadian Journal of Program Evaluation from 2002 to 2010. Throughout his career, Cousins has had considerable experience planning, delivering, and evaluating evaluation training and capacity building in Canada and abroad. Internationally he led evaluation capacity building in Central and West Africa and a major three and one-half year project in India. He is currently leading a nation-wide evaluation of teacher in-service training in that country in collaboration with several of the people he had previously trained. Cousins completed a three and one-half year term as director of the Centre for Research on Educational and Community Services at the University of Ottawa in July 2015. He continues to be an active member of CRECS, which has a strong mandate for research and evaluation capacity building. For more information, visit www.crecs.uottawa.ca.

Table of Contents

Introduction ix

Acknowledgments xix

Part I The Educational Evaluation Context 1

1 Globalization and Policy Research in Education Fazal Rizvi 3

2 Globalizing Influences on the Western Evaluation Imaginary Thomas A. Schwandt 19

3 Fundamental Evaluation Issues in a Global Society Nick L. Smith 37

Part II The Role of Science in Educational Evaluation 53

4 Evaluation, Method Choices, and Pathways to Consequences: Trying to Make Sense of How Evaluation Can Contribute to Sensemaking Melvin M. Mark 55

5 Randomized Experiments and Quasi-Experimental Designs in Educational Research Peter M. Steiner Angela Wroblewski Thomas D. Cook 75

6 Enhancing Impact Evidence on How Global Education Initiatives Work: Theory, Epistemological Foundations, and Principles for Applying Multiphase, Mixed Method Designs Madhabi Chatterji 97

7 The Evaluation of the Georgia Pre-K Program: An Example of a Scientific Evaluation of an Early Education Program Gary T. Henry Dana K. Rickman 113

8 Globalization-Blessing and Bane in Empirical Evaluation: Lessons in Three Acts Jacob Marszalek Debra D. Bragg 131

9 Science-Based Educational Evaluation and Student Learning in a Global Society: A Critical Appraisal Lois-ellin Datta 149

Part III Educational Evaluation, Capacity Building, and Monitoring 169

10 Evaluation, Accountability, and Performance Measurement in National Education Systems: Trends, Methods, and Issues Katherine E. Ryan Irwin Feller 171

11 A Precarious Balance: Educational Evaluation Capacity Building in a Globalized Society Miri Levin-Rozalis Barbara Rosenstein J. Bradley Cousins 191

12 International Assessments and Indicators: How Will Assessments and Performance Indicators Improve Educational Policies and Practices in a Globalized Society? Claudia V. Tamassia Raymond J. Adams 213

13 Exemplary Case: Implementing Large-Scale Assessment of Education in Mexico Edith J. Cisneros-Cohernour Thomas E. Grayson 231

14 Inquiry-Minded District Leaders: Evaluation as Inquiry, Inquiry as Practice Sharon F. Rallis Matthew Militello 253

15 Where Global Meets Local: Contexts, Constraints, and Consensus in School Evaluation in Ireland Gerry McNamara Joe O'Hara 273

16 Accountability and Capacity Building: Can They Live Together? David Nevo 291

Part IV Educational Evaluation as Learning and Discovery 305

17 Learning-Oriented Educational Evaluation in Contemporary Society Peter Dahler-Larsen 307

18 Meaningfully Engaging With Difference Through Mixed Methods Educational Evaluation Jennifer C. Greene 323

19 Case Study Methods in Educational Evaluation Linda Mabry 341

20 Developing a Community of Practice: Learning and Transformation Through Evaluation Christina A. Christie Brock M. Klein 357

21 Learning-in-(Inter)action: A Dialogical Turn to Evaluation and Learning Theo J. H. Niessen Tineke A. Abma Guy A. M. Widdershoven Cees P. M. van der Vleuten 375

22 Educational Evaluation as Mediated Mutual Learning John Elliott 395

Part V Educational Evaluation in a Political World 411

23 Own Goals: Democracy, Evaluation, and Rights in Millennium Projects Saville Kushner 413

24 Reclaiming Knowledge at the Margins: Culturally Responsive Evaluation in the Current Evaluation Moment Rodney K. Hopson 429

25 Evaluation for and by Navajos: A Narrative Case of the Irrelevance of Globalization Stafford Hood 447

26 Dialogue, Deliberation, and Democracy in Educational Evaluation: Theoretical Arguments and a Case Narrative Ove Karlsson Vestman Christina Segerholm 465

27 Pursuing the Wrong Indicators? The Development and Impact of Test-Based Accountability Harry Torrance 483

Part VI Educational Evaluation: Opportunities and New Dilemmas 499

28 Evaluation and Educational Policymaking Ulf P. Lundgren 501

29 Technology and Educational Evaluation Michael Scriven 511

30 Serving the Public Interest Through Educational Evaluation: Salvaging Democracy by Rejecting Neoliberalism Sandra Mathison 525

31 Dilemmas for Educational Evaluation in a Globalized Society J. Bradley Cousins Katherine E. Ryan 539

Author Index 555

Subject Index 569

About the Editors 577

About the Contributors 579