Learning More from Social Experiments: Evolving Analytic Approaches

Learning More from Social Experiments: Evolving Analytic Approaches

by Howard S. Bloom
     
 

Policy analysis has grown increasingly reliant on the random assignment experiment—a research method whereby participants are sorted by chance into either a program group that is subject to a government policy or program, or a control group that is not. Because the groups are randomly selected, they do not differ from one another systematically. Therefore any

See more details below

Overview

Policy analysis has grown increasingly reliant on the random assignment experiment—a research method whereby participants are sorted by chance into either a program group that is subject to a government policy or program, or a control group that is not. Because the groups are randomly selected, they do not differ from one another systematically. Therefore any differences between the groups at the end of the study can be attributed solely to the influence of the program or policy. But there are many questions that randomized experiments have not been able to address. What component of a social policy made it successful? Did a given program fail because it was designed poorly or because it suffered from low participation rates? In Learning More from Social Experiments, editor Howard Bloom and a team of innovative social researchers profile advancements in the scientific underpinnings of social policy research that can improve randomized experimental studies.

Using evaluations of actual social programs as examples, Learning More from Social Experiments makes the case that many of the limitations of random assignment studies can be overcome by combining data from these studies with statistical methods from other research designs. Carolyn Hill, James Riccio, and Bloom profile a new statistical model that allows researchers to pool data from multiple randomized-experiments in order to determine what characteristics of a program made it successful. Lisa Gennetian, Pamela Morris, Johannes Bos, and Bloom discuss how a statistical estimation procedure can be used with experimental data to single out the effects of a program’s intermediate outcomes (e.g., how closely patients in a drug study adhere to the prescribed dosage) on its ultimate outcomes (the health effects of the drug). Sometimes, a social policy has its true effect on communities and not individuals, such as in neighborhood watch programs or public health initiatives. In these cases, researchers must randomly assign treatment to groups or clusters of individuals, but this technique raises different issues than do experiments that randomly assign individuals. Bloom evaluates the properties of cluster randomization, its relevance to different kinds of social programs, and the complications that arise from its use. He pays particular attention to the way in which the movement of individuals into and out of clusters over time complicates the design, execution, and interpretation of a study.

Learning More from Social Experiments represents a substantial leap forward in the analysis of social policies. By supplementing theory with applied research examples, this important new book makes the case for enhancing the scope and relevance of social research by combining randomized experiments with non-experimental statistical methods, and it serves as a useful guide for researchers who wish to do so.

Read More

Product Details

ISBN-13:
9780871541277
Publisher:
Russell Sage Foundation
Publication date:
06/28/2005
Edition description:
New Edition
Pages:
264
Product dimensions:
6.40(w) x 9.30(h) x 1.00(d)

Table of Contents


Contributors     vii
Preface     ix
Precedents and Prospects for Randomized Experiments   Charles Michalopoulos     1
Modeling Cross-Site Experimental Differences to Find Out Why Program Effectiveness VariesHoward S. Bloom   Carolyn J. Hill   James A. Riccio     37
Constructing Instrumental Variables from Experimental Data to Explore How Treatments Produce Effects   Lisa A. Gennetian   Pamela A. Morris   Johannes M. Bos   Howard S. Bloom     75
Randomizing Groups to Evaluate Place-Based Programs   Howard S. Bloom     115
Using Experiments to Assess Nonexperimental Comparison-Group Methods for Measuring Program Effects   Howard S. Bloom   Charles Michalopoulos   Carolyn J. Hill     173
Index     237

Read More

Customer Reviews

Average Review:

Write a Review

and post it to your social network

     

Most Helpful Customer Reviews

See all customer reviews >