Learning More from Social Experiments: Evolving Analytic Approachesby Howard S. Bloom
Pub. Date: 06/28/2005
Publisher: Russell Sage Foundation
Policy analysis has grown increasingly reliant on the random assignment experimenta research method whereby participants are sorted by chance into either a program group that is subject to a government policy or program, or a control group that is not. Because the groups are randomly selected, they do not differ from one another systematically. Therefore any
Policy analysis has grown increasingly reliant on the random assignment experimenta research method whereby participants are sorted by chance into either a program group that is subject to a government policy or program, or a control group that is not. Because the groups are randomly selected, they do not differ from one another systematically. Therefore any differences between the groups at the end of the study can be attributed solely to the influence of the program or policy. But there are many questions that randomized experiments have not been able to address. What component of a social policy made it successful? Did a given program fail because it was designed poorly or because it suffered from low participation rates? In Learning More from Social Experiments, editor Howard Bloom and a team of innovative social researchers profile advancements in the scientific underpinnings of social policy research that can improve randomized experimental studies.
Using evaluations of actual social programs as examples, Learning More from Social Experiments makes the case that many of the limitations of random assignment studies can be overcome by combining data from these studies with statistical methods from other research designs. Carolyn Hill, James Riccio, and Bloom profile a new statistical model that allows researchers to pool data from multiple randomized-experiments in order to determine what characteristics of a program made it successful. Lisa Gennetian, Pamela Morris, Johannes Bos, and Bloom discuss how a statistical estimation procedure can be used with experimental data to single out the effects of a program’s intermediate outcomes (e.g., how closely patients in a drug study adhere to the prescribed dosage) on its ultimate outcomes (the health effects of the drug). Sometimes, a social policy has its true effect on communities and not individuals, such as in neighborhood watch programs or public health initiatives. In these cases, researchers must randomly assign treatment to groups or clusters of individuals, but this technique raises different issues than do experiments that randomly assign individuals. Bloom evaluates the properties of cluster randomization, its relevance to different kinds of social programs, and the complications that arise from its use. He pays particular attention to the way in which the movement of individuals into and out of clusters over time complicates the design, execution, and interpretation of a study.
Learning More from Social Experiments represents a substantial leap forward in the analysis of social policies. By supplementing theory with applied research examples, this important new book makes the case for enhancing the scope and relevance of social research by combining randomized experiments with non-experimental statistical methods, and it serves as a useful guide for researchers who wish to do so.
- Russell Sage Foundation
- Publication date:
- Edition description:
- New Edition
- Product dimensions:
- 6.00(w) x 9.00(h) x (d)
Table of Contents
Precedents and Prospects for Randomized Experiments Charles Michalopoulos 1
Modeling Cross-Site Experimental Differences to Find Out Why Program Effectiveness VariesHoward S. Bloom Carolyn J. Hill James A. Riccio 37
Constructing Instrumental Variables from Experimental Data to Explore How Treatments Produce Effects Lisa A. Gennetian Pamela A. Morris Johannes M. Bos Howard S. Bloom 75
Randomizing Groups to Evaluate Place-Based Programs Howard S. Bloom 115
Using Experiments to Assess Nonexperimental Comparison-Group Methods for Measuring Program Effects Howard S. Bloom Charles Michalopoulos Carolyn J. Hill 173
Most Helpful Customer Reviews
See all customer reviews