Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments: Dagstuhl Seminar 15481, Dagstuhl Castle, Germany, November 22 - 27, 2015, Revised Contributions

by Daniel Archambault, Helen Purchase, Tobias Hoßfeld

Overview

As the outcome of the Dagstuhl Seminar 15481 on Crowdsourcing and Human-Centered Experiments, this book is a primer for computer science researchers who intend to use crowdsourcing technology for human centered experiments.

The focus of this Dagstuhl seminar, held in Dagstuhl Castle in November 2015, was to discuss experiences and methodological considerations when using crowdsourcing platforms to run human-centered experiments to test the effectiveness of visual representations. The inspiring Dagstuhl atmosphere fostered discussions and brought together researchers from different research directions. The papers provide information on crowdsourcing technology and experimental methodologies, comparisons between crowdsourcing and lab experiments, the use of crowdsourcing for visualisation, psychology, QoE and HCI empirical studies, and finally the nature of crowdworkers and their work, their motivation and demographic background, as well as the relationships among people formingthe crowdsourcing community.

Product Details

ISBN-13:	9783319664347
Publisher:	Springer International Publishing
Publication date:	12/20/2017
Series:	Lecture Notes in Computer Science , #10264
Edition description:	1st ed. 2017
Pages:	191
Product dimensions:	6.10(w) x 9.25(h) x (d)

Table of Contents

Crowdsourcing Versus the Laboratory: Towards Human-centered Experiments Using the Crowd.- Understanding The Crowd: Ethical and Practical Matters in the Academic Use of Crowdsourcing.- Crowdsourcing Technology to Support Academic Research.- Crowdsourcing for Information Visualization: Promises and Pitfalls.- Cognitive Information Theories of Psychology and Applications with Visualization and HCI through Crowdsourcing Platforms.- Crowdsourcing Quality of Experience Experiments.