Simulation-Based Usability Evaluation of Spoken and Multimodal Dialogue Systems

by Stefan Hillmann

Overview

This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with former UBSs, as well as the empirical data, shows that the new simulation approach outperforms the former simulation. The improvement affects the prediction of dialogue metrics that are related to dialogue efficiency and dialogue effectiveness.

Furthermore, the book describes a parameter-based data model, as well as a related framework. Both are used to uniformly describe multimodal human-computer interactions and to provide such descriptions for usability evaluations. Finally, the book proposes a new two-stage method for the evaluation of UBSs. The method is based on the computation of a distance measures between two dialogue corpora and the pair-wise comparison of distances among several dialogue corpora.

Product Details

ISBN-13:	9783319873336
Publisher:	Springer International Publishing
Publication date:	05/31/2018
Series:	T-Labs Series in Telecommunication Services
Edition description:	Softcover reprint of the original 1st ed. 2018
Pages:	240
Product dimensions:	6.10(w) x 9.25(h) x (d)

Table of Contents

Introduction.- State of The Art.- MeMo Platform for Automatic Usability Evaluation.- Logging Framework for the Evaluation of Interactive Systems.- User Behaviour Model for the Evaluation of Interactive Systems.- Evaluation of User Behaviour Simulations.- Conclusions.