Towards Autonomous, Adaptive, and Context-Aware Multimodal Interfaces: Theoretical and Practical Issues: Third COST 2102 International Training School, Caserta, Italy, March 15-19, 2010, Revised Selected Papers

by Anna Esposito (Editor), Antonietta M. Esposito (Editor), Raffaele Martone (Editor), Vincent Müller (Editor), Gaetano Scarpetta (Editor)

Overview

This volume brings together the advanced research results obtained by the European COST Action 2102: "Cross Modal Analysis of Verbal and Nonverbal Communication". The research published in this book was discussed at the 3rd jointly EUCOGII-COST 2102 International Training School entitled "Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces: Theoretical and Practical Issues ", held in Caserta, Italy, on March 15-19, 2010. The book is arranged into two scientific sections. The 18 revised papers of the first section, "Human-Computer Interaction: Cognitive and Computational Issues", deal with conjectural and processing issues of defining models, algorithms, and strategies for implementing cognitive behavioural systems. The second section, "Synchrony through Verbal and Nonverbal Signals", presents 21 revised lectures that provide theoretical and practical solutions to the modelling of timing synchronization between linguistic and paralinguistic expressions, actions, body movements, activities in human interaction and on their assistance for an effective communication.

Product Details

ISBN-13:	9783642181832
Publisher:	Springer Berlin Heidelberg
Publication date:	03/11/2011
Series:	Lecture Notes in Computer Science , #6456
Edition description:	2011
Pages:	474
Product dimensions:	6.10(w) x 9.25(h) x 0.04(d)

Table of Contents

I Human-Computer Interaction: Cognitive and Computational Issues

Interaction and Resistance: The Recognition of Intentions in New Human-Computer Interaction Vincent C. Müller 1

Speaking without Thinking: Embodiment, Speech Technology and Social Signal Processing Tim Rohrer 8

More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech Alessandro Vinciarelli Hugues Salamin Gelareh Mohammadi Khiet Truong 23

A Timely Endeavor: Theoretical, Behavioral, Bioimaging, and Clinical Perspectives on Time Perception Argiro Vatakis Georgios Papadelis 34

Instruction and Belief Effects on Sentential Reasoning Olimpia Matarazzo Ivana Baldassarre 39

Audio-Visual Prosody: Perception, Detection, and Synthesis of Prominence Samer Al Moubayed Jonas Beskow Björn Granström David House 55

Adaptation in Turn-Initiations Štefan Benuš 72

Sentic Avatar: Multimodal Affective Conversational Agent with Common Sense Erik Cambria Isabelle Hupont Amir Hussain Eva Cerezo Sandra Baldassarri 81

Patterns of Synchronization of Non-verbal Cues and Speech in ECAs: Towards a More "Natural" Conversational Agent Nicla Rossini 96

Top-Down Influences on Eye-Movements during Painting Perception: The Effect of Task and Titles Evgenia Hristova Severina Georgieva Maurice Grinberg 104

Visual Sociology in the Classroom: Fostering Interaction Awareness Using Video Paolo Parmeggiani 116

Analysis of Interrogatives in Different Domains Helena Moniz Fernando Batista Isabel Trancoso Ana Isabel Mata 134

Interviewers' Use of Coercive Questioning during a Midterm Period Favorable to the Opposition Party Angiola Di Conza Augusto Gnisci Angelo Caputo 147

Emotions and Speech Disorders: Do Developmental Stutters Recognize Emotional Vocal Expressions? Anna Esposito Alda Troncone 155

Representing Meaning in Mind: When Predicate Argument Structures Meet Mental Representations Rosa Volpe 165

Beyond the Panopticon Framework: Privacy, Control and User Generated Content Manuela Farinosi 180

Micro and Macro Spatial Dimensions of New Media in Five European Countries Leopoldina Fortunati Federico de Luca 190

Nonverbal Expressions of Turn Management in TV Interviews: A Cross-Cultural Study between Greek and Icelandic Maria Koutsombogera Sigrún María Ammendrup Hannes Högni Vilhjálmsson Harris Papageorgiou 207

II Synchrony through Verbal and Nonverbal Signals

Interpretation and Generation of Dialogue with Multidimensional Context Models Harry Bunt 214

Coordination, Not Control, Is Central to Movement Fred Cummins 243

Speech, Gaze and Head Motion in a Face-to-Face Collaborative Task Sascha Fagel Gérard Bailly 256

Neuroelectric Methodologies for the Study of the Economic Decisions in Humans Giovanni Vecchiato Fabio Babiloni 265

An Evaluation Study on Speech Feature Densities for Bayesian Estimation in Robust ASR Simone Cifani Emanuele Principi Rudy Rotili Stefano Squartini Francesco Piazza 283

Naturalness, Adaptation and Cooperativeness in Spoken Dialogue Systems Milan Gnjatovic Darko Pekar Vlado Delic 298

Towards Semantic Multimodal Video Annotation Marco Grassi Christian Morbidoni Francesco Piazza 305

The Effect of Subharmonic Stimuli on Singing Voices Marena Balinova Peter Reichl Inma Hernáez Rioja Ibon Saratxaga 317

Speech Modeling Using the Complex Cepstrum Martin Vondra Robert Vích 324

Problems of the Automatic Emotion Recognitions in Spontaneous Speech; An Example for the Recognition in a Dispatcher Center Klára Vicsi Dávid Sztahó 331

Slovak Language Model from Internet Text Data Ján Staš Daniel Hládek Matú š Pleva Jozef Juhár 340

Automatic Recognition of Emotional State in Polish Speech Piotr Staroniewicz 347

Categorical Perception of Consonants and Vowels: Evidence from a Neurophonetic Model of Speech Production and Perception Bernd J. Kröger Peter Birkholz Jim Kannampuzha Christiane Neuschaefer-Rube 354

The MultiLis Corpus-Dealing with Individual Differences in Nonverbal Listening Behavior Iwan de Kok Dirk Heylen 362

Comparing the Rhythmical Characteristics of Speech and Music - Theoretical and Practical Issues Stephan Hübler Rüdiger Hoffmann 376

The Ability of Children with Mild Learning Disabilities to Encode Emotions through Facial Expressions Christiane El-Haddad Yiannis Laouris 387

Designing a Hungarian Multimodal Database - Speech Recording and Annotation Kinga Papay 403

Conveying Directional Gaze Cues to Support Remote Participation in Hybrid Meetings Betsy van Dijk Job Zwiers Rieks op den Akker Olga Kulyk Hendri Hondorp Dennis Hofs Anton Nijholt 412

Affect Recognition in Real Life Scenarios Theodoros Kostoulas Todor Ganchev Nikos Fakotakis 429

Understanding Parent-Infant Behaviors Using Non-negative Matrix Factorization Ammar Mahdhaoui Mohamed Chetouani 436

Learning and Knowledge-Based Sentiment Analysis in Movie Review Key Excerpts Björn Schuller Tobias Knaup 448

Author Index 473