Estimating Spoken Dialog System Quality with User Models

Spoken dialog systems have the potential to offer highly intuitive user interfaces, as they allow systems to be controlled using natural language. However, the complexity inherent in natural language dialogs means that careful testing of the system must be carried out from the very beginning of the...

Full description

Bibliographic Details
Main Author: Engelbrecht, Klaus-Peter
Format: eBook
Language:English
Published: Berlin, Heidelberg Springer Berlin Heidelberg 2013, 2013
Edition:1st ed. 2013
Series:T-Labs Series in Telecommunication Services
Subjects:
Online Access:
Collection: Springer eBooks 2005- - Collection details see MPG.ReNa
LEADER 02721nmm a2200361 u 4500
001 EB000389815
003 EBX01000000000000000242868
005 00000000000000.0
007 cr|||||||||||||||||||||
008 130626 ||| eng
020 |a 9783642315916 
100 1 |a Engelbrecht, Klaus-Peter 
245 0 0 |a Estimating Spoken Dialog System Quality with User Models  |h Elektronische Ressource  |c by Klaus-Peter Engelbrecht 
250 |a 1st ed. 2013 
260 |a Berlin, Heidelberg  |b Springer Berlin Heidelberg  |c 2013, 2013 
300 |a XIV, 130 p  |b online resource 
505 0 |a MeMo-Usability Workbench -- Evaluation of the Memo User Simulation – Use-Case Inspire Smart Home System -- Detection of Usability Problems Using an Ad-Hoc User Simulation -- Prediction Of User Judgments -- Application of Prediction Models in a Realistic Usage Scenario 
653 |a User interfaces (Computer systems) 
653 |a Engineering Acoustics 
653 |a Signal, Speech and Image Processing 
653 |a Telecommunication 
653 |a Communications Engineering, Networks 
653 |a Signal processing 
653 |a User Interfaces and Human Computer Interaction 
653 |a Acoustical engineering 
653 |a Human-computer interaction 
041 0 7 |a eng  |2 ISO 639-2 
989 |b Springer  |a Springer eBooks 2005- 
490 0 |a T-Labs Series in Telecommunication Services 
028 5 0 |a 10.1007/978-3-642-31591-6 
856 4 0 |u https://doi.org/10.1007/978-3-642-31591-6?nosfx=y  |x Verlag  |3 Volltext 
082 0 |a 621.382 
520 |a Spoken dialog systems have the potential to offer highly intuitive user interfaces, as they allow systems to be controlled using natural language. However, the complexity inherent in natural language dialogs means that careful testing of the system must be carried out from the very beginning of the design process.   This book examines how user models can be used to support such early evaluations in two ways:  by running simulations of dialogs, and by estimating the quality judgments of users. First, a design environment supporting the creation of dialog flows, the simulation of dialogs, and the analysis of the simulated data is proposed.  How the quality of user simulations may be quantified with respect to their suitability for both formative and summative evaluation is then discussed. The remainder of the book is dedicated to the problem of predicting quality judgments of users based on interaction data. New modeling approaches are presented, which process the dialogs as sequences, and which allow knowledge about the judgment behavior of users to be incorporated into predictions. All proposed methods are validated with example evaluation studies