Confidence in uncertainty. Error cost and commitment in early speech hypotheses

Loth S, Jettka K, Giuliani M, Kopp S, de Ruiter J (2018)
PLoS ONE 13(8): e0201516.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
OA 14.38 MB
Autor*in
Loth, SebastianUniBi ; Jettka, Katharina; Giuliani, Manuel; Kopp, StefanUniBi ; de Ruiter, JanUniBi
Abstract / Bemerkung
Interactions with artificial agents often lack immediacy because agents respond slower than their users expect. Automatic speech recognisers introduce this delay by analysing a user’s utterance only after it has been completed. Early, uncertain hypotheses of incremental speech recognisers can enable artificial agents to respond more timely. However, these hypotheses may change significantly with each update. Therefore, an already initiated action may turn into an error and invoke error cost. We investigated whether humans would use uncertain hypotheses for planning ahead and/or initiating their response. We designed a Ghost-in-the-Machine study in a bar scenario. A human participant controlled a bartending robot and perceived the scene only through its recognisers. The results showed that participants used uncertain hypotheses for selecting the best matching action. This is comparable to computing the utility of dialogue moves. Participants evaluated the available evidence and the error cost of their actions prior to initiating them. If the error cost was low, the participants initiated their response with only suggestive evidence. Otherwise, they waited for additional, more confident hypotheses if they still had time to do so. If there was time pressure but only little evidence, participants grounded their understanding with echo questions. These findings contribute to a psychologically plausible policy for human-robot interaction that enables artificial agents to respond more timely and socially appropriately under uncertainty.
Erscheinungsjahr
2018
Zeitschriftentitel
PLoS ONE
Band
13
Ausgabe
8
Art.-Nr.
e0201516
ISSN
1932-6203
eISSN
1932-6203
Finanzierungs-Informationen
Open-Access-Publikationskosten wurden durch die Deutsche Forschungsgemeinschaft und die Universität Bielefeld gefördert.
Page URI
https://pub.uni-bielefeld.de/record/2930233

Zitieren

Loth S, Jettka K, Giuliani M, Kopp S, de Ruiter J. Confidence in uncertainty. Error cost and commitment in early speech hypotheses. PLoS ONE. 2018;13(8): e0201516.
Loth, S., Jettka, K., Giuliani, M., Kopp, S., & de Ruiter, J. (2018). Confidence in uncertainty. Error cost and commitment in early speech hypotheses. PLoS ONE, 13(8), e0201516. https://doi.org/10.1371/journal.pone.0201516
Loth, Sebastian, Jettka, Katharina, Giuliani, Manuel, Kopp, Stefan, and de Ruiter, Jan. 2018. “Confidence in uncertainty. Error cost and commitment in early speech hypotheses”. PLoS ONE 13 (8): e0201516.
Loth, S., Jettka, K., Giuliani, M., Kopp, S., and de Ruiter, J. (2018). Confidence in uncertainty. Error cost and commitment in early speech hypotheses. PLoS ONE 13:e0201516.
Loth, S., et al., 2018. Confidence in uncertainty. Error cost and commitment in early speech hypotheses. PLoS ONE, 13(8): e0201516.
S. Loth, et al., “Confidence in uncertainty. Error cost and commitment in early speech hypotheses”, PLoS ONE, vol. 13, 2018, : e0201516.
Loth, S., Jettka, K., Giuliani, M., Kopp, S., de Ruiter, J.: Confidence in uncertainty. Error cost and commitment in early speech hypotheses. PLoS ONE. 13, : e0201516 (2018).
Loth, Sebastian, Jettka, Katharina, Giuliani, Manuel, Kopp, Stefan, and de Ruiter, Jan. “Confidence in uncertainty. Error cost and commitment in early speech hypotheses”. PLoS ONE 13.8 (2018): e0201516.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-06T09:19:00Z
MD5 Prüfsumme
6e08dbe686c3843946c10befef3b9746


Link(s) zu Volltext(en)
Access Level
OA Open Access

109 References

Daten bereitgestellt von Europe PubMed Central.

A Simplest Systematics for the Organization of Turn-Taking for Conversation
AUTHOR UNKNOWN, 1974
Projecting the End of a Speaker’s Turn: A Cognitive Cornerstone of Conversation
AUTHOR UNKNOWN, 2006
Universals and cultural variation in turn-taking in conversation.
Stivers T, Enfield NJ, Brown P, Englert C, Hayashi M, Heinemann T, Hoymann G, Rossano F, de Ruiter JP, Yoon KE, Levinson SC., Proc. Natl. Acad. Sci. U.S.A. 106(26), 2009
PMID: 19553212

AUTHOR UNKNOWN, 1995

AUTHOR UNKNOWN, 1984

AUTHOR UNKNOWN, 1984
Standardized task strain and system response times in human-computer interaction.
Thum M, Boucsein W, Kuhmann W, Ray WJ., Ergonomics 38(7), 1995
PMID: 7635125
Stress response caused by system response time when searching for information on the Internet.
Trimmel M, Meixner-Pendleton M, Haring S., Hum Factors 45(4), 2003
PMID: 15055458
The spatial and temporal signatures of word production components.
Indefrey P, Levelt WJ., Cognition 92(1-2), 2004
PMID: 15037128
Word frequency effects in speech production: Retrieval of syntactic information and of phonological form
AUTHOR UNKNOWN, 1994
Timing in speech production with special reference to word form encoding.
Levelt WJ., Ann. N. Y. Acad. Sci. 682(), 1993
PMID: 8323120
Early anticipation lies behind the speed of response in conversation.
Magyari L, Bastiaansen MC, de Ruiter JP, Levinson SC., J Cogn Neurosci 26(11), 2014
PMID: 24893743
Recovery from misanalyses of garden-path sentences
AUTHOR UNKNOWN, 1991
Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences
AUTHOR UNKNOWN, 1982

AUTHOR UNKNOWN, 0
Anticipating upcoming words in discourse: evidence from ERPs and reading times.
Van Berkum JJ, Brown CM, Zwitserlood P, Kooijman V, Hagoort P., J Exp Psychol Learn Mem Cogn 31(3), 2005
PMID: 15910130
Computational Approaches to the Pragmatics Problem
AUTHOR UNKNOWN, 2014
Great expectations: specific lexical anticipation influences the processing of spoken language.
Otten M, Nieuwland MS, Van Berkum JJ., BMC Neurosci 8(), 2007
PMID: 17963486

AUTHOR UNKNOWN, 1976

AUTHOR UNKNOWN, 1977
Speaking while monitoring addressees for understanding
AUTHOR UNKNOWN, 2004
Eye movements and spoken language comprehension: effects of visual context on syntactic ambiguity resolution.
Spivey MJ, Tanenhaus MK, Eberhard KM, Sedivy JC., Cogn Psychol 45(4), 2002
PMID: 12480476

AUTHOR UNKNOWN, 1998
The use of verb-specific information for prediction in sentence processing
AUTHOR UNKNOWN, 2013
The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements
AUTHOR UNKNOWN, 2003

AUTHOR UNKNOWN, 1991
Next Speakers Plan Their Turn Early and Speak after Turn-Final "Go-Signals".
Barthel M, Meyer AS, Levinson SC., Front Psychol 8(), 2017
PMID: 28443035

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 2015

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 2012

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 2015

AUTHOR UNKNOWN, 2014

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 2009
Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition
AUTHOR UNKNOWN, 2012

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 2011

AUTHOR UNKNOWN, 2012
POMDP-Based Statistical Spoken Dialog Systems: A Review
AUTHOR UNKNOWN, 2013

AUTHOR UNKNOWN, 2014
A hybrid approach to dialogue management based on probabilistic rules
AUTHOR UNKNOWN, 2015

AUTHOR UNKNOWN, 0
Gaussian Processes for POMDP-Based Dialogue Manager Optimization
AUTHOR UNKNOWN, 2014

AUTHOR UNKNOWN, 0
Evaluation and Optimisation of Incremental Processors
AUTHOR UNKNOWN, 2011

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0
A General, Abstract Model of Incremental Dialogue Processing
AUTHOR UNKNOWN, 2011

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0
Ghost-in-the-Machine reveals human social signals for human-robot interaction.
Loth S, Jettka K, Giuliani M, de Ruiter JP., Front Psychol 6(), 2015
PMID: 26582998
Wizard of Oz Studies in HRI: A Systematic Review and New Reporting Guidelines
AUTHOR UNKNOWN, 2012
Automatic detection of service initiation signals used in bars.
Loth S, Huth K, De Ruiter JP., Front Psychol 4(), 2013
PMID: 24009594

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0

AUTHOR UNKNOWN, 0
Bayesian t tests for accepting and rejecting the null hypothesis.
Rouder JN, Speckman PL, Sun D, Morey RD, Iverson G., Psychon Bull Rev 16(2), 2009
PMID: 19293088
Mixed-effects modeling with crossed random effects for subjects and items
AUTHOR UNKNOWN, 2008

AUTHOR UNKNOWN, 0
Fitting Linear Mixed-Effects Models Using lme4
AUTHOR UNKNOWN, 2015

AUTHOR UNKNOWN, 0
A Kenward-Roger Approximation and Parametric Bootstrap Methods for Tests in Linear Mixed Models—The R Package pbkrtest
AUTHOR UNKNOWN, 2014

AUTHOR UNKNOWN, 1969
G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences.
Faul F, Erdfelder E, Lang AG, Buchner A., Behav Res Methods 39(2), 2007
PMID: 17695343
Calibration of ρ Values for Testing Precise Null Hypotheses
AUTHOR UNKNOWN, 2001
Evaluating significance in linear mixed-effects models in R.
Luke SG., Behav Res Methods 49(4), 2017
PMID: 27620283
Communication and miscommunication: The role of egocentric processes
AUTHOR UNKNOWN, 2007
Avoiding attachment ambiguities: The role of constituent ordering
AUTHOR UNKNOWN, 2004
Perspective taking in children and adults: Equivalent egocentrism but differential correction
AUTHOR UNKNOWN, 2004
Social Projection as a Source of Cooperation
AUTHOR UNKNOWN, 2013
Heuristic game theory
AUTHOR UNKNOWN, 2014
Statistical criteria for establishing a truly false consensus effect
AUTHOR UNKNOWN, 1989

AUTHOR UNKNOWN, 2005

AUTHOR UNKNOWN, 1997
Effective task training strategies for human and robot instructors
AUTHOR UNKNOWN, 2015
A theory of memory retrieval
AUTHOR UNKNOWN, 1978
Prediction of turn-ends based on anticipation of upcoming words.
Magyari L, de Ruiter JP., Front Psychol 3(), 2012
PMID: 23112776

AUTHOR UNKNOWN, 0
Opening up Closings
AUTHOR UNKNOWN, 1973
Echo questions: A pragmatic account
AUTHOR UNKNOWN, 1994
The Preference for Self-Correction in the Organization of Repair in Conversation
AUTHOR UNKNOWN, 1977
Conceptual pacts and lexical choice in conversation.
Brennan SE, Clark HH., J Exp Psychol Learn Mem Cogn 22(6), 1996
PMID: 8921603

AUTHOR UNKNOWN, 0
Echoes of echoes? An episodic theory of lexical access.
Goldinger SD., Psychol Rev 105(2), 1998
PMID: 9577239
Unintended imitation in nonword repetition.
Kappes J, Baumgaertner A, Peschke C, Ziegler W., Brain Lang 111(3), 2009
PMID: 19811813
Group Rapport: Posture Sharing as a Nonverbal Indicator
AUTHOR UNKNOWN, 1976

AUTHOR UNKNOWN, 0
Predictions penetrate perception: Converging insights from brain, behaviour and disorder.
O'Callaghan C, Kveraga K, Shine JM, Adams RB Jr, Bar M., Conscious Cogn 47(), 2016
PMID: 27222169
A social Bayesian brain: How social knowledge can shape visual perception.
Otten M, Seth AK, Pinto Y., Brain Cogn 112(), 2016
PMID: 27221986
Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®
Quellen

PMID: 30067853
PubMed | Europe PMC

Suchen in

Google Scholar