PUB - Publikationen an der Universität Bielefeld

This paper presents a linguistic approach to trust in human conversations with LLM-based chatbots. Using the concept of trust calibration [Muir 1987] as a starting point, we aim to address the question of how to increase user AI literacy and prevent misuse of as well as overtrust in the information provided by LLM-based chatbots in educational contexts. We propose a linguistic-based model of trust calibration that supports users in adopting a critical perspective on trust calibration and controlling their trust level. The method combines previous studies on trust in human interaction, specifically linguistic trust cues displayed by human trustors to indicate their level of trustworthiness in naturally occurring contexts (see Nielsen and Nielsen 2022) with studies on proactive human-computer interaction (Kraus et al. 2021) and the social influence of conversational agent's embodiment in educational contexts (Leyzberg et al. 2012).