MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment

Ilinykh N, Zarrieß S, Schlangen D (2019)
In: arXiv:1907.05084.

Konferenzbeitrag| Englisch
 
Download
Es wurde kein Volltext hochgeladen. Nur Publikationsnachweis!
Abstract / Bemerkung
Building computer systems that can converse about their visual environment is one of the oldest concerns of research in Artificial Intelligence and Computational Linguistics (see, for example, Winograd's 1972 SHRDLU system). Only recently, however, have methods from computer vision and natural language processing become powerful enough to make this vision seem more attainable. Pushed especially by developments in computer vision, many data sets and collection environments have recently been published that bring together verbal interaction and visual processing. Here, we argue that these datasets tend to oversimplify the dialogue part, and we propose a task---MeetUp!---that requires both visual and conversational grounding, and that makes stronger demands on representations of the discourse. MeetUp! is a two-player coordination game where players move in a visual environment, with the objective of finding each other. To do so, they must talk about what they see, and achieve mutual understanding. We describe a data collection and show that the resulting dialogues indeed exhibit the dialogue phenomena of interest, while also challenging the language & vision aspect.
Erscheinungsjahr
2019
Titel des Konferenzbandes
arXiv:1907.05084
Page URI
https://pub.uni-bielefeld.de/record/2937291

Zitieren

Ilinykh N, Zarrieß S, Schlangen D. MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment. In: arXiv:1907.05084. 2019.
Ilinykh, N., Zarrieß, S., & Schlangen, D. (2019). MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment. arXiv:1907.05084
Ilinykh, N., Zarrieß, S., and Schlangen, D. (2019). “MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment” in arXiv:1907.05084.
Ilinykh, N., Zarrieß, S., & Schlangen, D., 2019. MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment. In arXiv:1907.05084.
N. Ilinykh, S. Zarrieß, and D. Schlangen, “MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment”, arXiv:1907.05084, 2019.
Ilinykh, N., Zarrieß, S., Schlangen, D.: MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment. arXiv:1907.05084. (2019).
Ilinykh, Nikolai, Zarrieß, Sina, and Schlangen, David. “MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment”. arXiv:1907.05084. 2019.

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Quellen

arXiv: 1907.05084

Suchen in

Google Scholar