Challenges in Designing Natural Language Interfaces for Complex Visual Models

Voigt H, Meuschke M, Lawonn K, Zarrieß S (2021)
In: Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing. Online: Association for Computational Linguistics: 66-73.

Konferenzbeitrag | Englisch
 
Autor*in
Voigt, Henrik; Meuschke, Monique; Lawonn, Kai; Zarrieß, SinaUniBi
Abstract / Bemerkung
Intuitive interaction with visual models becomes an increasingly important task in the field of Visualization (VIS) and verbal interaction represents a significant aspect of it. Vice versa, modeling verbal interaction in visual environments is a major trend in ongoing research in NLP. To date, research on Language {\&} Vision, however, mostly happens at the intersection of NLP and Computer Vision (CV), and much less at the intersection of NLP and Visualization, which is an important area in Human-Computer Interaction (HCI). This paper presents a brief survey of recent work on interactive tasks and set-ups in NLP and Visualization. We discuss the respective methods, show interesting gaps, and conclude by suggesting neural, visually grounded dialogue modeling as a promising potential for NLIs for visual models.
Erscheinungsjahr
2021
Titel des Konferenzbandes
Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing
Seite(n)
66-73
Page URI
https://pub.uni-bielefeld.de/record/2955816

Zitieren

Voigt H, Meuschke M, Lawonn K, Zarrieß S. Challenges in Designing Natural Language Interfaces for Complex Visual Models. In: Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing. Online: Association for Computational Linguistics; 2021: 66-73.
Voigt, H., Meuschke, M., Lawonn, K., & Zarrieß, S. (2021). Challenges in Designing Natural Language Interfaces for Complex Visual Models. Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing, 66-73. Online: Association for Computational Linguistics.
Voigt, H., Meuschke, M., Lawonn, K., and Zarrieß, S. (2021). “Challenges in Designing Natural Language Interfaces for Complex Visual Models” in Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing (Online: Association for Computational Linguistics), 66-73.
Voigt, H., et al., 2021. Challenges in Designing Natural Language Interfaces for Complex Visual Models. In Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing. Online: Association for Computational Linguistics, pp. 66-73.
H. Voigt, et al., “Challenges in Designing Natural Language Interfaces for Complex Visual Models”, Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing, Online: Association for Computational Linguistics, 2021, pp.66-73.
Voigt, H., Meuschke, M., Lawonn, K., Zarrieß, S.: Challenges in Designing Natural Language Interfaces for Complex Visual Models. Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing. p. 66-73. Association for Computational Linguistics, Online (2021).
Voigt, Henrik, Meuschke, Monique, Lawonn, Kai, and Zarrieß, Sina. “Challenges in Designing Natural Language Interfaces for Complex Visual Models”. Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing. Online: Association for Computational Linguistics, 2021. 66-73.
Link(s) zu Volltext(en)
Access Level
OA Open Access

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar