Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics

Schlangen D (2019)
In: Proceedings of the 13th International Conference on Computational Semantics - Long Papers. Dobnik S, Chatzikyriakidis S, Demberg V (Eds); Gothenburg, Sweden: Association for Computational Linguistics: 283-294.

Konferenzbeitrag | Veröffentlicht| Englisch
 
Download
OA 5.42 MB
Herausgeber*in
Dobnik, Simon; Chatzikyriakidis, Stergios; Demberg, Vera
Abstract / Bemerkung
Propelling, and propelled by, the "deep learning revolution", recent years have seen the introduction of ever larger corpora of images annotated with natural language expressions. We survey some of these corpora, taking a perspective that reverses the usual directionality, as it were, by viewing the images as semantic annotation of the natural language expressions. We discuss datasets that can be derived from the corpora, and tasks of potential interest for computational semanticists that can be defined on those. In this, we make use of relations provided by the corpora (namely, the link between expression and image, and that between two expressions linked to the same image) and relations that we can add (similarity relations between expressions, or between images). Specifically, we show that in this way we can create data that can be used to learn and evaluate lexical and compositional grounded semantics, and we show that the "linked to same image" relation tracks a semantic implication relation that is recognisable to annotators even in the absence of the linking image as evidence. Finally, as an example of possible benefits of this approach, we show that an exemplar-model-based approach to implication beats a (simple) distributional space-based one on some derived datasets, while lending itself to explainability.
Erscheinungsjahr
2019
Titel des Konferenzbandes
Proceedings of the 13th International Conference on Computational Semantics - Long Papers
Seite(n)
283-294
ISBN
978-1-950737-19-2
Page URI
https://pub.uni-bielefeld.de/record/2935855

Zitieren

Schlangen D. Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics. In: Dobnik S, Chatzikyriakidis S, Demberg V, eds. Proceedings of the 13th International Conference on Computational Semantics - Long Papers. Gothenburg, Sweden: Association for Computational Linguistics; 2019: 283-294.
Schlangen, D. (2019). Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics. In S. Dobnik, S. Chatzikyriakidis, & V. Demberg (Eds.), Proceedings of the 13th International Conference on Computational Semantics - Long Papers (pp. 283-294). Gothenburg, Sweden: Association for Computational Linguistics.
Schlangen, D. (2019). “Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics” in Proceedings of the 13th International Conference on Computational Semantics - Long Papers, Dobnik, S., Chatzikyriakidis, S., and Demberg, V. eds. (Gothenburg, Sweden: Association for Computational Linguistics), 283-294.
Schlangen, D., 2019. Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics. In S. Dobnik, S. Chatzikyriakidis, & V. Demberg, eds. Proceedings of the 13th International Conference on Computational Semantics - Long Papers. Gothenburg, Sweden: Association for Computational Linguistics, pp. 283-294.
D. Schlangen, “Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics”, Proceedings of the 13th International Conference on Computational Semantics - Long Papers, S. Dobnik, S. Chatzikyriakidis, and V. Demberg, eds., Gothenburg, Sweden: Association for Computational Linguistics, 2019, pp.283-294.
Schlangen, D.: Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics. In: Dobnik, S., Chatzikyriakidis, S., and Demberg, V. (eds.) Proceedings of the 13th International Conference on Computational Semantics - Long Papers. p. 283-294. Association for Computational Linguistics, Gothenburg, Sweden (2019).
Schlangen, David. “Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics”. Proceedings of the 13th International Conference on Computational Semantics - Long Papers. Ed. Simon Dobnik, Stergios Chatzikyriakidis, and Vera Demberg. Gothenburg, Sweden: Association for Computational Linguistics, 2019. 283-294.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Volltext(e)
Name
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-06-01T10:39:05Z
MD5 Prüfsumme
efc1944e45b27d9889ae5465358efae0

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar
ISBN Suche