2017 AnOverviewofNaturalLanguageInfe
- (Chatzikyriakidis et al., 2017) ⇒ Stergios Chatzikyriakidis, Robin Cooper, Simon Dobnik, and Staffan Larsson. (2017). “An Overview of Natural Language Inference Data Collection: The Way Forward?.” In: Proceedings of the Computing Natural Language Inference Workshop.
Subject Headings: Natural Language Inference Task.
Notes
Cited By
Quotes
Introduction
Understanding a Natural Language (NL) sentence amounts to understanding its consequences as well as the sentences that it is a consequence of. As Cooper et al. (1996) aptly put it “inferential ability is not only a central manifestation of semantic competence but is in fact centrally constitutive of it]]”. Given the latter claim, it is no surprise that the same authors argue that the best way to test the semantic adequacy of NLP systems is to look at how well they perform with regard to Natural Language Inference (NLI). It is very hard not to agree with this statement. Indeed, NLI is considered by many researchers to be the crux of computational semantics. This paper is about the datasets created for this need. In particular, we discuss the most common NLI resources arguing that all these a) fail to capture the wealth of inferential mechanisms present in NLI and b) seem to be driven by the dominant discourse in the field at the time of their creation. In light of these observations, we want to discuss the requirements that an adequate NLI platform must satisfy both in terms of the range of inference patterns found in reasoning with NL as well as the range of the data collection mechanisms that are needed in order to acquire this range of inferential patterns.
2 NLI Datasets
In this section we present the merits and drawbacks of three NLI datasets which represent some of the main strategies that have been used in the data collection of inference.
References
;
| Author | volume | Date Value | title | type | journal | titleUrl | doi | note | year | |
|---|---|---|---|---|---|---|---|---|---|---|
| 2017 AnOverviewofNaturalLanguageInfe | Stergios Chatzikyriakidis Robin Cooper Simon Dobnik Staffan Larsson | An Overview of Natural Language Inference Data Collection: The Way Forward? | 2017 |