2015 WikiQAAChallengeDatasetforOpenD

From GM-RKB
Jump to navigation Jump to search

Subject Headings: WikiQA Dataset; Question-Answering Dataset; Open-Domain Question Answering (QA) Benchmark.

Notes

Cited By

Quotes

Abstract

We describe the WikiQA dataset, a new publicly available set of question and sentence pairs, collected and annotated for research on open-domain question answering. Most previous work on answer sentence selection focuses on a dataset created using the TREC-QA data, which includes editor-generated questions and candidate answer sentences selected by matching content words in the question. WikiQA is constructed using a more natural process and is more than an order of magnitude larger than the previous dataset. In addition, the WikiQA dataset also includes questions for which there are no correct sentences, enabling researchers to work on answer triggering, a critical component in any QA system. We compare several systems on the task of answer sentence selection on both datasets and also describe the performance of a system on the problem of answer triggering using the WikiQA dataset.

References

BibTeX

@inproceedings{2015_WikiQAAChallengeDatasetforOpenD,
  author    = {Yi Yang and
               Wen-tau Yih and
               Christopher Meek},
  editor    = {Lluis Marquez and
               Chris Callison-Burch and
               Jian Su and
               Daniele Pighin and
               Yuval Marton},
  title     = {WikiQA: A Challenge Dataset for Open-Domain Question Answering},
  booktitle = {Proceedings of the 2015 Conference on Empirical Methods in Natural
               Language Processing (EMNLP 2015)},
  pages     = {2013--2018},
  publisher = {The Association for Computational Linguistics},
  year      = {2015},
  url       = {https://doi.org/10.18653/v1/d15-1237},
  doi       = {10.18653/v1/d15-1237},
}


 AuthorvolumeDate ValuetitletypejournaltitleUrldoinoteyear
2015 WikiQAAChallengeDatasetforOpenDWen-tau Yih
Christopher Meek
Yi Yang
WikiQA: A Challenge Dataset for Open-Domain Question Answering2015