Linguistic Semantic Analysis Benchmark Task

A Linguistic Semantic Analysis Benchmark Task is a NLP Benchmark Task that evaluates the performance of linguistic semantic analysis system.

• Context:
  • Task Input: Linguistic Data,
  • Task Output: a semantically analyzed data.
  • Task Requirement(s):
    • Benchmark Datasets: Linguistic semantic datasets,
    • Benchmark Performance Metric: Linguistic semantic metric (e.g. semantic similarity measure, semantic relatedness measure.
    • Linguistic semantic analysis system(s).
• Example(s):
  • a Semantic Textual Similarity Benchmark (STS-B) Task such as: SemEval Task.
  • …
• Counter-Example(s):
  • a Semantic Relation Mention Recognition Benchmark Task.
  • a Named Entity Recognition Benchmark Task;
  • a Coreference Resolution Benchmark Task;
  • a Question Answering Benchmark Task;
  • a Document Summarization Benchmark Task.
• See: Semantic Analysis Task, Semantic Similarity Task, Natural Language Processing System, Natural Language Translation Task, Natural Language Inference System, Lexical Entailment, Syntactic Parsing System, Morphological Analysis System, Word Sense Disambiguation, SemEval Task, LRE Map.

---

---