Cross-Lingual Semantic Word Similarity Benchmark Task

A Cross-Lingual Semantic Word Similarity Benchmark Task is a Semantic Word Similarity Benchmark Task that evaluates the performance of Cross-lingual Semantic Word Similarity Systems.

• Context:
  • Task Input: a multilingual data.
  • Task Output: semantic word similarity score.
  • Task Requirement(s):
    • Benchmark datasets: Cross-lingual semantic word similarity datasets.
    • ML training system or training corpora.
    • Benchmark performance metrics: semantic word similarity measure.
    • Cross-lingual semantic word similarity systems (a baseline system + participating systems).
• Example(s):
  • SemEval-2017 Task 2.
  • …
• Counter-Example(s):
  • a Multilingual Semantic Word Similarity Benchmark Task,
  • a Monolingual Semantic Word Similarity Benchmark Task.
• See: Multilingual and Cross-lingual Semantic Word Similarity Benchmark Task, Word Similarity, Semantic Similarity Analysis Task, Natural Language Processing Task, Semantic Analysis Task.

---