WordSim-353 Dataset

A WordSim-353 Dataset is a Multilingual and Cross-Lingual Semantic Word Similarity Dataset that can be used in a Semantic Word Similarity Benchmark Task.

• AKA: WordSimilarity-353 Test Collection Dataset.
• Context:
  • It was first introduced by Finkelstein et al. (2002).
• Example(s):
  • http://gabrilovich.com/resources/data/wordsim353/
  • https://www.wikidata.org/wiki/Q31845205,
  • https://scholia.toolforge.org/use/Q31845205
  • http://lcl.uniroma1.it/similarity-datasets/
  • ...
  • …
• Counter-Example(s):
  • RG-65 Dataset,
  • MC30 Dataset,
  • SimLex-999 Dataset.
• See: Training Dataset, Semantic Word Similarity Measure, Semantic Word Similarity System, SemEval-2017 Task 2, Reading Comprehension Dataset, Question-Answer Dataset.

---

---

References

2021

• (Gabrilovich, 2021) ⇒ http://gabrilovich.com/resources/data/wordsim353/ Released: 2002-02-10, Retrieved:2021-07-18.
  • QUOTE: The WordSimilarity-353 Test Collection contains two sets of English word pairs along with human-assigned similarity judgements. The collection can be used to train and/or test computer algorithms implementing semantic similarity measures (i.e., algorithms that numerically estimate similarity of natural language words).

2020

• (ACL, 2020) ⇒ https://aclweb.org/aclwiki/WordSimilarity-353_Test_Collection_(State_of_the_art) Last edited on 16 June 2020.
  • QUOTE: contains two sets of English word pairs along with human-assigned similarity judgements;
    • first set (set1) contains 153 word pairs along with their similarity scores assigned by 13 subjects;
    • second set (set2) contains 200 word pairs with similarity assessed by 16 subjects;
    • ...
    • performance is measured by Spearman's rank correlation coefficient.
    • introduced by Finkelstein et al. (2002);
    • subsequently used by many other researchers;

2017

• (Camacho-Collados et al., 2017) ⇒ Jose Camacho-Collados, aMohammad Taher Pilehvar, Nigel Collier, and Roberto Navigli. (2017). “SemEval-2017 Task 2: Multilingual and Cross-lingual Semantic Word Similarity.” In: Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval@ACL 2017).

2002

• (Finkelstein et al., 2002) ⇒ Lev Finkelstein, Evgeniy Gabrilovich, Yossi Matias, Ehud Rivlin, Zach Solan, Gadi Wolfman, and Eytan Ruppin (2002). "Placing Search in Context: The Concept Revisited". In: ACM Transactions on Information Systems (TOIS), Volume 20.

---