Analogy Recovery Task

References

http://www.marekrei.com/blog/
- The task under consideration is analogy recovery. These are questions in the form: a is to b as c is to d In a usual setting, the system is given words a, b, c, and it needs to find d.
  For example: ‘apple’ is to ‘apples’ as ‘car’ is to ? where the correct answer is ‘cars’. Or the well-known example: ‘man’ is to ‘woman’ as ‘king’ is to? where the desired answer is ‘queen’.
  While methods such as relation extraction would also be completely reasonable approaches to this problem, the research is mainly focused on solving it by using vector similarity methods. This means we create vector representations for each of the words, and then use their positions in the high-dimensional feature space to determine what the missing word should be.

(Mikolov et al., 2013b) ⇒ Tomáš Mikolov, Wen-tau Yih, and Geoffrey Zweig. (2013). “Linguistic Regularities in Continuous Space Word Representations..” In: HLT-NAACL.
- QUOTE: This allows vector-oriented reasoning based on the offsets between words. For example, the male / female relationship is automatically learned, and with the induced vector representations, "King - Man + Woman" results in a vector very close to "Queen.” We demonstrate that the word vectors capture syntactic regularities by means of syntactic analogy questions (provided with this paper), and are able to correctly answer almost 40% of the questions.