Language Representation Learning System

A Language Representation Learning System is a representation learning system that can solve a language representation learning task by a language representation learning algorithm.

• Example(s):
  • a Neural Language Representation System,
  • a Biomedical Language Representation System such as:
    • a BioBERT System;
  • an ERNIE System.
  • …
• Counter-Example(s):
  • a Knowledge Representation System.
• See: Language Model, Word-level Embedding, Character-level Embedding, Formal Language, Natural Language, Natural Language Processing System, Natural Language Understanding System.

---

---

References

2020

• (Lee et al., 2020) ⇒ Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, Donghyeon Kim, Sunkyu Kim, Chan Ho So, and Jaewoo Kang (2020). “BioBERT: A Pre-Trained Biomedical Language Representation Model For Biomedical Text Mining". In: Bioinformatics, 36(4), 1234-1240.

2019a

• (Bjerva et al., 2019) ⇒ Johannes Bjerva, Robert Ostling, Maria Han Veiga, Jorg Tiedemann, and Isabelle Augenstein (2019). “What do Language Representations Really Represent?". In: Computational Linguistics, 45(2), 381-389.

2019b

• (Zhang et al., 2019) ⇒ Zhengyan Zhang, Xu Han, Zhiyuan Liu, Xin Jiang, Maosong Sun, and Qun Liu (2019)."ERNIE: Enhanced Language Representation with Informative Entities".In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL). DOI:10.18653/v1/P19-1139.

---