Python-based Language Model Training System

A Python-based Language Model Training System is a LM training system that is a Python-based NLP system.

• Context:
  • It can range from being a Python-based Character-Level LM System, to being a Python-based Word-Level LM System, ...
  • It can range from being a Python-based Neural LM System, to being a Python-based Maximum Entropy LM System, ...
• Example(s):
  • (Goldberg, 2015).
  • …
• Counter-Example(s):
  • a Lua-based LM System.
• See: Word Embedding.

---

---

References

2015

• (Goldberg, 2015) ⇒ Yoav Goldberg. (2015). “The Unreasonable Effectiveness of Character-level Language Models (and Why RNNs Are Still Cool).” In: Blog Post.
  • QUOTE: … In what follows I will briefly describe these character-level maximum-likelihood language models, which are much less magical than RNNs and LSTMs, and show that they too can produce a rather convincing Shakespearean prose. I will also show about 30 lines of python code that take care of both training the model and generating the output. Compared to this baseline, the RNNs may seem somewhat less impressive. ...

---