Character-Level Language Model (LM)

From GM-RKB
(Redirected from character-aware LM)
Jump to navigation Jump to search

A Character-Level Language Model (LM) is a text-string likelihood function that operates on text character substrings.



References

2017

2015b

2015a

  • (Karpathy, 2015) ⇒ Andrej Karpathy. (2015). “The Unreasonable Effectiveness of Recurrent Neural Networks." May 21, 2015
    • QUOTE: … Okay, so we have an idea about what RNNs are, why they are super exciting, and how they work. We’ll now ground this in a fun application: We’ll train RNN character-level language models. That is, we’ll give the RNN a huge chunk of text and ask it to model the probability distribution of the next character in the sequence given a sequence of previous characters. This will then allow us to generate new text one character at a time. …

2003