Base Large Language Model (Base LLM)
(Redirected from Large Pretrained Base Language Model (Base LLM))
Jump to navigation
Jump to search
A Base Large Language Model (Base LLM) is a large pre-trained language model that is a base LM.
- Context:
- It can (typically) predict the next word in a given context.
- It can (often) generate contextually relevant text but may not follow specific instructions accurately.
- It can (typically) serve as a foundation for further fine-tuning in other models like Instruction Tuned LLM.
- It can be compared to a recent college graduate who has read extensively and accumulated a wealth of knowledge and insights on various topics.
- …
- Example(s):
- GPT-3, a large language model that can generate relevant responses based on the context it is given.
- …
- Counter-Example(s):
- Instruction Tuned LLM, a type of LLM fine-tuned for better instruction following.
- …
- See: Language Model, Reinforcement Learning, Natural Language Processing.