English as a Programming Language

An English as a Programming Language is a natural language programming language that ...

• See: Programming Language.

---

---

References

2023

• (Karpathy, 2023) => Andrej Karpathy. “The hottest new programming language is English” https://x.com/karpathy/status/1617979122625712128
  • This tweet went wide, thought I'd post some of the recent supporting articles that inspired it.
    • 1/ GPT-3 paper showed that LLMs perform in-context learning, and can be "programmed" inside the prompt with input:output examples to perform diverse tasks https://arxiv.org/abs/2005.14165
    • 2/ These two [1] https://arxiv.org/abs/2205.11916 , [2] https://arxiv.org/abs/2211.01910 are good examples that the prompt can further program the "solution strategy", and with a good enough design of it, a lot more complex multi-step reasoning tasks become possible.
    • 3/ These two articles/papers:
      • [1] https://evjang.com/2021/10/23/generalization.html
      • [2] https://arxiv.org/abs/2106.01345
    • bit more technical but TLDR good prompts include the desired/aspiring performance. GPTs don't "want" to succeed. They want to imitate. You want to succeed, and you have to ask for it.

---