Prompting & In-Context Learning (2020-2021)

Techniques for leveraging prompts and in-context learning in LLMs.

Few-Shot Learning

• Language Models are Few-Shot Learners - In-context learning foundations

Prompt-Based Learning

• Prompt Learning for Few-Shot Finetuning of Language Models - Discrete prompts

---

Key Insight: In-context learning enables LLMs to solve new tasks with minimal examples without any parameter updates.