Prefix Tuning: Optimizing Continuous Prompts for Generation

Authors: Li & Liang Year: 2021 ArXiv/Link: https://arxiv.org/abs/2101.00190

Summary

Learns continuous prompt embeddings prepended to input enabling efficient task adaptation.

Key Concepts

• Continuous prompts
• Learnable prefixes
• Prompt optimization
• Task adaptation
• Parameter efficiency

Impact

Efficient prompt-based adaptation for text generation

Category

Prompting Techniques

---