Beam Search, Greedy Decoding & Sampling: Trade-offs

Authors: Holtzman et al. Year: 2019 ArXiv/Link: https://arxiv.org/abs/1805.04833

Summary

Analysis of generation algorithms and their trade-offs between quality, diversity, and computational cost.

Key Concepts

• Decoding strategies
• Beam search
• Sampling
• Top-k sampling
• Quality vs diversity

Impact

Informed selection of decoding strategies for generation

Category

Decoding Strategies

---