Meta Llama 3

• Released: April 2024
• Sizes: 8B, 70B, 405B (flagship)
• Achievement: 92.9% on MMLU (competes with GPT-4)
• Architecture: GQA, extended training
• Context: 8K base, extensible
• Status: State-of-the-art open model
• License: Open weights, commercial OK