Google¶
Overview¶
Google (DeepMind) has pioneered multiple architectural innovations including attention mechanisms, and maintains a diverse portfolio from BERT to Gemini.
Models¶
- BERT (2018) - Encoder-only, foundation for NLU
- T5 (2019) - Seq2Seq, text-to-text framework
- PaLM (2022) - 540B dense model
- Gemini (2023) - Multimodal frontier model
Architecture Focus¶
- Attention innovations
- Bidirectional understanding
- Multimodal integration
- Efficient scaling
Current Status¶
Gemini is Google's frontier offering, competing with GPT-4 and Claude 3.