Google: Diverse Model Portfolio¶

Overview¶

Google (DeepMind) has pioneered multiple architectural innovations including attention mechanisms, and maintains a diverse portfolio from BERT to Gemini.

Models¶

BERT (2018) - Encoder-only, foundation for NLU
T5 (2019) - Seq2Seq, text-to-text framework
PaLM (2022) - 540B dense model
Gemini (2023) - Multimodal frontier model

Architecture Focus¶

Attention innovations
Bidirectional understanding
Multimodal integration
Efficient scaling

Current Status¶

Gemini is Google's frontier offering, competing with GPT-4 and Claude 3.