transformers
- Large Language Models
Models trained on enormous text corpora that generate and understand language: how they work, what they can and cannot do. - The Transformer Architecture
The attention-based architecture behind modern language models: self-attention, positional encoding, and why it replaced recurrence.