Word Embeddings Dense vector representations of words learned from text, in which semantically similar words have similar vectors.
The Transformer Architecture The attention-based architecture behind modern language models: self-attention, positional encoding, and why it replaced recurrence.
Large Language Models Models trained on enormous text corpora that generate and understand language: how they work, what they can and cannot do.