natural language processing

3 articles · All tags

• Word Embeddings
  Dense vector representations of words learned from text, in which semantically similar words have similar vectors.
• Large Language Models
  Models trained on enormous text corpora that generate and understand language: how they work, what they can and cannot do.
• The Transformer Architecture
  The attention-based architecture behind modern language models: self-attention, positional encoding, and why it replaced recurrence.