Recurrent Neural Networks Neural networks with internal state that process sequences step by step, used for language modeling, translation, and time series.
Convolutional Neural Networks Networks that learn from images and grids using shared-weight filters: convolution, pooling, and the architectures that won computer vision.
Backpropagation The algorithm that computes gradients through deep networks — the workhorse of training neural networks.