Recurrent Neural Networks

Published on July 07, 2026

Notes from CMU Advanced NLP.

Where RNNs sit in the evolution of NLP architectures:

Bag of Words
     │
     ▼
CBOW / Skip-Gram
     │
     ▼
    RNN
     │
     ▼
LSTM / GRU
     │
     ▼
 Attention
     │
     ▼
Transformer
     │
     ▼
Modern LLMs

Tags: nlp, rnn, neural_networks