Neural networks that process sequences, such as text, music or speech, one step at a time while keeping a memory of what came before. They led generative text before transformers.
