An early jewel of this period was the recurrent neural network, or RNN. A family of algorithms tailor-made to match the linear sequences of words, RNNs were able to quickly infer basic properties of text, in much the same way that convolutional neural networks like AlexNet processed images. Like CNNs, RNNs had existed for decades, but it wasn’t until now that their true power was realized.
