Machine learning with neural networks of many layers, each learning more abstract features than the last. Its breakthrough came in 2012, when AlexNet won the ImageNet image-recognition contest.
And then in 2012 there was Ilya, Alex and Geoff did ImageNet, and we just really did not see that coming. We'd been focused on things like warming up with generative modeling before proceeding to supervised training.
Ian Goodfellow, Ian Goodfellow on Inventing GANs
There was kind of, I think, like deep learning had crossed over into Twitter not long before then. I think there was this emergence of AI Twitter in that year or maybe the year before. It was mostly the young researchers who were adopting social media that were active.
Gene Kogan, Tom White & Gene Kogan on the Birth of GAN Art