Self-supervised learning is the most exciting area of AI development because it seeks to build common sense knowledge by allowing machines to learn from vast amounts of data without human annotation.

“But I would say the really big exciting one is self-supervised learning. We're trying to get less and less human supervision uh uh less and less human supervision of neural networks.”