Visual modality will be critical for future AI agents because humans need to communicate visually and the motivation for the tasks these models perform comes from people.

“But as long as there's people in the loop and as long as the the kind of the the motivation for the task they're solving comes from people, I think it makes total sense that that visual modality is going to be really critical for any of these AI agents going forward.”