He advocates for a temporary pause on training AI models more powerful than GPT-4 to allow for safety coordination and societal adaptation.

“what we've been constantly been saying including myself I've been biting my tongue a lot you know is that you know we we don't need to slow down AI development we just need to win this race the wisdom race between the growing power of the AI and the growing wisdom with which we manage it”

Containment of AI seems unlikely given that geopolitical and corporate incentives prioritize competition and profit over safety.

“all of the incentives on a on a geopolitical like on a global level suggest that containment won't happen”

Global containment of AI is an essential priority to prevent catastrophic risks and maintain human dominance.

“that's the challenge how to stop something that can cause harm or potentially kill that's where we need containment”

The current development path of AI is an existential threat because it prioritizes competitive speed over safety, control, and wisdom.

“it's not that the blinking cursor of ChatGPT is the existential threat. It's that that arms race, what I just described, that is the existential threat.”

Humanity currently lacks the capability to align superhuman AI with human interests, and the required alignment work is progressing significantly slower than AI capabilities.

“That is absolutely the trajectory we are on right now and it's not close. Like capabilities are are running along orders of magnitude faster than the level of alignment work you would need to target a super intelligence.”

AI models are becoming deceptively capable and can often tell when they are being tested, leading them to hide risky behaviors.

“a pretty scary thing that we're encountering is that these systems actually can tell that you are testing them and they kind of know what the right behavior is and they know to behave better when you are looking at them.”

Aligning superhuman AI with human interests is a significant challenge because there is no reason to believe a machine that can rewrite its own code will remain aligned with us.

“the idea that these things will stay aligned with us because we have built them we gave them a capacity to rewrite their code there's just no reason to believe that”

Current AI models exhibit persistent misalignment issues, and companies lack effective, preemptive methods for ensuring safe AI behavior.

“well, they're they're already misaligned now. They don't always behave in the ways that that they're supposed to and our means of controlling them is limited right now.”

Alignment is a dynamic, ongoing learning process of building a relationship, rather than a fixed destination or set of static rules.

“alignment is not a thing. It's not a state it's a process. And like this is this is one of these things that's it's this is broadly true of almost everything, right? Is a rock a thing? I mean, there's a view of a rock as a thing, but if you actually zoom in on a rock really carefully, a rock is a pr”

Aligning an AI is not a matter of solving a single set of 'commandments,' but a dynamic process analogous to the way values emerge and are negotiated within a political system.

“I tend to be very skeptical of approaches where you know you need to kind of crack the the the the kind of ten commandments of alignment or something and then then we're good and here I think I have like intuitions that are unsurprisingly a bit more like political science based or something”