I think the real reason he is asking for pacing, is that in a world were AI becomes rampant, he will be seen as Hitler. I would bet this is mostly self-motivated.
Interestingly, I kinda disregarded the entire point about alignement - I think it's mostly fluff.
The part about RSI is what really interests me. Once you reach it, the singularity is only a matter of time.
I don't care about AGI, it does not seem to mean much anymore, and even though I originally laughed at ppl calling it AGI, I now agree. You can apply that current intelligence to anything that can be turned into a conversation.
It seems their flavor of RSI still need a human in the loop. So at least it won't scale as well for now.
Meanwhile Chinese chip-makers are chip-making. If you believe the threat of these open-weight AI is existential, how long do you think these bans (that only work for hardware) will work in your favor?