Matthew Butterick:

I believe the catastrophes caused by AGI will be consequential but not agentic. By that I mean that AGI will feel about humans the way a tornado feels about houses it destroys: nothing at all. The harm to us will be an incidental effect of obstructing an irresistible force. So when AGI optimists say “These systems have no desires of their own; they’re not interested in taking over” — we shouldn’t be comforted. Both things can be true: no intention of domination, yet domination nevertheless.