I'm more concerned with the ethics involved. If an 'AI' ever becomes self-aware, what happens if we shut it off - and what does that make us?

BTW/FWIW, some decades ago I worked in proximity of (but not directly with) Marvin Minsky. As a software guy, I got a major laugh from him when I told him that "AI just means we don't know how to do that yet...". I ran across a manuscript to his 'Theory of Mind' book in my last office clean-out (not something special, he was looking for input from everyone around him at the Media Lab).

Reading his modeling of how an AI might work got me concerned about how we humans treat new consciousnesses.

Fortunately, we have yet to come close, in spite of all the things that computer systems can now do. (just as true back then - and what prompted my comment to Marvin)