“It is hypothetically possible for intelligence to exist without consciousness. A philosophical zombie. If consciousness is the limiting factor on distributed intelligence, a non-conscious yet intelligent AI could become far more powerful.”

“Such a being would be utterly alien to us, and potentially unconcerned with anything that did not further its own advancement- precisely the sort of bogeyman that keeps futurists up at night.”

[…]

“One more tool in our toolbox of self-destruction.”

From QC 3240: “Happy Thoughts”, ~10 years ago. We might have seen it then.

https://www.questionablecontent.net/view.php?comic=3240