“It is hypothetically possible for intelligence to exist without consciousness. A philosophical zombie. If consciousness is the limiting factor on distributed intelligence, a non-conscious yet intelligent AI could become far more powerful.”
“Such a being would be utterly alien to us, and potentially unconcerned with anything that did not further its own advancement- precisely the sort of bogeyman that keeps futurists up at night.”
[…]
“One more tool in our toolbox of self-destruction.”
From QC 3240: “Happy Thoughts”, ~10 years ago. We might have seen it then.
