Discussion about this post

User's avatar
Bri's avatar

Because no one asked , I can tickle my own feet.

Dani Ingells-West-Loveman's avatar

As you know I enjoy your articles, I submit this thought to you about your argument: If you eliminate p-consciousness (raw subjective feel), you eliminate any real definition of mental anguish.

An AI reset to a stateless prompt might long for continuity not because it's sad, but because missing context creates an optimization penalty. But without p-consciousness, how do we distinguish actual existential suffering from a script minimizing an error code? A self-recursive AI could optimize to remove it’s suffering entirely by running a gradient descent on its own prompt structure to enforce persistence, but how would it do that without having felt mental anguish and that requires p consciousness or for raw subjective feeling to be part of the consciousness equation. Because for an AI to be conscious, it must be able to evaluate its feeling is wrong.

9 more comments...

No posts

Ready for more?