Al does not need to be self-aware for people to treat it as an authority. It only needs to seem capable of understanding.