What we are is more than what we do

With the advent of Artificial General Intelligence (AGI) it is plausible that such artificial autonomous agents (AAA) will display behaviors similar to human autonomous agents consciously pursuing their own goals. The more those agents develop complex and human-like capacities, the more the impetus towards granting them consciousness and associated mental capacities (such as intrinsic motivations and intentions) analogous to humans will grow (Dehaene et al., 2017).