Human-machine sense of agency

Abstract Technological advances have resulted in highly automated systems increasing in number and popularity. However, the overarching issue continues to relate to how much autonomy to give to automation and whether it could degrade the human perception of control, which is referred to as Sense of Agency. When present, the operator will be aware that their actions will lead to a certain outcome, which in turn will improve the performance over the task. Furthermore, when Sense of Agency is present, the individuals underestimate the interval between their own actions and their outcomes. This effect, known as Intentional Binding, could provide feedback regarding the effect of both automation and mental workload in Human-Machine Interaction (HMI). The objective of this paper was to find out how Intentional Binding is affected by different levels of automation, mental workload, and time delay. Intentional Binding has been measured by using a time interval estimation task. Participants were asked to reproduce the time interval between a keypress and an acoustic tone presented with different time delays (500 to 1500 ms). Automation was manipulated at the time of the initial key press to create three conditions: a) Human Decision (keypress performed by the participants), b) System Warning (computer warned the participants to press a key), c) System Decision (keypress virtually performed by the computer). The mental workload was manipulated by adding a secondary memory task, with two or eight letters to remember. Results showed that Intentional Binding was greatest with decreasing automation intervention and mental workload. These findings suggest that automation and mental workload could play a key role in degrading the Sense of Agency. Further, the time delay was shown to have different effects on each automation condition. This new finding indicates that the time delay could be an important feature in HMI and needs to be carefully designed in automated systems.

[1]  A. Yamashita,et al.  The influence of action-outcome delay and arousal on sense of agency and the intentional binding effect , 2015, Consciousness and Cognition.

[2]  A. Bayliss,et al.  Physical and mental effort disrupts the implicit sense of agency , 2016, Cognition.

[3]  F. Ciardo,et al.  Attribution of intentional agency towards robots reduces one’s own sense of agency , 2019, Cognition.

[4]  P. Haggard,et al.  Sense of agency , 2012, Current Biology.

[5]  S. Sternberg.  High-Speed Scanning in Human Memory , 1966, Science.

[6]  Axel Cleeremans,et al.  Coercion Changes the Sense of Agency in the Human Brain , 2016, Current Biology.

[7]  A. Kiesel,et al.  The Time Course of Intentional Binding for Late Effects , 2018 .

[8]  W. Prinz,et al.  The Perceived Onset Time of Self- and Other-Generated Actions , 2003, Psychological science.

[9]  M. Jeannerod.  The mechanism of self-recognition in humans , 2003, Behavioural Brain Research.

[10]  Andrea Kiesel,et al.  The time course of intentional binding , 2016, CogSci.

[11]  P. Haggard,et al.  Automation Technology and Sense of Control: A Window on Human Agency , 2012, PloS one.

[12]  P. Haggard,et al.  From action intentions to action effects: how does the sense of agency come about? , 2014, Front. Hum. Neurosci..

[13]  Sukhvinder S. Obhi,et al.  Intentional binding and the sense of agency: A review , 2012, Consciousness and Cognition.

[14]  M. Buehner,et al.  Magnitude estimation reveals temporal binding at super-second intervals. , 2009, Journal of experimental psychology. Human perception and performance.

[15]  G. Aschersleben,et al.  Grounding the self in action , 2003, Consciousness and Cognition.

[16]  P. Haggard,et al.  Voluntary action and conscious awareness , 2002, Nature Neuroscience.

[17]  Sukhvinder S. Obhi,et al.  Sense of agency in joint action: influence of human and computer co-actors , 2011, Experimental Brain Research.

[18]  G. Knoblich,et al.  Do Implicit and Explicit Measures of the Sense of Agency Measure the Same Thing? , 2014, PloS one.

[19]  J. Gray,et al.  PsychoPy2: Experiments in behavior made easy , 2019, Behavior Research Methods.

[20]  Per B. Brockhoff,et al.  lmerTest Package: Tests in Linear Mixed Effects Models , 2017 .

[21]  H. Asama,et al.  The Sense of Agency in Driving Automation , 2019, Front. Psychol..

[22]  Dorit Wenke,et al.  How voluntary actions modulate time perception , 2009, Experimental Brain Research.

[23]  Lisanne Bainbridge,et al.  Ironies of automation , 1982, Autom..

[24]  B. Berberian,et al.  Man-Machine teaming: a problem of Agency , 2019, IFAC-PapersOnLine.

[25]  D. Coyle,et al.  The experience of agency in human-computer interactions: a review , 2014, Front. Hum. Neurosci..

[26]  N. Hon,et al.  Preoccupied minds feel less control: Sense of agency is modulated by cognitive load , 2013, Consciousness and Cognition.

[27]  Peter A Hancock,et al.  State of science: mental workload in ergonomics , 2015, Ergonomics.

[28]  John E. McEneaney.  Agency Effects in Human–Computer Interaction , 2013, Int. J. Hum. Comput. Interact..

[29]  Yannick P. J. Murray,et al.  The effect of cognitive effort on the sense of agency , 2020, PloS one.

[30]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.