Perception of Control in Artificial and Human Systems: A Study of Embodied Performance Interactions

Robots in human facing environments will move alongside human beings. This movement has both functional and expressive meaning and plays a crucial role in human perception of robots. Secondarily, how the robot is controlled – through methods like movement or programming and drivers like oneself or an algorithm – factors into human perceptions. This paper outlines the use of an embodied movement installation, “The Loop”, to understand perceptions generated between humans and various technological agents, including a NAO robot and a virtual avatar. Participants were questioned about their perceptions of control in the various agents. Initial results with human subjects demonstrate an increased likelihood to rate a robot and a robotic shadow as algorithmically controlled, versus a human performer and a human-shaped VR avatar which were more likely rated as human actor controlled or split between algorithm/human actor. Participants also showed a tendency to rate their own performance in the exercise as needing improvement. Qualitative data, collected in the form of text and drawings, was open-ended and abstract. Drawings of humans and geometric shapes frequently appeared, as did the words “mirror”, “movement”, and variations on the word “awareness”.

[1]  A. Kaeppler,et al.  II. Dance Ethnology and the Anthropology of Dance , 2000, Dance Research Journal.

[2]  Christophe d'Alessandro,et al.  Towards a Storytelling Humanoid Robot , 2010, AAAI Fall Symposium: Dialog with Robots.

[3]  Ben Shneiderman,et al.  Workplace user frustration with computers: an exploratory investigation of the causes and severity , 2006, Behav. Inf. Technol..

[4]  Hanafiah Yussof,et al.  Humanoid robot NAO: Review of control and motion exploration , 2011, 2011 IEEE International Conference on Control System, Computing and Engineering.

[5]  J. Burgoon,et al.  Interpersonal Adaptation: Dyadic Interaction Patterns , 1995 .

[6]  Zahira Merchant,et al.  Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis , 2014, Comput. Educ..

[7]  Tatsuya Nomura,et al.  The influence of people’s culture and prior experiences with Aibo on their attitude towards robots , 2006, AI & SOCIETY.

[8]  Ethan Zell,et al.  Self-evaluative effects of dimensional and social comparison , 2015 .

[9]  D. Kuhn,et al.  Effects of Dyadic Interaction on Argumentive Reasoning , 1997 .

[10]  Dor Abrahamson,et al.  You're It! Body, Action, and Object in STEM Learning , 2012, ICLS.

[11]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[12]  Amy LaViers,et al.  Time to Compile , 2018, MOCO.

[13]  Tatsuya Nomura,et al.  Cultural Differences in Attitudes Towards Robots , 2005 .

[14]  Mina C. Johnson-Glenberg,et al.  Embodied science and mixed reality: How gesture and motion capture affect physics education , 2017, Cognitive research: principles and implications.

[15]  Kristiina Jokinen,et al.  Multimodal Open-Domain Conversations with the Nao Robot , 2012, Natural Interaction with Robots, Knowbots and Smartphones, Putting Spoken Dialog Systems into Practice.

[16]  Mina C. Johnson-Glenberg,et al.  Effects of Embodied Learning and Digital Platform on the Retention of Physics Content: Centripetal Force , 2016, Front. Psychol..

[17]  Kun Qian,et al.  Developing a Gesture Based Remote Human-Robot Interaction System Using Kinect , 2013 .

[18]  Kathleen T. Ashenfelter,et al.  Spatiotemporal symmetry and multifractal structure of head movements during dyadic conversation. , 2009, Journal of experimental psychology. Human perception and performance.

[19]  S. L. Hansen Dating choices of high school students. , 1977 .

[20]  A. Tesser Reproductions Supplied by Edrs Are the Best That Can Be Made * * from the Original Document. toward a Self-evaluation Maintenance Model of Social Behavior* , 2007 .

[21]  R. Morris,et al.  Native American rhetoric: Dancing in the shadows of the ghost dance , 1990 .

[22]  Nick Campbell,et al.  Investigating the use of Non-verbal Cues in Human-Robot Interaction with a Nao robot , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[23]  J. Deutsch,et al.  Virtual Reality for Stroke Rehabilitation , 2012 .

[24]  S. Shamsuddin,et al.  Initial response of autistic children in human-robot interaction therapy with humanoid robot NAO , 2012, 2012 IEEE 8th International Colloquium on Signal Processing and its Applications.

[25]  J. Benenson,et al.  Age and sex differences in dyadic and group interaction. , 1997, Developmental psychology.

[26]  David Whitney,et al.  Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays , 2017, ISRR.

[27]  Mel Slater,et al.  Building Expression into Virtual Characters , 2006, Eurographics.

[28]  D. Navarre,et al.  Posture sharing in dyadic interaction , 1982 .

[29]  Du Guanglong,et al.  Markerless Kinect-Based Hand Tracking for Robot Teleoperation , 2012 .

[30]  K. Grammer,et al.  The Courtship Dance: Patterns of Nonverbal Synchronization in Opposite-Sex Encounters , 1998 .

[31]  Mina Johnson-Glenberg,et al.  Immersive VR and Education: Embodied Design Principles That Include Gesture and Hand Controls , 2018, Front. Robot. AI.

[32]  U. Alon,et al.  The mirror game as a paradigm for studying the dynamics of two people improvising motion together , 2011, Proceedings of the National Academy of Sciences.

[33]  A. LaViers,et al.  Time to Compile : An Interactive Art Installation , 2022 .

[34]  H. Hashimoto,et al.  Human motion tracking of mobile robot with Kinect 3D sensor , 2012, 2012 Proceedings of SICE Annual Conference (SICE).

[35]  Daniel N. Stern,et al.  Mother and infant at play: The dyadic interaction involving facial, vocal, and gaze behaviors. , 1974 .

[36]  Michael Tscholl,et al.  Enacted Misconceptions: Using Embodied Interactive Simulations to Examine Emerging Understandings of Science Concepts , 2014, ICLS.

[37]  John P. Robinson,et al.  Social and Psychological Influences on Computer User Frustration. , 2003 .

[38]  John C. McCarthy,et al.  Technology as experience , 2004, INTR.

[39]  B. Parkinson,et al.  Emotion and motivation , 1995 .

[40]  David Whitney,et al.  Comparing Robot Grasping Teleoperation Across Desktop and Virtual Reality with ROS Reality , 2017, ISRR.