Homuncular Flexibility: The Human Ability to Inhabit Nonhuman Avatars

This essay seeks to explicate an unorthodox idea that spans psychology, neuroscience, psychology, philosophy, and computer science called homuncular flexibility (HF). HF posits that the homunculus—the part of the cortex that maps movement and sensing of body parts—is capable of adapting to novel bodies, in particular bodies that have extra appendages or appendages capable of atypical movements. Evidence demonstrates neural plasticity in nature; for example, amputees experience cortical shifting such that their face receives extra attention in the brain after a limb is amputated. However, experiments such as the rubber hand illusion, in which people respond to rubber hands placed near their arms as if they were their actual hands, demonstrated that a person's sense of their body can be adjusted to include external objects. The recent advent of virtual reality technology, which can track physical human motions and display them on avatars, allows for the wholly new human experience of inhabiting distinctly nonhuman bodies. HF is a paradigm in which physical motions are transformed by remapping degrees of freedom from tracked movements onto an avatar. For example, if a human being were to inhabit an avatar of a lobster, controlling two of the eight lobster arms would be simply be a function of tracking the two physical arms and directly mapping those movements onto the avatar's first two arms. However, in order to control the remaining six arms, degrees of freedom that are orthogonal to the movements of the first two arms need to be measured and remapped. In this essay, we discuss advancements in neuroscience, psychology, and computer science that relate to HF. We review some preliminary studies that demonstrate how humans accommodate novel bodies. Finally, we discuss theoretical implications and practical applications relating to HF. Keywords: homuncular flexibility; avatars; tool use; body schema; virtual reality

[1]  H. Ehrsson The Experimental Induction of Out-of-Body Experiences , 2007, Science.

[2]  J. Bailenson,et al.  The Effect of Embodied Experiences on Self-Other Merging, Attitude, and Helping Behavior , 2013 .

[3]  J. Bailenson,et al.  Virtual Self-Modeling: The Effects of Vicarious Reinforcement and Identification on Exercise Behaviors , 2009 .

[4]  W. Penfield,et al.  SOMATIC MOTOR AND SENSORY REPRESENTATION IN THE CEREBRAL CORTEX OF MAN AS STUDIED BY ELECTRICAL STIMULATION , 1937 .

[5]  Andrea Stevenson Won,et al.  Non-immersive, virtual reality mirror visual feedback for treatment of persistent idiopathic facial pain. , 2012, Pain medicine.

[6]  Maria V. Sanchez-Vives,et al.  Extending Body Space in Immersive Virtual Reality: A Very Long Arm Illusion , 2012, PloS one.

[7]  Andy Clark,et al.  Re-inventing ourselves: the plasticity of embodiment, sensing, and mind. , 2007, The Journal of medicine and philosophy.

[8]  Rabindra A. Ratan,et al.  Self-Presence, Explicated: Body, Emotion, and Identity Extension into the Virtual Self , 2012 .

[9]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[10]  Akio Gofuku,et al.  Nonimmersive virtual reality mirror visual feedback therapy and its application for the treatment of complex regional pain syndrome: an open-label pilot study. , 2010, Pain medicine.

[11]  H. Ehrsson,et al.  An Alternative to Traditional Mirror Therapy: Illusory Touch Can Reduce Phantom Pain When Illusory Movement Does Not , 2013, The Clinical journal of pain.

[12]  H. Flor,et al.  Phantom movements and pain. An fMRI study in upper limb amputees. , 2001, Brain : a journal of neurology.

[13]  Hal E. Hershfield,et al.  Increasing Saving Behavior Through Age-Progressed Renderings of the Future Self , 2011, JMR, Journal of marketing research.

[14]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.

[15]  M Barinaga Remapping the motor cortex. , 1995, Science.

[16]  Rod McCall,et al.  Infinite Reality: Avatars, Eternal Life, New Worlds, and the Dawn of the Virtual Revolution , 2011, PRESENCE: Teleoperators and Virtual Environments.

[17]  V. Ramachandran,et al.  Synaesthesia in phantom limbs induced with mirrors , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[18]  Les Nelson,et al.  Do men heal more when in drag?: conflicting identity cues between user and avatar , 2011, CHI.

[19]  Wijnand A. IJsselsteijn,et al.  Embodiment and telepresence: Toward a comprehensive theoretical framework , 2012, Interact. Comput..

[20]  R. Pea,et al.  Media use, face-to-face communication, media multitasking, and social well-being among 8- to 12-year-old girls. , 2012, Developmental psychology.

[21]  J. Bailenson,et al.  The Proteus Effect: The Effect of Transformed Self-Representation on Behavior , 2007 .

[22]  Herta Flor,et al.  Morphing the body: Illusory feeling of an elongated arm affects somatosensory homunculus , 2007, NeuroImage.

[23]  V. Ramachandran,et al.  The use of visual feedback, in particular mirror visual feedback, in restoring brain function. , 2009, Brain : a journal of neurology.

[24]  R. Passingham,et al.  That's My Hand! Activity in Premotor Cortex Reflects Feeling of Ownership of a Limb , 2004, Science.

[25]  Clifford Nass,et al.  Cognitive control in media multitaskers , 2009, Proceedings of the National Academy of Sciences.

[26]  B U Meyer,et al.  Long-term reorganization of motor cortex outputs after arm amputation , 1999, Neurology.

[27]  Frank Biocca,et al.  The Cyborg's Dilemma: Progressive Embodiment in Virtual Environments , 2006, J. Comput. Mediat. Commun..

[28]  Mel Slater,et al.  Human Tails: Ownership and Control of Extended Humanoid Avatars , 2013, IEEE Transactions on Visualization and Computer Graphics.

[29]  Jaron Lanier,et al.  Homuncular Flexibility in Virtual Reality , 2015, J. Comput. Mediat. Commun..

[30]  Yvonne de Kort,et al.  Is This My Hand I See Before Me? The Rubber Hand Illusion in Reality, Virtual Reality, and Mixed Reality , 2006, PRESENCE: Teleoperators and Virtual Environments.