Emulation of Human Feelings and Behaviors in an Animated artwork

The behavior of an animated artwork, survivor — a classroom chair which walks, with a dynamics which some viewers find haunting — reflects an attempt to emulate (and suggest to viewers) some feelings and behaviors that are typical of survivors of landmine blasts, learning to use crutches. The artwork itself is intended for sensitizing viewers to the horror experienced by those who survive, and those who do not. The behavior of such a survivor is affected by several factors: some are due to the objective difficulty of using prosthetic legs, and some are due to emotional factors, e.g., fear, "shame" of being in such situation, and pain. The mechanical structure, strongly conditioned by artistic requirements, was combined with a control system that exhibits appropriate behaviors. Behavioral control, a technique developed for the control of mobile robots, was used in survivor, and implemented over a modified version of the traditional Brooks' subsumption architecture. This technique makes it possible to emulate normal locomotion behaviors such as the need of avoiding obstacles and typical animal feelings such as curiosity, hunger, fatigue and fear. We describe the mechanics and viewers' response, and formalize aesthetic response. We briefly survey computer modelling of emotions, robotic art, and biomimetic locomotion in robotics.

[1]  Karen Caplovitz Barrett,et al.  Avoiders vs. Amenders: Implications for the investigation of guilt and shame during Toddlerhood? , 1993 .

[2]  A. Shiloh Never in Anger: Portrait of an Eskimo Family , 1971 .

[3]  Giulio Tononi,et al.  A robotic system emulating the adaptive orienting behavior of the barn owl , 1997, Proceedings of International Conference on Robotics and Automation.

[4]  William S. Faught CONVERSATIONAL ACTION PATTERNS IN DIALOGS , 1978 .

[5]  Ronald A. Cole,et al.  Perceptive animated interfaces: first steps toward a new paradigm for human-computer interaction , 2003, Proc. IEEE.

[6]  Daniel Thalmann,et al.  Computer animation in future technologies , 1996 .

[7]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[8]  C. Ellington The novel aerodynamics of insect flight: applications to micro-air vehicles. , 1999, The Journal of experimental biology.

[9]  Roger D. Quinn,et al.  Posture control of a cockroach-like robot , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[10]  Thomas S Collett,et al.  Using artificial evolution and selection to model insect navigation , 2001, Current Biology.

[11]  William S. Faught,et al.  Affect As Motivation For Cognitive And Conative Processes , 1975, IJCAI.

[12]  C. Ellis Anger: The Struggle for Emotional Control in America's History , 1987, Psychological Medicine.

[13]  Rodney A. Brooks,et al.  A Robot that Walks; Emergent Behaviors from a Carefully Evolved Network , 1989, Neural Computation.

[14]  U. Wikan managing the heart to brighten face and soul: emotions in Balinese morality and health care , 1989 .

[15]  Friedrich Pfeiffer,et al.  The Tum-Walking Machine , 1995, Intell. Autom. Soft Comput..

[16]  M. Dickinson,et al.  The Control of Mechanical Power in Insect Flight , 1998 .

[17]  S. Al-Moghrabi,et al.  Inorganic carbon uptake for photosynthesis by the symbiotic coral-dinoflagellate association II. Mechanisms for bicarbonate uptake , 1996 .

[18]  T. S. Collett,et al.  Places and patterns — a study of context learning in honeybees , 1997, Journal of Comparative Physiology A.

[19]  F. Lehmann,et al.  The control of wing kinematics and flight forces in fruit flies (Drosophila spp.). , 1998, The Journal of experimental biology.

[20]  Marian Stewart Bartlett,et al.  A comparison of Gabor filter methods for automatic detection of facial landmarks , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[21]  John J. Fitzpatrick,et al.  Emotion and Social Change: Toward a New Psychohistory , 1989 .

[22]  Francis J. Broucek,et al.  Shame and the Self , 1991 .

[23]  Randall D. Beer,et al.  Biologically inspired approaches to robotics: what can we learn from insects? , 1997, CACM.

[24]  Franck Nicoloff,et al.  Threats and illocutions , 1989 .

[25]  H. Cruse,et al.  Adaptive control for insect leg position: controller properties depend on substrate compliance , 2004, Journal of Comparative Physiology A.

[26]  R. Beer,et al.  Biorobotic approaches to the study of motor systems , 1998, Current Opinion in Neurobiology.

[27]  Cristiano Castelfranchi,et al.  Artificial Intelligence Modelling social action for AI agents , 2003 .

[28]  J. Movellan,et al.  Are Your Eyes Smiling? Detecting genuine smiles with support vector machines and Gabor wavelets , 2001 .

[29]  J. Barbalet,et al.  Emotion, Social Theory, And Social Structure , 1998 .

[30]  M. Dickinson,et al.  The control of flight force by a flapping wing: lift and drag production. , 2001, The Journal of experimental biology.

[31]  Michael H Dickinson,et al.  Motor output reflects the linear superposition of visual and olfactory inputs in Drosophila , 2004, Journal of Experimental Biology.

[32]  Marian Stewart Bartlett,et al.  3-D headposeestimation fr om video by nonlinear stochasticparticle filtering , 2001 .

[33]  Margo K. Apostolus Robot Choreography: Moving in a New Direction , 2017 .

[34]  F. Grasso,et al.  Effectiveness of Continuous Bilateral Sampling for Robot Chemotaxis in a Turbulent Odor Plume: Implications for Lobster Chemo-orientation. , 1997, The Biological bulletin.

[35]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[36]  M. Dickinson,et al.  Muscle efficiency and elastic storage in the flight motor of Drosophila. , 1995, Science.

[37]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[38]  J. Davitz The language of emotion , 1969 .

[39]  J. Vanneste REPRINTS , 1987, The Lancet.

[40]  H. Cruse What mechanisms coordinate leg movement in walking arthropods? , 1990, Trends in Neurosciences.

[41]  A. Modigliani,et al.  Embarrassment, facework, and eye contact: testing a theory of embarrassment. , 1971, Journal of personality and social psychology.

[42]  Thomas Kindermann,et al.  Walking: A Complex Behavior Controlled by Simple Networks , 1995, Adapt. Behav..

[43]  Marian Stewart Bartlett,et al.  Computer Recognition of Facial Actions: A study of co-articulation effects , 2001 .

[44]  H. Cruse,et al.  A Biologically Inspired Controller for Hexapod Walking: Simple Solutions by Exploiting Physical Properties , 2001, The Biological Bulletin.

[45]  F. Hara,et al.  Facial interaction between animated 3D face robot and human beings , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[46]  Frank W. Grasso,et al.  Biomimetic robot lobster performs chemo-orientation in turbulence using a pair of spatially separated sensors: Progress and challenges , 2000, Robotics Auton. Syst..

[47]  E. Goffman Behavior in Public Places , 1963 .

[48]  V. Sadock American Cool: Constructing a Twentieth-Century Emotional Style , 1995 .

[49]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[50]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[51]  B. Braathen,et al.  First steps towards automatic recognition of spontaneous facial action units , 2001, PUI '01.

[52]  Fumio Hara,et al.  State-of-the art in component technology for an animated face robot-its component technology development for interactive communication with humans , 1996, Adv. Robotics.

[53]  Eduardo Kac Towards a Chronology of Robotic Art , 2001 .

[54]  P. Stearns,et al.  The role of fear: transitions in American emotional standards for children, 1850-1950. , 1991, The American historical review.

[55]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[56]  Barbara Laslett,et al.  Unfeeling knowledge: Emotion and objectivity in the history of sociology , 1990 .

[57]  R. Grigg Shame and Guilt , 2005 .

[58]  W. Saltzman,et al.  Polymers for tissue engineering , 1996 .

[59]  R. W. White Motivation reconsidered: the concept of competence. , 1959, Psychological review.

[60]  Randall D. Beer,et al.  Analysis of a distributed model of leg coordination , 2000, Biological Cybernetics.

[61]  Benjamin Kilborne,et al.  Self-Conscious Emotions: The Psychology of Shame, Guilt, Embarrassment, and Pride. , 1997 .

[62]  Michael H Dickinson,et al.  Odor localization requires visual feedback during free flight in Drosophila melanogaster , 2003, Journal of Experimental Biology.

[63]  Fumio Hara,et al.  A face robot able to recognize and produce facial expression , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[64]  Ephraim Nissan,et al.  A FORMALISM FOR A CASE STUDY IN THE WATERTIME PROJECT: THE CITY WATER SYSTEM IN GRENOBLE, FROM PRIVATIZATION TO REMUNICIPALIZATION , 2004, Appl. Artif. Intell..

[65]  B. Mesquita,et al.  The social roles and functions of emotions , 1994 .

[66]  Daniel Thalmann,et al.  SMILE: A Multilayered Facial Animation System , 1991, Modeling in Computer Graphics.

[67]  Bruce A. Draper,et al.  Recognizing faces with PCA and ICA , 2003, Comput. Vis. Image Underst..

[68]  Huosheng Hu,et al.  Evolving locomotion gaits for quadruped walking robots , 2005, Ind. Robot.

[69]  R. Full,et al.  Adhesive force of a single gecko foot-hair , 2000, Nature.

[70]  M. Triantafyllou,et al.  Tissue engineering of fish skin: behavior of fish cells on poly(ethylene glycol terephthalate)/poly(butylene terephthalate) copolymers in relation to the composition of the polymer substrate as an initial step in constructing a robotic/living tissue hybrid. , 2004, Tissue engineering.

[71]  N. Franceschini,et al.  From insect vision to robot vision , 1992 .

[72]  EPHRAIM NISSAN,et al.  IDENTIFICATION AND DOING WITHOUT IT, III: AUTHORITATIVE OPINIONS, PURPOSEFUL ACTION, RELABELED GOODS, AND FORENSIC EXAMINATIONS. THE CASE OF THE STUFFED BIRDS: ITS NARRATIVE DYNAMICS SET IN FORMULAE , 2003, Cybern. Syst..

[73]  Jerry E. Pratt,et al.  Virtual model control of a bipedal walking robot , 1997, Proceedings of International Conference on Robotics and Automation.

[74]  M. Dickinson,et al.  Neuromuscular control of aerodynamic forces and moments in the blowfly, Calliphora vicina , 2004, Journal of Experimental Biology.

[75]  Ephraim Nissan,et al.  IDENTIFICATION AND DOING WITHOUT IT, II: VISUAL EVIDENCE FOR PINPOINTING IDENTITY. HOW ALEXANDER WAS FOUND OUT: PURPOSEFUL ACTION, ENLISTING SUPPORT, ASSUMED IDENTITY, AND RECOGNITION. A GOAL-DRIVEN FORMAL ANALYSIS , 2003, Cybern. Syst..

[76]  Yoshiyuki Sankai,et al.  Power assist method based on Phase Sequence and muscle force condition for HAL , 2005, Adv. Robotics.

[77]  Ross Buck,et al.  The communication of emotion , 1984 .

[78]  J. T. Watson,et al.  Leg kinematics and muscle activity during treadmill running in the cockroach, Blaberus discoidalis : I. Slow running , 1997, Journal of Comparative Physiology A.

[79]  Daniel P. Ferris,et al.  Powered lower limb orthoses for gait rehabilitation. , 2005, Topics in spinal cord injury rehabilitation.

[80]  Ephraim Nissan,et al.  EMOTION, CULTURE, COMMUNICATION , 1997 .

[81]  A. Hochschild,et al.  The Managed Heart: Commercialization of Human Feeling. , 1985 .

[82]  Ephraim Nissan,et al.  IDENTIFICATION AND DOING WITHOUT IT, IV: A FORMAL MATHEMATICAL ANALYSIS FOR THE FEVEROLES CASE, OF MIX-UP OF KINDS AND ENSUING LITIGATION; AND A FORMALISM FOR THE "CARDIFF GIANT" DOUBLE HOAX , 2003, Cybern. Syst..

[83]  E. Doyle McCarthy,et al.  The Sociology of emotions : original essays and research papers , 1991 .

[84]  C. Wouters On Status Competition and Emotion Management: The Study of Emotions as a New Field , 1992 .

[85]  Michael H Dickinson,et al.  Closing the loop between neurobiology and flight behavior in Drosophila , 2004, Current Opinion in Neurobiology.

[86]  P. Ekman,et al.  Who knows what about contempt: A reply to Izard and Haynes , 1988 .

[87]  Daniel Thalmann,et al.  Complex models for visualizing synthetic actors , 1991 .

[88]  John L. Pollock,et al.  How to Build a Person: A Prolegomenon , 1992, IEEE Expert.

[89]  R. Edelmann Social Embarrassment: An Analysis of the Process , 1985 .

[90]  R. Arnheim Perceptual abstraction and art. , 1947, Psychological review.

[91]  P. Ekman,et al.  A new pan-cultural facial expression of emotion , 1986 .

[92]  Shigeki Sugano,et al.  The robot musician 'wabot-2' (waseda robot-2) , 1987, Robotics.

[93]  Michael G. Dyer,et al.  The Role of Affect in Narratives , 1983, Cogn. Sci..

[94]  Antonio Camurri,et al.  Interactive environments for music and multimedia , 1999, Multimedia Systems.

[95]  Ephraim Nissan,et al.  IDENTIFICATION AND DOING WITHOUT IT, I: A SITUATIONAL CLASSIFICATION OF MISAPPLIED PERSONAL IDENTITY, WITH A FORMALISM FOR A CASE OF MULTIPLE USURPED IDENTITY IN MARIVAUX , 2003, Cybern. Syst..

[96]  Huosheng Hu,et al.  A 3D simulator for autonomous robotic fish , 2004, Int. J. Autom. Comput..

[97]  E. Kac Foundation and Development of Robotic Art , 1997 .

[98]  F. Grasso Invertebrate-Inspired Sensory-Motor Systems and Autonomous, Olfactory-Guided Exploration , 2001, The Biological Bulletin.

[99]  L. Wurmser The mask of shame , 1977 .

[100]  Gwen Littlewort,et al.  An approach to automatic recognition of spontaneous facial actions , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[101]  Javier R. Movellan,et al.  Towards Automatic Recognition of Spontaneous Facial Actions , 2003 .

[102]  Kenneth Mark Colby,et al.  Clinical artificial intelligence , 1981, Behavioral and Brain Sciences.

[103]  Fumio Hara,et al.  Real-time facial interaction between human and 3D face robot agent , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[104]  C. Izard The face of emotion , 1971 .

[105]  M. Dyer Emotions and their computations: Three computer models , 1987 .

[106]  Risto Mukkulainen,et al.  Script Recognition with Hierarchical Feature Maps , 1990 .

[107]  M. Dickinson,et al.  Summation of visual and mechanosensory feedback in Drosophila flight control , 2004, Journal of Experimental Biology.

[108]  Barbara Stenross,et al.  THE HIGHS AND LOWS OF EMOTIONAL LABOR , 1989 .

[109]  Thomas Kindermann,et al.  Control of Walking in the Stick Insect: From Behavior and Physiology to Modeling , 1999, Auton. Robots.

[110]  Dongbing Gu,et al.  Hybrid learning architecture for fuzzy control of quadruped walking robots , 2005, Int. J. Intell. Syst..

[111]  R. Jackson,et al.  Cues by which Portia fimbriata, an araneophagic jumping spider, distinguishes jumping-spider prey from other prey. , 2000, The Journal of experimental biology.

[112]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[113]  H. Cruse,et al.  Behaviour-based modelling of hexapod locomotion: linking biology and technical application. , 2004, Arthropod structure & development.

[114]  A. Wierzbicka Emotion, language, and cultural scripts. , 1994 .

[115]  Michael H Dickinson,et al.  Spatial organization of visuomotor reflexes in Drosophila , 2004, Journal of Experimental Biology.

[116]  Gwen Littlewort,et al.  A Prototype for Automatic Recognition of Spontaneous Facial Actions , 2002, NIPS.

[117]  R J Full,et al.  How animals move: an integrative view. , 2000, Science.

[118]  Yan,et al.  Wing transmission for a micromechanical flying insect , 2001 .

[119]  Paul Graham,et al.  Route learning by insects , 2003, Current Opinion in Neurobiology.

[120]  Ronald S. Fearing,et al.  Synthetic gecko foot-hair micro/nano-structures as dry adhesives , 2003 .

[121]  K. Pearson,et al.  Characteristics of Leg Movements and Patterns of Coordination in Locusts Walking on Rough Terrain , 1984 .

[122]  P. Stearns Jealousy: The Evolution of an Emotion in American History , 1989 .

[123]  Daniel E. Koditschek,et al.  Characterization of monoped equilibrium gaits , 1997, Proceedings of International Conference on Robotics and Automation.

[124]  W. Crozier Explanations of social shyness , 1982 .

[125]  Thomas Kindermann,et al.  Walknet--a biologically inspired network to control six-legged walking , 1998, Neural Networks.

[126]  H. M. Hanson Effects of discrimination training on stimulus generalization. , 1959, Journal of experimental psychology.

[127]  Gerald C. Cupchik,et al.  Interest and Pleasure as Dimensions of Aesthetic Response , 1990 .

[128]  Randall D. Beer,et al.  Evolution and Analysis of Model CPGs for Walking: II. General Principles and Individual Variability , 1999, Journal of Computational Neuroscience.

[129]  Giancarlo Ferrigno,et al.  ELITE: A goal oriented vision system for moving objects detection , 1991, Robotica.

[130]  Atsuo Takanishi,et al.  Development of a biped walking robot having antagonistic driven joints using nonlinear spring mechanism , 1997, Proceedings of International Conference on Robotics and Automation.

[131]  Randall D. Beer,et al.  Evolution and Analysis of Model CPGs for Walking: I. Dynamical Modules , 1999, Journal of Computational Neuroscience.

[132]  Mark E. Nelson,et al.  Sense Organs of Insect Legs and the Selection of Sensors for Agile Walking Robots , 1996, Int. J. Robotics Res..

[133]  Dina B. Crocket Shame, resentment, envy, and pity — A semantic analysis☆ , 1979 .

[134]  F. Reid Rediscovering the Social Group: A Self-Categorization Theory , 1987 .

[135]  Mohsen Shahinpoor,et al.  Biomimetic robotic propulsion using polymeric artificial muscles , 1997, Proceedings of International Conference on Robotics and Automation.

[136]  F. Grasso,et al.  Behavior of Purely Chemotactic Robot Lobster Reveals Different Odor Dispersal Patterns in the Jet Region and the Patch Field of a Turbulent Plume. , 1996, The Biological bulletin.

[137]  Michael G. Dyer,et al.  Learning Distributed Representations of Conceptual Knowledge and their Application to Script-based Story Processing , 1990 .

[138]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[139]  R. Full,et al.  Evidence for van der Waals adhesion in gecko setae , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[140]  Thomas Rist,et al.  Integrating Models of Personality and Emotions into Lifelike Characters , 1999, IWAI.

[141]  Eduardo Kac,et al.  Ornitorrinco and Rara Avis: Telepresence Art on the Internet , 2017 .

[142]  E. Goffman Interaction Ritual. Essays on Face-to-Face Behaviour. London (Allen Lane) 1967. , 1967 .

[143]  Randall D. Beer,et al.  Leg Coordination Mechanisms in the Stick Insect Applied to Hexapod Robot Locomotion , 1993, Adapt. Behav..