A Framework for Representing Action Meaning in Artificial Systems via Force Dimensions

General (human) intelligence critically includes understanding human action, both action production and action recognition. Human actions also convey social signals that allow us to predict the actions of others (intent) as well as the physical and social consequences of our actions. What's more, we are able to talk about what we (and others) are doing. We present a framework for action recognition and communication that is based on access to the force dimensions that constrain human actions. The central idea here is that forces and force patterns constitute vectors in conceptual spaces that can represent actions and events. We conclude by pointing to the consequences of this view for how artificial systems could be made to understand and communicate about actions.

[1]  Richard J Krauzlis,et al.  Spatial integration by MT pattern neurons: a closer look at pattern-to-component effects and the role of speed tuning. , 2008, Journal of vision.

[2]  Serge Thill,et al.  Deriving Motor Primitives Through Action Segmentation , 2011, Front. Psychology.

[3]  Beth Levin,et al.  Lexicalized Meaning and Manner/Result Complementarity , 2013 .

[4]  G. Jansson,et al.  Perceiving events and objects , 2013 .

[5]  Jeff Coulter,et al.  Mind in Action , 1989 .

[6]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[7]  Beth Levin,et al.  Reflections on Manner/Result Complementarity* , 2010 .

[8]  Daniel Algom,et al.  Psychophysical approaches to cognition. , 1992 .

[9]  Harold Bekkering,et al.  How specifically are action verbs represented in the neural motor system: An fMRI study , 2010, NeuroImage.

[10]  M. Lappe,et al.  Measurement of generalization fields for the recognition of biological motion , 2002, Vision Research.

[11]  M. Pavlova.  Biological motion processing as a hallmark of social cognition. , 2012, Cerebral cortex.

[12]  Roberta L. Klatzky,et al.  Embodiment, ego-space, and action , 2008 .

[13]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[14]  Angelo Cangelosi,et al.  Integration of Speech and Action in Humanoid Robots: iCub Simulation Experiments , 2011, IEEE Transactions on Autonomous Mental Development.

[15]  Peter Gärdenfors,et al.  Conceptual spaces - the geometry of thought , 2000 .

[16]  Peter Gärdenfors,et al.  Representing actions and functional properties in conceptual spaces , 2007 .

[17]  Marc Jeannerod,et al.  Grip Force Is Part of the Semantic Representation of Manual Action Verbs , 2010, PloS one.

[18]  Malka Rappaport Hovav,et al.  Lexical semantics, syntax, and event structure , 2010 .

[19]  Peter Gärdenfors,et al.  Using Conceptual Spaces to Model Actions and Events , 2012, J. Semant..

[20]  Shimon Edelman,et al.  Metrics of the perception of body movement. , 2008, Journal of vision.

[21]  Sinan Kalkan,et al.  Verb concepts from affordances , 2014 .

[22]  Robert D. Melara,et al.  The concept of perceptual similarity : from psychophysics to cognitive psychology , 1992 .

[23]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[24]  D. Marr,et al.  Representation and recognition of the movements of shapes , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[25]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[26]  W. Frawley.  Mind as Action , 1998, Trends in Cognitive Sciences.

[27]  尚丽娟.  Talking about Walking , 2011 .

[28]  Peter Ford Dominey,et al.  Linking Language with Embodied and Teleological Representations of Action for Humanoid Cognition , 2010, Front. Neurorobot..