Image Schema Combinations and Complex Events

Formal knowledge representation struggles to represent the dynamic changes within complex events in a cognitively plausible way. Image schemas, on the other hand, are spatiotemporal relationships used in cognitive science as building blocks to conceptualise objects and events on a high level of abstraction. In this paper, we explore this modelling gap by looking at how image schemas can capture the skeletal information of events and describe segmentation cuts essential for conceptualising dynamic changes. The main contribution of the paper is the introduction of a more systematic approach for the combination of image schemas with one another in order to capture the conceptual representation of complex concepts and events. To reach this goal we use the image schema logic ISL, and, based on foundational research in cognitive linguistics and developmental psychology, we motivate three different methods for the formal combination of image schemas: merge, collection, and structured combination. These methods are then used for formal event segmentation where the changes in image-schematic state generate the points of separation into individual scenes. The paper concludes with a demonstration of our methodology and an ontological analysis of the classic commonsense reasoning problem of ‘cracking an egg.’

[1]  Patrick J. Hayes,et al.  The Naive Physics Manifesto , 1990, The Philosophy of Artificial Intelligence.

[2]  L. Boroditsky Metaphoric structuring: understanding time through spatial metaphors , 2000, Cognition.

[3]  Bernhard Nebel,et al.  The Finest of its Class: The Natural Point-Based Ternary Calculus for Qualitative Spatial Reasoning , 2004, Spatial Cognition.

[4]  Anthony G. Cohn,et al.  Qualitative Spatial Representation and Reasoning with the Region Connection Calculus , 1997, GeoInformatica.

[5]  A. Cohn,et al.  A qualitative trajectory calculus as a basis for representing moving objects in Geographical Information Systems , 2006 .

[6]  Nicola Guarino,et al.  Relationships and Events: Towards a General Theory of Reification and Truthmaking , 2016, AI*IA.

[7]  Reinhold Rauh,et al.  A Cognitive Assessment of Topological Spatial Relations: Results from an Empirical Investigation , 1997, COSIT.

[8]  Fabian Neuhaus,et al.  Choosing the Right Path: Image Schema Theory as a Foundation for Concept Invention , 2015, J. Artif. Gen. Intell..

[9]  Seana Coulson,et al.  Understanding Timelines: Conceptual Metaphor and Conceptual Integration , 2009 .

[10]  Beate Hamp,et al.  The Fundamental System of Spatial Schemas in Language , 2022 .

[11]  Brandon Bennett,et al.  Corpus Guided Sense Cluster Analysis: a methodology for ontology development (with examples from the spatial domain) , 2014, FOIS.

[12]  Michael Beetz,et al.  KnowRobSIM — Game Engine-Enabled Knowledge Processing Towards Cognition-Enabled Robot Control , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Joseph A. Goguen,et al.  Institutions: abstract model theory for specification and programming , 1992, JACM.

[14]  Giancarlo Guizzardi,et al.  Towards an Ontology of Scenes and Situations , 2018, 2018 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA).

[15]  Dagmar Gromann,et al.  In, out and through: formalising some dynamic aspects of the image schema containment , 2018, SAC.

[16]  George Lakoff Image Schemas: From Linguistic Analysis to Neural Grounding , 2005 .

[17]  Jean M. Mandler,et al.  On defining image schemas , 2014, Language and Cognition.

[18]  Giancarlo Guizzardi,et al.  What's Cracking? How Image Schema Combinations Can Model Conceptualisations of Events , 2018, TriCoLore.

[19]  Till Mossakowski,et al.  Between Contact and Support: Introducing a Logic for Image Schemas and Directed Movement , 2017, AI*IA.

[20]  Moritz Tenorth,et al.  KnowRob: A knowledge processing infrastructure for cognition-enabled robots , 2013, Int. J. Robotics Res..

[21]  Jean M. Mandler,et al.  A summary of The foundations of mind: Origins of conceptual thought , 2004 .

[22]  Nicolas Troquard,et al.  The Mouse and the Ball - Towards a Cognitively-Based and Ontologically-Grounded Logic of Agency , 2018, FOIS.

[23]  Leora Morgenstern,et al.  Mid-Sized Axiomatizations of Commonsense Problems: A Case Study in Egg Cracking , 2001, Stud Logica.

[24]  J. Zlatev What's in a schema? Bodily mimesis and the grounding of language , 2005 .

[25]  J. Mandler Perceptual and Conceptual Processes in Infancy , 2000 .

[26]  V. Lifschitz Cracking an Egg: An Exercise in Commonsense Reasoning , 1998 .

[27]  Christian D. Schunn,et al.  Causality and the categorisation of objects and events , 1995 .

[28]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[29]  Andrew U. Frank,et al.  Formal specification of image schemata -- a step towards interoperability in geographic information systems , 1999, Spatial Cogn. Comput..

[30]  Thora Tenbrink,et al.  A linguistic ontology of space for natural language processing , 2010, Artif. Intell..

[31]  Nicolas Markey Past is for free: on the complexity of verifying linear temporal properties with past , 2003, Acta Informatica.

[32]  Dov M. Gabbay,et al.  Adding a temporal dimension to a logic system , 1992, J. Log. Lang. Inf..

[33]  Hubert Cuyckens,et al.  The Oxford handbook of cognitive linguistics , 2010 .

[34]  Till Mossakowski,et al.  The Distributed Ontology, Model and Specification Language - DOL , 2016, WADT.

[35]  Giancarlo Guizzardi,et al.  Formal definition of a general ontology pattern language using a graph grammar , 2017, 2017 Federated Conference on Computer Science and Information Systems (FedCSIS).

[36]  Michael Harrington,et al.  Taking a Stand on the Meanings of Stand: Bodily Experience as Motivation for Polysemy , 1994, J. Semant..

[37]  Oliver Kutz,et al.  Blending under deconstruction , 2019, Annals of Mathematics and Artificial Intelligence.

[38]  Till Mossakowski,et al.  What is a Logic Translation? , 2009, Logica Universalis.

[39]  N. Belnap,et al.  Facing the Future: Agents and Choices in Our Indeterminist World , 2001 .

[40]  Werner Kuhn,et al.  An Image-Schematic Account of Spatial Categories , 2007, COSIT.

[41]  Gilles Fauconnier,et al.  Conceptual Integration Networks , 1998, Cogn. Sci..

[42]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[43]  M. Kracht,et al.  Logically Possible Worlds and Counterpart Semantics for Modal Logic , 2007 .

[44]  Giancarlo Guizzardi,et al.  Ontology Patterns: Clarifying Concepts and Terminology , 2013, WOP.

[45]  Gérard Ligozat,et al.  Reasoning about Cardinal Directions , 1998, J. Vis. Lang. Comput..

[46]  Christoph Lange,et al.  The Distributed Ontology , Modelling and Specification Language – DOL , 2013 .

[47]  Jodie A. Baird,et al.  Infants parse dynamic action. , 2001, Child development.

[48]  Till Mossakowski,et al.  Carnap, Goguen, and the Hyperontologies: Logical Pluralism and Heterogeneous Structuring in Ontology Design , 2010, Logica Universalis.

[49]  J. Hintikka,et al.  What is Logic , 2007 .

[50]  Cristóbal Pagán Cánovas Erotic Emissions in Greek Poetry: A Generic Integration Network , 2010 .

[51]  Carsten Lutz,et al.  E-connections of abstract description systems , 2004, Artif. Intell..

[52]  Jeffrey M. Zacks,et al.  Segmentation in the perception and memory of events , 2008, Trends in Cognitive Sciences.

[53]  Joseph A. Goguen,et al.  What is a Logic , 2007 .

[54]  Antony Galton,et al.  Space, Time, and Movement , 1997 .

[55]  Gerd Wagner,et al.  Towards Ontological Foundations for the Conceptual Modeling of Events , 2013, ER.

[56]  A. Wierzbicka Semantics: Primes and Universals , 1996 .

[57]  Mark Reynolds The complexity of temporal logic over the reals , 2010, Ann. Pure Appl. Log..

[58]  Dagmar Gromann,et al.  Crowdsourcing Image Schemas , 2018, TriCoLore.

[59]  Jeffrey M. Zacks,et al.  Event perception: a mind-brain perspective. , 2007, Psychological bulletin.

[60]  Fabian Neuhaus,et al.  Image Schemas and Concept Invention , 2018, Concept Invention.

[61]  Kai-Uwe Kühnberger,et al.  A computational framework for conceptual blending , 2018, Artif. Intell..

[62]  Anthony G. Cohn,et al.  A Spatial Logic based on Regions and Connection , 1992, KR.

[63]  Stephan Merz,et al.  Temporal Logic and State Systems (Texts in Theoretical Computer Science. An EATCS Series) , 2010 .

[64]  R. Wallace The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason , 1988 .

[65]  Pietro Galliani,et al.  A Toothful of Concepts: Towards a Theory of Weighted Concept Combination , 2019, Description Logics.

[66]  Alan Cienki,et al.  Some properties and groupings of image schemas , 1997 .

[67]  Oliver Kutz,et al.  A narrative in three acts: Using combinations of image schemas to model events , 2017, BICA 2017.