Cognitive Interpretation of Everyday Activities - Toward Perceptual Narrative Based Visuo-Spatial Scene Interpretation

We position a narrative-centred computational model for high-level knowledge representation and reasoning in the context of a range of assistive technologies concerned with "visuo-spatial perception and cognition" tasks. Our proposed narrative model encompasses aspects such as \emph{space, events, actions, change, and interaction} from the viewpoint of commonsense reasoning and learning in large-scale cognitive systems. The broad focus of this paper is on the domain of "human-activity interpretation" in smart environments, ambient intelligence etc. In the backdrop of a "smart meeting cinematography" domain, we position the proposed narrative model, preliminary work on perceptual narrativisation, and the immediate outlook on constructing general-purpose open-source tools for perceptual narrativisation. ACM Classification: I.2 Artificial Intelligence: I.2.0 General -- Cognitive Simulation, I.2.4 Knowledge Representation Formalisms and Methods, I.2.10 Vision and Scene Understanding: Architecture and control structures, Motion, Perceptual reasoning, Shape, Video analysis General keywords: cognitive systems; human-computer interaction; spatial cognition and computation; commonsense reasoning; spatial and temporal reasoning; assistive technologies

[1]  R. Barthes,et al.  An Introduction to the Structural Analysis of Narrative , 1975 .

[2]  Mehul Bhatt,et al.  Rotunde - A Smart Meeting Cinematography Initiative - Tools, Datasets, and Benchmarks for Cognitive Interpretation and Control , 2013, AAAI Workshop: Space, Time, and Ambient Intelligence.

[3]  Carl P. L. Schultz,et al.  CLP(QS): A Declarative Spatial Reasoning Framework , 2011, COSIT.

[4]  A. U. Frank,et al.  Qualitative Spatial Reasoning , 2008, Encyclopedia of GIS.

[5]  Erik T. Mueller,et al.  Reasoning about RoboCup Soccer Narratives , 2011, UAI.

[6]  Mehul Bhatt,et al.  Reasoning about Space, Actions, and Change: A Paradigm for Applications of Spatial Reasoning , 2014 .

[7]  Erik T. Mueller,et al.  Modelling Space and Time in Narratives about Restaurants , 2007, Lit. Linguistic Comput..

[8]  A. G. Cohn,et al.  Interleaved Inductive-Abductive Reasoning for Learning Event-Based Activity Models , 2011 .

[9]  Inderjeet Mani,et al.  Computational Modeling of Narrative , 2013, Computational Modeling of Narrative.

[10]  Lars Kulik.  Qualitative Spatial Change , 2002, Künstliche Intell..

[11]  Javier Pinto,et al.  Occurrences and Narratives as Constraints in the Branching Structure of the Situation Calculus , 1998, J. Log. Comput..

[12]  Mehul Bhatt,et al.  Spatio-Temporal Abduction for Scenario and Narrative Completion ( A Preliminary Statement ) , 2010 .

[13]  Mehul Bhatt,et al.  Narrative based Postdictive Reasoning for Cognitive Robotics , 2013, ArXiv.

[14]  Erik T. Mueller,et al.  Symbolic Probabilistic Reasoning for Narratives , 2011, AAAI Spring Symposium: Logical Formalizations of Commonsense Reasoning.

[15]  Srini Narayanan,et al.  Toward a Computational Model of Narrative , 2010, AAAI Fall Symposium: Computational Models of Narrative.

[16]  Anthony G. Cohn,et al.  Qualitative Spatial Representation and Reasoning , 2008, Handbook of Knowledge Representation.

[17]  Murray Shanahan,et al.  Narratives in the Situation Calculus , 1994, J. Log. Comput..

[18]  John McCarthy,et al.  Concept of logical AI , 2000 .