QSRlib: a software library for online acquisition of qualitative spatial relations from video

There is increasing interest in using Qualitative Spatial Relations as a formalism to abstract from noisy and large amounts of video data in order to form high level conceptualisations, e.g. of activities present in video. We present a library to support such work. It is compatible with the Robot Operating System (ROS) but can also be used stand alone. A number of QSRs are built in; others can be easily added.

[1]  Anthony G. Cohn,et al.  Workflow Activity Monitoring Using Dynamics of Pair-Wise Qualitative Spatial Relations , 2012, MMM.

[2]  Anthony G. Cohn,et al.  Unsupervised Learning of Qualitative Motion Behaviours by a Mobile Robot , 2016, AAMAS.

[3]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[4]  Nico Van de Weghe,et al.  Implementing a qualitative calculus to analyse moving point objects , 2011, Expert Syst. Appl..

[5]  John Folkesson,et al.  Combining Top-down Spatial Reasoning and Bottom-up Object Class Recognition for Scene Understanding , 2014, IROS 2014.

[6]  Bernhard Nebel,et al.  Qualitative Spatial Reasoning about Relative Position: The Tradeoff between Strong Formal Properties and Successful Reasoning about Route Graphs , 2003, Spatial Cognition.

[7]  Bruno Laeng,et al.  Representation of Spatial Relations , 2013 .

[8]  Anthony G. Cohn,et al.  Qualitative and Quantitative Spatio-temporal Relations in Daily Living Activity Recognition , 2014, ACCV.

[9]  Anthony G. Cohn,et al.  From Video to RCC8: Exploiting a Distance Based Semantics to Stabilise the Interpretation of Mereotopological Relations , 2011, COSIT.

[10]  Andrew U. Frank,et al.  Qualitative Spatial Reasoning: Cardinal Directions as an Example , 1996, Int. J. Geogr. Inf. Sci..

[11]  Anthony G. Cohn,et al.  Building qualitative event models automatically from visual input , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Anthony G. Cohn,et al.  Qualitative Spatial Representation and Reasoning , 2008, Handbook of Knowledge Representation.

[13]  John Folkesson,et al.  A Comparison of Qualitative and Metric Spatial Relation Models for Scene Understanding , 2015, AAAI.

[14]  Luis Fariñas del Cerro,et al.  Tractability Results in the Block Algebra , 2002, J. Log. Comput..

[15]  Anthony G. Cohn,et al.  Unsupervised Learning of Event Classes from Video , 2010, AAAI.

[16]  Reinhard Moratz,et al.  Empirical Complexity Issues of Practical Qualitative Spatial Reasoning about Relative Position , 2004 .

[17]  Yi Zhang,et al.  Qualitative spatial reasoning about Internal Cardinal Direction relations , 2007 .

[18]  A. Cohn,et al.  A qualitative trajectory calculus as a basis for representing moving objects in Geographical Information Systems , 2006 .

[19]  Marco Ragni,et al.  Deductive Spatial Reasoning : From Neurological Evidence to a Cognitive Model , 2010 .

[20]  Anthony G. Cohn,et al.  Unsupervised Activity Recognition Using Latent Semantic Analysis on a Mobile Robot , 2016, ECAI.

[21]  P. Johnson-Laird.  How We Reason , 2006 .

[22]  J.-F. Condotta,et al.  The QAT: A Qualitative Algebra Toolkit , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[23]  Juan Chen,et al.  A survey of qualitative spatial representations , 2013, Knowledge engineering review (Print).

[24]  Richard Waldinger,et al.  A Guide to Snark , 2000 .

[25]  Anthony G. Cohn,et al.  Benchmarking qualitative spatial calculi for video activity analysis , 2011 .

[26]  J. O. Wallgrün,et al.  SparQ : A Toolbox for Qualitative Spatial Representation and Reasoning , 2006 .

[27]  Pierre Grenon,et al.  Tucking RCC in Cyc's Ontological Bed , 2003, IJCAI.

[28]  Zeno Gantner,et al.  GQR: A Fast Solver for Binary Qualitative Constraint Networks , 2009, AAAI Spring Symposium: Benchmarking of Qualitative Spatial and Temporal Reasoning Systems.

[29]  Marc Hanheide,et al.  A Computational Model of Human-Robot Spatial Interactions Based on a Qualitative Trajectory Calculus , 2015, Robotics.

[30]  Anthony G. Cohn,et al.  Learning Relational Event Models from Video , 2015, J. Artif. Intell. Res..

[31]  Eliseo Clementini,et al.  Qualitative Representation of Positional Information , 1997, Artif. Intell..

[32]  Anjan Chatterjee,et al.  The Neural Basis for Spatial Relations , 2010, Journal of Cognitive Neuroscience.