VoxML: A Visualization Modeling Language

We present the specification for a modeling language, VoxML, which encodes semantic knowledge of real-world objects represented as three-dimensional models, and of events and attributes related to and enacted over these objects. VoxML is intended to overcome the limitations of existing 3D visual markup languages by allowing for the encoding of a broad range of semantic knowledge that can be exploited by a variety of systems and platforms, leading to multimodal simulations of real-world scenarios using conceptual objects that represent their semantic values.

[1]  Staffan Larsson,et al.  Modelling Language, Action, and Perception in Type Theory with Records , 2012, CSLP.

[2]  James J. Gibson,et al.  The Ecological Approach to Visual Perception: Classic Edition , 2014 .

[3]  Anthony G. Cohn,et al.  A Spatial Logic based on Regions and Connection , 1992, KR.

[4]  Jonathan Barzilai,et al.  On the foundations of measurement , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[5]  Andrew McCallum,et al.  Transition-based Dependency Parsing with Selectional Branching , 2013, ACL.

[6]  R. Shaw,et al.  Perceiving, Acting and Knowing : Toward an Ecological Psychology , 1978 .

[7]  Markus Vincze,et al.  A Cognitive Modeling Approach for the Semantic Aggregation of Object Prototypes from Geometric Primitives: Toward Understanding Implicit Object Topology , 2007, ACIVS.

[8]  Bernhard Beckert,et al.  Dynamic Logic , 2007, The KeY Approach.

[9]  Will Goldstone.  Unity Game Development Essentials , 2009 .

[10]  Mark Giambruno.  3D graphics and animation , 1997 .

[11]  三嶋 博之.  The theory of affordances , 2008 .

[12]  Christopher Potts,et al.  Text to 3D Scene Generation with Rich Lexical Grounding , 2015, ACL.

[13]  Tim Fernando,et al.  Situations in LTL as strings , 2009, Inf. Comput..

[14]  George S. Carson,et al.  Developing the VRML 97 International Standard , 1999, IEEE Computer Graphics and Applications.

[15]  Mark Steedman,et al.  Plans, Affordances, And Combinatory Grammar , 2002 .

[16]  Laurent Romary,et al.  International standard for a linguistic annotation framework , 2003, HLT-NAACL 2003.

[17]  James Pustejovsky,et al.  Generating Simulations of Motion Events from Verbal Descriptions , 2014, *SEMEVAL.

[18]  G. Miller,et al.  Language and Perception , 1976 .

[19]  A. Tversky,et al.  Foundations of Measurement, Vol. III: Representation, Axiomatization, and Invariance , 1990 .

[20]  James Pustejovsky,et al.  On the Representation of Inferences and their Lexicalization , 2013 .

[21]  B. Grünbaum.  Are Your Polyhedra the Same as My Polyhedra , 2003 .

[22]  Johan van Benthem.  Logic and the flow of information , 1995 .

[23]  James Pustejovsky,et al.  The Qualitative Spatial Dynamics of Motion in Language , 2011, Spatial Cogn. Comput..

[24]  G. Miller,et al.  Contextual correlates of semantic similarity , 1991 .

[25]  Harry Bunt,et al.  A METHODOLOGY FOR DESIGNING SEMANTIC ANNOTATION LANGUAGES EXPLOITING SEMANTIC-SYNTACTIC ISOMORPHISMS , 2009 .

[26]  J. Pustejovsky.  Dynamic Event Structure and Habitat Theory , 2013 .

[27]  Richard Sproat,et al.  WordsEye: an automatic text-to-scene conversion system , 2001, SIGGRAPH.

[28]  Don Brutzman,et al.  X3D: Extensible 3D Graphics for Web Authors , 2007 .

[29]  Tim Fernando,et al.  Segmenting Temporal Intervals for Tense and Aspect , 2013, MOL.

[30]  Jeffrey Mark Siskind,et al.  Grounding the Lexical Semantics of Verbs in Visual Perception using Force Dynamics and Event Logic , 1999, J. Artif. Intell. Res..

[31]  James Pustejovsky,et al.  Temporal and Event Information in Natural Language Text , 2005, Lang. Resour. Evaluation.

[32]  S S Stevens,et al.  On the Theory of Scales of Measurement. , 1946, Science.

[33]  James Pustejovsky,et al.  The Generative Lexicon , 1995, CL.

[34]  Robin Cooper,et al.  Spatial Descriptions in Type Theory with Records , 2013 .