PeNTa: Formal Modeling for Multi-touch Systems Using Petri Net

Multi-touch technology has become pervasive in our daily lives, with iPhones, iPads, touch displays, and other devices. It is important to find a user input model that can work for multi-touch gesture recognition and can serve as a building block for modeling other modern input devices e.g., Leap Motion, gyroscope. We present a novel approach to model multi-touch input using Petri Nets. We formally define our method, explain how it works, and the possibility to extend it for other devices.

[1]  Douglas C. Engelbart,et al.  Display-Selection Techniques for Text Manipulation , 1967 .

[2]  William M. Newman,et al.  A system for interactive graphical programming , 1968, AFIPS Spring Joint Computing Conference.

[3]  James L. Peterson,et al.  Petri Nets , 1977, CSUR.

[4]  Kurt Lautenbach,et al.  System Modelling with High-Level Petri Nets , 1981, Theor. Comput. Sci..

[5]  Peter Radford,et al.  Petri Net Theory and the Modeling of Systems , 1982 .

[6]  Richard W. Pew,et al.  Perspectives on human performance modelling , 1983, Autom..

[7]  Wolfgang Reisig,et al.  Petri Nets , 1985, EATCS Monographs on Theoretical Computer Science.

[8]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[9]  Brad A. Myers.  A new model for handling input , 1990, TOIS.

[10]  William Buxton,et al.  A three-state model of graphical input , 1990, INTERACT.

[11]  Kurt Jensen.  Coloured Petri Nets , 1992, EATCS Monographs in Theoretical Computer Science.

[12]  Michael E. Atwood,et al.  Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance , 1993, Hum. Comput. Interact..

[13]  Kurt Jensen,et al.  Coloured Petri nets (2nd ed.): basic concepts, analysis methods and practical use: volume 1 , 1996 .

[14]  René David,et al.  Continuous and Hybrid Petri Nets , 1998, J. Circuits Syst. Comput..

[15]  Hyung Lee-Kwang,et al.  Modeling and recognition of hand gesture using colored Petri nets , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[16]  K. Mortensen.  Efficient Data-Structures and Algorithms for a Coloured Petri Nets Simulator , 2001 .

[17]  Jonathan Billington,et al.  8.3.1 A New Graphical Systems Engineering International Standard: ISO/IEC 15909 for High‐level Petri Nets , 2001 .

[18]  Hassane Alla,et al.  Discrete, continuous, and hybrid Petri Nets , 2004 .

[19]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[20]  Songyang Lao,et al.  A gestural interaction design model for multi-touch displays , 2009, BCS HCI.

[21]  Jean Vanderdonckt,et al.  Human-Centered Software Engineering - Software Engineering Models, Patterns and Architectures for HCI , 2009, Human-Computer Interaction Series.

[22]  Rainer Groh,et al.  Towards a formalization of multi-touch gestures , 2010, ITS '10.

[23]  Beat Signer,et al.  Midas: a declarative multi-touch interaction framework , 2010, TEI.

[24]  Su Liu,et al.  PIPE+ - A Modeling Tool for High Level Petri Nets , 2011, SEKE.

[25]  Tuukka M. Takala,et al.  Survey of 3DUI applications and development challenges , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[26]  Antonio Cisternino,et al.  A Compositional Model for Gesture Definition , 2012, HCSE.

[27]  Tony DeRose,et al.  Proton++: a customizable declarative multitouch framework , 2012, UIST.

[28]  Yang Li,et al.  Gesture coder: a tool for programming multi-touch gestures by demonstration , 2012, CHI.

[29]  Antonio Cisternino,et al.  GestIT: a declarative and compositional framework for multiplatform gesture definition , 2013, EICS '13.

[30]  Eric Barboni,et al.  Formal description of multi-touch interactions , 2013, EICS '13.

[31]  Naphtali Rishe,et al.  Exploring modeling language for multi-touch systems using petri nets , 2013, ITS.

[32]  Francisca Santana Robles,et al.  Coloured Petri Nets Basic Concepts, Analysis Methods and Practical Use , 2015 .