Multi-touch Graph-Based Interaction for Knowledge Discovery on Mobile Devices: State-of-the-Art and Future Challenges

Graph-based knowledge representation is a hot topic for some years and still has a lot of research potential, particularly in the advancement in the application of graph-theory for creating benefits in the biomedical domain. Graphs are most powerful tools to map structures within a given data set and to recognize relationships between specific data objects. Many advantages of graph-based data structures can be found in the applicability of methods from network analysis, topology and data mining (e.g. small-world phenomenon, cluster analysis). In this paper we present the state-of-the-art in graph-based approaches for multi-touch interaction on mobile devices and we highlight some open problems to stimulate further research and future developments. This is particularly important in the medical domain, as a conceptual graph analysis may provide novel insights on hidden patterns in data, hence support interactive knowledge discovery.

[1]  Kwan-Liu Ma,et al.  Large-Scale Graph Visualization and Analytics , 2013, Computer.

[2]  Alfredo Cuzzocrea,et al.  Availability, Reliability, and Security in Information Systems and HCI , 2013, Lecture Notes in Computer Science.

[3]  A. Mowshowitz,et al.  Entropy and the complexity of graphs. I. An index of the relative complexity of a graph. , 1968, The Bulletin of mathematical biophysics.

[4]  Mike Wu,et al.  Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[5]  N. Trinajstic,et al.  Information theory, distance matrix, and molecular branching , 1977 .

[6]  André Calero Valdez,et al.  On Graph Entropy Measures for Knowledge Discovery from Publication Network Data , 2013, CD-ARES.

[7]  Per Ola Kristensson,et al.  Multi-touch rotation gestures: performance and ergonomics , 2013, CHI.

[8]  M. Sheelagh T. Carpendale,et al.  A set of multi-touch graph interaction techniques , 2010, ITS '10.

[9]  Nuria Aleixos,et al.  A new paradigm based on agents applied to free-hand sketch recognition , 2012, Expert Syst. Appl..

[10]  Septimiu Crisan,et al.  Optical Multi-touch System for Patient Monitoring and Medical Data Analysis , 2009 .

[11]  Sung Ho Han,et al.  Intuitive Multi-Touch Gestures for Mobile Web Browsers , 2013, Interact. Comput..

[12]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[13]  M. Sharir,et al.  Sphere-of-influence graphs in higher dimensions , 1994 .

[14]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[15]  Rex A. Dwyer The Expected Size of the Sphere-of-influence Graph , 1995, Comput. Geom..

[16]  W. Bu A MULTI-TOUCH THREE DIMENSIONAL TOUCH-SENSITIVE TABLET , 1985 .

[17]  Kenneth C. Smith,et al.  Feature extraction as a tool for computer input , 1982, ICASSP.

[18]  James A. Landay,et al.  Implications for a gesture design tool , 1999, CHI '99.

[19]  M. Sheelagh T. Carpendale,et al.  Edgelens: an interactive method for managing edge congestion in graphs , 2003, IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714).

[20]  F Emmert-Streib,et al.  Networks for systems biology: conceptual connection of data and function. , 2011, IET systems biology.

[21]  Lawrence B. Holder,et al.  Mining Graph Data , 2006 .

[22]  Keinosuke Fukunaga,et al.  A Graph-Theoretic Approach to Nonparametric Cluster Analysis , 1976, IEEE Transactions on Computers.

[23]  Richard W. Daniels,et al.  Keyboard Design and Operation: A Review of the Major Issues , 1972 .

[24]  Sung Ho Han,et al.  An Analytical Approach to Creating Multitouch Gesture Vocabularies in Mobile Devices: A Case Study for Mobile Web Browsing Gestures , 2014, Int. J. Hum. Comput. Interact..

[25]  Norman,et al.  Structural Models: An Introduction to the Theory of Directed Graphs. , 1966 .

[26]  Christos Faloutsos,et al.  Graph mining: Laws, generators, and algorithms , 2006, CSUR.

[27]  Sidney S. Fels,et al.  FlowField and beyond: applying pressure-sensitive multi-point touchpad interaction , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[28]  Feng Wang,et al.  Empirical evaluation for finger input properties in multi-touch interaction , 2009, CHI.

[29]  H. Wiener Structural determination of paraffin boiling points. , 1947, Journal of the American Chemical Society.

[30]  Manojit Sarkar,et al.  Graphical fisheye views of graphs , 1992, CHI.

[31]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[32]  Andreas Holzinger,et al.  An Answer to "Who Needs a Stylus?" on Handwriting Recognition on Mobile Devices , 2011, ICETE.

[33]  James D. Hollan,et al.  Pad++: a zooming graphical interface for exploring alternate interface physics , 1994, UIST '94.

[34]  Rainer Groh,et al.  Towards a formalization of multi-touch gestures , 2010, ITS '10.

[35]  E. Salas,et al.  Human Factors : The Journal of the Human Factors and Ergonomics Society , 2007 .

[36]  William Buxton,et al.  ThinSight: versatile multi-touch sensing for thin form-factor displays , 2007, UIST.

[37]  Albert-László Barabási,et al.  Evolution of Networks: From Biological Nets to the Internet and WWW , 2004 .

[38]  Anders Ynnerman,et al.  Multi-Touch Table System for Medical Visualization: Application to Orthopedic Surgery Planning , 2011, IEEE Transactions on Visualization and Computer Graphics.

[39]  S. Strogatz Exploring complex networks , 2001, Nature.

[40]  Tomer Moscovich Multi-touch interaction , 2006, CHI EA '06.

[41]  David G. Stork,et al.  Pattern Classification , 1973 .

[42]  Michael A. Soss On the size of the euclidean sphere of influence graph , 1999, CCCG.

[43]  Lawrence B. Holder,et al.  Mining Graph Data: Cook/Mining Graph Data , 2006 .

[44]  S. Böcker,et al.  Comprehensive cluster analysis with Transitivity Clustering , 2011, Nature Protocols.

[45]  Matthias Dehmer,et al.  An efficient heuristic approach to detecting graph isomorphism based on combinations of highly discriminating invariants , 2013, Adv. Comput. Math..

[46]  Helen C. Purchase Evaluating Graph Drawing Aesthetics: Defining and Exploring a New Empirical Research Area , 2004 .

[47]  Nenad Trinajstić,et al.  Topological characterization of cyclic structures , 1980 .

[48]  Edward C. Kirby Sensitivity of Topological Indexes to Methyl Group Branching in Octanes and Azulenes, or What Does a Topological Index Index? , 1994, J. Chem. Inf. Comput. Sci..

[49]  Sheelagh Carpendale,et al.  Supporting Interactive Graph Exploration with Edge Plucking , .

[50]  M. Sheelagh T. Carpendale,et al.  CoCoNutTrix: Collaborative Retrofitting for Information Visualization , 2009, IEEE Computer Graphics and Applications.

[51]  Dan Gusfield Algorithms on Strings, Trees, and Sequences - Computer Science and Computational Biology , 1997 .

[52]  Andreas Holzinger,et al.  An investigation of finger versus stylus input in medical scenarios , 2008, ITI 2008 - 30th International Conference on Information Technology Interfaces.

[53]  Matthias Dehmer,et al.  Large-scale analysis of structural branching measures , 2014, Journal of Mathematical Chemistry.

[54]  Matthias Dehmer,et al.  Information Indices with High Discriminative Power for Graphs , 2012, PloS one.

[55]  Godfried T. Toussaint,et al.  The relative neighbourhood graph of a finite planar set , 1980, Pattern Recognit..

[56]  Danny Holten,et al.  Hierarchical Edge Bundles: Visualization of Adjacency Relations in Hierarchical Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[57]  Igor Jurisica,et al.  Knowledge Discovery and interactive Data Mining in Bioinformatics - State-of-the-Art, future challenges and research directions , 2014, BMC Bioinformatics.

[58]  Jean-Daniel Fekete,et al.  Author Manuscript, Published in "sigchi Conference on Human Factors in Computing Systems Topology-aware Navigation in Large Networks , 2022 .

[59]  Christina Courtright,et al.  Context in information behavior research , 2007 .

[60]  Tracy Anne Hammond,et al.  PaleoSketch: accurate primitive sketch recognition and beautification , 2008, IUI '08.

[61]  Andreas Holzinger,et al.  Finger Instead of Mouse: Touch Screens as a Means of Enhancing Universal Access , 2002, User Interfaces for All.

[62]  Andreas Holzinger,et al.  Human-Computer Interaction and Knowledge Discovery (HCI-KDD): What Is the Benefit of Bringing Those Two Fields to Work Together? , 2013, CD-ARES.

[63]  Helen C. Purchase,et al.  Which Aesthetic has the Greatest Effect on Human Understanding? , 1997, GD.

[64]  Helen C. Purchase,et al.  Metrics for Graph Drawing Aesthetics , 2002, J. Vis. Lang. Comput..

[65]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[66]  Bill Buxton,et al.  31.1: Invited Paper: A Touching Story: A Personal Perspective on the History of Touch Interfaces Past and Future , 2010 .

[67]  Jon M. Kleinberg,et al.  Navigation in a small world , 2000, Nature.

[68]  Benjamin B. Bederson,et al.  A review of overview+detail, zooming, and focus+context interfaces , 2009, CSUR.

[69]  M. Sheelagh T. Carpendale,et al.  Supporting interactive graph exploration using edge plucking , 2007, Electronic Imaging.

[70]  Xinyu Wu,et al.  A fast and robust fingertips tracking algorithm for vision-based multi-touch interaction , 2013, 2013 10th IEEE International Conference on Control and Automation (ICCA).

[71]  Mohammad S. Obaidat,et al.  E-Business and Telecommunications , 2014, Communications in Computer and Information Science.

[72]  Septimiu Crisan,et al.  Optimization of a Multi-Touch Sensing Device for Biomedical Applications , 2013 .

[73]  Matthias Dehmer,et al.  Towards an Information Theory of Complex Networks - Statistical Methods and Applications , 2011 .

[74]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[75]  Matthias Dehmer,et al.  Information Theory of Networks , 2011, Symmetry.

[76]  Abdallah Eteleeb,et al.  UTR extension and alternate polyadenylation in neuroplasticity: an emerging paradigm? , 2014, BMC Bioinformatics.