Applications of Multi-Touch Tabletop Displays and Their Challenging Issues: An Overview

Multi-touch tabletop displays provide a co-located collaborative workspace for multiple users around a physical table. They sit together and perform collaborative interaction to select and manipulate digital contents using their bare fingers. However, these systems bring a new paradigm shift in user interaction and present various challenges to design natural user interfaces respectively. The growing popularity of tabletop displays and their related issues have gained a greater attention among researchers in academia and industry. It creates a need to present an overview of multi-touch tabletop displays. This review paper attempts to present the touch enabling technologies that support in the construction of multi-touch tabletop displays. It also presents the important applications of multi-touch tabletop displays in different domains and their challenging issues in different perspectives. Finally, this paper proposes the future work.

[1]  Chilwoo Lee,et al.  HCI(Human Computer Interaction) Using Multi-touch Tabletop Display , 2007, 2007 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing.

[2]  Elisabeth André,et al.  Surface-poker: multimodality in tabletop games , 2010, ITS '10.

[3]  Kris Luyten,et al.  Multi-user Multi-touch Setups for Collaborative Learning in an Educational Setting , 2010, CDVE.

[4]  Chengyun Yang,et al.  A comparative ergonomics study: Performing reading-based tasks on a large-scale tabletop vs. laptop , 2012 .

[5]  Melanie Tory,et al.  Roles of notes in co-located collaborative visualization , 2009 .

[6]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[7]  Uta Hinrichs,et al.  Information visualization on interactive tabletops in work vs. public settings , 2010 .

[8]  Regan L. Mandryk,et al.  Integrating Point and Touch for Interaction with Digital Tabletop Displays , 2006, IEEE Computer Graphics and Applications.

[9]  Oscar Frykholm,et al.  Design and Evaluation of Interaction Technology for Medical Team Meetings , 2011, INTERACT.

[10]  Christoph Richter,et al.  Interactive Displays and Next-Generation Interfaces , 2009, Hagenberg Research.

[11]  Shahzad Malik,et al.  An exploration of multi-finger interaction on multi-touch surfaces , 2007 .

[12]  Andrew D. Wilson PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[13]  Abigail Sellen,et al.  At home with surface computing? , 2012, CHI.

[14]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[15]  Saul Greenberg,et al.  Multimodal multiplayer tabletop gaming , 2007, CIE.

[16]  Milad Alemzadeh,et al.  Human-Computer Interaction: Overview on State of the Art , 2008 .

[17]  William Ribarsky,et al.  Hierarchical multi-touch selection techniques for collaborative geospatial analysis , 2009, Defense + Commercial Sensing.

[18]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[19]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[20]  Philip Tuddenham,et al.  Graspables revisited: multi-touch vs. tangible input for tabletop displays in acquisition and manipulation tasks , 2010, CHI.

[21]  Lijun Tang,et al.  Creating touch-screens anywhere with interactive projected displays , 2003, MULTIMEDIA '03.

[22]  Mary Czerwinski,et al.  An exploratory study of co-located collaborative visual analytics around a tabletop display , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[23]  Teddy Seyed,et al.  SkyHunter: a multi-surface environment for supporting oil and gas exploration , 2013, ITS.

[24]  Emma Mercier,et al.  Multi-touch tables and the relationship with collaborative classroom pedagogies: A synthetic review , 2011, Int. J. Comput. Support. Collab. Learn..

[25]  Sergi Jordà,et al.  The reacTable: a tangible tabletop musical instrument and collaborative workbench , 2006, SIGGRAPH '06.

[26]  W. Bu A MULTI-TOUCH THREE DIMENSIONAL TOUCH-SENSITIVE TABLET , 1985 .

[27]  Mark Ashdown,et al.  High-Resolution Interactive Displays , 2010, Tabletops.

[28]  Améziane Aoussat,et al.  How do interactive tabletop systems influence collaboration? , 2012, Comput. Hum. Behav..

[29]  Halimah Badioze Zaman,et al.  The Implementation of Multi-touch Table to Support the Military Decision Making through Critical Success Factors (CSFs) , 2013, HCI.

[30]  Daniel J. Wigdor,et al.  Perception of elementary graphical elements in tabletop and multi-surface environments , 2007, CHI.

[31]  Pedro Miguel Moreira,et al.  Natural user interfaces in serious games for rehabilitation , 2011, 6th Iberian Conference on Information Systems and Technologies (CISTI 2011).

[32]  Corey Manders,et al.  Building a Multi-touch Tabletop for Classrooms , 2011, Edutainment.

[33]  Daniel J. Wigdor,et al.  Direct-touch vs. mouse input for tabletop displays , 2007, CHI.

[34]  Niklas Elmqvist,et al.  Interaction Workspaces : Identity Tracking for Multi-user Collaboration on Camera-based Multi-touch Tabletops , 2009 .

[35]  Constantine Stephanidis,et al.  iEat: An Interactive Table for Restaurant Customers' Experience Enhancement , 2013, HCI.

[36]  Klaus H. Hinrichs,et al.  Bimanual Interaction with Interscopic Multi-Touch Surfaces , 2009, INTERACT.

[37]  Edward Tse Multimodal co-located interaction , 2008 .

[38]  Pam J. Mayhew,et al.  Technical Review: Current Issues of Usability Testing , 2009 .

[39]  Pierre Dillenbourg,et al.  Interactive tabletops in education , 2011, Int. J. Comput. Support. Collab. Learn..

[40]  Karsten Nebe,et al.  Exploiting New Interaction Techniques for Disaster Control Management Using Multitouch-, Tangible- and Pen-Based-Interaction , 2011, HCI.

[41]  Mary Czerwinski,et al.  Co-Located Collaborative Visual Analytics around a Tabletop Display , 2012, IEEE Transactions on Visualization and Computer Graphics.

[42]  Anthony Collins,et al.  Firestorm: a brainstorming application for collaborative group work at tabletops , 2011, ITS '11.

[43]  Andri Ioannou,et al.  Mapping Ideas Around the Table , 2012 .

[44]  Marti A. Hearst,et al.  A comparison of the affordances of a digital desk and tablet for architectural image tasks , 2002, Int. J. Hum. Comput. Stud..

[45]  Johannes Schöning,et al.  Multi-Touch Surfaces - A Technical Guide Technical Report TUM-I0833 Categories and Subject Descriptors , 2007 .

[46]  Elise van den Hoven,et al.  Weathergods: tangible interaction in a digital tabletop game , 2007, Tangible and Embedded Interaction.

[47]  Fabio Pianesi,et al.  The Collaborative Workspace: A Co-located Tabletop Device to Support Meetings , 2009, Computers in the Human Interaction Loop.

[48]  Yasir Malik,et al.  Review of Challenges, Requirements, and Approaches of Pervasive Computing System Evaluation , 2012 .

[49]  M. Sheelagh T. Carpendale,et al.  Collaborative coupling over tabletop displays , 2006, CHI.

[50]  Jun Munemori,et al.  Development of Communication Support System at Mealtimes Using Tabletop Interface , 2013, HCI.

[51]  Steven K. Feiner,et al.  Rubbing and tapping for precise and rapid selection on touch-screen displays , 2008, CHI.

[52]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[53]  Jochen Rick,et al.  Collaborative learning with interactive surfaces: an interdisciplinary agenda , 2010, ICLS.

[54]  Ting-Han Chen,et al.  Mojo iCuisine: The Design and Implementation of an Interactive Restaurant Tabletop Menu , 2011, HCI.

[55]  Lloyd H. Nakatani,et al.  Soft machines: A philosophy of user-computer interface design , 1983, CHI '83.

[56]  Regan L. Mandryk,et al.  System Guidelines for Co-located, Collaborative Work on a Tabletop Display , 2003, ECSCW.

[57]  Jefferson Y. Han Multi-touch interaction wall , 2006, SIGGRAPH '06.

[58]  Takeshi Naemura,et al.  Optical Design of Tabletop Displays and Interactive Applications , 2010, Tabletops.

[59]  Meredith Ringel Morris,et al.  DiamondSpin: an extensible toolkit for around-the-table interaction , 2004, CHI.

[60]  Uta Hinrichs,et al.  Collaborative interaction on large tabletop displays , 2006 .

[61]  Feng Wang,et al.  Empirical evaluation for finger input properties in multi-touch interaction , 2009, CHI.

[62]  Peter Brandl,et al.  Large interactive surfaces based on digital pens , 2007 .

[63]  M. Tomitsch,et al.  Challenges for Designing the User Experience of Multi-touch Interfaces , 2010 .

[64]  Takeshi Naemura,et al.  Lumisight table: a face-to-face collaboration support system that optimizes direction of projected information to each stakeholder , 2004, CSCW.

[65]  Hannes Kaufmann,et al.  DrillSample: precise selection in dense handheld augmented reality environments , 2013, VRIC.

[66]  Stacey D. Scott,et al.  Investigating Tabletop Interfaces to Support Collaborative Decision-Making in Maritime Operations , 2010 .

[67]  Meredith Ringel Morris Supporting Effective Interaction with Tabletop Groupware , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[68]  Chi-Wing Fu,et al.  A multi-touch interface for fast architectural sketching and massing , 2013, CHI.

[69]  Feng Wang,et al.  A Survey on the Development of Multi-touch Technology , 2010, 2010 Asia-Pacific Conference on Wearable Computing Systems.

[70]  Ann Morrison,et al.  Multitouch and surface computing , 2009, CHI Extended Abstracts.

[71]  Meredith Ringel Morris,et al.  Insights on Interactive Tabletops: A Survey of Researchers and Developers , 2009 .

[72]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[73]  Patrick Baudisch,et al.  The generalized perceived input point model and how to double touch accuracy by extracting fingerprints , 2010, CHI.

[74]  Ehud Sharlin,et al.  Touching the depths: introducing tabletop interaction to reservoir engineering , 2010, ITS '10.

[75]  Andreas Butz,et al.  Interaction on the Tabletop: Bringing the Physical to the Digital , 2010, Tabletops.

[76]  Tobias Isenberg,et al.  Data Visualization on Interactive Surfaces: A Research Agenda , 2013, IEEE Computer Graphics and Applications.

[77]  Chi-Wing Fu,et al.  Multi-touch techniques for exploring large-scale 3D astrophysical simulations , 2010, CHI.

[78]  Weiyuan Liu,et al.  Natural user interface- next mainstream product user interface , 2010, 2010 IEEE 11th International Conference on Computer-Aided Industrial Design & Conceptual Design 1.

[79]  Panayiotis Zaphiris,et al.  Ideas Mapping, Surface Computing and User Experience , 2012, I-UxSED.

[80]  Anders Ynnerman,et al.  Multi-Touch Table System for Medical Visualization: Application to Orthopedic Surgery Planning , 2011, IEEE Transactions on Visualization and Computer Graphics.

[81]  Michael J. Morgan,et al.  Multi-touch Display Technology and Collaborative Learning Tasks , 2010 .

[82]  M. Sheelagh T. Carpendale,et al.  Theory of Tabletop Territoriality , 2010, Tabletops.

[83]  Sisi Zlatanova,et al.  Multi-user tangible interfaces for effective decision-making in disaster management , 2008 .

[84]  Gerald Penn,et al.  Living with a Tabletop: Analysis and Observations of Long Term Office Use of a Multi-Touch Table , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[85]  António S. Câmara Natural User Interfaces , 2011, INTERACT.

[86]  Morten Fjeld,et al.  Introduction: A Short History of Tabletop Research, Technologies, and Products , 2010, Tabletops.

[87]  J. Kay,et al.  Tabletop File System Access: Associative and Hierarchical Approaches , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[88]  M. Sheelagh T. Carpendale,et al.  Roles of Orientation in Tabletop Collaboration: Comprehension, Coordination and Communication , 2004, Computer Supported Cooperative Work (CSCW).

[89]  T. C. Nicholas Graham,et al.  Raptor: sketching games with a tabletop computer , 2010, Future Play.

[90]  Regan L. Mandryk,et al.  Exploring display factors that influence co-located collaboration: angle, size, number, and user arrangement , 2005 .

[91]  Meredith Ringel Morris,et al.  Exploring the effects of group size and table size on interactions with tabletop shared-display groupware , 2004, CSCW.

[92]  Anne Marie Piper,et al.  Supporting medical communication for older patients with a shared touch-screen computer , 2013, Int. J. Medical Informatics.

[93]  Meredith Ringel Morris,et al.  Experiences with and observations of direct-touch tabletops , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[94]  K. Hinckley Input technologies and techniques , 2002 .

[95]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[96]  Septimiu Crisan,et al.  Optical Multi-touch System for Patient Monitoring and Medical Data Analysis , 2009 .

[97]  James D. Hollan,et al.  SLAP widgets: bridging the gap between virtual and physical controls on tabletops , 2009, CHI.

[98]  Clifton Forlines,et al.  Tabletop Games: Platforms, Experimental Games and Design Recommendations , 2010 .

[99]  Elise van den Hoven,et al.  Tangible play: research and design for tangible and tabletop games , 2007, IUI '07.

[100]  Sharon L. Oviatt,et al.  Multimodal Interfaces: A Survey of Principles, Models and Frameworks , 2009, Human Machine Interaction.

[101]  Andrea Sanna,et al.  Multi-touch user interface evaluation for 3D object manipulation on mobile devices , 2009, Journal on Multimodal User Interfaces.

[102]  Sandeep K. S. Gupta,et al.  Smart classroom: Enhancing collaborative learning using pervasive computing technology , 2003 .

[103]  Derrick J. Parkhurst,et al.  Enhancing Multi-user Interaction with Multi-touch Tabletop Displays Using Hand Tracking , 2008, First International Conference on Advances in Computer-Human Interaction.

[104]  Kasper Hornbæk,et al.  Tangible bots: interaction with active tangibles in tabletop interfaces , 2011, CHI.

[105]  Jefferson Y. Han Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[106]  Erik Duval,et al.  Visualizing Geospatial Co-authorship Data on a Multitouch Tabletop , 2011, Smart Graphics.

[107]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[108]  Stephen J. Westerman,et al.  Individual differences in human-computer interaction , 1993 .

[109]  William Buxton,et al.  ThinSight: integrated optical multi-touch sensing through thin form-factor displays , 2007, EDT '07.

[110]  Mike Wu,et al.  Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays , 2003, UIST '03.

[111]  T. C. Nicholas Graham,et al.  A low-cost infrastructure for tabletop games , 2008, Future Play.

[112]  Mark Fihn,et al.  Introduction to Touchscreen Technologies , 2012, Handbook of Visual Display Technology.

[113]  Chris North,et al.  Understanding Multi-touch Manipulation for Surface Computing , 2009, INTERACT.

[114]  Matthew Turk,et al.  Multimodal interaction: A review , 2014, Pattern Recognit. Lett..

[115]  Patrick Jermann,et al.  An empirical evaluation of touch and tangible interfaces for tabletop displays , 2010, TEI '10.

[116]  Xiang Cao,et al.  Detecting and leveraging finger orientation for interaction with direct-touch surfaces , 2009, UIST '09.

[117]  Chia Shen From Clicks to Touches: Enabling Face-to-Face Shared Social Interface on Multi-touch Tabletops , 2007, HCI.

[118]  Stuart F Brown Hands-on computing. , 2008, Scientific American.

[119]  Henk J. Scholten,et al.  Tangible User Interfaces in Order to Improve Collaborative Interactions and Decision-Making during Disaster Management , 2007, Prehospital and Disaster Medicine.

[120]  Martin Spindler,et al.  Spatially aware tangible display interaction in a tabletop environment , 2012, ITS.

[121]  Massimo Zancanaro,et al.  Dimensions of collaboration on a tabletop interface for children with autism spectrum disorder , 2011, CHI.

[122]  Meredith Ringel Morris,et al.  Informing the Design of Direct-Touch Tabletops , 2006, IEEE Computer Graphics and Applications.

[123]  M. Sheelagh T. Carpendale,et al.  Exploring tangible and direct touch interfaces for manipulating 2D and 3D information on a digital table , 2009, ITS '09.