Accessibility and tangible interaction in distributed workspaces based on multi-touch surfaces

Traditional interaction mechanisms in distributed digital spaces often fail to consider the intrinsic properties of action, perception, and communication among workgroups, which may affect access to the common resources used to mutually organize information. By developing suitable spatial geometries and natural interaction mechanisms, distributed spaces can become blended where the physical and virtual boundaries of local and remote spaces merge together to provide the illusion of a single unified space. In this paper, we discuss the importance of blended interaction in distributed spaces and the particular challenges faced when designing accessible technology. We illustrate this discussion through a new tangible interaction mechanism for collaborative spaces based on tabletop system technology implemented with optical frames. Our tangible elements facilitate the exchange of digital information in distributed collaborative settings by providing a physical manifestation of common digital operations. The tangibles are designed as passive elements that do not require the use of any additional hardware or external power while maintaining a high degree of accuracy.

[1]  Roy Want,et al.  Embodied user interfaces for really direct manipulation , 2000, CACM.

[2]  Esther M. Arkin,et al.  An efficiently computable metric for comparing polygonal shapes , 1991, SODA '90.

[3]  Manuel Contero,et al.  On the Integration of Tangible Elements with Multi-touch Surfaces for the Collaborative Creation of Concept Maps , 2016, HCI.

[4]  Patrick Olivier,et al.  Building Interactive Multi-Touch Surfaces , 2009, J. Graphics, GPU, & Game Tools.

[5]  Kathy Ryall,et al.  UbiTable: Impromptu Face-to-Face Collaboration on Horizontal Interactive Surfaces , 2003, UbiComp.

[6]  David Benyon,et al.  Presence in blended spaces , 2012, Interact. Comput..

[7]  Hiroshi Ishii,et al.  I/O brush: drawing with everyday objects as ink , 2004, CHI.

[8]  Daniel Fallman,et al.  Wear, point, and tilt: designing support for mobile service and maintenance in industrial settings , 2002, DIS '02.

[9]  Anand Vardhan Bhalla,et al.  Comparative Study of Various Touchscreen Technologies , 2010 .

[10]  F. R. Wilson The Hand: How Its Use Shapes the Brain, Language, and Human Culture , 1998 .

[11]  Hideyuki Suzuki,et al.  Interaction-level support for collaborative learning: AlgoBlock - an open programming language , 1995, CSCL.

[12]  Hiroshi Ishii,et al.  Interaction techniques for musical performance with tabletop tangible interfaces , 2006, ACE '06.

[13]  Jonathan Cohen,et al.  Logjam: a tangible multi-person interface for video logging , 1999, CHI '99.

[14]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[15]  Patrick Reuter,et al.  GeoTUI: a tangible user interface for geoscience , 2008, TEI.

[16]  Remco C. Veltkamp,et al.  Shape matching: similarity measures and algorithms , 2001, Proceedings International Conference on Shape Modeling and Applications.

[17]  James Gibson,et al.  Block Jam: A Tangible Interface for Interactive Music , 2003, NIME.

[18]  Mark Weiser,et al.  Some computer science issues in ubiquitous computing , 1993, CACM.

[19]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[20]  Dieter Müller Mixed Reality Systems , 2009, Int. J. Online Eng..

[21]  Paula Alexandra Silva,et al.  Tangible Interaction on Tabletops for Elderly People , 2011, ICEC.

[22]  Steve Hinske Determining the Position and Orientation of Multi-Tagged Objects Using RFID Technology , 2007, Fifth Annual IEEE International Conference on Pervasive Computing and Communications Workshops (PerComW'07).

[23]  Xin Jin,et al.  Quality Threshold Clustering , 2017, Encyclopedia of Machine Learning and Data Mining.

[24]  Victor M. Ruiz Penichet,et al.  Cognitive rehabilitation based on collaborative and tangible computer games , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[25]  Hiroshi Ishii,et al.  Tangible User Interfaces , 2006 .

[26]  Emma Mercier,et al.  Multi-touch tables and the relationship with collaborative classroom pedagogies: A synthetic review , 2011, Int. J. Comput. Support. Collab. Learn..

[27]  Mitchel Resnick,et al.  Extending tangible interfaces for education: digital montessori-inspired manipulatives , 2005, CHI.

[28]  William Buxton,et al.  An empirical evaluation of graspable user interfaces: towards specialized, space-multiplexed input , 1997, CHI.

[29]  Andreas Butz,et al.  Physical handles at the interactive surface: exploring tangibility and its benefits , 2008, AVI '08.

[30]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[31]  Gil Weinberg,et al.  The Squeezables: Toward an Expressive and Interdependent Multi-player Musical Instrument , 2001, Computer Music Journal.

[32]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[33]  Abigail Sellen,et al.  Putting the physical into the digital: issues in designing hybrid interactive surfaces , 2009 .

[34]  Fredrik Öhberg,et al.  Designing blended reality space: conceptual foundations and applications , 2011, BCS HCI.

[35]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[36]  Mariano Alcañiz Raya,et al.  HumanTop: a multi-object tracking tabletop , 2012, Multimedia Tools and Applications.

[37]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[38]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[39]  Manuel Contero,et al.  Evaluation of a distributed collaborative workspace as a creativity tool in the context of design education , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[40]  Eva Hornecker,et al.  A Design Theme for Tangible Interaction: Embodied Facilitation , 2005, ECSCW.

[41]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[42]  Sara Price,et al.  What have you done! the role of 'interference' in tangible environments for supporting collaborative learning , 2009, CSCL.

[43]  Manuel Contero,et al.  Use of Tangible Marks with Optical Frame Interactive Surfaces in Collaborative Design Scenarios Based on Blended Spaces , 2014, CDVE.

[44]  Hiroshi Ishii,et al.  Audiopad: A Tag-based Interface for Musical Performance , 2002, NIME.

[45]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[46]  Ken Hinckley,et al.  Passive real-world interface props for neurosurgical visualization , 1994, CHI '94.

[47]  Jack Sklansky,et al.  Finding the convex hull of a simple polygon , 1982, Pattern Recognit. Lett..

[48]  Aaron J. Quigley,et al.  Blended interaction: envisioning future collaborative interactive spaces , 2013, CHI Extended Abstracts.