Gesture-Based Interface for Connection and Control of Multi-device in a Tabletop Display Environment

In this paper, we propose a gesture-based interface for connection and control of multiple devices in a ubiquitous computing environment. With simple selection and pointing gestures, users can easily control connections between multiple devices as well as manage information or data between them. Based on a robust gesture recognition algorithm and a virtual network computing technology, we implemented this concept in an intelligent meeting room consisting of a tabletop, interactive wall displays, and other popular devices such as laptops and mobile devices. We also performed a preliminary user study in this environment, and the results show the usability of the suggested interface.

[1]  Jun Rekimoto,et al.  tranSticks: physically manipulatable virtual connections , 2005, CHI.

[2]  Rob Miller,et al.  Synchronizing clipboards of multiple computers , 1999, UIST '99.

[3]  Clifton Forlines,et al.  MultiSpace: enabling electronic document micro-mobility in table-centric, multi-device environments , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[4]  Andy Hopper,et al.  Virtual Network Computing , 1998, IEEE Internet Comput..

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[7]  Kori Inkpen Quinn,et al.  That one there! Pointing to establish device identity , 2002, UIST '02.

[8]  박지형,et al.  Intelligent and Responsive Spaces: Integrated Design of Ambient Physical Spaces and Information Spaces , 2008 .

[9]  Hiroshi Ishii,et al.  Slurp: tangibility spatiality and an eyedropper , 2008, CHI Extended Abstracts.

[10]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[11]  Jun Rekimoto,et al.  Proximal Interactions: A Direct Manipulation Technique for Wireless Networking , 2003, INTERACT.

[12]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[13]  Norbert A. Streitz,et al.  i-LAND: an interactive landscape for creativity and innovation , 1999, CHI '99.

[14]  Yasuyoshi Inagaki,et al.  Touch-and-connect: a connection request framework for ad-hoc networks and the pervasive computing environment , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[15]  Daniel J. Wigdor,et al.  Table-centric interactive spaces for real-time collaboration , 2006, AVI '06.

[16]  Terry Winograd,et al.  PointRight: experience with flexible input redirection in interactive workspaces , 2002, UIST '02.

[17]  Ki-Won Yeom,et al.  Select-and-point: a novel interface for multi-device connection and control based on simple hand gestures , 2008, CHI Extended Abstracts.

[18]  Jun Rekimoto,et al.  SyncTap: An Interaction Technique for Mobile Networking , 2003, Mobile HCI.

[19]  Julien Letessier,et al.  Visual tracking of bare fingers for interactive surfaces , 2004, UIST '04.

[20]  Armando Fox,et al.  Stanford interactive workspaces: a framework for physical and graphical user interface prototyping , 2002, IEEE Wirel. Commun..

[21]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.