Left and right hand distinction for multi-touch tabletop interactions

In multi-touch interactive systems, it is of great significance to distinguish which hand of the user is touching the surface in real time. Left-right hand distinction is essential for recognizing the multi-finger gestures and further fully exploring the potential of bimanual interaction. However, left-right hand distinction is beyond the capability of most existing multi-touch systems. In this paper, we present a new method for left and right hand distinction based on the human anatomy, work area, finger orientation and finger position. Considering the ergonomics principles of gesture designing, the body-forearm triangle model was proposed. Furthermore, a heuristic algorithm was introduced to group multi-touch contact points and then made left-right hand distinction. A dataset of 2880 images has been set up to evaluate the proposed left-right hand distinction method. The experimental results demonstrate that our method can guarantee the high recognition accuracy and real time performance in freely bimanual multi-touch interactions.

[1]  Elisabeth André,et al.  Hand distinction for multi-touch tabletop interaction , 2009, ITS '09.

[2]  Dominik Schmidt,et al.  IdWristbands: IR-based user identification on multi-touch surfaces , 2010, ITS '10.

[3]  Otmar Hilliges,et al.  Bringing physics to the surface , 2008, UIST '08.

[4]  Judy Kay,et al.  Seamless and continuous user identification for interactive tabletops using personal device handshaking and body tracking , 2012, CHI EA '12.

[5]  Karthik Ramani,et al.  Extended multitouch: recovering touch posture and differentiating users using a depth camera , 2012, UIST.

[6]  Feng Wang,et al.  Empirical evaluation for finger input properties in multi-touch interaction , 2009, CHI.

[7]  Bernd Fröhlich,et al.  Finger and hand detection for multi-touch interfaces based on maximally stable extremal regions , 2012, ITS '12.

[8]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[9]  John F. Hughes,et al.  Indirect mappings of multi-touch input using one and two hands , 2008, CHI.

[10]  Shahzad Malik,et al.  Visual touchpad: a two-handed gestural input device , 2004, ICMI '04.

[11]  Chiew-Lan Tai,et al.  Multi-touch finger registration and its applications , 2015 .

[12]  Y. Guiard.  Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[13]  Thomas B. Moeslund,et al.  A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI , 2003, Gesture Workshop.

[14]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[15]  Mathieu Raynal,et al.  Modeless Pointing with Low-Precision Wrist Movements , 2013, INTERACT.

[16]  Derrick J. Parkhurst,et al.  Enhancing Multi-user Interaction with Multi-touch Tabletop Displays Using Hand Tracking , 2008, First International Conference on Advances in Computer-Human Interaction.

[17]  Saul Greenberg,et al.  What caused that touch?: expressive interaction with a surface through fiduciary-tagged gloves , 2010, ITS '10.

[18]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[19]  L. C. Pigage,et al.  Motion and time study , 1954 .

[20]  Volker Roth,et al.  The IR ring: authenticating users' touches on a multi-touch display , 2010, UIST '10.

[21]  Marc Herrlich,et al.  Left and Right Hand Distinction for Multi-touch Displays , 2011, Smart Graphics.

[22]  Xiang Cao,et al.  ShapeTouch: Leveraging contact shape on interactive surfaces , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[23]  Xiang 'Anthony' Chen,et al.  The fat thumb: using the thumb's contact size for single-handed mobile interaction , 2012, Mobile HCI.

[24]  Xiang Cao,et al.  Detecting and leveraging finger orientation for interaction with direct-touch surfaces , 2009, UIST '09.

[25]  Xing-Dong Yang,et al.  See me, see you: a lightweight method for discriminating user touches on tabletop displays , 2012, CHI.

[26]  Dunja Mladenic,et al.  MTi: A method for user identification for multitouch displays , 2013, Int. J. Hum. Comput. Stud..

[27]  Chiew-Lan Tai,et al.  Multitouch finger registration and its applications , 2010, OZCHI '10.

[28]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.