Investigation of fingertip blobs on optical multi-touch screen

Recently, multi-touch tabletop displays provided the Natural User Interface (NUI). Humans use the bare finger as a pointing device for manipulation of interactive elements on multi-touch surface. However, fingertip size occupies the large space instead of appropriate target point and creates ambiguity in touch detection. To overcome issue possibly, we develop an optical multi-touch screen using the Frustrated Total Internal Reflection (FTIR) sensing technique for investigation of the fingertip blobs. In order to conduct the experiment we specify the interaction mechanism which provides the stability in finger touch detection. When users touch with the multi-touch screen using their fingers, we obtain the fingertip blobs that are used for investigation. We take each fingertip blob as an image and compute its relative pixel intensity values using the image processing tool. The investigation exhibits the variation in pixel values each fingertip blobs. The unit variance in intensity of pixel values helps in identifying the error rate in finger touch detection. The study identifies the factors that generate the error rate and ambiguity in finger touch detection. Our study may support for avoiding the error rate and enhancing the finger touch detection. It may also helpful for achieving the accuracy in finger touch detection and for designing and implementing the interactive elements for multi-touch screens.

[1]  Stuart F Brown.  Hands-on computing. , 2008, Scientific American.

[2]  S.J.V. Nichols.  New Interfaces at the Touch of a Fingertip , 2007 .

[3]  Derrick J. Parkhurst,et al.  Enhancing Multi-user Interaction with Multi-touch Tabletop Displays Using Hand Tracking , 2008, First International Conference on Advances in Computer-Human Interaction.

[4]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[5]  Daniel J. Wigdor,et al.  Direct-touch vs. mouse input for tabletop displays , 2007, CHI.

[6]  Josef Kittler,et al.  Online Communities and Social Computing , 2009, Lecture Notes in Computer Science.

[7]  Alan Esenther,et al.  Fluid DTMouse: better mouse support for touch-based interactions , 2006, AVI '06.

[8]  Chil-Woo Lee,et al.  Multi-touch Interaction for Table-Top Display , 2006, ICAT.

[9]  Mike Wu,et al.  Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays , 2003, UIST '03.

[10]  William Buxton,et al.  ThinSight: integrated optical multi-touch sensing through thin form-factor displays , 2007, EDT '07.

[11]  Andrew D. Wilson.  TouchLight: an imaging touch screen and display for gesture-based interaction , 2004, ICMI '04.

[12]  Ben Shneiderman,et al.  High Precision Touchscreens: Design Strategies and Comparisons with a Mouse , 1991, Int. J. Man Mach. Stud..

[13]  Zhen Liu,et al.  A Robust Blob Recognition and Tracking Method in Vision-Based Multi-touch Technique , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing with Applications.

[14]  Gerald Penn,et al.  Living with a Tabletop: Analysis and Observations of Long Term Office Use of a Multi-Touch Table , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[15]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[16]  Andrew D. Wilson.  PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[17]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[18]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[19]  Ravin Balakrishnan,et al.  Sphere: multi-touch interactions on a spherical display , 2008, UIST '08.

[20]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[21]  Pierre Dillenbourg,et al.  Multi-finger interactions with papers on augmented tabletops , 2009, TEI.

[22]  Shumin Zhai,et al.  High precision touch screen interaction , 2003, CHI '03.

[23]  B. Shneiderman,et al.  Touch screens now offer compelling uses , 1991, IEEE Software.

[24]  C. D. Mote,et al.  Force response of the fingertip pulp to repeated compression--effects of loading rate, loading angle and anthropometry. , 1997, Journal of biomechanics.

[25]  Chia Shen.  From Clicks to Touches: Enabling Face-to-Face Shared Social Interface on Multi-touch Tabletops , 2007, HCI.