Bare Finger 3D Air-Touch System Using an Embedded Optical Sensor Array for Mobile Displays

Generally, 3-D interactive systems are used in systems with large displays and are not suitable for portable devices. To “touch” a floating 3-D image displayed from a mobile device, we proposed a camera-free, 3D, interactive, virtual-touch system for bare fingers. By embedding optical sensors into the display pixels and adding angular scanning illuminators to the edge of the display, a flat panel can sense the images reflected off a bare finger. The three-axis (x, y, z) information of the fingertip can be determined by analyzing these reflected images. The proposed 3-D virtual-touch system successfully functions with a 4-in mobile display.

[1]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, ACM Trans. Graph..

[2]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[3]  Adi Abileah,et al.  56.3: Active Matrix LCD with Integrated Optical Touch Screen , 2003 .

[4]  Terry Griffin,et al.  59.3: Integrated Optical Touch Panel in a 14.1″ AMLCD , 2004 .

[5]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[6]  Yi-Pai Huang,et al.  Superzone Fresnel Liquid Crystal Lens for Temporal Scanning Auto-Stereoscopic Display , 2012, Journal of Display Technology.

[7]  Klaus H. Hinrichs,et al.  2d touching of 3d stereoscopic objects , 2011, CHI.

[8]  Douglas Lanman,et al.  BiDi screen: a thin, depth-sensing LCD for 3D interaction using light fields , 2009, SIGGRAPH 2009.

[9]  Greg Welch,et al.  Motion Tracking: No Silver Bullet, but a Respectable Arsenal , 2002, IEEE Computer Graphics and Applications.

[10]  Hirotaka Hayashi,et al.  Incorporation of input function into displays using LTPS TFT technology , 2006 .

[11]  Yasuhiro Takaki,et al.  Multi‐view 3‐D display employing a flat‐panel display with slanted pixel arrangement , 2010 .

[12]  Andrew D. Wilson.  PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[13]  Bahram Javidi,et al.  Recent Developments in 3-D Imaging Technologies , 2010, Journal of Display Technology.

[14]  Andrew D. Wilson.  TouchLight: an imaging touch screen and display for gesture-based interaction , 2004, ICMI '04.

[15]  Hsuan‐Yu Tung,et al.  P‐195: Multi‐user and Multi‐touch System for 3D‐interactive Display , 2011 .

[16]  Yi-Pai Huang,et al.  50.4: A Virtual Touched 3D Interactive Display with Embedded Optical Sensor Array for 5‐axis (x, y, z, θ, φ) Detection , 2011 .

[17]  Henry J. Gardner,et al.  A Wii remote, a game engine, five sensor bars and a virtual reality theatre , 2007, OZCHI '07.

[18]  Lin-Yao Liao,et al.  2‐D/3‐D switchable autostereoscopic display with multi‐electrically driven liquid‐crystal (MeD‐LC) lenses , 2010 .

[19]  A. Rizzo,et al.  Initial usability assessment of off-the-shelf video game consoles for clinical game-based motor rehabilitation , 2009 .

[20]  Gerald D. Morrison.  A camera-based input device for large interactive displays , 2005, IEEE Computer Graphics and Applications.

[21]  Hiromi Kato,et al.  31.3: A System LCD with Integrated 3-Dimensional Input Device , 2010 .

[22]  Yi-Pai Huang,et al.  Three-Dimensional Virtual Touch Display System for Multi-User Applications , 2013, Journal of Display Technology.