Depth Camera in Human-Computer Interaction: An Overview

With the continuous development of multimedia technology, simple two-dimensional(2D) scenes have already can't meet the needs of people's requirements because people want a more direct reflection on the real world. As a newly developing distance measuring hardware, the depth camera technology opens a new epoch for three-dimensional(3D) geometric information acquisition. A plenty of applications like geometry reconstruction, mixed reality, gesture reorganization etc. are all depend on accurate and fast analysis of 3D scenes. This paper gives an overview of recent developments in depth camera technology and introduces the depth measurement methods used in reality. And it also presents the ongoing researches and applications on depth cameras used in Human-Computer Interaction (HCI), like using depth camera as a touch sensor, using depth camera in 3D reconstruction, hand gesture recognition and tangible interaction.

[1]  Li Guan,et al.  3D Object Reconstruction with Heterogeneous Sensor Data , 2008 .

[2]  Xiang Cao,et al.  Detecting and leveraging finger orientation for interaction with direct-touch surfaces , 2009, UIST '09.

[3]  Andreas Butz,et al.  Interactions in the air: adding further depth to interactive tabletops , 2009, UIST '09.

[4]  Christopher R. Wren,et al.  Volumetric Operations with Surface Margins , 2002 .

[5]  Elisabeth André,et al.  Hand distinction for multi-touch tabletop interaction , 2009, ITS '09.

[6]  A.D. Wilson.  Depth-Sensing Video Cameras for 3D Tangible Tabletop Interaction , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[7]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[8]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[10]  Andrew D. Wilson.  Using a depth camera as a touch sensor , 2010, ITS '10.

[11]  Dieter Fox,et al.  Interactive 3D modeling of indoor environments with a consumer depth camera , 2011, UbiComp '11.

[12]  Voicu Popescu,et al.  The depth discontinuity occlusion camera , 2006, I3D '06.

[13]  Zhengyou Zhang,et al.  3D Deformable Face Tracking with a Commodity Depth Camera , 2010, ECCV.

[14]  Sebastian Thrun,et al.  High-quality scanning using time-of-flight depth superresolution , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[15]  Dieter Fox,et al.  RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments , 2012, Int. J. Robotics Res..

[16]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[17]  Karsten Nebe,et al.  dSensingNI: a framework for advanced tangible interaction using a depth camera , 2012, TEI.

[18]  B. Cyganek.  An Introduction to 3D Computer Vision Techniques and Algorithms , 2009 .

[19]  Dieter Fox,et al.  RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments , 2010, ISER.

[20]  Takeo Kanade,et al.  A multiple-baseline stereo , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Chung-Hyun Ahn,et al.  Three-dimensional scene reconstruction using multiview images and depth camera , 2005, IS&T/SPIE Electronic Imaging.

[22]  Junsong Yuan,et al.  Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera , 2011, ACM Multimedia.

[23]  Yo-Sung Ho,et al.  3-D video generation using hybrid camera system , 2009, IMMERSCOM.

[24]  Hrvoje Benko,et al.  Beyond flat surface computing: challenges of depth-aware and curved interfaces , 2009, ACM Multimedia.

[25]  Tong Jing.  Depth Camera in Computer Vision and Computer Graphics: An Overview , 2011 .