Alternative approach to develop digital hologram interaction system by bounding volumes for identifying object collision

Digital holography technology has been considered a powerful method for reconstructing real objects and displaying completed 3D information. Although many studies on holographic displays have been conducted, research on interaction methods for holographic displays is still in an early stage. For developing an appropriate interaction method for digital holograms, a two-way interaction which is able to provide natural interaction between humans and holograms should be considered. However, digital holography technology is not yet fully developed to make holograms capable of naturally responding to human behaviors. Thus, the purpose of this study was to propose an alternative interaction method capable of applying it to interacting with holograms in the future. In order to propose an intuitive interaction method based on computer-generated objects, we utilized a depth camera, Kinect, which provides depth information per pixel. In doing so, humans and environment surrounding them were captured by the depth camera. The captured depth images were simulated on a virtual space and computer graphic objects were generated on the same virtual space. Detailed location information of humans was continuously extracted to provide a natural interaction with the generated objects. In order to easily identify whether two objects were overlapped or not, bounding volumes were generated around both humans and objects, respectively. The local information of the bounding volumes was correlated with one another, which made it possible for humans to control the computer-generated objects. Then, we confirmed a result of interaction through computer generated holograms. As a result, we obtained extreme reduction of computation time accuracy within 80% through bounding volume.

[1]  Wolfgang Broll,et al.  The virtual round table - a collaborative augmented multi-user environment , 2000, CVE '00.

[2]  Wendy Plesniak,et al.  Spatial interaction with haptic holograms , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[3]  Kui Yuan,et al.  Collision detection for a haptic interface , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.

[4]  Eyal Ofek,et al.  Depth keying , 2003, IS&T/SPIE Electronic Imaging.

[5]  Nasser Kehtarnavaz,et al.  Real-time computation of disparity for hand-pair gesture recognition using a stereo webcam , 2011, Journal of Real-Time Image Processing.

[6]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Wolfgang Hürst,et al.  Gesture-based interaction via finger tracking for mobile augmented reality , 2011, Multimedia Tools and Applications.

[8]  M. Levas.  OBBTree : A Hierarchical Structure for Rapid Interference Detection , .

[9]  Donald P. Greenberg,et al.  Improved Computational Methods for Ray Tracing , 1984, TOGS.

[10]  Christoph W. Borst,et al.  A Spring Model for Whole-Hand Virtual Grasping , 2006, Presence: Teleoperators & Virtual Environments.

[11]  Christoph W. Borst,et al.  Virtual grasp release method and evaluation , 2012, Int. J. Hum. Comput. Stud..

[12]  Stefan Seipel,et al.  Physically co-located haptic interaction with 3D displays , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[13]  Si Chen,et al.  Movement and deformation of virtual object based on argument passing method , 2012, 2012 IEEE International Conference on Virtual Environments Human-Computer Interfaces and Measurement Systems (VECIMS) Proceedings.

[14]  Jesús Bescós,et al.  Real-time user independent hand gesture recognition from time-of-flight camera video using static and dynamic models , 2011, Machine Vision and Applications.

[15]  Lik-Kwan Shark,et al.  Immersive manipulation of virtual objects through glove-based hand gesture interaction , 2011, Virtual Reality.

[16]  Heiko Maaß,et al.  Vision-based Hand Representation and Intuitive Virtual Object Manipulation in Mixed Reality , 2012 .

[17]  Min-Hyung Choi,et al.  Free-Form Deformation Axis Aligned Bounding Box , 2009, ISA.

[18]  Robert G. Radwin,et al.  Virtual exertions: A user interface combining visual information, kinesthetics and biofeedback for virtual object manipulation , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[19]  Ai Poh Loh,et al.  Attention Based Detection and Recognition of Hand Postures Against Complex Backgrounds , 2012, International Journal of Computer Vision.