Cost-effective haptic-based networked virtual environments with high-resolution tiled display

In this paper, a haptic-based NVE (networked virtual environment) supporting high-resolution tiled display is proposed with a resource management scheme for future home applications such as a haptic-based networked game. Although NVEs with haptic interaction and immersive display have been developed in previous studies, they usually require expensive system configurations. In order to implement a cost-effective system, our proposed design includes a tiled display supporting high-resolution with several low-cost LCDs. The display nodes of the tiled display also have low processing and storage resource requirements because they only need to handle display-ready pixels received from the application node. The proposed resource management scheme, called as an object-based display scheme, reduces the resource requirements of the application node that would otherwise require significant resources to manage all the display nodes and to provide a user with haptic feedback. The proposed scheme segments graphic scenes into several pixelated virtual objects and assigns different frame rates to each object according to the interest of user. Experimental results confirm that the proposed scheme reduces the required network bandwidth and appropriately assigns the limited processing resources to graphic and haptic renderings for a high-level visual and haptic quality.

[1]  Maneesh Agrawala,et al.  Non-invasive interactive visualization of dynamic architectural environments , 2003, I3D '03.

[2]  Pat Hanrahan,et al.  Tracking graphics state for networked rendering , 2000, Workshop on Graphics Hardware.

[3]  Russell M. Taylor,et al.  Adding force display to a stereoscopic head-tracked projection display , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[4]  Aiguo Song,et al.  Stable haptic rendering with detailed energy-compensating control , 2008, Comput. Graph..

[5]  Michael Zyda,et al.  Networked virtual environments - desgin and implementation , 1999 .

[6]  Sethuraman Panchanathan,et al.  Neuro-cognitively inspired haptic user interfaces , 2008, Multimedia Tools and Applications.

[7]  Richard May,et al.  A Survey of Large High-Resolution Display Technologies, Techniques, and Applications , 2006, IEEE Virtual Reality Conference (VR 2006).

[8]  François Conti,et al.  CHAI: An Open-Source Library for the Rapid Development of Haptic Scenes , 2005 .

[9]  Venkatram Vishwanath,et al.  Multi-application inter-tile synchronization on ultra-high-resolution display walls , 2010, MMSys '10.

[10]  JongWon Kim,et al.  Transparency analysis and haptic synchronization for transparency of force-reflecting teleoperation , 2009, 2009 8th Annual Workshop on Network and Systems Support for Games (NetGames).

[11]  Jérémie Allard,et al.  Net Juggler: running VR Juggler with multiple displays on a commodity component cluster , 2002, Proceedings IEEE Virtual Reality 2002.

[12]  ChoiSeungmoon,et al.  Perceived Instability of Virtual Haptic Texture , 2007 .

[13]  Harrick M. Vin,et al.  Integrating virtual reality, tele-conferencing, and entertainment into multimedia home computers , 1992 .

[14]  Abdulmotaleb El-Saddik,et al.  Experiments in haptic-based authentication of humans , 2008, Multimedia Tools and Applications.

[15]  Hong Z. Tan,et al.  Perceived Instability of Virtual Haptic Texture: III. Effect of Update Rate , 2007, PRESENCE: Teleoperators and Virtual Environments.

[16]  Luc Renambot,et al.  SAGE: the Scalable Adaptive Graphics Environment , 2004 .

[17]  김종필,et al.  Robustly Stable Haptic Interaction Control using an Energy-Bounding Algorithm , 2010 .

[18]  Jochen Lang,et al.  HaptiCast : A Physically-Based 3 D Game with Haptic Feedback , 2006 .

[19]  Adam Finkelstein,et al.  Data distribution strategies for high-resolution displays , 2001, Comput. Graph..

[20]  Paul A. Navrátil,et al.  A Practical Guide to Large Tiled Displays , 2009, ISVC.

[21]  JongWon Kim,et al.  Decomposable decoding and display structure for scalable media visualization over advanced collaborative environments , 2005, SPIE Optics East.

[22]  Ming-Chang Tsai,et al.  A low-cost force feedback joystick and its use in PC video games , 1995 .

[23]  Mark Carson,et al.  NIST Net: a Linux-based network emulation tool , 2003, CCRV.

[24]  Luc Renambot,et al.  Enabling high resolution collaborative visualization in display rich virtual organizations , 2009, Future Gener. Comput. Syst..

[25]  JongWon Kim,et al.  Priority-based haptic event filtering for transmission and error control in networked virtual environments , 2009, Multimedia Systems.

[26]  Seokhee Lee,et al.  Transparency analysis and delay compensation scheme for haptic-based networked virtual environments , 2009, Comput. Commun..

[27]  Yo-Sung Ho,et al.  3D video player system with haptic interaction based on depth image-based representation , 2006, IEEE Transactions on Consumer Electronics.

[28]  Gerard de Haan,et al.  An overview of flaws in emerging television displays and remedial video processing , 2001, IEEE Trans. Consumer Electron..

[29]  Jeremy N. Bailenson,et al.  Virtual interpersonal touch: Haptic interaction and copresence in collaborative virtual environments , 2008, Multimedia Tools and Applications.

[30]  JongWon Kim,et al.  Haptic Event Prioritization and Network Adaptation Scheme for Collaborative Virtual Environments , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.

[31]  Jerzy Z. Sasiadek,et al.  Haptic force control based on impedance/admittance control aided by visual feedback , 2007, Multimedia Tools and Applications.

[32]  Hiroo Iwata,et al.  Volume haptization , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[33]  J. Edward Colgate,et al.  Passivity of a class of sampled-data systems: Application to haptic interfaces , 1997, J. Field Robotics.

[34]  Makoto Sato,et al.  Immersive multi-projector display on hybrid screens with human-scale haptic and locomotion interfaces , 2004, 2004 International Conference on Cyberworlds.