Webizing collaborative interaction space for cross reality with various human interface devices

Recently, web based cross reality (XR) concept embracing virtual reality (VR), augmented reality (AR), and mixed reality (MR) technology has emerged, but user interaction devices for collaborative work supported in web environments are limited. The Virtual-Reality Peripheral Network (VRPN) in the traditional VR environment provides a device-independent and network transparent interface. To promote the development of web based XR applications, a common method is required to support a collaborative interaction space in VR, AR, and MR contexts according to the user environment and various interaction devices that can be used without limitation of XR content in web based XR environments as well. In this paper, we propose a webizing method for a collaborative interaction space that provides user authentication and manages user sessions in XR environments. In addition, the webizing method supports human interface devices and related events via an interaction adaptor that delivers events based on user session and converts event messages according to XR content types such as VRPN messages, X3D sensor data, and HTML DOM events to deal with interaction events.

[1]  Heedong Ko,et al.  Webizing Mixed Reality for Cooperative Augmentation of Life Experience , 2016, CSCW '16 Companion.

[2]  James Scicluna,et al.  SmartReality: Integrating the Web into Augmented Reality , 2012, I-SEMANTICS.

[3]  Martin Gaedke,et al.  Exploiting single-user web applications for shared editing: a generic transformation approach , 2012, WWW.

[4]  David Wescott,et al.  The A-frame , 2006 .

[5]  Jens Keil,et al.  Skeletal input for user interaction in X3D , 2013, Web3D '13.

[6]  Mirina Grosz,et al.  World Wide Web Consortium , 2010 .

[7]  Martin Gaedke,et al.  Analyzing the suitability of web applications for a single-user to multi-user transformation , 2013, WWW '13 Companion.

[8]  Svenja Kahn,et al.  Enhancing realism of mixed reality applications through real-time depth-imaging devices in X3D , 2011, Web3D '11.

[9]  Heedong Ko,et al.  Webizing human interface devices for virtual reality , 2016, VRST.

[10]  Philipp Slusallek,et al.  XML3D: interactive 3D graphics for the web , 2010, Web3D '10.

[11]  Martin Lechner,et al.  OGC® Augmented Reality Markup Language 2.0 (ARML 2.0) , 2015 .

[12]  Robert W. Lindeman,et al.  Coordinated 3D interaction in tablet- and HMD-based hybrid virtual environments , 2014, SUI.

[13]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[14]  D. Freda,et al.  Application of the Virtual Reality Modeling Language (VRML) to Geologic Remote Sensing , 1997 .

[15]  John David N. Dionisio,et al.  3D Virtual worlds and the metaverse: Current status and future possibilities , 2013, CSUR.

[16]  Blair MacIntyre,et al.  The Argon AR Web Browser and standards-based AR application environment , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[17]  Dieter W. Fellner,et al.  A flexible approach to gesture recognition and interaction in X3D , 2012, Web3D '12.

[18]  Roy T. Fielding,et al.  Hypertext Transfer Protocol - HTTP/1.1 , 1997, RFC.

[19]  Jacek Jankowski,et al.  Writing Effective Use Cases for the Declarative 3D for the Web Architecture , 2012, Dec3D.

[20]  松田 晃一,et al.  Virtual Reality Modeling Language , 1997 .

[21]  Tom Pixley Document Object Model (DOM) Level 3 Events Specification , 2000 .

[22]  Junwei Lu,et al.  Generalizing operational transformation to the standard general markup language , 2002, CSCW '02.