Enabling multi-user interaction in large high-resolution distributed environments

As the amount and the resolution of collected scientific data increase, scientists are realizing the potential benefits that large high-resolution displays can have in assimilating this incoming data. Often this data has to be processed on powerful remote computing and storage resources, converted to high-resolution digital media and yet visualized on a local tiled-display. This is the basic premise behind the OptIPuter model. While the streaming middleware to enable this kind of work exists and the optical networking infrastructure is becoming more widely available, enabling multi-user interaction in such environments is still a challenge. In this paper, we present an interaction system we developed to support collaborative work on large high-resolution displays using multiple interaction devices and scalable, distributed user interface widgets. This system allows multiple users to simultaneously interact with local or remote data, media and applications, through a variety of physical interaction devices on large high-resolution displays. Finally, we present our experiences with using the system over the past two years. Most importantly, having an actual working system based on the OptIPuter model allows us to focus our research efforts to better understand how to make such high-resolution environments more user-friendly and usable in true real-world collaborative scenarios as opposed to constrained laboratory settings.

[1]  Takeo Igarashi,et al.  Ninja cursors: using multiple cursors to assist target acquisition on large screens , 2008, CHI.

[2]  Mary Czerwinski,et al.  Large display research overview , 2006, Color Imaging Conference.

[3]  Chris North,et al.  Dynamic size and speed cursor for large, high-resolution displays , 2006 .

[4]  Klara Nahrstedt,et al.  Gaia: A Middleware Infrastructure to Enable Active Spaces1 , 2002 .

[5]  P.E. Mantey,et al.  Large Classroom Experience with an Interactive Tiled Display Mural , 2006, Proceedings. Frontiers in Education. 36th Annual Conference.

[6]  Alessandro Soro,et al.  Multitouch Sensing for Collaborative Interactive Walls , 2008, HCIS.

[7]  Kenton O'Hara,et al.  Social Impact , 2019, Encyclopedia of Food and Agricultural Ethics.

[8]  Paul Wielinga,et al.  Building a 100 Mpixel graphics device for the OptIPuter , 2006, Future Gener. Comput. Syst..

[9]  Chris North,et al.  Move to improve: promoting physical navigation to increase user performance with large displays , 2007, CHI.

[10]  Bernd Hamann,et al.  A practical system for laser pointer interaction on large displays , 2005, VRST '05.

[11]  Saul Greenberg,et al.  Speech-filtered bubble ray: improving target acquisition on display walls , 2007, ICMI '07.

[12]  Luc Renambot,et al.  Enabling high resolution collaborative visualization in display rich virtual organizations , 2009, Future Gener. Comput. Syst..

[13]  Patrick Baudisch,et al.  Soap: a pointing device that works in mid-air , 2006, UIST.

[14]  Daniel Vogel,et al.  HybridPointing: fluid switching between absolute and relative pointing with a direct input device , 2006, UIST.

[15]  Andrew A. Chien,et al.  The OptIPuter , 2003, CACM.

[16]  Abhishek Ranjan,et al.  Interacting with large displays from a distance with vision-tracked multi-finger gestural input , 2005, SIGGRAPH '06.

[17]  Andrew E. Johnson,et al.  High-Performance Dynamic Graphics Streaming for Scalable Adaptive Graphics Environment , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[18]  Per Hasvold,et al.  A Large, High Resolution Tiled Display for Medical Use: Experiences from Prototyping of a Radiology Scenario , 2008, MIE.

[19]  Qian Liu,et al.  Author's Personal Copy Future Generation Computer Systems the Optiportal, a Scalable Visualization, Storage, and Computing Interface Device for the Optiputer , 2022 .

[20]  William Buxton,et al.  Large Displays in Automotive Design , 2000, IEEE Computer Graphics and Applications.

[21]  Jason Leigh,et al.  CYBER-COMMONS: MERGING REAL AND VIRTUAL WORLDS : Cyber-masbups of very large data sts tel users explore, analyze, and comprehend the science behind the information being streamed , 2008 .

[22]  Mike Potel,et al.  Cinematic Meeting Facilities Using Large Displays , 2005 .

[23]  Chris North,et al.  Analysis of User Behavior on High-Resolution Tiled Displays , 2005, INTERACT.

[24]  Armando Fox,et al.  The Event Heap: a coordination infrastructure for interactive workspaces , 2002, Proceedings Fourth IEEE Workshop on Mobile Computing Systems and Applications.

[25]  Daniel Vogel,et al.  Distant freehand pointing and clicking on very large, high resolution displays , 2005, UIST.

[26]  Jason Leigh,et al.  Cyber-commons: merging real and virtual worlds , 2008, CACM.

[27]  Klara Nahrstedt,et al.  A Middleware Infrastructure for Active Spaces , 2002, IEEE Pervasive Comput..

[28]  JongWon Kim,et al.  The global lambda visualization facility: An international ultra-high-definition wide-area visualization collaboratory , 2006, Future Gener. Comput. Syst..

[29]  Chris North,et al.  The effects of peripheral vision and physical navigation on large scale visualization , 2008, Graphics Interface.

[30]  Peter Tandler Software Infrastructure for Ubiquitous Computing Environments: Supporting Synchronous Collaboration with Heterogeneous Devices , 2001, UbiComp.