CGLXTouch: A multi-user multi-touch approach for ultra-high-resolution collaborative workspaces

This paper presents an approach for empowering collaborative workspaces through ultra-high resolution tiled display environments concurrently interfaced with multiple multi-touch devices. Multi-touch table devices are supported along with portable multi-touch tablet and phone devices, which can be added to and removed from the system on the fly. Events from these devices are tagged with a device identifier and are synchronized with the distributed display environment, enabling multi-user support. As many portable devices are not equipped to render content directly, a remotely scene is streamed in. The presented approach scales for large numbers of devices, providing access to a multitude of hands-on techniques for collaborative data analysis.

[1]  Ståle Navrud,et al.  Valuing Cultural Heritage , 2002 .

[2]  Darren Gergle,et al.  Emotion rating from short blog texts , 2008, CHI.

[3]  Joe Michael Kniss,et al.  Interactive volume rendering using multi-dimensional transfer functions and direct manipulation widgets , 2001, Proceedings Visualization, 2001. VIS '01..

[4]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Falko Kuester,et al.  CGLX: A Scalable, High-Performance Visualization Framework for Networked Display Environments , 2011, IEEE Transactions on Visualization and Computer Graphics.

[6]  Mark H. Ellisman,et al.  Filamentous actin is concentrated in specific subpopulations of neuronal and glial structures in rat central nervous system , 2001, Brain Research.

[7]  Masatoshi Ishikawa,et al.  Khronos projector , 2005, SIGGRAPH '05.

[8]  Chris Ho-Stuart,et al.  A sense of touch in online sculpting , 2004, GRAPHITE '04.

[9]  Andrew C. Simpson,et al.  Integrative Biology - the challenges of developing a collaborative research environment for heart and cancer modelling , 2007, Future Gener. Comput. Syst..

[10]  Kirk Martinez High Resolution Digital Imaging of Paintings: The Vasari Project , 1991 .

[11]  Gerrit Voss,et al.  A multi-thread safe foundation for scene graphs and its extension to clusters , 2002, EGPGV.

[12]  Regan L. Mandryk,et al.  System Guidelines for Co-located, Collaborative Work on a Tabletop Display , 2003, ECSCW.

[13]  Falko Kuester,et al.  The StarCAVE, a third-generation CAVE and virtual reality OptIPortal , 2009, Future Gener. Comput. Syst..

[14]  Meredith Ringel Morris,et al.  Barehands: implement-free interaction with a wall-mounted display , 2001, CHI Extended Abstracts.

[15]  Wolfgang Blochinger,et al.  Structured collaborative workflow design , 2009, Future Gener. Comput. Syst..

[16]  Jonathan Arnowitz,et al.  It's mine... , 2005, INTR.

[17]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[18]  Andrew D. Wilson TouchLight: an imaging touch screen and display for gesture-based interaction , 2004, ICMI '04.

[19]  John F. Hughes,et al.  Sculpting: an interactive volumetric modeling technique , 1991, SIGGRAPH.

[20]  Jun Rekimoto,et al.  A multiple device approach for supporting whiteboard-based interactions , 1998, CHI.

[21]  Stevan Harnad,et al.  Symbol grounding problem , 1990, Scholarpedia.

[22]  Michael Cohen,et al.  Capturing and viewing gigapixel images , 2007, SIGGRAPH 2007.

[23]  Venkatram Vishwanath,et al.  JuxtaView - a tool for interactive visualization of large imagery on scalable tiled displays , 2004, 2004 IEEE International Conference on Cluster Computing (IEEE Cat. No.04EX935).

[24]  Martin Kraus,et al.  High-quality pre-integrated volume rendering using hardware-accelerated pixel shading , 2001, HWWS '01.

[25]  Alan Hedge,et al.  Multi-Touch: A New Tactile 2-D Gesture Interface for Human-Computer Interaction , 2001 .

[26]  Min Chen,et al.  Feature Aligned Volume Manipulation for Illustration and Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[27]  Jefferson Y. Han Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[28]  Lance Williams,et al.  Pyramidal parametrics , 1983, SIGGRAPH.

[29]  Lucian Plesa The Design, Implementation and operation of the JPL OnEarth WMS Server , 2008, Geospatial Services and Applications for the Internet.

[30]  Scott R. Klemmer,et al.  Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology , 2011, UIST 2011.

[31]  Luc Renambot,et al.  Enabling high resolution collaborative visualization in display rich virtual organizations , 2009, Future Gener. Comput. Syst..

[32]  Luc Renambot,et al.  SAGE: the Scalable Adaptive Graphics Environment , 2004 .

[33]  Elizabeth F. Churchill,et al.  Collaborative Virtual Environments: Digital Places and Spaces for Interaction , 2001 .

[34]  Arie E. Kaufman,et al.  Volume sculpting , 1995, I3D '95.

[35]  Andrew A. Chien,et al.  Collaborative data visualization for Earth Sciences with the OptIPuter , 2006, Future Gener. Comput. Syst..

[36]  Kai Li,et al.  Scalable and ultra-high resolution mpeg video delivery on tiled displays , 2003 .

[37]  Xing Chen,et al.  Lumipoint: multi-user laser-based interaction on large tiled displays , 2002 .

[38]  Joan L. Mitchell,et al.  MPEG Video: Compression Standard , 1996 .

[39]  Hans P. Moravec When will computer hardware match the human brain , 1998 .

[40]  Cees T. A. M. de Laat,et al.  Special section: OptIPlanet - The OptIPuter global collaboratory , 2009, Future Gener. Comput. Syst..

[41]  Alessandro Piva,et al.  Multispectral imaging of paintings , 2008, IEEE Signal Processing Magazine.

[42]  Soo-Ik Chae,et al.  A high-performance OpenVG accelerator with dual-scanline filling rendering , 2008, IEEE Transactions on Consumer Electronics.

[43]  Carlos D. Correa Visualizing what lies inside , 2009, COMG.

[44]  David Saunders,et al.  Ten years of art imaging research , 2002, Proc. IEEE.

[45]  Maurizio Seracini,et al.  Wipe‐Off: An Intuitive Interface for Exploring Ultra‐Large Multi‐Spectral Data Sets for Cultural Heritage Diagnostics , 2009, Comput. Graph. Forum.

[46]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[47]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[48]  Gordon Stoll,et al.  WireGL: a scalable graphics system for clusters , 2001, SIGGRAPH.

[49]  Vladimir Pavlovic,et al.  Speech/Gesture Interface to a Visual-Computing Environment , 2000, IEEE Computer Graphics and Applications.

[50]  Kirk Martinez,et al.  VIPS - a highly tuned image processing software architecture , 2005, IEEE International Conference on Image Processing 2005.

[51]  Roger L. Easton,et al.  Multispectral imaging of the Archimedes palimpsest , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[52]  Carolina Cruz-Neira,et al.  VR Juggler: a virtual platform for virtual reality application development , 2001, Proceedings IEEE Virtual Reality 2001.

[53]  Terry Winograd,et al.  Fluid interaction with high-resolution wall-size displays , 2001, UIST '01.

[54]  Anoop Gupta,et al.  Tools and applications for large-scale display walls , 2005, IEEE Computer Graphics and Applications.

[55]  Paul Wielinga,et al.  Building a 100 Mpixel graphics device for the OptIPuter , 2006, Future Gener. Comput. Syst..

[56]  Abhishek Ranjan,et al.  Interacting with large displays from a distance with vision-tracked multi-finger gestural input , 2005, SIGGRAPH '06.

[57]  R. Lehrle,et al.  Forensics, fakes, and failures: Pyrolysis is one part in the overall armoury , 1997 .

[58]  Óscar Belmonte Fernández,et al.  Federate resource management in a Distributed Virtual Environment , 2010, Future Gener. Comput. Syst..

[59]  Vladimir Pavlovic,et al.  Speech/gesture interface to a visual computing environment for molecular biologists , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[60]  Chris North,et al.  Effects of tiled high-resolution display on basic visualization and navigation tasks , 2005, CHI EA '05.

[61]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[62]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[63]  Hamish A. Carr,et al.  Accelerating marching cubes with graphics hardware , 2006, CASCON.

[64]  Falko Kuester,et al.  Giga-stack: A method for visualizing giga-pixel layered imagery on massively tiled displays , 2010, Future Gener. Comput. Syst..

[65]  Kenneth C. Smith,et al.  A multi-touch three dimensional touch-sensitive tablet , 1985, CHI '85.

[66]  Hui Chen,et al.  Real-time haptic sculpting in virtual volume space , 2002, VRST '02.

[67]  Qian Liu,et al.  Author's Personal Copy Future Generation Computer Systems the Optiportal, a Scalable Visualization, Storage, and Computing Interface Device for the Optiputer , 2022 .

[68]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[69]  Dr. Rory Lewis,et al.  iPhone and iPad Apps for Absolute Beginners , 2013, Apress.

[70]  Todd Hansen,et al.  Wireless Measurement and Analysis on HPWREN , 2001 .

[71]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[72]  Petr Holub,et al.  Distributed and collaborative visualization of large data sets using high-speed networks , 2006, Future Gener. Comput. Syst..

[73]  Xiang Cao,et al.  VisionWand: interaction techniques for large displays using a passive wand tracked in 3D , 2003, UIST '03.

[74]  Andrew E. Johnson,et al.  High-Performance Dynamic Graphics Streaming for Scalable Adaptive Graphics Environment , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[75]  Tetsuro Fujii,et al.  4K SHD Real-Time Video Streaming System With JPEG 2000 Parallel Codec , 2006, APCCAS 2006 - 2006 IEEE Asia Pacific Conference on Circuits and Systems.

[76]  Meredith Ringel Morris,et al.  DiamondSpin: an extensible toolkit for around-the-table interaction , 2004, CHI.

[77]  Antti Oulasvirta,et al.  It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre , 2008, CHI.

[78]  Matthias Koenig,et al.  Embedding VTK and ITK into a visual programming and rapid prototyping platform , 2006, SPIE Medical Imaging.

[79]  Alan M. MacEachren,et al.  Exploring high-D spaces with multiform matrices and small multiples , 2003, IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714).

[80]  Kurt Akeley,et al.  Reality Engine graphics , 1993, SIGGRAPH.

[81]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[82]  Hiroshi Ishii,et al.  Wetpaint: scraping through multi-layered images , 2009, CHI.