Toward tangibles and display-rich interfaces for co-located and distributed genomics collaborations

We discuss and present design probes investigating how pervasive displays could offer unique opportunities for enhancing discovery and learning with “big data.” Our collaboration across three universities undertook a series of design exercises investigating approaches for collaborative, interactive, tangibles, and multitouch-engaged visualizations of genomic and related scientific datasets. These exercises led to several envisionments of tangible interfaces that employ active tokens and interactive surfaces to facilitate co-located and distributed engagement with large datasets. We describe some of the motivation and background for these envisioned interfaces; consider key aspects linking and distinguishing the designs; and relate these to the present and near-future state of the art for tangible and multitouch engagement with pervasive displays toward collaborative science.

[1]  James D. Watson,et al.  The Double Helix: A Personal Account of the Discovery of the Structure of DNA , 1968 .

[2]  W. D. Garvey Communication, the Essence of Science: Facilitating Information Exchange Among Librarians, Scientists, Engineers, and Students , 1979 .

[3]  Robert Aish 3D input for CAAD systems , 1979 .

[4]  Robert Aish,et al.  Architecture without numbers — CAAD based on a 3D modelling system , 1984 .

[5]  Frederick P. Brooks,et al.  Using a manipulator for force display in molecular docking , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[6]  Kenneth G. Wilson Grand challenges to computational science , 1989, Future Gener. Comput. Syst..

[7]  Mark Weiser The computer for the 21st century , 1991 .

[8]  Sidney W. Fox Due credit , 1993, Nature.

[9]  Arie E. Kaufman,et al.  Proceedings of the conference on Visualization '04 , 1994 .

[10]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[11]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[12]  John Riedl,et al.  A spreadsheet approach to information visualization , 1997, Proceedings of VIZ '97: Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium.

[13]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[14]  H. Ishii,et al.  Urp: a luminous-tangible workbench for urban planning and design , 1999, CHI '99.

[15]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[16]  Yehudit Judy Dori,et al.  Virtual and Physical Molecular Modeling: Fostering Model Perception and Spatial Understanding , 2001, J. Educ. Technol. Soc..

[17]  Hiroshi Ishii,et al.  Urban Simulation and the Luminous Planning Table , 2001 .

[18]  E. Marshall Bermuda Rules: Community Spirit, With Teeth , 2001, Science.

[19]  Mark W. Newman,et al.  The designers' outpost: a tangible interface for collaborative web site , 2001, UIST '01.

[20]  Gaetano Borriello,et al.  Labscape: A Smart Environment for the Cell Biology Laboratory , 2002, IEEE Pervasive Comput..

[21]  Brygg Ullmer,et al.  Tangible interfaces for manipulating aggregates of digital information , 2002 .

[22]  Wendy E. Mackay,et al.  The missing link: augmenting biology laboratory notebooks , 2002, UIST '02.

[23]  Scott R. Klemmer,et al.  Two worlds apart: bridging the gap between physical and virtual media for distributed design collaboration , 2003, CHI '03.

[24]  Regan L. Mandryk,et al.  System Guidelines for Co-located, Collaborative Work on a Tabletop Display , 2003, ECSCW.

[25]  Kori M. Inkpen “ Just Because ” The Challenges of Evaluating Face-to-Face Collaboration , 2004 .

[26]  Regan L. Mandryk,et al.  Methodology for Evaluating Collaboration Behaviour in Co-Located Environments , 2004 .

[27]  Hiroshi Ishii,et al.  Immersive design of DMA molecules with a tangible interface , 2004, IEEE Visualization 2004.

[28]  Meredith Ringel Morris,et al.  Beyond "social protocols": multi-user coordination policies for co-located groupware , 2004, CSCW.

[29]  Jack Dongarra,et al.  Computational Science: Ensuring America's Competitiveness , 2005 .

[30]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[31]  Michel F. Sanner,et al.  Tangible augmented interfaces for structural molecular biology , 2005, IEEE Computer Graphics and Applications.

[32]  Daniel J. Blankenberg,et al.  Galaxy: a platform for interactive large-scale genome analysis. , 2005, Genome research.

[33]  Ravin Balakrishnan,et al.  Keepin' it real: pushing the desktop metaphor with physics, piles and the pen , 2006, CHI.

[34]  Scott R. Klemmer,et al.  ButterflyNet: a mobile capture and access system for field biology research , 2006, CHI.

[35]  Andreas Paepcke,et al.  TeamTag: exploring centralized versus replicated controls for co-located tabletop groupware , 2006, CHI.

[36]  Pattie Maes,et al.  Siftables: towards sensor network user interfaces , 2007, TEI.

[37]  Morten Fjeld,et al.  Tangible user interface for chemistry education: comparative evaluation and re-design , 2007, CHI.

[38]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[39]  Orit Shaer,et al.  The tangible video editor: collaborative video editing with active tokens , 2007, Tangible and Embedded Interaction.

[40]  Hiroshi Ishii,et al.  Tangible bits: beyond pixels , 2008, TEI.

[41]  Albrecht Schmidt,et al.  TEI goes on: Tangible and Embedded Interaction. , 2008 .

[42]  Natasha Myers,et al.  Molecular Embodiments and the Body-work of Modeling in Protein Crystallography , 2008 .

[43]  E. Mardis The impact of next-generation sequencing technology on genetics. , 2008, Trends in genetics : TIG.

[44]  Christopher P Austin,et al.  Prepublication data sharing , 2009, Nature.

[45]  Tom Bartindale,et al.  Stacks on the surface: resolving physical order using fiducial markers with structured transparency , 2009, ITS '09.

[46]  M. Sheelagh T. Carpendale,et al.  Getting practical with interactive tabletop displays: designing for dense data, "fat fingers," diverse interactions, and face-to-face collaboration , 2009, ITS '09.

[47]  Michael S. Horn,et al.  Visualizing Biodiversity with Voronoi Treemaps , 2009, 2009 Sixth International Symposium on Voronoi Diagrams.

[48]  E Birney,et al.  Prepublication data sharing: Benefits and Best Practices of Rapid Pre-Publication Data Release , 2009 .

[49]  M. Sheelagh T. Carpendale,et al.  Getting practical with interactive tabletop displays: designing for dense data, "fat fingers," diverse interactions, and face-to-face collaboration , 2009, ITS '09.

[50]  klaguia Prepublication Data Sharing , 2009 .

[51]  Hao Jiang,et al.  WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system , 2009, CHI.

[52]  Pattie Maes,et al.  Interaction with embodied media , 2009 .

[53]  Elise van den Hoven,et al.  Framing tangible interaction frameworks , 2009, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[54]  Martin Kaltenbrunner reacTIVision and TUIO: a tangible tabletop toolkit , 2009, ITS '09.

[55]  J. Iwasa Animating the model figure. , 2010, Trends in cell biology.

[56]  C. E. Pearson,et al.  Table S2: Trans-factors and trinucleotide repeat instability Trans-factor , 2010 .

[57]  D. Altshuler,et al.  A map of human genome variation from population-scale sequencing , 2010, Nature.

[58]  Christopher W. Branton,et al.  Cartouche: conventions for tangibles bridging diverse interactive systems , 2010, TEI '10.

[59]  A. Nekrutenko,et al.  Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences , 2010, Genome Biology.

[60]  Mary Czerwinski,et al.  An exploratory study of co-located collaborative visual analytics around a tabletop display , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[61]  Bertrand Schneider,et al.  Benefits of a Tangible Interface for Collaborative Learning and Interaction , 2011, IEEE Transactions on Learning Technologies.

[62]  Jakob E. Bardram,et al.  The eLabBench: an interactive tabletop system for the biology laboratory , 2011, ITS '11.

[63]  L. Chin,et al.  Making sense of cancer genomic data. , 2011, Genes & development.

[64]  Emiliano De Cristofaro,et al.  Countering GATTACA: efficient and secure testing of fully-sequenced human genomes , 2011, CCS '11.

[65]  Michael S. Horn,et al.  The DeepTree Exhibit: Visualizing the Tree of Life to Facilitate Informal Learning , 2012, IEEE Transactions on Visualization and Computer Graphics.

[66]  Emily Sun,et al.  Sifteo cubes , 2012, CHI Extended Abstracts.

[67]  Bertrand Schneider,et al.  Phylo-Genie: engaging students in collaborative 'tree-thinking' through tabletop techniques , 2012, CHI.

[68]  Kenny Q. Ye,et al.  An integrated map of genetic variation from 1,092 human genomes , 2012, Nature.

[69]  Orit Shaer,et al.  The design, development, and deployment of a tabletop interface for collaborative exploration of genomic data , 2012, Int. J. Hum. Comput. Stud..

[70]  Alex S. Taylor,et al.  At the seams: DIYbio and opportunities for HCI , 2012, DIS '12.

[71]  Miriam K. Konkel,et al.  Centromere Remodeling in Hoolock leuconedys (Hylobatidae) by a New Transposable Element Unique to the Gibbons , 2012, Genome biology and evolution.

[72]  Hugo Y. K. Lam,et al.  Personal Omics Profiling Reveals Dynamic Molecular and Medical Phenotypes , 2012, Cell.

[73]  Ali Mazalek,et al.  From big data to insights: opportunities and challenges for TEI in genomics , 2013, TEI '13.

[74]  Panos Markopoulos,et al.  Five key challenges in end-user development for tangible and embodied interaction , 2013, ICMI '13.

[75]  A. Olson,et al.  Student Learning about Biomolecular Self-Assembly Using Two Different External Representations , 2013, CBE life sciences education.

[76]  Monica M. C. Schraefel,et al.  TouchViz: a case study comparing two interfaces for data analytics on tablets , 2013, CHI.

[77]  Tobias Isenberg,et al.  Data Visualization on Interactive Surfaces: A Research Agenda , 2013, IEEE Computer Graphics and Applications.

[78]  Shreeya Nanda,et al.  Unpublished genomic data–how to share? , 2014, BMC Genomics.

[79]  P. Hartvigsen The Computer for the 21st Century (1991) , 2014 .

[80]  Luc Geurts,et al.  Playfully learning visual perspective taking skills with sifteo cubes , 2014, CHI PLAY.

[81]  Guillaume Levieux,et al.  Designing tangible video games: lessons learned from the sifteo cubes , 2014, CHI.

[82]  Ali Mazalek,et al.  Tangible Meets Gestural : Gesture Based Interaction with Active Tokens , 2014 .

[83]  Ali Mazalek,et al.  Exploring the design space of gestural interaction with active tokens through user-defined gestures , 2014, CHI.

[84]  Tommaso Turchi,et al.  Pervasive Displays in the Wild: Employing End User Programming in Adaption and Re-Purposing , 2015, IS-EUD.

[85]  Bertrand Schneider,et al.  3D Tangibles Facilitate Joint Visual Attention in Dyads , 2015, CSCL.

[86]  Orit Shaer,et al.  Eugenie: Multi-Touch and Tangible Interaction for Bio-Design , 2015, TEI.

[87]  J. T. Childers,et al.  Combined Measurement of the Higgs Boson Mass in $pp$ Collisions at $\sqrt{s}=7$ and 8 TeV with the ATLAS and CMS Experiments , 2015, 1503.07589.

[88]  The Ligo Scientific Collaboration,et al.  Observation of Gravitational Waves from a Binary Black Hole Merger , 2016, 1602.03837.

[89]  Miriam K. Konkel,et al.  Discovery of a new repeat family in the Callithrix jacchus genome , 2016, Genome research.

[90]  Pierre Dragicevic,et al.  Zooids: Building Blocks for Swarm User Interfaces , 2016, UIST.

[91]  Von Welch,et al.  Reproducing GW150914: The First Observation of Gravitational Waves From a Binary Black Hole Merger , 2016, Computing in Science & Engineering.

[92]  Ali Mazalek,et al.  Actibles: Open Source Active Tangibles , 2016, ISS.

[93]  Orit Shaer,et al.  Towards Understanding Collaboration around Interactive Surfaces: Exploring Joint Visual Attention , 2016, UIST.

[94]  Ali Mazalek,et al.  Sparse Tangibles: Collaborative Exploration of Gene Networks using Active Tangibles and Interactive Tabletops , 2016, TEI.

[95]  Understanding Collaborative Decision Making Around a Large-Scale Interactive Tabletop , 2017, Proc. ACM Hum. Comput. Interact..

[96]  Rolf Backofen,et al.  Jupyter and Galaxy: Easing entry barriers into complex data analyses for biomedical researchers , 2017, PLoS Comput. Biol..

[97]  Alan J. Dix,et al.  TAPAS: A tangible End-User Development tool supporting the repurposing of Pervasive Displays , 2017, J. Vis. Lang. Comput..

[98]  Ali Mazalek,et al.  Tangible VR: Diegetic Tangible Objects for Virtual Reality Narratives , 2017, Conference on Designing Interactive Systems.

[99]  Orit Shaer,et al.  BacPack: Exploring the Role of Tangibles in a Museum Exhibit for Bio-Design , 2017, TEI.

[100]  Oded Nov,et al.  Communicating Personal Genomic Information to Non-experts: A New Frontier for Human-Computer Interaction , 2017, Found. Trends Hum. Comput. Interact..

[101]  Ali Mazalek,et al.  Tangible Tensors: An Interactive System for Grasping Trends in Biological Systems Modeling , 2019, Creativity & Cognition.

[102]  Ali Mazalek,et al.  Envisioning tangibles and display-rich interfaces for co-located and distributed genomics collaborations , 2019, PerDis.

[103]  Ali Mazalek,et al.  Tangible BioNets , 2019, Proc. ACM Hum. Comput. Interact..

[104]  Ali Mazalek,et al.  Design and evaluation of graphical feedback on tangible interactions in a low-resolution edge display , 2019, PerDis.

[105]  Roman Rädle,et al.  Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices , 2019, CHI.