Embodied Human-Data Interaction

We propose the concept of human-data interaction (HDI) as the human manipulation, analysis, and sensemaking of large, unstructured, and complex datasets. We then proceed to suggest an embodied approach to HDI to build physical reasoning environments for these difficult and polymorphic tasks. We illustrate our approach with two examples: tangible lenses for visual exploration, and an educational computer game with tangible bricks.

[1]  M. Sheelagh T. Carpendale,et al.  Interactive Tree Comparison for Co-located Collaborative Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[2]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[3]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[4]  Niklas Elmqvist,et al.  Hugin: a framework for awareness and coordination in mixed-presence collaborative information visualization , 2010, ITS '10.

[5]  R. Bowen Loftin,et al.  Multisensory perception: beyond the visual in visualization , 2003, Comput. Sci. Eng..

[6]  M. Sheelagh T. Carpendale,et al.  An exploratory study of visual information analysis , 2008, CHI.

[7]  Chris North,et al.  Information-rich virtual environments: theory, tools, and research agenda , 2003, VRST '03.

[8]  Stuart K. Card,et al.  The cost structure of sensemaking , 1993, INTERCHI.

[9]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[10]  John T. Stasko,et al.  Casual Information Visualization: Depictions of Data in Everyday Life , 2007, IEEE Transactions on Visualization and Computer Graphics.

[11]  Donald A. Norman,et al.  Things that make us smart , 1979 .

[12]  Christopher Andrews,et al.  Space to think: large high-resolution displays for sensemaking , 2010, CHI.

[13]  Jonathan Grudin,et al.  Partitioning digital worlds: focal and peripheral awareness in multiple monitor use , 2001, CHI.

[14]  Yvonne Rogers,et al.  External cognition: how do graphical representations work? , 1996, Int. J. Hum. Comput. Stud..

[15]  Ben Shneiderman,et al.  Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data , 2008, TCHI.

[16]  Daniel Weiskopf,et al.  A mixing board interface for graphics and visualization applications , 2007, GI '07.

[17]  Paul Dourish,et al.  Where the action is , 2001 .

[18]  Jonathan C. Roberts,et al.  Review of Designs for Haptic Data Visualization , 2010, IEEE Transactions on Haptics.

[19]  Anthony C. Robinson,et al.  Collaborative synthesis of visual analytic results , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.