Information at the wave of your hand

Many universities are placing large screen displays in public locations to provide information about their academic programs and events. Typically, these displays are not interactive and the person viewing the information can only see a small subset as (s)he passes by. We present a gesture-based interactive system that can be used for any public information system when the information can be represented by entities and relations. In our demonstration system we have defined entities and relations among classes, professors, research topics, organizations, and events both within a department at a university. This Gesture Interactive Information System is a "Walk-Up-And-Use" interface that utilizes gesture recognition via Microsoft Kinect, and is designed so that multiple users may interact with the system. To provide clarity and visual hierarchy, information is displayed in clusters of circles with different sizes and color to differentiate between the various information types. This information can be arranged by type or discipline in order to provide users with multiple ways to explore the relationships between the various entities in the information system. Our user evaluation studies show that the system was able to attract the passers-by attention and engage them. The mean rating for system's design consistency, content engagement, and ease of navigation was significantly higher than other usability aspects.

[1]  Fernanda B. Viégas,et al.  Artifacts of the Presence Era: Using Information Visualization to Create an Evocative Souvenir , 2004 .

[2]  Jörg Müller,et al.  The Audience Funnel: Observations of Gesture Based Interaction With Multiple Large Displays in a City Center , 2011, Int. J. Hum. Comput. Interact..

[3]  Jan O. Borchers,et al.  Overcoming Assumptions and Uncovering Practices: When Does the Public Really Look at Public Displays? , 2008, Pervasive.

[4]  Peter P. Chen The entity-relationship model: toward a unified view of data , 1975, VLDB '75.

[5]  Ben Shneiderman,et al.  Tree-maps: a space-filling approach to the visualization of hierarchical information structures , 1991, Proceeding Visualization '91.

[6]  Brad A. Myers,et al.  Maximizing the guessability of symbolic input , 2005, CHI Extended Abstracts.

[7]  Matthew O. Ward,et al.  XmdvTool: integrating multiple methods for visualizing multivariate data , 1994, Proceedings Visualization '94.

[8]  Alireza Sahami Shirazi,et al.  Digifieds: insights into deploying digital public notice areas in the wild , 2011, MUM.

[9]  Margot Brereton,et al.  Designing Interaction for Local Communications: An Urban Screen Study , 2009, INTERACT.

[10]  Pat Hanrahan,et al.  Polaris: A System for Query, Analysis, and Visualization of Multidimensional Relational Databases , 2002, IEEE Trans. Vis. Comput. Graph..

[11]  Ann Morrison,et al.  Worlds of information: designing for engagement at a public multi-touch display , 2010, CHI.

[12]  Yvonne Rogers,et al.  Rethinking 'multi-user': an in-the-wild study of how groups approach a walk-up-and-use tabletop interface , 2011, CHI.

[13]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[14]  Jörg Müller,et al.  StrikeAPose: revealing mid-air gestures on public displays , 2013, CHI.

[15]  Anthony Collins,et al.  Conveying interactivity at an interactive public information display , 2013, PerDis.

[16]  Albrecht Schmidt,et al.  Requirements and design space for interactive public displays , 2010, ACM Multimedia.

[17]  Carlos Duarte,et al.  Mapping interaction onto media façades , 2012, PerDis '12.

[18]  Maurizio Lenzerini,et al.  A Methodology for Data Schema Integration in the Entity Relationship Model , 1984, IEEE Transactions on Software Engineering.

[19]  Antti Oulasvirta,et al.  It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre , 2008, CHI.

[20]  Bella Martin,et al.  Universal Methods of Design: 100 Ways to Research Complex Problems, Develop Innovative Ideas, and Design Effective Solutions , 2012 .

[21]  Yang Gao,et al.  ShifTable: A Natural Remote Target-Selection Technique on Large Displays , 2014, Interact. Comput..

[22]  Florian Alt,et al.  Looking glass: a field study on noticing interactivity of a shop window , 2012, CHI.

[23]  David W. McDonald,et al.  Proactive displays: Supporting awareness in fluid social environments , 2008, TCHI.

[24]  John T. Stasko,et al.  The InfoCanvas: information conveyance through personalized, expressive art , 2001, CHI Extended Abstracts.

[25]  D. Norman Emotional design : why we love (or hate) everyday things , 2004 .

[26]  Meredith Ringel Morris,et al.  Web on the wall: insights from a multimodal interaction elicitation study , 2012, ITS.

[27]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[28]  Ted Boren,et al.  Thinking aloud: reconciling theory and practice , 2000 .

[29]  S. Sundar,et al.  Social interaction in mobile games: priming opponents' presence and haptic feedback , 2014 .

[30]  Martin Wattenberg,et al.  Artistic Data Visualization: Beyond Visual Analytics , 2007, HCI.

[31]  Anthony Tang,et al.  Shadow reaching: a new perspective on interaction for large displays , 2007, UIST.

[32]  Heidrun Schumann,et al.  A scalable framework for information visualization , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[33]  Kellogg S. Booth,et al.  Mid-air text input techniques for very large wall displays , 2009, Graphics Interface.

[34]  Kim Halskov,et al.  Understanding the Dynamics of Engaging Interaction in Public Spaces , 2011, INTERACT.

[35]  Daniel A. Keim,et al.  Information Visualization and Visual Data Mining , 2002, IEEE Trans. Vis. Comput. Graph..

[36]  Lucy T. Nowell,et al.  ThemeRiver: Visualizing Thematic Changes in Large Document Collections , 2002, IEEE Trans. Vis. Comput. Graph..