New Impressions in Interaction Design: A Task Taxonomy for Elastic Displays

Abstract Novel shape-changing interfaces promise to provide a rich haptic experience for human-computer interaction. As a specific instance of shape-changing interfaces, Elastic Displays provide large interaction surfaces that can be temporally deformed using force-touch. The unique property of these displays is that they automatically return to their initial flat state. Recently, several review and position papers have stimulated a discussion towards consolidating the knowledge about shape-changing interfaces. The knowledge about Elastic Displays is similarly scattered across multiple publications from recent years. This paper contributes a task taxonomy based on productive uses of Elastic Displays found in literature, on the web, and in our interaction lab. This taxonomy emphasizes tasks, but also encompasses general aspects regarding content types, visualization technology, and interaction styles. All aspects of the taxonomy are illustrated using case studies from literature.

[1]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[2]  Sungmin Cho,et al.  ElaScreen: exploring multi-dimensional data using elastic screen , 2013, CHI Extended Abstracts.

[3]  Max Mühlhäuser,et al.  Xpaaand: interaction techniques for rollable displays , 2011, CHI.

[4]  Calvin C. Gotlieb A time to retrospect and prospect , 2008, CACM.

[5]  Jürgen Steimle,et al.  FoldMe: interacting with double-sided foldable displays , 2012, Tangible and Embedded Interaction.

[6]  Jun Rekimoto,et al.  Lumen: interactive visual and shape display for calm computing , 2004, SIGGRAPH '04.

[7]  Miriam Sturdee,et al.  Analysis and Classification of Shape-Changing Interfaces for Design and Application-based Research , 2018, ACM Comput. Surv..

[8]  Rainer Groh,et al.  Exploring Big Data Landscapes with Elastic Displays , 2017, Mensch & Computer Workshopband.

[9]  Sean Follmer,et al.  Grand Challenges in Shape-Changing Interface Research , 2018, CHI.

[10]  Masatoshi Ishikawa,et al.  Khronos projector , 2005, SIGGRAPH '05.

[11]  Huai Liu,et al.  Metamorphic Testing , 2018, ACM Comput. Surv..

[12]  Rainer Groh,et al.  FlexiWall: Exploring Layered Data with Elastic Displays , 2014, ITS '14.

[13]  Mike Sinclair,et al.  TouchMover 2.0 - 3D touchscreen with force feedback and haptic texture , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[14]  Ravin Balakrishnan,et al.  Keepin' it real: pushing the desktop metaphor with physics, piles and the pen , 2006, CHI.

[16]  Rainer Groh,et al.  Improving Motive-Based Search - Utilization of Vague Feelings and Ideas in the Process of Information Seeking , 2013, HCI.

[17]  Naoki Kawakami,et al.  GelForce: a vision-based traction field computer interface , 2005, CHI Extended Abstracts.

[18]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[19]  Towards a Design Space for Elastic Displays , 2013 .

[20]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[21]  Majken Kirkegaard Rasmussen,et al.  Shape-changing interfaces: a review of the design space and open research questions , 2012, CHI.

[22]  Nobuhiro Takahashi,et al.  Interactive surface that have dynamic softness control , 2012, AVI.

[23]  Kasper Hornbæk,et al.  User-defined gestures for elastic, deformable displays , 2014, AVI.

[24]  Mathias Müller Data Exploration on Elastic Displays using Physical Metaphors , 2015 .

[25]  Jan O. Borchers,et al.  MudPad: tactile feedback for touch surfaces , 2011, CHI EA '11.

[26]  Hiroshi Ishii,et al.  Relief: a scalable actuated shape display , 2010, TEI '10.

[27]  Rainer Groh,et al.  FlexiWall: Interaction in-between 2D and 3D Interfaces , 2014, HCI.

[28]  Rainer Groh,et al.  DepthTouch: an elastic surface for tangible computing , 2012, AVI.

[29]  Helge J. Ritter,et al.  An integrated multi-modal actuated tangible user interface for distributed collaborative planning , 2012, Tangible and Embedded Interaction.

[30]  Dhairya Dand,et al.  Obake: interactions on a 2.5D elastic display , 2013, UIST '13 Adjunct.

[31]  Roel Vertegaal,et al.  An inflatable hemispherical multi-touch display , 2010, TEI.

[32]  Sriram Subramanian,et al.  TableHop: An Actuated Fabric Display Using Transparent Electrodes , 2016, CHI.

[33]  Masatoshi Ishikawa,et al.  The deformable workspace: A membrane between real and virtual space , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.