Using Design Fiction to Inform Shape-Changing Interface Design and Use

Abstract Shape-changing interfaces are tangible, physically dynamic devices which enable user-experience beyond 2D screens. Within Human Computer Interaction, researchers are developing these from low-resolution, low-fidelity prototypes, toward a vision of a truly malleable world. The main focus is in producing and testing hardware, and basic user interactions, which leaves the question unanswered: what are shape-changing interfaces good for? In response, we propose the use of design fiction to investigate potential applications for this technology: to create and analyse artifacts relating to future use-scenarios for shape-change. Whilst research within shape-change often proposes future use-cases for prototypes during discussion, they are seldom in a form that presents them as everyday artifacts. Here, we present and discuss a printed game-play instruction manual for a truly high resolution shape-changing game entitled First Hand, which aims to draw parallels between current gaming practices and the tangible nature of shape-changing interfaces.

[1]  Hans-Werner Gellersen,et al.  ReForm: Integrating Physical and Digital Design through Bidirectional Fabrication , 2015, UIST.

[2]  Bin He,et al.  BRAIN^COMPUTER INTERFACE , 2007 .

[3]  Mark Blythe,et al.  Research through design fiction: narrative in real and imaginary abstracts , 2014, CHI.

[4]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[5]  Panos Markopoulos,et al.  The design space of shape-changing interfaces: a repertory grid study , 2014, Conference on Designing Interactive Systems.

[6]  Sriram Subramanian,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014, ACM Trans. Graph..

[7]  Miriam Sturdee,et al.  Design Fiction: How to Build a Voight-Kampff Machine , 2016, CHI Extended Abstracts.

[8]  Ken Perlin,et al.  clayodor: Retrieving Scents through the Manipulation of Malleable Material , 2015, TEI.

[9]  Hideki Koike,et al.  ClaytricSurface: An Interactive Deformable Display with Dynamic Stiffness Control , 2014, IEEE Computer Graphics and Applications.

[10]  Majken Kirkegaard Rasmussen,et al.  "It's alive, it's magic, it's in love with you": opportunities, challenges and open questions for actuated interfaces , 2013, OZCHI.

[11]  Jakob Grue Simonsen,et al.  Sketching Shape-changing Interfaces: Exploring Vocabulary, Metaphors Use, and Affordances , 2016, CHI.

[12]  Zi Ye,et al.  Cobra: flexible displays for mobilegaming scenarios , 2010, CHI EA '10.

[13]  Sriram Subramanian,et al.  TableHop: An Actuated Fabric Display Using Transparent Electrodes , 2016, CHI.

[14]  Sriram Subramanian,et al.  Floating charts: Data plotting using free-floating acoustically levitated representations , 2016, 2016 IEEE Symposium on 3D User Interfaces (3DUI).

[15]  Hans-Werner Gellersen,et al.  Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences , 2015, CHI.

[16]  J. G. Tanenbaum,et al.  Design fictional interactions , 2014, Interactions.

[17]  Joseph Lindley,et al.  Game vaporware as design fictions , 2016, MindTrek.

[18]  Ron Wakkary,et al.  Steampunk as design fiction , 2012, CHI.

[19]  Andy Darby,et al.  Participatory design fictions:co-designing and debating dementia-friendly futures , 2016 .

[20]  Joep W. Frens,et al.  From Movement to Mechanism: Exploring Expressive Movement Qualities in Shape-change , 2015, Tangible and Embedded Interaction.

[21]  Takuya Nojima,et al.  Hairlytop interface: An interactive surface display comprised of hair-like soft actuators , 2013, 2013 World Haptics Conference (WHC).

[22]  Katherine Isbister,et al.  Emotion and motion: games as inspiration for shaping the future of interface , 2011, INTR.

[23]  Hans-Werner Gellersen,et al.  The Royal Corgi: Exploring Social Gaze Interaction for Immersive Gameplay , 2015, CHI.

[24]  Tovi Grossman,et al.  Multi-finger gestural interaction with 3d volumetric displays , 2004, UIST '04.

[25]  Faisal Taher,et al.  ShapeClip: Towards Rapid Prototyping with Shape-Changing Displays for Designers , 2015, CHI.

[26]  Hiroshi Ishii,et al.  TRANSFORM: Embodiment of "Radical Atoms" at Milano Design Week , 2015, CHI Extended Abstracts.

[27]  Hiroshi Ishii,et al.  Radical atoms: beyond tangible bits, toward transformable materials , 2012, INTR.

[28]  Miriam Sturdee,et al.  A Public Ideation of Shape-Changing Applications , 2015, ITS.

[29]  Stuart Reeves,et al.  Alternate endings: using fiction to explore design futures , 2014, CHI Extended Abstracts.

[30]  Joseph Lindley,et al.  Anticipatory Ethnography: Design Fiction as an Input to Design Ethnography , 2014 .

[31]  Giovanni Maria Troiano,et al.  SCI-FI: Shape-Changing Interfaces, Future Interactions , 2016, NordiCHI.

[32]  Dag Svanæs,et al.  Material Programming: a Design Practice for Computational Composites , 2016, NordiCHI.

[33]  Majken Kirkegaard Rasmussen,et al.  Shape-changing interfaces: a review of the design space and open research questions , 2012, CHI.

[34]  Johan Redström,et al.  Computational composites , 2007, CHI.

[35]  Max Mühlhäuser,et al.  Xpaaand: interaction techniques for rollable displays , 2011, CHI.

[36]  Faisal Taher,et al.  Exploring Interactions with Physically Dynamic Bar Charts , 2015, CHI.

[37]  Faisal Taher,et al.  ShapeCanvas: An Exploration of Shape-Changing Content Generation by Members of the Public , 2016, CHI.

[38]  Hiroshi Ishii,et al.  ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation , 2011, UIST.

[39]  Liam J. Bannon,et al.  Reimagining HCI: toward a more human-centered perspective , 2011, INTR.

[40]  Hiroshi Ishii,et al.  Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices , 2012, UIST.

[41]  Joseph Lindley,et al.  Back to the future: 10 years of design fiction , 2015, BCS HCI.