SCI-FI: Shape-Changing Interfaces, Future Interactions

Shape-changing interfaces (SCI) are rapidly evolving and creating new interaction paradigms in human-computer interaction (HCI). However, empirical research in SCI is still bound to present technological limitations and existing prototypes can only show a limited number of potential applications for shape change. In this paper we attempt to broaden the pool of examples of what shape change may be good for by investigating SCI using Science Fiction (Sci-Fi) movies. We look at 340 Sci-Fi movies to identify instances of SCI and analyze their behavioral patterns and the context in which they are used. The result of our analysis presents four emerging behavioral patterns of shape change: (1) Reconfiguration, (2) Transformation, (3) Adaptation, and (4) Physicalization. We report a selection of SCI instances from Sci-Fi movies, which show how these behavioral patterns model functionalities of shape change and what they can do. Finally, we conclude by providing a discussion on how our results can inspire the design of SCI.

[1]  Zack J. Butler,et al.  Distributed systems of self-reconfiguring robots , 2002, SIGGRAPH '02.

[2]  Roel Vertegaal,et al.  Paperfold: a shape changing mobile device with multiple reconfigurable electrophoretic magnetic display tiles , 2014, CHI Extended Abstracts.

[3]  Hiroshi Ishii,et al.  bioLogic: Natto Cells as Nanoactuators for Shape Changing Interfaces , 2015, CHI.

[4]  Fabian Hemmert,et al.  Living interfaces: the thrifty faucet , 2009, TEI.

[5]  Ann Blandford,et al.  Semi-structured qualitative studies , 2013 .

[6]  Chris Harrison,et al.  Providing dynamically changeable physical buttons on a visual display , 2009, CHI.

[7]  Hiroshi Ishii,et al.  Radical atoms: beyond tangible bits, toward transformable materials , 2012, INTR.

[8]  Ron Wakkary,et al.  Design fictions , 2012, TEI.

[9]  Veronica Teichrieb,et al.  An Open Catalog of Hand Gestures from Sci-Fi Movies , 2015, CHI Extended Abstracts.

[10]  Nathan Shedroff,et al.  Make it so: learning from sci-fi interfaces , 2012, AVI.

[11]  Woohun Lee,et al.  Shape-changing robot for stroke rehabilitation , 2014, Conference on Designing Interactive Systems.

[12]  John Burn.  Shapes of Things to Come , 2012 .

[13]  Chris Preist,et al.  Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems , 2015 .

[14]  Holly A. Yanco,et al.  Changing shape: improving situation awareness for a polymorphic robot , 2006, HRI '06.

[15]  Kasper Hornbæk,et al.  Deformable Interfaces for Performing Music , 2015, CHI.

[16]  Jürgen Steimle,et al.  FoldMe: interacting with double-sided foldable displays , 2012, Tangible and Embedded Interaction.

[17]  Hiroshi Ishii,et al.  TRANSFORM as Adaptive and Dynamic Furniture , 2015, CHI Extended Abstracts.

[18]  Peter C. Wright,et al.  Pastiche scenarios: Fiction as a resource for user centred design , 2006, Interact. Comput..

[19]  Majken Kirkegaard Rasmussen,et al.  Shape-changing interfaces: a review of the design space and open research questions , 2012, CHI.

[20]  Luc Geurts,et al.  The skweezee system: enabling the design and the programming of squeeze interactions , 2013, UIST.

[21]  Philippa Mothersill,et al.  Awakened apparel: embedded soft actuators for expressive fashion and functional garments , 2014, TEI '14.

[22]  Roel Vertegaal,et al.  MorePhone: an actuated shape changing flexible smartphone , 2013, CHI Extended Abstracts.

[23]  Sebastian Boring,et al.  Dark patterns in proxemic interactions: a critical perspective , 2014, Conference on Designing Interactive Systems.

[24]  Ivan Poupyrev,et al.  Proceedings of the 26th annual ACM symposium on User interface software and technology , 2013, UIST 2013.

[25]  Kasper Hornbæk,et al.  User-defined gestures for elastic, deformable displays , 2014, AVI.

[26]  Zack J. Butler,et al.  Self-reconfiguring robots , 2002, CACM.

[27]  Roel Vertegaal,et al.  PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays , 2011, CHI.

[28]  Hiroshi Ishii,et al.  Relief: a scalable actuated shape display , 2010, TEI '10.

[29]  Susanna Paasovaara,et al.  Kinetic device: designing interactions with a deformable mobile interface , 2012, CHI Extended Abstracts.

[30]  Teemu Tuomas Ahmaniemi,et al.  What is a device bend gesture really good for? , 2014, CHI.

[31]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[32]  Audrey Girouard,et al.  Bending the rules: bend gesture classification for flexible displays , 2013, CHI.

[33]  Fabian Hemmert,et al.  Animate mobiles: proxemically reactive posture actuation as a means of relational interaction with mobile phones , 2013, TEI '13.

[34]  Pierre Dragicevic,et al.  Opportunities and Challenges for Data Physicalization , 2015, CHI.

[35]  Akira Wakita,et al.  Blob manipulation , 2012, Tangible and Embedded Interaction.

[36]  Hiroshi Ishii,et al.  PneUI: pneumatically actuated soft composite materials for shape changing interfaces , 2013, UIST.

[37]  Hiroshi Ishii,et al.  Bosu: a physical programmable design tool for transformability with soft mechanics , 2010, Conference on Designing Interactive Systems.

[38]  Woohun Lee,et al.  MoleBot: a robotic creature based on physical transformability , 2012, VRIC '12.

[39]  Anton Nijholt,et al.  Smart material interfaces: "a material step to the future" , 2012, SMI '12.

[40]  Faisal Taher,et al.  Exploring Interactions with Physically Dynamic Bar Charts , 2015, CHI.

[41]  Andreas Butz,et al.  A survey of human-computer interaction design in science fiction movies , 2008, INTETAIN '08.

[42]  Jun Iio,et al.  The Database on Near-Future Technologies for User Interface Design from SciFi Movies , 2014, HCI.

[43]  Zi Ye,et al.  Cobra: flexible displays for mobilegaming scenarios , 2010, CHI EA '10.

[44]  Youngwoo Park,et al.  The Trial of Bendi in a Coffeehouse: Use of a Shape-Changing Device for a Tactile-Visual Phone Conversation , 2015, CHI.

[45]  Hiroshi Ishii,et al.  Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices , 2012, UIST.

[46]  Sriram Subramanian,et al.  Is my phone alive?: a large-scale study of shape change in handheld devices using videos , 2014, CHI.

[47]  Youngwoo Park,et al.  Wrigglo: shape-changing peripheral for interpersonal mobile communication , 2014, CHI.

[48]  Masaaki Kurosu.  User Interfaces That Appeared in SciFi Movies and Their Reality , 2014, HCI.

[49]  Markus Löchtefeld,et al.  Morphees: toward high "shape resolution" in self-actuated flexible mobile devices , 2013, CHI.