A Public Ideation of Shape-Changing Applications

The shape-changing concept where objects reconfigure their physical geometry has the potential to transform our interactions with computing devices, displays and everyday artifacts. Their dynamic physicality capitalizes on our inherent tactile sense and facilitates object re-appropriation. Research both within and outside HCI continues to develop a diverse range of technological solutions and materials to enable shape-change. However, as an early-stage enabling technology, the community has yet to identify important applications and use-cases to fully exploit its value. To expose and document a range of applications for shape-change, we employed unstructured brainstorming within a public engagement study. A 74-participant brainstorming exercise with members of the public produced 336 individual ideas that were coded into 11 major themes: entertainment, augmented living, medical, tools & utensils, research, architecture, infrastructure, industry, wearables, and education & training. This work documents the methodology and resultant application ideas along with reflections on the approach for gathering application ideas to enable shape-changing interactive surfaces and objects.

[1]  Jason Alexander,et al.  Evaluating the effectiveness of physical shape-change for in-pocket mobile device notifications , 2014, CHI.

[2]  Andrew Vande Moere,et al.  A wearable folding display for self-expression , 2006, OZCHI '06.

[3]  Pieter Jan Stappers,et al.  Co-creation and the new landscapes of design , 2008 .

[4]  Jun-ichiro Watanabe,et al.  Bookisheet: bendable device for browsing content using the metaphor of leafing through the pages , 2008, UbiComp.

[5]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[6]  Jan O. Borchers,et al.  The BendDesk demo: multi-touch on a curved display , 2010, ITS '10.

[7]  Faisal Taher,et al.  Exploring Interactions with Physically Dynamic Bar Charts , 2015, CHI.

[8]  Jun Rekimoto,et al.  Lumen: interactive visual and shape display for calm computing , 2004, SIGGRAPH '04.

[9]  Liam J. Bannon,et al.  Reimagining HCI: toward a more human-centered perspective , 2011, INTR.

[10]  Hiroshi Ishii,et al.  Illuminating clay: a 3-D tangible interface for landscape analysis , 2002, CHI.

[11]  Anton Nijholt,et al.  Smart material interfaces: a new form of physical interaction , 2012, CHI EA '12.

[12]  Scott R. Klemmer,et al.  How bodies matter: five themes for interaction design , 2006, DIS '06.

[13]  Roger W. Cholewiak,et al.  Sensory and Physiological Bases of Touch , 1991 .

[14]  Hiroshi Ishii,et al.  Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration , 2014, UIST.

[15]  Roel Vertegaal,et al.  MorePhone: a study of actuated shape deformations for flexible thin-film smartphone notifications , 2013, CHI.

[16]  Sachiko Kodama,et al.  Dynamic ferrofluid sculpture: organic shape-changing art forms , 2008, CACM.

[17]  Mark D. Gross,et al.  WearAir: expressive t-shirts for air quality sensing , 2010, TEI '10.

[18]  Fabian Hemmert,et al.  Living interfaces: the thrifty faucet , 2009, TEI.

[19]  Marcelo Coelho,et al.  Kukkia and Vilkas: kinetic electronic garments , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[20]  Hiroshi Ishii,et al.  Radical atoms: beyond tangible bits, toward transformable materials , 2012, INTR.

[21]  Zi Ye,et al.  Cobra: flexible displays for mobilegaming scenarios , 2010, CHI EA '10.

[22]  Susanna Paasovaara,et al.  Kinetic device: designing interactions with a deformable mobile interface , 2012, CHI Extended Abstracts.

[23]  Takuya Nojima,et al.  Hairlytop interface: An interactive surface display comprised of hair-like soft actuators , 2013, 2013 World Haptics Conference (WHC).

[24]  N. Fox Boundary Objects, Social Meanings and the Success of New Technologies , 2011 .

[25]  Anton Nijholt,et al.  Advances in Computer Entertainment , 2013, Lecture Notes in Computer Science.

[26]  Faisal Taher,et al.  ShapeClip: Towards Rapid Prototyping with Shape-Changing Displays for Designers , 2015, CHI.

[27]  Hideki Koike,et al.  ClaytricSurface: An Interactive Deformable Display with Dynamic Stiffness Control , 2014, IEEE Computer Graphics and Applications.

[28]  Yoshifumi Kitamura,et al.  TransformTable: a self-actuated shape-changing digital table , 2013, ITS.

[29]  Jeffrey Bardzell,et al.  SKIN: designing aesthetic interactive surfaces , 2010, TEI '10.

[30]  Majken Kirkegaard Rasmussen,et al.  Causing commotion with a shape-changing bench: experiencing shape-changing interfaces in use , 2014, CHI.

[31]  Pattie Maes,et al.  Flexpad: highly flexible bending interactions for projected handheld displays , 2013, CHI.

[32]  Tony DeRose,et al.  Toolglass and magic lenses: the see-through interface , 1993, SIGGRAPH.

[33]  Ivan Poupyrev,et al.  Gummi: a bendable computer , 2004, CHI '04.

[34]  Sriram Subramanian,et al.  Tilt displays: designing display surfaces with multi-axis tilting and actuation , 2012, Mobile HCI.

[35]  Fabian Hemmert,et al.  Shape-changing mobiles: tapering in two-dimensional deformational displays in mobile phones , 2010, CHI Extended Abstracts.

[36]  Susan Leigh Star,et al.  Institutional Ecology, `Translations' and Boundary Objects: Amateurs and Professionals in Berkeley's Museum of Vertebrate Zoology, 1907-39 , 1989 .

[37]  Hiroshi Ishii,et al.  Bosu: a physical programmable design tool for transformability with soft mechanics , 2010, Conference on Designing Interactive Systems.

[38]  Edward H. Adelson,et al.  deForm: an interactive malleable surface for capturing 2.5D arbitrary objects, tools and touch , 2011, UIST.

[39]  Fabian Hemmert,et al.  Shape-changing mobiles: tapering in one-dimensional deformational displays in mobile phones , 2010, TEI '10.

[40]  中島康祐,et al.  FuSA 2 Touch Display:大画面毛状マルチタッチディスプレイ , 2012 .

[41]  Roel Vertegaal,et al.  Mood fern: exploring shape transformations in reactive environments , 2014, Advances in Computer Entertainment.

[42]  Majken Kirkegaard Rasmussen,et al.  Shape-changing interfaces: a review of the design space and open research questions , 2012, CHI.