Physical interaction in a dematerialized world

Dematerialization is an ongoing process in today's generation of intelligent, digital products; content becomes disengaged from fixed carriers, and flows freely through networks and devices. We have witnessed how music CDs and cash money have been replaced by MP3 files and digital payments, as well as how dematerialization has entered the field of books. In this study, the process of dematerialization is explored. We define it and focus on its benefits and drawbacks, while trying to find answers to the question of how to design dematerialized products without neglecting the rich values of the physical world. Regarding this, we take a look at the approach of Tangible Interaction, and find it inspirational. Subsequently, in two design cases of an audio system and a payment terminal, we lay the foundations for our own design approach, which is situated in between the Tangible Interaction approach and the approach that is applied in today's generation of digital products. Finally, our approach is placed within the context of the Rich Interaction paradigm.

[1]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[2]  A. L. Edwards.  The social desirability variable in personality assessment and research , 1958 .

[3]  IndustrIAl desIGn,et al.  Industrial Design , 1964, Nature.

[4]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[5]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[6]  Judith Greene,et al.  Learning to Use Statistical Tests in Psychology , 1982 .

[7]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[8]  J Vernon.  Getting in touch. , 1983, Today's OR nurse.

[9]  Michel Waisvisz,et al.  The Hands: A Set of Remote MIDI-Controllers , 1985, ICMC.

[10]  William Buxton,et al.  There's more to interaction than meets the eye: some issues in manual input , 1987 .

[11]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[12]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[13]  Lisa Krohn,et al.  Beyond Beige: Interpretive Design for the Post-Industrial Age , 1989 .

[14]  Jiajie Zhang,et al.  The Interaction of Internal and External Representations in a Problem Solving Task , 1990 .

[15]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[16]  R. Hopkins.  Pragmatist Aesthetics: Living Beauty, Rethinking Art , 1994 .

[17]  M. Ruffin.  On being digital. , 1995, Physician executive.

[18]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[19]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[20]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[21]  Thomas Massie.  A Tangible Goal for 3D Modeling , 1998, IEEE Computer Graphics and Applications.

[22]  Hiroshi Ishii,et al.  mediaBlocks: physical containers, transports, and controls for online media , 1998, SIGGRAPH.

[23]  Drazen Prelec,et al.  The Red and the Black: Mental Accounting of Savings and Debt , 1998 .

[24]  H. Ishii,et al.  Urp: a luminous-tangible workbench for urban planning and design , 1999, CHI '99.

[25]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[26]  N. Cross.  Design Research: a disciplined conversation , 1999 .

[27]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[28]  Bert Bongers,et al.  Physical Interfaces in the Electronic Arts Interaction Theory and Interfacing Techniques for Real-time Performance , 2000 .

[29]  C. van Wijk.  Toetsende statistiek: Basistechnieken. Een praktijkgerichte inleiding voor onderzoekers van taal, gedrag en communicatie , 2000 .

[30]  Jacob Buur,et al.  Taking the best from a company history - designing with interaction styles , 2000, DIS '00.

[31]  Kennon M. Sheldon,et al.  What is satisfying about satisfying events? Testing 10 candidate psychological needs. , 2001, Journal of personality and social psychology.

[32]  Peter J. Denning,et al.  The invisible future: the seamless integration of technology into everyday life , 2001 .

[33]  Paul Dourish,et al.  Where the action is , 2001 .

[34]  Johan Redström,et al.  Slow Technology – Designing for Reflection , 2001, Personal and Ubiquitous Computing.

[35]  Stephan Wensveen,et al.  Set me free, give me degrees of freedom , 2002 .

[36]  Barton C. Massey,et al.  DESIGN METHODS , 2002 .

[37]  Stephan Wensveen,et al.  But how, Donald, tell us how?: on the creation of meaning in interaction design through feedforward and inherent feedback , 2002, DIS '02.

[38]  Caroline Hummels,et al.  Beauty in usability : forget about ease of use! , 2002 .

[39]  Stephan Wensveen,et al.  Push me, shove me and I show you how you feel: recognising mood from emotionally rich interaction , 2002, DIS '02.

[40]  Oscar de Bruijn,et al.  Living memory: agent-based information management for connected local communities , 2002, Interact. Comput..

[41]  Johan Redström,et al.  From use to presence: on the expressions and aesthetics of everyday computational things , 2002, TCHI.

[42]  Johan Redström,et al.  Textile displays: using textiles to investigate computational technology as design material , 2002, NordiCHI '02.

[43]  Caroline Hummels,et al.  In Search of Resonant Human Computer Interaction: Building and Testing Aesthetic Installations , 2003, INTERACT.

[44]  Dilip Soman,et al.  The Effect of Payment Transparency on Consumption: Quasi-Experiments from the Field , 2003 .

[45]  H. Kundel,et al.  Measurement of observer agreement. , 2003, Radiology.

[46]  Timothy Jaeger.  The (Anti-)Laptop Aesthetic , 2003 .

[47]  C. P. Goodman,et al.  The Tacit Dimension , 2003 .

[48]  Michael Burmester,et al.  AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität , 2003, MuC.

[49]  Hiroshi Ishii,et al.  A tangible interface for IP network simulation , 2003, CHI Extended Abstracts.

[50]  Kenneth P. Fishkin,et al.  A taxonomy for and analysis of tangible interfaces , 2004, Personal and Ubiquitous Computing.

[51]  Y Wang,et al.  Bringing Clay and Sand into Digital Design — Continuous Tangible user Interfaces , 2004 .

[52]  Martin Ludvigsen,et al.  Aesthetic interaction: a pragmatist's aesthetics of interactive systems , 2004, DIS '04.

[53]  Albrecht Schmidt,et al.  Tangible interfaces in perspective , 2004, Personal and Ubiquitous Computing.

[54]  E. Voet,et al.  Dematerialization: Not Just a Matter of Weight , 2004 .

[55]  Joep W. Frens,et al.  Tangible products: redressing the balance between appearance and action , 2004, Personal and Ubiquitous Computing.

[56]  D. Norman.  Emotional design : why we love (or hate) everyday things , 2004 .

[57]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[58]  Stephan Wensveen,et al.  Interaction frogger: a design framework to couple action and function through feedback and feedforward , 2004, DIS '04.

[59]  Mark Weiser,et al.  Designing Calm Technology , 2004 .

[60]  Mitchel Resnick,et al.  Extending tangible interfaces for education: digital montessori-inspired manipulatives , 2005, CHI.

[61]  Hiroshi Ishii,et al.  Token+constraint systems for tangible interaction with digital information , 2005, TCHI.

[62]  Steve Higgins,et al.  Interactive whiteboards: boon or bandwagon? A critical review of the literature , 2005, J. Comput. Assist. Learn..

[63]  John Thackara,et al.  In the Bubble: Designing in a Complex World , 2005 .

[64]  S Sietske Klooster,et al.  Designing products as an integral part of choreography of interaction : the product's form as an integral part of movement , 2005 .

[65]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .

[66]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[67]  P. Verbeek,et al.  What things do , 2005 .

[68]  Caroline Hummels,et al.  Let's Make Things Engaging , 2005, Funology.

[69]  Ben Matthews,et al.  Easy doesn’t do it: skill and expression in tangible aesthetics , 2007, Personal and Ubiquitous Computing.

[70]  I. V. Diest,et al.  Verdere validering van de Positive and Negative Affect Schedule (PANAS) en vergelijking van twee Nederlandstalige versies , 2006, gedrag en gezondheid.

[71]  Caroline Hummels,et al.  Move to get moved: a search for methods, tools and knowledge to design for expressive and rich movement-based interaction , 2007, Personal and Ubiquitous Computing.

[72]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[73]  Scott R. Klemmer,et al.  How bodies matter: five themes for interaction design , 2006, DIS '06.

[74]  Joep Frens,et al.  Designing for rich interaction : integrating form, interaction, and function , 2006 .

[75]  Shakeel Siddiqui,et al.  Extending the Self in a Virtual World , 2006 .

[76]  J. P. Djajadiningrat,et al.  Disintermediating the PC: a product centric view on Web 2.0 , 2007, DPPI.

[77]  Caroline Hummels,et al.  The aesthetics of the impossible , 2007 .

[78]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[79]  Andrew Keen,et al.  The Cult of the Amateur: How blogs, MySpace, YouTube, and the rest of today's user-generated media are destroying our economy, our culture, and our values , 2007 .

[80]  Hiroshi Ishii,et al.  Tangible bits: beyond pixels , 2008, TEI.

[81]  John Zimmerman,et al.  The Role of Design Artifacts in Design Theory Construction , 2008 .

[82]  Joydeep Srivastava,et al.  Monopoly money: the effect of payment coupling and form on spending behavior. , 2008, Journal of experimental psychology. Applied.

[83]  Yoram Eshet,et al.  Back to the Future: An Historical Perspective on the Pendulum-Like Changes in Literacy , 2009, Minds and Machines.

[84]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[85]  Lei da Chen,et al.  A model of consumer acceptance of mobile payment , 2008, Int. J. Mob. Commun..

[86]  Philip Ross,et al.  Ethics and aesthetics in intelligent product and system design , 2008 .

[87]  Dan Saffer,et al.  Designing for Interaction: Creating Innovative Applications and Devices , 2009 .

[88]  Hanna Landin.  Anxiety and trust and other expressions of interaction , 2009 .

[89]  Robert B. Johnston,et al.  Making ubiquitous computing available , 2009, CACM.

[90]  Bill Buxton,et al.  Multi-Touch Systems that I Have Known and Loved , 2009 .

[91]  Eva Hornecker,et al.  Of pages and paddles: Children's expectations and mistaken interactions with physical-digital tools , 2009, Interact. Comput..

[92]  Philip Ross,et al.  Designing behavior in interaction : using aesthetic experience as a mechanism for design , 2010 .

[93]  Sarah Diefenbach,et al.  Needs, affect, and interactive products - Facets of user experience , 2010, Interact. Comput..

[94]  Marc Hassenzahl,et al.  The Inference of Perceived Usability From Beauty , 2010, Hum. Comput. Interact..

[95]  Daniel Fällman.  Desktop Computing as Paradigm : Hidden Assumptions that Suppress Mobile Information Technology , 2010 .

[96]  John Zimmerman,et al.  An analysis and critique of Research through Design: towards a formalization of a research approach , 2010, Conference on Designing Interactive Systems.

[97]  Stephan Wensveen,et al.  Aesthetic Interaction: A Framework , 2010, Design Issues.

[98]  Tomas Sokoler,et al.  A Material Strategy : Exploring Material Properties of Computers , 2010 .

[99]  John Zimmerman,et al.  Teenagers and their virtual possessions: design opportunities and issues , 2011, CHI.

[100]  Scott R. Klemmer,et al.  Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology , 2011, UIST 2011.

[101]  John David Ebert.  The New Media Invasion: Digital Technologies and the World They Unmake , 2011 .

[102]  Lars Hallnäs,et al.  On the foundations of interaction design aesthetics: Revisiting the notions of form and expression , 2011 .

[103]  S. Murthy,et al.  Less is more… (more or less…). , 2011, The Journal of thoracic and cardiovascular surgery.

[104]  P. Magaudda.  When materiality ‘bites back’: Digital music consumption practices in the age of dematerialization , 2011 .

[105]  Jeremy R. Cooperstock,et al.  To Virtualize or Not? The Importance of Physical and Virtual Components in Augmented Reality Board Games , 2011, ICEC.

[106]  Peter-Paul Verbeek,et al.  Moralizing Technology: Understanding and Designing the Morality of Things , 2011 .

[107]  John Bowers,et al.  The logic of annotated portfolios: communicating the value of 'research through design' , 2012, DIS '12.

[108]  Hiroshi Ishii,et al.  Radical atoms: beyond tangible bits, toward transformable materials , 2012, INTR.

[109]  Miguel Bruns Alonso,et al.  How to design for transformation of behavior through interactive materiality , 2012, NordiCHI.

[110]  Caroline Hummels,et al.  Hard Cash in a Dematerialized World , 2012 .

[111]  Timo Partala,et al.  Understanding the most satisfying and unsatisfying user experiences: Emotions, psychological needs, and context , 2012, Interact. Comput..

[112]  Tobias Schwarz,et al.  Blended Interaction : Toward a Framework for the Design of Interactive Spaces , 2012, AVI 2012.

[113]  William W. Gaver.  What should we expect from research through design? , 2012, CHI.

[114]  Caroline Hummels,et al.  Radical clashes: what tangible interaction is made of , 2013, TEI '13.

[115]  V. Dijk.  Creating traces, sharing insight : explorations in embodied cognition design , 2013 .

[116]  Caroline Hummels,et al.  Matter of transformation: designing an alternative tomorrow inspired by phenomenology , 2013, INTR.

[117]  M. Hassenzahl,et al.  Designing Moments of Meaning and Pleasure. Experience Design and Happiness , 2013 .

[118]  R. Belk.  Extended Self in a Digital World , 2013 .

[119]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[120]  Sarah Diefenbach,et al.  Exploring relationships between interaction attributes and experience , 2013, DPPI.

[121]  Guido De Grande,et al.  Designing experienceable systems by using microcontroller based platforms , 2013 .

[122]  Muriel Zimmerman,et al.  Design Research Through Practice: From the Lab, Field, and Showroom , 2011, IEEE Transactions on Professional Communication.

[123]  Anna Vallgårda,et al.  Giving form to computational things: developing a practice of interaction design , 2014, Personal and Ubiquitous Computing.

[124]  Sarah Diefenbach,et al.  An interaction vocabulary. describing the how of interaction. , 2013, CHI Extended Abstracts.

[125]  Erik Stolterman,et al.  What makes a prototype novel?: a knowledge contribution concern for interaction design research , 2014, NordiCHI.

[126]  Sarah Diefenbach,et al.  Aesthetics of interaction: a literature synthesis , 2014, NordiCHI.

[127]  Joep W. Frens,et al.  Interactive demo of an experimental payment terminal , 2014 .

[128]  Joep W. Frens,et al.  Advanced cardboard modeling: exploring the aesthetics of the third way , 2014, TEI '14.

[129]  Lola Hernández,et al.  Cash versus Debit Card: The Role of Budget Control , 2014 .

[130]  Sarah Diefenbach,et al.  The 'hedonic' in human-computer interaction: history, contributions, and future research directions , 2014, Conference on Designing Interactive Systems.

[131]  Hiroshi Ishii,et al.  Shape Displays: Spatial Interaction with Dynamic Physical Form , 2015, IEEE Computer Graphics and Applications.

[132]  Caroline Hummels,et al.  Seven Principles to Design for Embodied Sensemaking , 2015, TEI.

[133]  Steven Kyffin,et al.  Navigating the Innovation Matrix : An Approach to Design-led Innovation , 2022 .

[134]  PIBA-DIBA or How to Blend the Digital with the Physical , .