Creating e-shopping multisensory flow experience through augmented-reality interactive technology

Purpose Drawing on virtual liminoid theory, the purpose of this paper is to examine factors that induce a multisensory flow experience in an e-shopping context through the use of augmented-reality interactive technology (ARIT). Design/methodology/approach To validate the research framework, a task-based laboratory study was performed. Participants were recruited through a snowball e-mail method and requested to freely and independently use ARIT for clothes fitting in the laboratory, after which they completed a questionnaire; 336 valid responses were received. Findings Empirical results revealed that three decorating psychological states (sense of body ownership, sense of ownership control, and self-explorative engagement) directly induced a multisensory flow experience. Furthermore, two multisensory factors (sense of self-location and haptic imagery) mediated the multisensory flow experience through these three decorating psychological states. Practical implications Consumers not only rely on generating self-display for optimal fitting in virtual avatar decoration in an e-shopping context but also concentrate more on expression and control of self-body. As consumers’ decorating psychological states require an ideal form of self-expression, a high degree of autonomy in exploring self-decoration options will create more value for consumers. Considering that expressing and controlling the self-body in addition to self-explorative engagement in virtual avatar decoration will trigger the flow experience in an e-shopping context, increasing the use of multisensory ARIT to trigger decorating psychological states in e-shopping contexts is highly recommended. Originality/value In this study, a relationship was constructed among virtual liminoid theory, flow theory, and multisensory technology, and an integrated conceptual framework was developed for the relationship between decorating psychological states and multisensory flow experience.

[1]  James K. Beggan.  On the social nature of nonsocial perception: The mere ownership effect. , 1992 .

[2]  R. Belk.  Possessions and the Extended Self , 1988 .

[3]  Jesse Fox,et al.  Persuasive avatars: The effects of customizing a virtual salesperson's appearance on brand liking and purchase intentions , 2015, Int. J. Hum. Comput. Stud..

[4]  Jiyeon Kim,et al.  Sensory enabling technology acceptance model (SE‐TAM): A multiple‐group structural model comparison , 2008 .

[5]  Valeria I. Petkova,et al.  The Perspective Matters! Multisensory Integration in Ego-Centric Reference Frames Determines Full-Body Ownership , 2011, Front. Psychology.

[6]  Alexander E. Voiskounsky,et al.  Playing Online Games: Flow Experience , 2004, PsychNology J..

[7]  I. Altman,et al.  Privacy regulation, territorial displays, and effectiveness of individual functioning. , 1980 .

[8]  Wynne W. Chin,et al.  Structural equation modeling analysis with small samples using partial least squares , 1999 .

[9]  P. Haggard,et al.  Having a body versus moving your body: How agency structures body-ownership , 2006, Consciousness and Cognition.

[10]  Yongxia Skadberg,et al.  Visitors' flow experience while browsing a Web site: its measurement, contributing factors and consequences , 2004, Comput. Hum. Behav..

[11]  Mo Adam Mahmood,et al.  On-line Shopping Behavior: Cross-Country Empirical Research , 2004, Int. J. Electron. Commer..

[12]  Michael J. Singer,et al.  The Factor Structure of the Presence Questionnaire , 2005, Presence: Teleoperators & Virtual Environments.

[13]  Scott G. Dacko.  Enabling smart retail settings via mobile augmented reality shopping apps , 2017 .

[14]  Hong-Youl Ha,et al.  A new understanding of satisfaction model in e-re-purchase situation , 2010 .

[15]  Thomas Mussweiler,et al.  The Effects of Thin and Heavy Media Images on Overweight and Underweight Consumers: Social Comparison Processes and Behavioral Implications , 2010 .

[16]  Ernst Prelinger,et al.  Extension and Structure of the Self , 1959 .

[17]  K. Hiraki,et al.  Rubber Hand Illusion under Delayed Visual Feedback , 2009, PloS one.

[18]  Nikolaus Franke,et al.  Complementing Mass Customization Toolkits with User Communities: How Peer Input Improves Customer Self‐Design* , 2008 .

[19]  Belén Mesurado,et al.  Engagement, Flow, Self-Efficacy, and Eustress of University Students: A Cross-National Comparison Between the Philippines and Argentina , 2016, The Journal of psychology.

[20]  H. Ehrsson,et al.  Moving a Rubber Hand that Feels Like Your Own: A Dissociation of Ownership and Agency , 2012, Front. Hum. Neurosci..

[21]  O. Blanke,et al.  Spatial aspects of bodily self-consciousness , 2009, Consciousness and Cognition.

[22]  Yoonhyuk Jung,et al.  Understanding the Role of Sense of Presence and Perceived Autonomy in Users' Continued Use of Social Virtual Worlds , 2011, J. Comput. Mediat. Commun..

[23]  Norbert Schwarz,et al.  I Like Your Product When I like My Photo: Misattribution Using Interactive Virtual Mirrors , 2012 .

[24]  Ana Javornik,et al.  Augmented reality: Research agenda for studying the impact of its media characteristics on consumer behaviour , 2016 .

[25]  Scott T. Allison,et al.  Possession enhancement in an interpersonal context: An extension of the mere ownership effect , 1999 .

[26]  J. Bargh.  Attention and Automaticity in the Processing of Self-Relevant Information , 1982 .

[27]  J. L. Pierce,et al.  The State of Psychological Ownership: Integrating and Extending a Century of Research , 2003 .

[28]  Yoonhyuk Jung,et al.  Understanding consumption in social virtual worlds: A sensemaking perspective on the consumption of virtual goods , 2014 .

[29]  Jari Salo,et al.  Why do teens spend real money in virtual worlds? A consumption values and developmental psychology perspective on virtual consumption , 2015, Int. J. Inf. Manag..

[30]  Ana Javornik,et al.  ‘It’s an illusion, but it looks real!’ Consumer affective, cognitive and behavioural responses to augmented reality applications , 2016 .

[31]  T. Metzinger,et al.  Full-body illusions and minimal phenomenal selfhood , 2009, Trends in Cognitive Sciences.

[32]  David L. Mothersbaugh,et al.  The Effect of Online versus Offline Retailer-Brand Image Incongruity on the Flow Experience , 2015 .

[33]  C. N. Macrae,et al.  Mike or me? Self-recognition in a split-brain patient , 2002, Nature Neuroscience.

[34]  James C. Spohrer,et al.  Developing a framework to improve virtual shopping in digital malls with intelligent self-service systems , 2014 .

[35]  Xi Chen,et al.  Factors Influencing Consumption Experience of Mobile Commerce: a Study from Experiential View , 2012, Internet Res..

[36]  Russell W. Belk,et al.  Digital consumption and the extended self , 2014 .

[37]  R L Klatzky,et al.  Imagined haptic exploration in judgments of object properties. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[38]  Sylvain Senecal,et al.  Whether and How Virtual Try-On Influences Consumer Responses to an Apparel Web Site , 2012, Int. J. Electron. Commer..

[39]  S. Forsythe,et al.  Adoption of Virtual Try-on technology for online apparel shopping , 2008 .

[40]  Debra Trampe,et al.  The Self-Activation Effect of Advertisements: Ads Can Affect Whether and How Consumers Think about the Self , 2011 .

[41]  Anja Bechmann,et al.  Mapping actor roles in social media: Different perspectives on value creation in theories of user participation , 2013, New Media Soc..

[42]  Ting-Jui Chou,et al.  The Role of Flow Experience in Cyber-Game Addiction , 2003, Cyberpsychology Behav. Soc. Netw..

[43]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[44]  Weng Marc Lim.  Antecedents and consequences of e-shopping: an integrated model , 2015, Internet Res..

[45]  P. Julien,et al.  Competitive Strategy and Performance of Exporting SMEs: An Empirical Investigation of the Impact of Their Export Information Search and Competencies , 2003 .

[46]  Tseng-Lung Huang,et al.  USING AUGMENTED REALITY TO REINFORCE VIVID MEMORIES AND PRODUCE A DIGITAL INTERACTIVE EXPERIENCE , 2015 .

[47]  Julio Jiménez,et al.  Adoption vs acceptance of e‐commerce: two different decisions , 2009 .

[48]  Jacques Nantel,et al.  My virtual model: Virtual reality comes into fashion , 2004 .

[49]  Hsi-Peng Lu,et al.  The role of Internet addiction in online game loyalty: an exploratory study , 2008, Internet Res..

[50]  Mutaz M. Al-Debei,et al.  Consumer attitudes towards online shopping: The effects of trust, perceived benefits, and perceived web quality , 2015, Internet Res..

[51]  P. Benson,et al.  Towards a functional neuroanatomy of self processing: effects of faces and words. , 2000, Brain research. Cognitive brain research.

[52]  Frank Huber,et al.  Kausalmodellierung mit partial least squares : eine anwendungsorientierte Einführung , 2007 .

[53]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[54]  J. Webster,et al.  The Dimensionality and Correlates of Flow in Human-Computer Interactions. , 1993 .

[55]  Susan Rose,et al.  Online customer experience in e-retailing: an empirical model of antecedents and outcomes , 2012 .

[56]  Marko Sarstedt,et al.  Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research , 2014 .

[57]  F. Sultan,et al.  Are the Drivers and Role of Online Trust the Same for All Web Sites and Consumers? A Large-Scale Exploratory Empirical Study , 2005 .

[58]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[59]  Seung-A. Annie Jin,et al.  Avatars Mirroring the Actual Self versus Projecting the Ideal Self: The Effects of Self-Priming on Interactivity and Immersion in an Exergame, Wii Fit , 2009, Cyberpsychology Behav. Soc. Netw..

[60]  Marjolein P. M. Kammers,et al.  What is embodiment? A psychometric approach , 2008, Cognition.

[61]  Ju-Young M. Kang.  Augmented reality and motion capture apparel e-shopping values and usage intention , 2014 .

[62]  Dennis L. Hoffman,et al.  Marketing in Hypermedia Computer-Mediated Environments : Conceptual Foundations 1 ) , 1998 .

[63]  Marko Sarstedt,et al.  PLS-SEM: Indeed a Silver Bullet , 2011 .

[64]  C. N. Macrae,et al.  Finding the Self? An Event-Related fMRI Study , 2002, Journal of Cognitive Neuroscience.

[65]  Tseng-Lung Huang,et al.  Formation of augmented-reality interactive technology's persuasive effects from the perspective of experiential value , 2014, Internet Res..

[66]  M. Slater,et al.  Multisensory Stimulation Can Induce an Illusion of Larger Belly Size in Immersive Virtual Reality , 2011, PloS one.

[67]  Lynn Dailey.  Navigational web atmospherics Explaining the influence of restrictive navigation cues , 2004 .

[68]  Sheng-Chieh Huang,et al.  A private versus a public space: Anonymity and buying decorative symbolic goods for avatars in a virtual world , 2012, Comput. Hum. Behav..

[69]  Yoonhyuk Jung,et al.  Virtual goods, real goals: Exploring means-end goal structures of consumers in social virtual worlds , 2014, Inf. Manag..

[70]  K. Vogeley,et al.  The “sense of agency” and its underlying cognitive and neural mechanisms , 2008, Consciousness and Cognition.

[71]  Ioannis Pachoulakis,et al.  AUGMENTED REALITY PLATFORMS FOR VIRTUAL FITTING ROOMS , 2012 .

[72]  Michel Tenenhaus,et al.  PLS path modeling , 2005, Comput. Stat. Data Anal..

[73]  Rose Sebastianelli,et al.  The relative importance of e-tailer website attributes on the likelihood of online purchase , 2015, Internet Res..

[74]  Joann Peck,et al.  In Search of a Surrogate for Touch: The Effect of Haptic Imagery on Perceived Ownership , 2013 .

[75]  Yvonne de Kort,et al.  Is This My Hand I See Before Me? The Rubber Hand Illusion in Reality, Virtual Reality, and Mixed Reality , 2006, PRESENCE: Teleoperators and Virtual Environments.

[76]  Charles H. Noble,et al.  Exploring the relationships among liminal transitions, symbolic consumption, and the extended self , 1997 .

[77]  S. Deshpande,et al.  Task Characteristics and the Experience of Optimal Flow in Human—Computer Interaction , 1994 .

[78]  Tino Fenech,et al.  Web retailing adoption: exploring the nature of internet users Web retailing behaviour , 2003 .

[79]  Nikolaus Franke,et al.  The "I Designed It Myself" Effect in Mass Customization , 2010, Manag. Sci..

[80]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[81]  M. Csíkszentmihályi.  Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[82]  N. Mandel,et al.  Positive and Negative Media Image Effects on the Self , 2006 .

[83]  A. Paivio.  Perceptual comparisons through the mind’s eye , 1975, Memory & cognition.

[84]  Sonia Livingstone,et al.  Taking risky opportunities in youthful content creation: teenagers' use of social networking sites for intimacy, privacy and self-expression , 2008, New Media Soc..

[85]  Rudolf R. Sinkovics,et al.  The Use of Partial Least Squares Path Modeling in International Marketing , 2009 .