Situated and mobile displays for reflection on shopping and nutritional choices

In this paper, we explore the use of peoples’ shopping data to raise awareness and to enable reflection about nutrition. In order to ground our Nutriflect approach, we conducted 125 structured interviews in grocery stores. Informed by the results of this exploratory study, we designed a system that shows a household’s collective food consumption patterns via situated displays in the home and through mobile devices in-store. The system aimed to minimize the need for manual entry of nutrition-related data by the users. To evaluate our system, we conducted a 4-week field study in eight households with 21 inhabitants and situated in-store shopping inquiries with a subset of 9 of these users, using actual shopping data from participants. In these studies, we identified issues regarding the interaction design of Internet of Things applications and explored the use of complementary distributed displays to provide tailored cues in context. The approach taken showed the potential to foster reflection about shopping and nutritional choices and for integration with people’s everyday practices.

[1]  R. Thaler,et al.  Nudge: Improving Decisions About Health, Wealth, and Happiness , 2008 .

[2]  Minna Isomursu,et al.  Experiences from interaction design for NFC applications , 2009, J. Ambient Intell. Smart Environ..

[3]  Milind R. Naphade,et al.  The dubuque water portal: evaluation of the uptake, use and impact of residential water consumption feedback , 2012, CHI.

[4]  Manfred Tscheligi,et al.  The PerCues Framework and Its Application for Sustainable Mobility , 2007, PERSUASIVE.

[5]  Hiroshi Ishii,et al.  Ambient Displays: Turning Architectural Space into an Interface between People and Digital Information , 1998, CoBuild.

[6]  Anton Gustafsson,et al.  The power-aware cord: energy awareness through ambient information display , 2005, CHI Extended Abstracts.

[7]  Rebecca E. Grinter,et al.  Characteristics of shared health reflections in a local community , 2010, CSCW '10.

[8]  Geraldine Fitzpatrick,et al.  Nutriflect: reflecting collective shopping behavior and nutrition , 2014, CHI.

[9]  Yvonne Rogers,et al.  How to nudge in Situ: designing lambent devices to deliver salient information in supermarkets , 2011, UbiComp '11.

[10]  William G. Griswold,et al.  Usability and Feasibility of PmEB: A Mobile Phone Application for Monitoring Real Time Caloric Balance , 2006, Mob. Networks Appl..

[11]  Krzysztof Z. Gajos,et al.  Platemate: crowdsourcing nutritional analysis from food photographs , 2011, UIST.

[12]  Harri Oinas-Kukkonen,et al.  A foundation for the study of behavior change support systems , 2012, Personal and Ubiquitous Computing.

[13]  Jesper Kjeldskov,et al.  Using mobile phones to support sustainability: a field study of residential electricity consumption , 2012, CHI.

[14]  Andreas Möller,et al.  MobiMed: comparing object identification techniques on smartphones , 2012, NordiCHI.

[15]  L. Festinger.  A Theory of Social Comparison Processes , 1954 .

[16]  Charles Duhigg,et al.  How Companies Learn Your Secrets , 2012 .

[17]  R. Kimokoti,et al.  Diet, the global obesity epidemic, and prevention. , 2011, Journal of the American Dietetic Association.

[18]  Albrecht Schmidt,et al.  Perci: Pervasive Service Interaction with the Internet of Things , 2009, IEEE Internet Computing.

[19]  David W. McDonald,et al.  Activity sensing in the wild: a field trial of ubifit garden , 2008, CHI.

[20]  Albrecht Schmidt,et al.  Advertising on Public Display Networks , 2012, Computer.

[21]  Gösta Samuelson,et al.  Global strategy on diet, physical activity and health , 2004 .

[22]  Jodi Forlizzi,et al.  Mining behavioral economics to design persuasive technology for healthy choices , 2011, CHI.

[23]  Jindong Tan,et al.  DietCam: Automatic dietary assessment with mobile camera phones , 2012, Pervasive Mob. Comput..

[24]  Gaetano Borriello,et al.  2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops Design and Evaluation of a Food Index-based Nutrition Diary , 2022 .

[25]  Wolf-Joachim Fischer,et al.  Food intake recognition conception for wearable devices , 2011, MobileHealth '11.

[26]  Elizabeth D. Mynatt,et al.  Displays in the Wild: Understanding the Dynamics and Evolution of a Display Ecology , 2006, Pervasive.

[27]  Manfred Tscheligi,et al.  Enhancing the Shopping Experience with Ambient Displays: A Field Study in a Retail Store , 2007, AmI.

[28]  Yvonne Rogers,et al.  When Do We Eat? An Evaluation of Food Items Input into an Electronic Food Monitoring Application , 2006, 2006 Pervasive Health Conference and Workshops.

[29]  Ellen Yi-Luen Do,et al.  MunchCrunch: a game to learn healthy-eating heuristics , 2009, IDC.

[30]  Geraldine Fitzpatrick,et al.  Creating visibility: understanding the design space for food waste , 2012, MUM.

[31]  C. M. Medaglia,et al.  A Survey about User Experience Improvement in Mobile Proximity Payment , 2012, 2012 4th International Workshop on Near Field Communication.

[32]  Philippe A. Palanque,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2014, International Conference on Human Factors in Computing Systems.

[33]  Tobie Kerridge,et al.  Threshold devices: looking out from the home , 2008, CHI.

[34]  Luís Carriço,et al.  Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services , 2010, MobileHCI 2010.

[35]  Daniel J. Wigdor.  Architecting next-generation user interfaces , 2010, AVI.

[36]  Alan J. Dix,et al.  A taxonomy for and analysis of multi-person-display ecosystems , 2009, Personal and Ubiquitous Computing.

[37]  Eric C. Larson,et al.  The design and evaluation of prototype eco-feedback displays for fixture-level water usage data , 2012, CHI.

[38]  B. J. Fogg.  The Six Most Powerful Persuasion Strategies , 2006, PERSUASIVE.

[39]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.

[40]  Silvia Lindtner,et al.  Fish'n'Steps: Encouraging Physical Activity with an Interactive Computer Game , 2006, UbiComp.

[41]  Alina Hang,et al.  Visual design of physical user interfaces for NFC-based mobile interaction , 2010, Conference on Designing Interactive Systems.

[42]  Scott Flanagan,et al.  Nudge: Improving Decisions about Health, Wealth, and Happiness , 2010 .

[43]  Vassilis Kostakos,et al.  Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems , 2008 .

[44]  Patrick Olivier,et al.  Food practices as situated action: exploring and designing for everyday food practices with households , 2013, CHI.

[45]  R. Zajonc.  SOCIAL FACILITATION. , 1965, Science.