Smartwatch in vivo

In recent years, the smartwatch has returned as a form factor for mobile computing with some success. Yet it is not clear how smartwatches are used and integrated into everyday life differently from mobile phones. For this paper, we used wearable cameras to record twelve participants' daily use of smartwatches, collecting and analysing incidents where watches were used from over 34 days of user recording. This allows us to analyse in detail 1009 watch uses. Using the watch as a timepiece was the most common use, making up 50% of interactions, but only 14% of total watch usage time. The videos also let us examine why and how smartwatches are used for activity tracking, notifications, and in combination with smartphones. In discussion, we return to a key question in the study of mobile devices: how are smartwatches integrated into everyday life, in both the actions that we take and the social interactions we are part of?

[1]  Kenton O'Hara,et al.  Dealing with mobility: understanding access anytime, anywhere , 2001, TCHI.

[2]  Faria Sana,et al.  Laptop multitasking hinders classroom learning for both users and nearby peers , 2013, Comput. Educ..

[3]  Eric Horvitz,et al.  Disruption and recovery of computing tasks: field study, analysis, and directions , 2007, CHI.

[4]  Andrew K. Przybylski,et al.  Can you connect with me now? How the presence of mobile communication technology influences face-to-face conversation quality , 2013 .

[5]  Raquel Benbunan-Fich,et al.  Self-interruptions in discretionary multitasking , 2013, Comput. Hum. Behav..

[6]  Patrick Baudisch,et al.  The generalized perceived input point model and how to double touch accuracy by extracting fingerprints , 2010, CHI.

[7]  Meredith E. David,et al.  My life has become a major distraction from my cell phone: Partner phubbing and relationship satisfaction among romantic partners , 2016, Comput. Hum. Behav..

[8]  Dirk Wenig,et al.  HoverZoom: making on-screen keyboards more accessible , 2014, CHI Extended Abstracts.

[9]  Benjamin B. Bederson,et al.  AppLens and launchTile: two designs for one-handed thumb use on small devices , 2005, CHI.

[10]  Geehyuk Lee,et al.  SplitBoard: A Simple Split Soft Keyboard for Wristwatch-sized Touch Screens , 2015, CHI.

[11]  Deborah A. Newton,et al.  Technology in Action , 2013 .

[12]  Mary Czerwinski,et al.  Instant Messaging and Interruption: Influence of Task Type on Performance , 2000 .

[13]  James Baker,et al.  A historical perspective of speech recognition , 2014, CACM.

[14]  Kenton O'Hara,et al.  Everyday dwelling with WhatsApp , 2014, CSCW.

[15]  Kent Lyons,et al.  The Multiple Dispositions of On-Body and Wearable Devices , 2014, IEEE Pervasive Computing.

[16]  Marcus Sanchez Svensson,et al.  Configuring Awareness , 2002, Computer Supported Cooperative Work (CSCW).

[17]  Kenton O'Hara,et al.  Understanding the materiality of writing from multiple sources , 2002, Int. J. Hum. Comput. Stud..

[18]  Phoebe Sengers,et al.  "I lie to myself that i have freedom in my own schedule": productivity tools and experiences of busyness , 2011, CHI.

[19]  Barry A. T. Brown,et al.  100 days of iPhone use: understanding the details of mobile device use , 2014, MobileHCI '14.

[20]  Martin Pielot,et al.  An in-situ study of mobile phone notifications , 2014, MobileHCI '14.

[21]  Michael Rohs,et al.  HoverFlow: expanding the design space of around-device interaction , 2009, Mobile HCI.

[22]  Hagen Soltau,et al.  On the influence of hyperarticulated speech on recognition performance , 1998, ICSLP.

[23]  Eric Horvitz,et al.  RightSPOT: A Novel Sense of Location for a Smart Personal Object , 2003, UbiComp.

[24]  Barry A. T. Brown,et al.  Searchable Objects: Search in Everyday Conversation , 2015, CSCW.

[25]  Stéphane Huot,et al.  TapTap and MagStick: improving one-handed target acquisition on small touch-screens , 2008, AVI '08.

[26]  Oskar Juhlin,et al.  Digitizing fashion , 2015, Interactions.

[27]  Ian Oakley,et al.  Interaction on the edge: offset sensing for small devices , 2014, CHI.

[28]  Kent Lyons,et al.  What can a dumb watch teach a smartwatch?: informing the design of smartwatches , 2015, SEMWEB.

[29]  Blockin.  Towards High Quality Text Entry on Smartwatches , 2014 .

[30]  Niels Taatgen,et al.  What Makes Interruptions Disruptive?: A Process-Model Account of the Effects of the Problem State Bottleneck on Task Interruption and Resumption , 2015, CHI.

[31]  Tiina Keisanen,et al.  Objects as Tools for Talk , 2014 .

[32]  Tero Karppi,et al.  Our metrics, ourselves: A hundred years of self-tracking from the weight scale to the wrist wearable device , 2015 .

[33]  Benjamin B. Bederson,et al.  Target size study for one-handed thumb use on small touchscreen devices , 2006, Mobile HCI.

[34]  Dennis B. Beringer.  Caculator Watches as Data Entry Devices: The Fundamental Things Apply as Time Goes by , 1984 .

[35]  Birsen Donmez,et al.  Smartwatches vs. smartphones: a preliminary report of driver behavior and perceived risk while responding to notifications , 2015, AutomotiveUI.

[36]  Marta E. Cecchinato,et al.  Smartwatches: the Good, the Bad and the Ugly? , 2015, CHI Extended Abstracts.

[37]  Hyeonjoong Cho,et al.  A text entry technique for wrist-worn watches with tiny touchscreens , 2014, UIST'14 Adjunct.

[38]  Tero Jokela,et al.  A Diary Study on Combining Multiple Information Devices in Everyday Activities and Tasks , 2015, CHI.

[39]  Amy Ogan,et al.  ZoomBoard: a diminutive qwerty soft keyboard using iterative zooming for ultra-small devices , 2013, CHI.

[40]  Antonio Krüger,et al.  Back to the app: the costs of mobile application interruptions , 2012, Mobile HCI.

[41]  Blaine A. Price,et al.  Wearables: has the age of smartwatches finally arrived? , 2015, Commun. ACM.

[42]  Marina Jirotka,et al.  The Case of the Disappearing Ox: Seeing Through Digital Images to an Analysis of Ancient Texts , 2010, CHI 2010.

[43]  L. Mumford.  Technics and Civilization , 1934, Nature.

[44]  Barry A. T. Brown,et al.  From in the wild to in vivo: Video Analysis of Mobile Device Use , 2015, MobileHCI.

[45]  Xinyu Zhang,et al.  Ubiquitous keyboard for small mobile devices: harnessing multipath fading for fine-grained keystroke localization , 2014, MobiSys.

[46]  Alexander H. Waibel,et al.  Interactive recovery from speech recognition errors in speech user interfaces , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[47]  Stephen J. Morrissey,et al.  Reviews of Human Factors and Ergonomics , 2008 .

[48]  Gierad Laput,et al.  Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click , 2014, CHI.

[49]  Wei-Hung Chen,et al.  Blowatch: Blowable and Hands-free Interaction for Smartwatches , 2015, CHI Extended Abstracts.

[50]  Jaime Teevan,et al.  WearWrite: Orchestrating the Crowd to Complete Complex Tasks from Wearables , 2015, UIST.

[51]  Mark T. Smith.  Reconciling ICT and Wearable Design: Ten Lessons from Working with Swatch , 2007 .

[52]  Johannes Schöning,et al.  WatchMe: A Novel Input Method Combining a Smartwatch and Bimanual Interaction , 2015, CHI Extended Abstracts.

[53]  Kenton O'Hara,et al.  Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services , 2012 .

[54]  G Salvendy,et al.  Microbreak length, performance, and stress in a data entry task. , 1989, Ergonomics.

[55]  Antonio J. Acosta,et al.  Integrated Circuit Design. Power and Timing Modeling, Optimization and Simulation , 2002, Lecture Notes in Computer Science.

[56]  C Kendrick,et al.  On the autobiography of Malcolm X. , 1971, Journal of the National Medical Association.

[57]  Patrick Baudisch,et al.  Understanding touch , 2011, CHI.

[58]  Mark D. Dunlop,et al.  Text Input on a Smart Watch , 2014, IEEE Pervasive Computing.

[59]  S. Ceci,et al.  "Don't forget to take the cupcakes out of the oven": prospective memory, strategic time-monitoring, and context. , 1985, Child development.

[60]  Patrick Baudisch,et al.  Back-of-device interaction allows creating very small touch devices , 2009, CHI.

[61]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[62]  Roope Raisamo,et al.  Glance Awareness and Gaze Interaction in Smartwatches , 2015, CHI Extended Abstracts.

[63]  M. Life.  iPhone in vivo : video analysis of mobile device use , 2013 .

[64]  Niels Henze,et al.  100,000,000 taps: analysis and improvement of touch performance in the large , 2011, Mobile HCI.

[65]  Anne E. Trefethen,et al.  The Data Deluge: An e-Science Perspective , 2003 .

[66]  Melanie Swan,et al.  Sensor Mania! The Internet of Things, Wearable Computing, Objective Metrics, and the Quantified Self 2.0 , 2012, J. Sens. Actuator Networks.

[67]  Frank Bentley,et al.  "It's kind of like an extra screen for my phone": Understanding Everyday Uses of Consumer Smart Watches , 2015, CHI Extended Abstracts.

[68]  Christian Piguet.  The First Quartz Electronic Watch , 2002, PATMOS.

[69]  Thomas L. Martin,et al.  Time and time again: parallels in the development of the watch and the wearable computer , 2002, Proceedings. Sixth International Symposium on Wearable Computers,.

[70]  Peng Dai,et al.  Inserting Micro-Breaks into Crowdsourcing Workflows , 2013, HCOMP.

[71]  C. Heath,et al.  Technology in Action: ‘Interaction’ with computers in architecture , 2000 .