Eyecam: Revealing Relations between Humans and Sensing Devices through an Anthropomorphic Webcam

We are surrounded by sensing devices. We are accustomed to them, appreciate their benefits, and even create affective bonds and might neglect the implications they might have for our daily life. By presenting Eyecam, an anthropomorphic webcam mimicking a human eye, we challenge conventional relationships with ubiquitous sensing devices and call to re-think how sensing devices might appear and behave. Inspired by critical design, Eyecam is an exaggeration of a familiar sensing device which allows for critical reflections on its perceived functionalities and its impact on human-human and human-device relations. We identify 5 different roles Eyecam can take: Mediator, Observer, Mirror, Presence, and Agent. Contributing design fictions and thinking prompts, we allow for articulation on privacy awareness and intrusion, affect in mediated communication, agency and self-perception along with speculation on potential futures. We envision this work to contribute to a bold and responsible design of ubiquitous sensing devices.

[1]  Paul Dourish,et al.  “Resistance is futile”: reading science fiction alongside ubiquitous computing , 2014, Personal and Ubiquitous Computing.

[2]  Tony Belpaeme,et al.  Comparing Robot Embodiments in a Guided Discovery Learning Interaction with Children , 2015, Int. J. Soc. Robotics.

[3]  Roxanne Leitão,et al.  Anticipating Smart Home Security and Privacy Threats with Survivors of Intimate Partner Abuse , 2019, Conference on Designing Interactive Systems.

[4]  A. Senju,et al.  Direct gaze captures visuospatial attention , 2005 .

[5]  Joep W. Frens,et al.  Tangible products: redressing the balance between appearance and action , 2004, Personal and Ubiquitous Computing.

[6]  P. Verbeek What Things Do: Philosophical Reflections on Technology, Agency, and Design , 2005 .

[7]  Mark Blythe,et al.  Research through design fiction: narrative in real and imaginary abstracts , 2014, CHI.

[8]  A. Bandara,et al.  Open Research Online , 2020 .

[9]  A. Hamilton,et al.  The Role of Eye Gaze During Natural Social Interactions in Typical and Autistic People , 2019, Front. Psychol..

[10]  Michael S. Bernstein,et al.  Reflective physical prototyping through integrated design, test, and analysis , 2006, UIST.

[11]  Andreas Butz,et al.  Comparing Input Modalities for Peripheral Interaction: A Case Study on Peripheral Music Control , 2013, INTERACT.

[12]  David A. Wagner,et al.  Somebody's Watching Me?: Assessing the Effectiveness of Webcam Indicator Lights , 2015, CHI.

[13]  Paul Resnick,et al.  It's Creepy, But it Doesn't Bother Me , 2016, CHI.

[14]  Rainer Böhme,et al.  Users Protect Their Privacy If They Can: Determinants of Webcam Covering Behavior , 2016 .

[15]  David Knox,et al.  Using technology to control intimate partners: An exploratory study of college undergraduates , 2011, Comput. Hum. Behav..

[16]  T. Foulsham,et al.  Speaking and Listening with the Eyes: Gaze Signaling during Dyadic Interactions , 2015, PloS one.

[17]  Catherine Pelachaud,et al.  Skin-On Interfaces: A Bio-Driven Approach for Artificial Skin Design to Cover Interactive Devices , 2019, UIST.

[18]  Betti Marenko,et al.  Neo-Animism and Design , 2014 .

[19]  Alireza Sahami Shirazi,et al.  Exploiting thermal reflection for interactive systems , 2014, CHI.

[20]  Jennifer Preece,et al.  Empathy and online interpersonal trust: A fragile relationship , 2004, Behav. Inf. Technol..

[21]  Fabian Hemmert,et al.  Living interfaces: the thrifty faucet , 2009, TEI.

[22]  Eric Paulos,et al.  Making Multiple Uses of the Obscura 1C Digital Camera: Reflecting on the Design, Production, Packaging and Distribution of a Counterfunctional Device , 2015, CHI.

[23]  Susanne Boll,et al.  Are you hiding it?: usage habits of lifelogging camera wearers , 2017, MobileHCI.

[24]  Adam J. Lee,et al.  Tangible Privacy , 2020, Proc. ACM Hum. Comput. Interact..

[25]  Fabian Hemmert,et al.  Animate mobiles: proxemically reactive posture actuation as a means of relational interaction with mobile phones , 2013, TEI '13.

[26]  Tadayoshi Kohno,et al.  In situ with bystanders of augmented reality glasses: perspectives on recording and privacy-mediating technologies , 2014, CHI.

[27]  Antti Oulasvirta,et al.  Long-term effects of ubiquitous surveillance in the home , 2012, UbiComp.

[28]  Jeffrey Bardzell,et al.  Interaction criticism: An introduction to the practice , 2011, Interact. Comput..

[29]  C. P. Goodman,et al.  The Tacit Dimension , 2003 .

[30]  James Pierce,et al.  On the presentation and production of design research artifacts in HCI , 2014, Conference on Designing Interactive Systems.

[31]  Carman Neustaedter,et al.  The Design of a Context-Aware Home Media Space for Balancing Privacy and Awareness , 2003, UbiComp.

[32]  Stephen Checkoway,et al.  iSeeYou: Disabling the MacBook Webcam Indicator LED , 2014, USENIX Security Symposium.

[33]  Illah R. Nourbakhsh,et al.  The role of expressiveness and attention in human-robot interaction , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[34]  Brian Scassellati,et al.  The Physical Presence of a Robot Tutor Increases Cognitive Learning Gains , 2012, CogSci.

[35]  John Zimmerman,et al.  Critical design and critical theory: the challenge of designing for provocation , 2012, DIS '12.

[36]  Paul Strohmeier,et al.  PolySense: Augmenting Textiles with Electrical Functionality using In-Situ Polymerization , 2020, CHI.

[37]  David W. Murray,et al.  Parallel Tracking and Mapping on a camera phone , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[38]  Sara Kiesler,et al.  Social psychological aspects of computer-mediated communication , 1984 .

[39]  Shao-Kang Lo,et al.  The Nonverbal Communication Functions of Emoticons in Computer-Mediated Communication , 2008, Cyberpsychology Behav. Soc. Netw..

[40]  James Pierce,et al.  Smart Home Security Cameras and Shifting Lines of Creepiness: A Design-Led Inquiry , 2019, CHI.

[41]  Gregory D. Abowd,et al.  OptoSense: Towards Ubiquitous Self-Powered Ambient Light Sensing Surfaces , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[42]  Daniel R. Horne,et al.  The Privacy Paradox: Personal Information Disclosure Intentions versus Behaviors , 2007 .

[43]  Hui-Shyong Yeo,et al.  Project Zanzibar: A Portable and Flexible Tangible Interaction Platform , 2018, CHI.

[44]  Kimiko Ryokai,et al.  Personal laughter archives: reflection through visualization and interaction , 2020, UbiComp/ISWC Adjunct.

[45]  Elisabetta Zibetti,et al.  Towards Behavioral Objects: A Twofold Approach for a System of Notation to Design and Implement Behaviors in Non-anthropomorphic Robotic Artifacts , 2014, Dance Notations and Robot Motion.

[46]  Torben Wallbaum,et al.  Evaluating a Wearable Camera's Social Acceptability In-the-Wild , 2019, CHI Extended Abstracts.

[47]  Saskia Bakker,et al.  Introduction:framing peripheral interaction , 2016 .

[48]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[49]  Kristina Höök,et al.  Experiencing the Affective Diary , 2009, Personal and Ubiquitous Computing.

[50]  Susanne Boll,et al.  Your smart glasses' camera bothers me!: exploring opt-in and opt-out gestures for privacy mediation , 2018, NordiCHI.

[51]  Zhongmin Cai,et al.  I'm All Eyes and Ears: Exploring Effective Locators for Privacy Awareness in IoT Scenarios , 2020, CHI.

[52]  Yang Wang,et al.  Privacy Perceptions and Designs of Bystanders in Smart Homes , 2019, Proc. ACM Hum. Comput. Interact..

[53]  Susanne Boll,et al.  Beyond LED Status Lights - Design Requirements of Privacy Notices for Body-worn Cameras , 2018, TEI.

[54]  T. Foulsham,et al.  The where, what and when of gaze allocation in the lab and the natural environment , 2011, Vision Research.

[55]  Joe Marshall,et al.  Uncomfortable interactions , 2012, CHI.

[56]  Kristina Höök,et al.  Somaesthetic Appreciation Design , 2016, CHI.

[57]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[58]  Fabian Hemmert Ambient Life : Permanent Tactile Life-like Actuation as a Status Display in Mobile Phones , 2008 .

[59]  Yang Zhang,et al.  Wall++: Room-Scale Interactive and Context-Aware Sensing , 2018, CHI.

[60]  Alessandro Roncone,et al.  Physiologically Inspired Blinking Behavior for a Humanoid Robot , 2016, ICSR.

[61]  Catherine Pelachaud,et al.  Conveying Emotions Through Device-Initiated Touch , 2020, IEEE Transactions on Affective Computing.

[62]  Ivan Poupyrev,et al.  Soli , 2016, ACM Trans. Graph..

[63]  Mathias Funk,et al.  Peekaboo Cam: Designing an Observational Camera for Home Ecologies Concerning Privacy , 2019, Conference on Designing Interactive Systems.

[64]  Takanori Shibata,et al.  Living With Seal Robots—Its Sociopsychological and Physiological Influences on the Elderly at a Care House , 2007, IEEE Transactions on Robotics.

[65]  Vanessa Evers,et al.  A Simple Nod of the Head: The Effect of Minimal Robot Movements on Children's Perception of a Low-Anthropomorphic Robot , 2017, CHI.

[66]  Francisco Esteves,et al.  The Face of Wrath: Critical Features for Conveying Facial Threat , 1999 .

[67]  C. Schwabenland,et al.  Doing gender in the ‘new office’ , 2018 .

[68]  Sriram Subramanian,et al.  Is my phone alive?: a large-scale study of shape change in handheld devices using videos , 2014, CHI.

[69]  Shengdong Zhao,et al.  Considering Wake Gestures for Smart Assistant Use , 2020, CHI Extended Abstracts.

[70]  Mel Slater,et al.  The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment , 2003, CHI '03.

[71]  Richmond Y. Wong,et al.  Sensor Illumination: Exploring Design Qualities and Ethical Implications of Smart Cameras and Image/Video Analytics , 2020, CHI.

[72]  Joshua McVeigh-Schultz,et al.  AniThings: animism and heterogeneous multiplicity , 2013, CHI Extended Abstracts.

[73]  Susanne Boll,et al.  PrivacEye: privacy-preserving head-mounted eye tracking using egocentric scene image and eye movement features , 2018, ETRA.

[74]  Steve Mann,et al.  Telepointer: Hands-free completely self-contained wearable visual augmented reality without headwear and without any infrastructural reliance , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[75]  Jodi Forlizzi,et al.  "Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage , 2018, Conference on Designing Interactive Systems.

[76]  James Pierce Lamps, Curtains, Robots: 3 Scenarios for the Future of the Smart Home , 2019, Creativity & Cognition.

[77]  Josh Lovejoy The UX of AI: Using Google Clips to Understand how a Human-Centered Design Process Elevates Artificial Intelligence , 2018, AAAI Spring Symposia.

[78]  Kimiko Ryokai,et al.  Life-Affirming Biosensing in Public: Sounding Heartbeats on a Red Bench , 2019, CHI.

[79]  Jarmo Laaksolahti,et al.  Anthropomorphism - a Multi-Layered Phenomenon , 2000 .

[80]  Carman Neustaedter,et al.  Blur filtration fails to preserve privacy for home-based video conferencing , 2006, TCHI.

[81]  Catherine Pelachaud,et al.  MobiLimb: Augmenting Mobile Devices with a Robotic Limb , 2018, UIST.

[82]  Capacitivo: Contact-Based Object Recognition on Interactive Fabrics using Capacitive Sensing , 2020, UIST.

[83]  S. Linden,et al.  The Feeling of Being Watched: Do Eye Cues Elicit Negative Affect? , 2017 .

[84]  Kamil Kopecký,et al.  Misuse of web cameras to manipulate children within the so-called webcam trolling , 2016, Telematics Informatics.

[85]  Roel Vertegaal,et al.  An Evaluation of Shape Changes for Conveying Emotions , 2016, CHI.

[86]  James Pierce Roomba+Clips Cam: Exploring Unpredictable Autonomy in Everyday Smart Systems , 2020, Conference on Designing Interactive Systems.

[87]  Ivan Poupyrev,et al.  Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum , 2016, UIST.

[88]  Rainer Böhme,et al.  Webcam Covering as Planned Behavior , 2018, CHI.

[89]  Carman Neustaedter,et al.  Intimacy in long-distance relationships over video chat , 2012, CHI.

[90]  Youngwoo Park,et al.  Wrigglo: shape-changing peripheral for interpersonal mobile communication , 2014, CHI.

[91]  Lone Koefoed Hansen,et al.  Intimate Futures: Staying with the Trouble of Digital Personal Assistants through Design Fiction , 2018, Conference on Designing Interactive Systems.

[92]  Abigail Sellen,et al.  Design for Privacy in Ubiquitous Computing Environments , 1993, ECSCW.

[93]  Anthony Dunne,et al.  Speculative Everything: Design, Fiction, and Social Dreaming , 2013 .

[94]  Jelle van Dijk Post-human interaction design, yes, but cautiously , 2020, Conference on Designing Interactive Systems.

[95]  Sunny Consolvo,et al.  Living in a glass house: a survey of private moments in the home , 2011, UbiComp '11.

[96]  Ben J. A. Kröse,et al.  Products as Agents: Metaphors for Designing the Products of the IoT Age , 2017, CHI.

[97]  Florian Alt,et al.  HeartChat: Heart Rate Augmented Mobile Chat to Support Empathy and Awareness , 2017, CHI.

[98]  Da-Yuan Huang,et al.  Aarnio: Passive Kinesthetic Force Output for Foreground Interactions on an Interactive Chair , 2019, CHI.

[99]  Marion Koelle,et al.  Don't look at me that way!: Understanding User Attitudes Towards Data Glasses Usage , 2015, MobileHCI.

[100]  Carman Neustaedter,et al.  You are Being Watched: Bystanders' Perspective on the Use of Camera Devices in Public Spaces , 2016, CHI Extended Abstracts.

[101]  Brian R. Duffy,et al.  Anthropomorphism and the social robot , 2003, Robotics Auton. Syst..

[102]  Eyal Ofek,et al.  IllumiRoom: peripheral projected illusions for interactive experiences , 2013, SIGGRAPH '13.

[103]  B. Scassellati,et al.  Social eye gaze in human-robot interaction , 2017, J. Hum. Robot Interact..