The Design of Social Drones: A Review of Studies on Autonomous Flyers in Inhabited Environments

The design space of social drones, where autonomous flyers operate in close proximity to human users or bystanders, is distinct from use cases involving a remote human operator and/or an uninhabited environment; and warrants foregrounding human-centered design concerns. Recently, research on social drones has followed a trend of rapid growth. This paper consolidates the current state of the art in human-centered design knowledge about social drones through a review of relevant studies, scaffolded by a descriptive framework of design knowledge creation. Our analysis identified three high-level themes that sketch out knowledge clusters in the literature, and twelve design concerns which unpack how various dimensions of drone aesthetics and behavior relate to pertinent human responses. These results have the potential to inform and expedite future research and practice, by supporting readers in defining and situating their future contributions. The materials and results of our analysis are also published in an open online repository that intends to serve as a living hub for a community of researchers and designers working with social drones.

[1]  Jürgen Scheible,et al.  DroneCAST: towards a programming toolkit for airborne multimedia display applications , 2017, MobileHCI.

[2]  Morten Fjeld,et al.  Social Drone Companion for the Home Environment: a User-Centric Exploration , 2017, HAI.

[3]  Morten Fjeld,et al.  How would you gesture navigate a drone?: a user-centered approach to control a drone , 2016, MindTrek.

[4]  Markus Funk Human-drone interaction , 2018, Interactions.

[5]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[6]  Wataru Yamada,et al.  iSphere: Self-Luminous Spherical Drone Display , 2017, UIST.

[7]  Emilia I. Barakova,et al.  Boxing against drones: Drones in sports education , 2016, IDC.

[8]  Yücel Yemez,et al.  User Interface Paradigms for Visually Authoring Mid-Air Gestures: A Survey and a Provocation , 2014, EGMI@EICS.

[9]  Joseph J. LaViola,et al.  Exploring 3d gesture metaphors for interaction with unmanned aerial vehicles , 2013, IUI '13.

[10]  Markus Funk,et al.  Tactile Drones - Providing Immersive Tactile Feedback in Virtual Reality through Quadcopters , 2017, CHI Extended Abstracts.

[11]  Albrecht Schmidt,et al.  Midair displays: exploring the concept of free-floating public displays , 2014, CHI Extended Abstracts.

[12]  Markus Funk,et al.  Quadcopter-Projected In-Situ Navigation Cues for Improved Location Awareness , 2018, CHI.

[13]  Andreas Butz,et al.  Empowerment in HCI - A Survey and Framework , 2018, CHI.

[14]  Roel Vertegaal,et al.  BitDrones: Towards Levitating Programmable Matter Using Interactive 3D Quadcopter Displays , 2015, UIST.

[15]  Jeonghye Han,et al.  Social Proxemics of Human-Drone Interaction: Flying Altitude and Size , 2018, HRI.

[16]  Kang-Ping Liu,et al.  Exploring interaction modalities for a selfie drone , 2015, SIGGRAPH Asia Posters.

[17]  Justin Manweiler,et al.  Privacy and Fear in the Drone Era: Preserving Privacy Expectations Through Technology , 2018, CHI Extended Abstracts.

[18]  Jinwoo Kim,et al.  Getting home safely with drone , 2016, UbiComp Adjunct.

[19]  Jangwon Lee,et al.  Human-Drone Interaction: Drone Delivery & Services for Social Events , 2018, Conference on Designing Interactive Systems.

[20]  James A. Landay,et al.  Aeroquake: Drone Augmented Dance , 2018, Conference on Designing Interactive Systems.

[21]  Roel Vertegaal,et al.  GridDrones: A Self-Levitating Physical Voxel Lattice for 3D Surface Deformations , 2018, CHI Extended Abstracts.

[22]  Kiyoshi Kiyokawa,et al.  A Non-grounded and Encountered-type Haptic Display Using a Drone , 2016, SUI.

[23]  Ehud Sharlin,et al.  Collocated interaction with flying robots , 2011, 2011 RO-MAN.

[24]  Bilge Mutlu,et al.  Communication of Intent in Assistive Free Flyers , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[25]  Florian Alt,et al.  GazeDrone: Mobile Eye-Based Interaction in Public Space Without Augmenting the User , 2018, DroNet@MobiSys.

[26]  Roel Vertegaal,et al.  s: Towa ctive Se , 2022 .

[27]  E. Hall,et al.  The Hidden Dimension , 1970 .

[28]  Kamin Whitehouse,et al.  Reactive Control of Autonomous Drones , 2016, MobiSys.

[29]  James A. Landay,et al.  Drone Near Me , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[30]  Takashi Suehiro,et al.  Action elements of emotional body expressions for flying robots , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[31]  Michael A. Goodrich,et al.  Supporting wilderness search and rescue using a camera‐equipped mini UAV , 2008, J. Field Robotics.

[32]  Terrence Fong,et al.  Smart SPHERES: A Telerobotic Free-Flyer for Intravehicular Activities in Space , 2013 .

[33]  Morten Fjeld,et al.  A Drone Agent to Support a Clean Environment , 2015, HAI.

[34]  Yücel Yemez,et al.  Hotspotizer: end-user authoring of mid-air gestural interactions , 2014, NordiCHI.

[35]  Javier Irizarry,et al.  Usability assessment of drone technology as safety inspection tools , 2012, J. Inf. Technol. Constr..

[36]  João Marcelo X. N. Teixeira,et al.  Teleoperation Using Google Glass and AR, Drone for Structural Inspection , 2014, 2014 XVI Symposium on Virtual and Augmented Reality.

[37]  Morten Fjeld,et al.  Exploring Proxemics for Human-Drone Interaction , 2017, HAI.

[38]  Carman Neustaedter,et al.  Elevating Communication, Collaboration, and Shared Experiences in Mobile Video through Drones , 2016, Conference on Designing Interactive Systems.

[39]  Florian Mueller,et al.  Jogging with a Quadcopter , 2015, CHI.

[40]  Albrecht Schmidt,et al.  Midair Displays: Concept and First Experiences with Free-Floating Pervasive Displays , 2014, PerDis.

[41]  James A. Landay,et al.  FlyMap: Interacting with Maps Projected from a Drone , 2018, PerDis.

[42]  Mohammad Obaid,et al.  Towards Supporting Remote Cheering during Running Races with Drone Technology , 2017, CHI Extended Abstracts.

[43]  Jürgen Scheible,et al.  Displaydrone: a flying robot based interactive display , 2013, PerDis.

[44]  Andreas Butz,et al.  A Bermuda Triangle?: A Review of Method Application and Triangulation in User Experience Evaluation , 2018, CHI.

[45]  John Zimmerman,et al.  Mapping Machine Learning Advances from HCI Research to Reveal Starting Places for Design Innovation , 2018, CHI.

[46]  Qian Wang,et al.  Power line inspection with a flying robot , 2010, 2010 1st International Conference on Applied Robotics for the Power Industry.

[47]  Martin Molina,et al.  Natural user interfaces for human-drone multi-modal interaction , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[48]  Christoph Bartneck,et al.  Stop! That is close enough. How body postures influence human-robot proximity , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[49]  Markus Funk,et al.  In-situ-displaydrone: facilitating co-located interactive experiences via a flying screen , 2016, PerDis.

[50]  Sangki Yun,et al.  Indoor Follow Me Drone , 2017, MobiSys.

[51]  Jennifer Lee,et al.  Communicating Robot Motion Intent with Augmented Reality , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[52]  Markus Funk,et al.  DroneNavigator: Using Leashed and Free-Floating Quadcopters to Navigate Visually Impaired Travelers , 2017, ASSETS.

[53]  Michael A. Goodrich,et al.  Supporting wilderness search and rescue using a camera-equipped mini UAV: Research Articles , 2008 .

[54]  Majed Al Zayer,et al.  Exploring the Use of a Drone to Guide Blind Runners , 2016, ASSETS.

[55]  Jonna Häkkilä,et al.  Investigating drone motion as pedestrian guidance , 2017, MUM.

[56]  Alvaro A. Cárdenas,et al.  Understanding Security Threats in Consumer Drones Through the Lens of the Discovery Quadcopter Family , 2017, IoT S&P@CCS.

[57]  Muhammad Abdullah,et al.  HapticDrone: An Encountered-Type Kinesthetic Haptic Interface with Controllable Force Feedback: Initial Example for 1D Haptic Feedback , 2017, UIST.

[58]  Markus Funk,et al.  DroneNavigator: Using Drones for Navigating Visually Impaired Persons , 2015, ASSETS.

[59]  Marshini Chetty,et al.  Spiders in the Sky: User Perceptions of Drones, Privacy, and Security , 2017, CHI.

[60]  James A. Landay,et al.  Drone & me: an exploration into natural human-drone interaction , 2015, UbiComp.

[61]  James A. Landay,et al.  Drone & Wo: Cultural Influences on Human-Drone Interaction Techniques , 2017, CHI.

[62]  Eirini Malliaraki Social Interaction with Drones using Human Emotion Recognition , 2018, HRI '18.

[63]  Shaowen Bardzell,et al.  How HCI talks about sexuality: discursive strategies, blind spots, and opportunities for future research , 2011, CHI.

[64]  James A. Landay,et al.  Emotion encoding in Human-Drone Interaction , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[65]  Yunus Karaca,et al.  The potential use of unmanned aircraft systems (drones) in mountain search and rescue operations , 2017, The American journal of emergency medicine.

[66]  Bilge Mutlu,et al.  Communicating Directionality in Flying Robots , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[67]  Tatsuo Nakajima,et al.  KinecDrone: enhancing somatic sensation to fly in the sky with Kinect and AR.Drone , 2014, AH.

[68]  Sebastian Magierowski,et al.  Vehicle Routing Problems for Drone Delivery , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[69]  B. Bluethmann,et al.  The Human Exploration Telerobotics project: Objectives, approach, and testing , 2012, 2012 IEEE Aerospace Conference.

[70]  Noel E. Sharkey,et al.  Death strikes from the sky: the calculus of proportionality , 2009, IEEE Technology and Society Magazine.

[71]  Phoebe Sengers,et al.  Mapping the landscape of sustainable HCI , 2010, CHI.

[72]  Markus Funk,et al.  Flyables: Exploring 3D Interaction Spaces for Levitating Tangibles , 2018, Tangible and Embedded Interaction.

[73]  Hendrik Knoche,et al.  Knowing You, Seeing Me: Investigating User Preferences in Drone-Human Acknowledgement , 2018, CHI.

[74]  Cesar Lucho,et al.  Daedalus: A sUAV for Human-Robot Interaction , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[75]  Hassan Noura,et al.  A gesture based kinect for quadrotor control , 2015, 2015 International Conference on Information and Communication Technology Research (ICTRC).

[76]  Ilsun You,et al.  Socializing Drones for Inter-Service Operability in Ultra-Dense Wireless Networks using Blockchain , 2017, MIST@CCS.