LEADOR: A Method for End-To-End Participatory Design of Autonomous Social Robots

Participatory design (PD) has been used to good success in human-robot interaction (HRI) but typically remains limited to the early phases of development, with subsequent robot behaviours then being hardcoded by engineers or utilised in Wizard-of-Oz (WoZ) systems that rarely achieve autonomy. In this article, we present LEADOR (Led-by-Experts Automation and Design Of Robots), an end-to-end PD methodology for domain expert co-design, automation, and evaluation of social robot behaviour. This method starts with typical PD, working with the domain expert(s) to co-design the interaction specifications and state and action space of the robot. It then replaces the traditional offline programming or WoZ phase by an in situ and online teaching phase where the domain expert can live-program or teach the robot how to behave whilst being embedded in the interaction context. We point out that this live teaching phase can be best achieved by adding a learning component to a WoZ setup, which captures implicit knowledge of experts, as they intuitively respond to the dynamics of the situation. The robot then progressively learns an appropriate, expert-approved policy, ultimately leading to full autonomy, even in sensitive and/or ill-defined environments. However, LEADOR is agnostic to the exact technical approach used to facilitate this learning process. The extensive inclusion of the domain expert(s) in robot design represents established responsible innovation practice, lending credibility to the system both during the teaching phase and when operating autonomously. The combination of this expert inclusion with the focus on in situ development also means that LEADOR supports a mutual shaping approach to social robotics. We draw on two previously published, foundational works from which this (generalisable) methodology has been derived to demonstrate the feasibility and worth of this approach, provide concrete examples in its application, and identify limitations and opportunities when applying this framework in new environments.

[1]  Séverin Lemaignan,et al.  Artificial cognition for social human-robot interaction: An implementation , 2017, Artif. Intell..

[2]  Tony Belpaeme,et al.  Teaching robots social autonomy from in situ human guidance , 2019, Science Robotics.

[3]  Jerry Alan Fails,et al.  Interactive machine learning , 2003, IUI '03.

[4]  Pelle Ehn,et al.  Participation in design things , 2008, PDC.

[5]  Tony Belpaeme,et al.  SPARC: Supervised Progressively Autonomous Robot Competencies , 2015, ICSR.

[6]  Heather Draper,et al.  Care, Monitoring, and Companionship: Views on Care Robots from Older People and Their Carers , 2015, International Journal of Social Robotics.

[7]  Tone Bratteteig,et al.  Does AI make PD obsolete?: exploring challenges from artificial intelligence to participatory design , 2018, PDC.

[8]  Paul Bremner,et al.  In-Situ Learning from a Domain Expert for Real World Socially Assistive Robot Deployment , 2020, Robotics: Science and Systems.

[9]  Goldie Nejat,et al.  A focus group study on the design considerations and impressions of a socially assistive robot for long-term care , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[10]  Maartje M. A. de Graaf,et al.  Sharing a life with Harvey: Exploring the acceptance of and relationship-building with a social robot , 2015, Comput. Hum. Behav..

[11]  Jørgen Ole Bærenholdt,et al.  Design Research : Synergies from Interdisciplinary Perspectives , 2010 .

[12]  Chien-Ming Huang,et al.  PATI: a projection-based augmented table-top interface for robot programming , 2019, IUI.

[13]  Selma Sabanovic,et al.  Robots in Society, Society in Robots , 2010, Int. J. Soc. Robotics.

[14]  Paul Bremner,et al.  Effective Persuasion Strategies for Socially Assistive Robots , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Ginevra Castellano,et al.  Discovering social interaction strategies for robots from restricted-perception Wizard-of-Oz studies , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[16]  Andrea Lockerd Thomaz,et al.  Teachable robots: Understanding human teaching behavior to build more effective robot learners , 2008, Artif. Intell..

[17]  Patricia Alves-Oliveira,et al.  YOLO, a Robot for Creativity: A Co-Design Study with Children , 2017, IDC.

[18]  Jesper Simonsen,et al.  User participation in implementation , 2012, PDC '12.

[19]  Paul Baxter,et al.  Child-robot interaction in the wild: advice to the aspiring experimenter , 2011, ICMI '11.

[20]  Jesper Simonsen,et al.  Design Research : Synergies from Interdisciplinary Perspectives , 2010 .

[21]  Takayuki Kanda,et al.  Data-Driven HRI: Learning Social Behaviors by Example From Human–Human Interaction , 2016, IEEE Transactions on Robotics.

[22]  Maya Cakmak,et al.  Code3: A System for End-to-End Programming of Mobile Manipulator Robots for Novices and Experts , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[23]  Ingo Lütkebohle,et al.  A robot as fitness companion: Towards an interactive action-based motivation model , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[24]  Paul Bremner,et al.  Social Robots for Engagement in Rehabilitative Therapies: Design Implications from a Study with Therapists , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[25]  Jenay M. Beer,et al.  The domesticated robot: Design guidelines for assisting older adults to age in place , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[26]  Ya-Huei Wu,et al.  Designing robots for the elderly: appearance issue and beyond. , 2012, Archives of gerontology and geriatrics.

[27]  Cynthia Breazeal,et al.  Learning Social Interaction from the Wizard: A Proposal , 2014, AAAI 2014.

[28]  Elin A. Björling,et al.  Exploring Teens as Robot Operators, Users and Witnesses in the Wild , 2020, Frontiers in Robotics and AI.

[29]  Fabio Paternò,et al.  Trigger-Action Programming for Personalising Humanoid Robot Behaviour , 2019, CHI.

[30]  Laurel D. Riek,et al.  Wizard of Oz studies in HRI , 2012, J. Hum. Robot Interact..

[31]  Maya Cakmak,et al.  Figaro: A Tabletop Authoring Environment for Human-Robot Interaction , 2021, CHI.

[32]  Jodi Forlizzi,et al.  How robotic products become social products: An ethnographic study of cleaning in the home , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[33]  Elin A. Björling,et al.  Participatory Research Principles in Human-Centered Design: Engaging Teens in the Co-Design of a Social Robot , 2019, Multimodal Technol. Interact..

[34]  B. Bloom The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[35]  Praminda Caleb-Solly,et al.  Mutual Shaping in the Design of Socially Assistive Robots: A Case Study on Social Robots for Therapy , 2019, Int. J. Soc. Robotics.

[36]  Jesper Simonsen,et al.  Situated Design Methods , 2014 .

[37]  Maya Cakmak,et al.  Power to the People: The Role of Humans in Interactive Machine Learning , 2014, AI Mag..

[38]  Goldie Nejat,et al.  A Social Robot Learning to Facilitate an Assistive Group-Based Activity from Non-expert Caregivers , 2020, Int. J. Soc. Robotics.

[39]  Ke Huo,et al.  GhostAR: A Time-space Editor for Embodied Authoring of Human-Robot Collaborative Task with Augmented Reality , 2019, UIST.

[40]  Jesper Simonsen,et al.  Routledge International Handbook of Participatory Design , 2012 .

[41]  Wan Ling Chang,et al.  Interaction Expands Function: Social Shaping of the Therapeutic Robot PARO in a Nursing Home , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[42]  Masahiro Fujita,et al.  Ethological modeling and architecture for an entertainment robot , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[43]  Jesper Simonsen,et al.  Sustained Participatory Design: Extending the Iterative Approach , 2012, Design Issues.

[44]  Wan Ling Chang,et al.  Steps Toward Participatory Design of Social Robots: Mutual Learning with Older Adults with Depression , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[45]  Gregory D. Hager,et al.  CoSTAR: Instructing collaborative robots with behavior trees and vision , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[46]  Allison Sauppé,et al.  Bodystorming Human-Robot Interactions , 2019, UIST.

[47]  Maya Cakmak,et al.  Enabling building service robots to guide blind people a participatory design approach , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[48]  de GraafMaartje,et al.  Sharing a life with Harvey , 2015 .

[49]  Jeffrey P. Bigham,et al.  Co-designing Socially Assistive Sidekicks for Motion-based AAC , 2021, 2021 16th ACM/IEEE International Conference on Human-Robot Interaction (HRI).