Knowledge Management for Rapidly Extensible Collaborative Robots

It is difficult – but increasingly important – to build collaborative systems that can do a range of jobs in a range of ways in a range of conditions. Much of this difficulty stems from the broad scope of contextual and collaborative knowledge required to interact productively with humans amidst uncertainty and change. With respect to physical collaboration, human-robot interaction (HRI) studies have made progress on related problems by constraining uncertainty and dynamism, thus limiting the knowledge required. Our participation in an extreme context prevented us from adopting these approaches: The Defense Advanced Research Projects Agency (DARPA) Aircrew Labor In-Cockpit Automation System (ALIAS) program has a requirement that the prototype robotic copilot system it seeks to develop must be extensible in 30 days to function in a different, unspecified aircraft in a range of flight conditions and missions. To accommodate, we developed a knowledge management-inspired approach and system that allowed a variety of stakeholders to curate and rely on a dynamic body of flight-related knowledge. This had significant positive implications across design, test and use of the system, crucially enabling pilots to compose a robot- and human-legible plan for their interaction with the system using familiar conventions. Our contributions promise to accelerate quality development of extensible collaborative robotic systems for settings such as general medical assistance, disaster response and construction that require collaborative problem solving in highly uncertain, dynamic and variable conditions.

[1]  Elin Anna Topp,et al.  Simplified Programming of Re-Usable Skills on a Safe Industrial Robot - Prototype and Evaluation , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[2]  Bradley Hayes,et al.  Improving Robot Controller Transparency Through Autonomous Policy Explanation , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[3]  Pamela J. Hinds,et al.  Challenges to grounding in human-robot interaction , 2006, HRI '06.

[4]  Illah R. Nourbakhsh,et al.  Human-robot teaming for search and rescue , 2005, IEEE Pervasive Computing.

[5]  S. Kiesler,et al.  Group decision making and communication technology , 1992 .

[6]  Paul M. Leonardi,et al.  The Lure of the Virtual , 2012, Organ. Sci..

[7]  Beth A. Bechky,et al.  10 Coordination in Organizations: An Integrative Perspective , 2009 .

[8]  Diane E. Bailey,et al.  Teaching-Learning Ecologies: Mapping the Environment to Structure Through Action , 2011, Organ. Sci..

[9]  Jeffrey M. Bradshaw,et al.  Knowledge acquisition as a constructive modeling activity , 1993, Int. J. Intell. Syst..

[10]  Jacob W. Crandall,et al.  Learning to Interact with a Human Partner , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[11]  Karon E. MacLean,et al.  Gestures for industry Intuitive human-robot communication from human observation , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[12]  Atreyi Kankanhalli,et al.  Contributing Knowledge to Electronic Knowledge Repositories: An Empirical Investigation , 2005, MIS Q..

[13]  Thomas Streinz,et al.  The Autonomy Paradox , 2015, All the News That’s Fit to Click.

[14]  Stefanos Nikolaidis,et al.  Efficient Model Learning from Joint-Action Demonstrations for Human-Robot Collaborative Tasks , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Siddhartha S. Srinivasa,et al.  Collaborative manipulation: New challenges for robotics and HRI , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[16]  Peter Tyndale A taxonomy of knowledge management software tools: origins and applications , 2002 .

[17]  Robin R. Murphy,et al.  Human-robot interaction in rescue robotics , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  Brian Scassellati,et al.  Promoting collaboration with social robots , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[19]  Yan Xiao,et al.  Coordination in Fast-Response Organizations , 2006, Manag. Sci..

[20]  Jesper Smith,et al.  Team IHMC's Lessons Learned from the DARPA Robotics Challenge: Finding Data in the Rubble , 2017, J. Field Robotics.

[21]  Maja J. Mataric,et al.  How Robot Verbal Feedback Can Improve Team Performance in Human-Robot Task Collaborations , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[22]  Stefanos Nikolaidis,et al.  Human-robot cross-training: Computational formulation, modeling and evaluation of a human team training strategy , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  Kuanhao Zheng,et al.  Supervisory control of multiple social robots for navigation , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[24]  Kevin Crowston,et al.  The interdisciplinary study of coordination , 1994, CSUR.

[25]  Dorothy E. Leidner,et al.  Review: Knowledge Management and Knowledge Management Systems: Conceptual Foundations and Research Issues , 2001, MIS Q..

[26]  Pamela J. Hinds,et al.  Out of Sight, Out of Sync: Understanding Conflict in Distributed Teams , 2003, Organ. Sci..

[27]  Bilge Mutlu,et al.  Anticipatory robot control for efficient human-robot collaboration , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[28]  Paul M. Leonardi,et al.  Minding the Gaps: Understanding Technology Interdependence and Coordination in Knowledge Work , 2010, Organ. Sci..

[29]  E. Barrett Sociomedia: multimedia, hypermedia, and the social construction of knowledge , 1992 .

[30]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[31]  Koen V. Hindriks,et al.  Ontological reasoning for human-robot teaming in search and rescue missions , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[32]  P. Goodman Groups That Work (and Those That Don't)Groups That Work (and Those That Don't) by Hackman Richard. San Francisco: Jossey-Bass, 1991, 512 pp. , 1992 .

[33]  Wendy Ju,et al.  Exploring shared control in automated driving , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[34]  Robert E. Kraut,et al.  The use of visual information in shared visual spaces: informing the development of virtual co-presence , 2002, CSCW '02.

[35]  R. Murphy,et al.  Up from the Rubble: Lessons Learned about HRI from Search and Rescue , 2005 .

[36]  Rachid Alami,et al.  An implemented theory of mind to improve human-robot shared plans execution , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[37]  Mary L. Cummings,et al.  Teamwork in controlling multiple robots , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[38]  Kevin Crowston,et al.  Organizing Business Knowledge: The MIT Process Handbook , 2003 .

[39]  Albert H. Segars,et al.  Knowledge Management: An Organizational Capabilities Perspective , 2001, J. Manag. Inf. Syst..

[40]  Holly A. Yanco,et al.  Analysis of Human‐robot Interaction at the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[41]  Beth A. Bechky Gaffers, Gofers, and Grips: Role-Based Coordination in Temporary Organizations , 2006, Organ. Sci..

[42]  Michael Lewis,et al.  Towards human control of robot swarms , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[43]  Paul R. Carlile,et al.  Transferring, Translating, and Transforming: An Integrative Framework for Managing Knowledge Across Boundaries , 2004, Organ. Sci..

[44]  Guus Schreiber,et al.  Knowledge Engineering and Management: The CommonKADS Methodology , 1999 .

[45]  Wanda J. Orlikowski,et al.  What Difference Does a Robot Make? The Material Enactment of Distributed Coordination , 2015, Organ. Sci..

[46]  Jodi Forlizzi,et al.  Designing interfaces for multi-user, multi-robot systems , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[47]  Beth A. Bechky Sharing Meaning Across Occupational Communities: The Transformation of Understanding on a Production Floor , 2003, Organ. Sci..

[48]  S. Newell,et al.  Managing Knowledge Work and Innovation , 2009 .

[49]  Sonia Chernova,et al.  Interactive Hierarchical Task Learning from a Single Demonstration , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[50]  Siddhartha S. Srinivasa,et al.  Effects of Robot Motion on Human-Robot Collaboration , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[51]  Heeseok Lee,et al.  Knowledge Management Enablers, Processes, and Organizational Performance: An Integrative View and Empirical Examination , 2003, J. Manag. Inf. Syst..

[52]  Brian Scassellati,et al.  Robot nonverbal behavior improves task performance in difficult collaborations , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[53]  Henrik Eriksson,et al.  The evolution of Protégé: an environment for knowledge-based systems development , 2003, Int. J. Hum. Comput. Stud..

[54]  Mohan Sridharan,et al.  Knowledge Acquisition with Selective Active Learning for Human-Robot Interaction , 2015, HRI.

[55]  Leila Takayama,et al.  Strategies for human-in-the-loop robotic grasping , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).