Negotiating the Creative Space in Human-Robot Collaborative Design

We describe a physical interactive system for human-robot collaborative design (HRCD) consisting of a tangible user interface (TUI) and a robotic arm that simultaneously manipulates the TUI with the human designer. In an observational study of 12 participants exploring a complex design problem together with the robot, we find that human designers have to negotiate both the physical and the creative space with the machine. They also often ascribe social meaning to the robot's pragmatic behaviors. Based on these findings, we propose four considerations for future HRCD systems: managing the shared workspace, communicating preferences about design goals, respecting different design styles, and taking into account the social meaning of design acts.

[1]  Margaret M. Burnett,et al.  A strategy-centric approach to the design of end-user debugging tools , 2010, CHI.

[2]  Patrick Baudisch,et al.  RoMA: Interactive Fabrication with Augmented Reality and a Robotic 3D Printer , 2018, CHI.

[3]  Kazuhiko Kawamura,et al.  Intelligent robotic systems in service of the disabled , 1995 .

[4]  Ehud Sharlin,et al.  Exploring the use of tangible user interfaces for human-robot interaction: a comparative study , 2008, CHI.

[5]  Mary Lou Maher,et al.  Formalising Design Exploration as Co-Evolution , 1996 .

[6]  Scott R. Klemmer,et al.  How bodies matter: five themes for interaction design , 2006, DIS '06.

[7]  Bertrand Schneider,et al.  Benefits of a Tangible Interface for Collaborative Learning and Interaction , 2011, IEEE Transactions on Learning Technologies.

[8]  Steve Harrison,et al.  Digital drumming: a study of co-located, highly coordinated, dyadic collaboration , 2010, CHI.

[9]  Hyunseung Bang,et al.  Side-by-Side Human–Computer Design Using a Tangible User Interface , 2018, Design Computing and Cognition '18.

[10]  Hyunseung Bang,et al.  Extracting and Applying Knowledge with Adaptive Knowledge-Driven Optimization to Architect an Earth Observing Satellite System , 2017 .

[11]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[12]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[13]  Guy Hoffman,et al.  Wearing your arm on your sleeve: Studying usage contexts for a wearable robotic forearm , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[14]  Antonio Volpentesta,et al.  Thinking Style Diversity and Collaborative Design Learning , 2009, PRO-VE.

[15]  Mary Lou Maher,et al.  An experimental study of computer mediated collaborative design , 1996, Proceedings of WET ICE '96. IEEE 5th Workshop on Enabling Technologies; Infrastucture for Collaborative Enterprises.

[16]  David C. Brown,et al.  Defining configuring , 1998, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[17]  Brian Scassellati,et al.  Robot nonverbal behavior improves task performance in difficult collaborations , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[18]  Mark Billinghurst,et al.  Tangible tiles: design and evaluation of a tangible user interface in a collaborative tabletop setup , 2006, OZCHI.

[19]  James Fogarty,et al.  Regroup: interactive machine learning for on-demand group creation in social networks , 2012, CHI.

[20]  Takayuki Kanda,et al.  Human creativity can be facilitated through interacting with a social robot , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  Mark W. Newman,et al.  The designers' outpost: a tangible interface for collaborative web site , 2001, UIST '01.

[22]  Kristina Höök,et al.  CHI '12 Extended Abstracts on Human Factors in Computing Systems , 2012, CHI 2012.

[23]  Gerhard Fischer,et al.  Transcending the individual human mind—creating shared understanding through collaborative design , 2000, TCHI.

[24]  Stephen J. Beckett,et al.  The Logic of the Design Problem: A Dialectical Approach , 2017, Design Issues.

[25]  Meghna Babbar-Sebens,et al.  Interactive Genetic Algorithm with Mixed Initiative Interaction for multi-criteria ground water monitoring design , 2012, Appl. Soft Comput..

[26]  E. F. Crawley,et al.  VASSAR: Value assessment of system architectures using rules , 2013, 2013 IEEE Aerospace Conference.

[27]  Jonathan Cagan,et al.  Human and Computational Approaches for Design Problem-Solving , 2016 .

[28]  Andrea Lockerd Thomaz,et al.  Turn-Taking Based on Information Flow for Fluent Human-Robot Interaction , 2011, AI Mag..

[29]  Cynthia Breazeal,et al.  Collaboration in Human-Robot Teams , 2004, AIAA 1st Intelligent Systems Technical Conference.

[30]  Michael Mateas,et al.  Tanagra: a mixed-initiative level design tool , 2010, FDG.

[31]  Gerhard Fischer,et al.  Social creativity: turning barriers into opportunities for collaborative design , 2004, PDC 04.

[32]  Lucienne Blessing,et al.  Understanding the differences between how novice and experienced designers approach design tasks , 2003 .

[33]  Antonios Liapis,et al.  Can Computers Foster Human Users’ Creativity? Theory and Praxis of Mixed-Initiative Co-Creativity , 2016 .

[34]  Maja J. Mataric,et al.  Embodiment and Human-Robot Interaction: A Task-Based Perspective , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[35]  David Johan Christensen,et al.  Playte, a tangible interface for engaging human-robot interaction , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[36]  한승헌,et al.  인터넷 기반 Collaborative Design 시스템 개발 , 1997 .

[37]  Lora Oehlberg,et al.  Improvising with an Audience-Controlled Robot Performer , 2018, Conference on Designing Interactive Systems.

[38]  Sanjay Mittal,et al.  Towards a Generic Model of Configuraton Tasks , 1989, IJCAI.

[39]  Mi Jeong Kim,et al.  The impact of tangible user interfaces on spatial cognition during collaborative design , 2008 .

[40]  Ernest A. Edmonds,et al.  Support for collaborative design: agents and emergence , 1994, CACM.

[41]  Sung-Bae Cho,et al.  Towards Creative Evolutionary Systems with Interactive Genetic Algorithm , 2002, Applied Intelligence.

[42]  Malte F. Jung.  Affective Grounding in Human-Robot Interaction , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[43]  Cynthia Breazeal,et al.  Improved human-robot team performance using Chaski, A human-inspired plan execution system , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[44]  Guy Hoffman,et al.  Interactive improvisation with a robotic marimba player , 2011, Auton. Robots.

[45]  Ross Bencina,et al.  reacTIVision: a computer-vision framework for table-based tangible interaction , 2007, TEI.

[46]  Tobias Schwinn,et al.  Human and Robot Collaboration Enabling the Fabrication and Assembly of a Filament-Wound Structure , 2016 .

[47]  Hao Yan,et al.  Shared reality: physical collaboration with a virtual peer , 2000, CHI Extended Abstracts.

[48]  Pamela J. Hinds,et al.  Whose Job Is It Anyway? A Study of Human-Robot Interaction in a Collaborative Task , 2004, Hum. Comput. Interact..