Developing a Questionnaire to Evaluate Customers’ Perception in the Smart City Robotic Challenge

In this paper, we present an approach to develop a new type of questionnaire for evaluating customers’ perceptions in the upcoming Smart CIty RObotic Challenge (SciRoc). The approach consists of two steps. First, it relies on interviewing experts on Human-Robot Interaction (HRI) to understand which robot’s behaviours can potentially affect the users’ perceptions during a HRI task. Then, it leverages a user survey to filter out those robot’s behaviours that are not significantly relevant from the end user perspective. We concretely enacted our approach over a specific scenario developed in the context of SciRoc, which instructs a robot to take an elevator of a shopping mall asking support to the customers of the mall. The results of the survey have allowed us to derive a final list of 17 behaviours to be captured in the questionnaire, which has been finally developed relying on a 5-point Likert-scale.

[1]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[2]  Patrick Rives,et al.  Adaptive spacing in human-robot interactions , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  T. Kanda,et al.  Psychology in human-robot communication: an attempt through investigation of negative attitudes and anxiety toward robots , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[4]  Leila Takayama,et al.  Influences on proxemic behaviors in human-robot interaction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Ehud Sharlin,et al.  Evaluating Human-Robot Interaction , 2011, Int. J. Soc. Robotics.

[6]  Gregory D. Abowd,et al.  Human-Computer Interaction, third edition , 2004 .

[7]  J. Dawes.  Do Data Characteristics Change According to the Number of Scale Points Used? An Experiment Using 5-Point, 7-Point and 10-Point Scales , 2008 .

[8]  Bilge Mutlu,et al.  Human-robot proxemics: Physical and psychological distancing in human-robot interaction , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  Steven J. Stroessner,et al.  The Robotic Social Attributes Scale (RoSAS): Development and Validation , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[10]  Tiziana Catarci,et al.  Enabling Symbiotic Autonomy in Short-Term Interactions: A User Study , 2016, ICSR.

[11]  Markus Vincze,et al.  Help, Anyone? A User Study For Modeling Robotic Behavior To Mitigate Malfunctions With The Help Of The User , 2016, ArXiv.

[12]  Maja J. Mataric,et al.  Proxemics and performance: Subjective human evaluations of autonomous sociable robot distance and social signal understanding , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  M. Tscheligi,et al.  Robots asking for directions: the willingness of passers-by to support robots , 2010, HRI 2010.

[14]  K. Á. T.,et al.  Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI) , 2000, Natural Language Engineering.

[15]  Laurel D. Riek,et al.  Wizard of Oz studies in HRI , 2012, J. Hum. Robot Interact..