Using the wizard of Oz paradigm to prototype automated vehicles: methodological challenges

Wizard of Oz (WoOz) vehicles are becoming increasingly popular within the human factors research community to prototype automated vehicles in real traffic conditions. With promising results, researchers have so far used the WoOz approach, among other topics, to assess user interfaces, the effect of non-driving related tasks or the development of drowsiness during automated driving. However, a research gap exists considering standardized methodological guidelines for the implementation of WoOz studies in the context of automated driving. In an attempt to fill this gap, this paper investigates the components and their connections in tests using WoOz vehicles. It also applies the three main test quality criteria, objectivity, reliability and validity to the WoOz method. Based on this analysis, methodological challenges are discussed in detail and necessary research questions are deduced. Both challenges and research questions may serve as a thought-provoking impulse when designing WoOz studies in the future.

[1]  A. Green,et al.  Applying the Wizard-of-Oz framework to cooperative service discovery and configuration , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[2]  G. Lienert,et al.  Testaufbau und Testanalyse , 1962 .

[3]  P. Green The Wizard of Oz: a tool for rapid development of user interfaces. Final report , 1985 .

[4]  Sandra A. McIntire,et al.  Foundations of Psychological Testing: A Practical Approach , 2006 .

[5]  Tal Oron-Gilad,et al.  Road Characteristics and Driver Fatigue: A Simulator Study , 2007, Traffic injury prevention.

[6]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[7]  Niels Ole Bernsen,et al.  WIZARD OF OZ PROTOTYPING : WHEN AND HOW ? , 1993 .

[8]  G. C. Dominioni,et al.  Automated driving : subjective assessment of different strategies to manage drowsiness , 2018 .

[9]  Kurt Blumenröder Auf dem Weg zum hochautomatisierten Fahren , 2015 .

[10]  Wendy Ju,et al.  Marionette: Enabling On-Road Wizard-of-Oz Autonomous Driving Studies , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[11]  Klaus Bengler,et al.  Highly automated driving: How to get the driver drowsy and how does drowsiness influence various take-over aspects? , 2017 .

[12]  Klaus Bengler,et al.  How long does it take to relax? Observation of driver behavior during real-world conditionally automated driving , 2019 .

[13]  Frederik Naujoks,et al.  Noncritical State Transitions During Conditionally Automated Driving on German Freeways: Effects of Non–Driving Related Tasks on Takeover Time and Takeover Quality , 2019, Hum. Factors.

[14]  Nigel Gilbert,et al.  Simulating speech systems , 1991 .

[15]  Miklós Dr. Kiss,et al.  Das Wizard of Oz Fahrzeug: Rapid Prototyping und Usability Testing von zukünftigen Fahrerassistenzsystemen , 2008 .

[16]  Klaus Bengler,et al.  Automated Driving: The Potential of Non-driving-Related Tasks to Manage Driver Drowsiness , 2018 .

[17]  Matthias Rauterberg,et al.  Development of On-Road Automated Vehicle Simulator for Motion Sickness Studies , 2018 .

[18]  Wendy Ju,et al.  The RRADS platform: a real road autonomous driving simulator , 2015, AutomotiveUI.