Application of Scheduling Methods in Designing Multimodal In-Vehicle Systems

Multimodal in-vehicle systems (MIVS) may improve time-sharing performance of drivers. However, it is not always clear for designers of MIVS about how to select appropriate modalities and determine the optimal order of messages presented to a driver. To solve this problem, this paper proposes a general procedure to select several scheduling methods (e.g., Johnson’s rule and non-identical parallel machine scheduling methods) and uses these scheduling methods to assign appropriate modalities and determine optimal order of messages presented to a driver. An empirical study of an example multimodal in-vehicle system was conducted and it validated the effectiveness of scheduling methods as a tool to improve driver performance and reduce driver workload. Further extensions of the current methodology and usage of this general procedure to select other scheduling methods are also discussed.

[1]  J M Violanti,et al.  Cellular phones and traffic accidents: an epidemiological approach. , 1996, Accident; analysis and prevention.

[2]  Yili Liu,et al.  The queuing network-model human processor (QN-MHP): an engineering approach for modeling cognitive performance , 2001 .

[3]  A. Kok.  On the utility of P3 amplitude as a measure of processing capacity. , 2001, Psychophysiology.

[4]  Norman I. Badler,et al.  New Behavioral Paradigms for Virtual Human Models , 2005 .

[5]  Joo Hyun Kim,et al.  New capabilities for the virtual-human Santos™ , 2006 .

[6]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[7]  Chris Baber,et al.  Using critical path analysis to model multimodal human-computer interaction , 2001, Int. J. Hum. Comput. Stud..

[8]  S. M. Johnson,et al.  Optimal two- and three-stage production schedules with setup times included , 1954 .

[9]  DOUGLAS WAGNER,et al.  A Computer-Based Methodology for Evaluating the Content of Variable Message Signage , 1997, J. Intell. Transp. Syst..

[10]  Massimo Cellario.  Human-Centered Intelligent Vehicles: Toward Multimodal Interface Integration , 2001, IEEE Intell. Syst..

[11]  Nitin Gupta,et al.  The effects of adverse condition warning system characteristics on driver performance: An investigation of alarm signal type and threshold level , 2002, Behav. Inf. Technol..

[12]  Matthew P. Reed,et al.  The HUMOSIM Ergonomics Framework: A New Approach to Digital Human Simulation for Ergonomic Analysis , 2006 .

[13]  Omer Tsimhoni,et al.  EFFECTS OF VISUAL DEMAND AND IN-VEHICLE TASK COMPLEXITY ON DRIVING AND TASK PERFORMANCE AS ASSESSED BY VISUAL OCCLUSION , 1999 .

[14]  Yili Liu,et al.  Modeling Psychological Refractory Period (PRP) and Practice Effect on PRP with Queuing Networks and Reinforcement Learning Algorithms , 2004, ICCM.

[15]  Changxu Wu,et al.  Queuing Network Modeling of Reaction Time, Response Accuracy, and Stimulus-Lateralized Readiness Potential Onset Time in a Dual Task , 2006 .

[16]  Yili Liu,et al.  Modeling Steering Using the Queueing Network — Model Human Processor (QN-MHP) , 2003 .

[17]  Ulrich Raschke,et al.  On the Design of a Task Based Human Simulation System , 2005 .

[18]  G. Rand.  Sequencing and Scheduling: An Introduction to the Mathematics of the Job-Shop , 1982 .

[19]  Yili Liu,et al.  Modeling Human Transcription Typing with Queuing Network-Model Human Processor (QN-MHP) , 2004 .

[20]  Jon Driver,et al.  Cross-modal links in attention between audition, vision, and touch: Implications for interface design , 1997 .

[21]  Jingzhou Yang,et al.  Santos™: A New Generation of Virtual Humans , 2005 .

[22]  Gary M. Olson,et al.  The growth of cognitive modeling in human-computer interaction since GOMS , 1990 .

[23]  Jia Li,et al.  Integrating Human Performance and Anthropometric Modeling in the Crew Station Design Tool , 2005 .

[24]  A. Newell.  You can't play 20 questions with nature and win : projective comments on the papers of this symposium , 1973 .

[25]  Ying Liu,et al.  Applying Empirical Data on Upper Torso Movement to Real-time Collision-free Reach Tasks , 2005 .

[26]  Limin Zhang.  Cognitive Task Network Modeling and Human Task Simulation Visualization in 3D Environment (-Preliminary Feasibility Study) , 2003 .

[27]  H Pashler,et al.  Processing stages in overlapping tasks: evidence for a central bottleneck. , 1984, Journal of experimental psychology. Human perception and performance.

[28]  E. Donchin,et al.  Performance of concurrent tasks: a psychophysiological analysis of the reciprocity of information-processing resources. , 1983, Science.

[29]  W. Chase,et al.  Visual information processing. , 1974 .

[30]  Yili Liu,et al.  Queuing Network Modeling of Driver Workload and Performance , 2006, IEEE Transactions on Intelligent Transportation Systems.

[31]  Richard Reviewer-Granger.  Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[32]  H Alm,et al.  The effects of a mobile telephone task on driver behaviour in a car following situation. , 1995, Accident; analysis and prevention.

[33]  Daniel P. Siewiorek,et al.  Multimodal contextual car-driver interface , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[34]  Randall W. Hill,et al.  Toward Virtual Humans , 2006, AI Mag..

[35]  Yili Liu,et al.  Queueing Network-Model Human Processor (QN-MHP): A computational architecture for multitask performance in human-machine systems , 2006, TCHI.

[36]  Michele Mariani.  COMMUNICAR: DESIGNING MULTIMODAL INTERACTION FOR ADVANCED IN-VEHICLE INTERFACES , 2002 .