Auditory versus visual spatial stimulus-response mappings in tracking and discrete dual task performance: implications for human-machine interface design

A discrete four-choice response task with auditory signal presentation and a joystick-controlled visual tracking task was used to investigate how spatial compatibility influences the dual-task performance of different display-control settings. It was found that the more incompatible the stimulus-response mapping, the longer the delay for both tasks, presumably because of the longer stimulus encoding time required for the incompatible conditions. A comparison of the findings of this study with those of past experiments on visual visual setting shows that the dual-task performance in a cross-modality (auditory visual) setting was significantly better than that in an intra-modality (visual visual) setting because of visual scanning required in the intra-modal dual tasks. However, when the locations of visual visual tasks were close enough such that ambient and focal vision was concurrently used for information processing, the dual-task performance of intra-modality (visual visual) configuration was slightly better than that of the cross-modality (auditory visual) configuration. Practitioner Summary: The effect of spatial compatibility with auditory signal presentation in multiple display-control configurations was examined in a dual-task paradigm. The results provided important and useful ergonomics design implications and consequent recommendations for intra- and cross- modal interface design. The results should facilitate human-machine system design and improve overall system performance.