Development of a Framework for Multimodal Research: Creation of a Bibliographic Database

Abstract : The purpose of this report is to describe the development of a framework to enable classification, evaluation, and comparison of multimodal display research, based on task demands, display characteristics, research design, and individual differences. In this report, we describe the process by which a bibliographic database was developed and organized. First, the framework was specified, which then guided the identification and review of research and theory-based articles that were included in the bibliography. The results of the overall effort, the multimodal framework and article tracking sheet, bibliographic database, and searchable multimodal database make substantial and valuable contributions to the accumulation and interpretation of multimodal research. References collected in this effort are listed in the appendix.

[1]  Hong Z. Tan,et al.  Do multimodal signals need to come from the same place? Crossmodal attentional links between proximal and distal surfaces , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[2]  Nelson Cowan,et al.  When visual and verbal memories compete: Evidence of cross-domain limits in working memory , 2004, Psychonomic bulletin & review.

[3]  Eric J. Seibel,et al.  Testing Visual Search Performance Using Retinal Light Scanning as a Future Wearable Low Vision Aid , 2003, Int. J. Hum. Comput. Interact..

[4]  C. Swindells,et al.  TorqueBAR: an ungrounded haptic feedback device , 2003, ICMI '03.

[5]  Kevin W. Williams,et al.  Impact of Aviation Highway-in-the-Sky Displays on Pilot Situation Awareness , 2000 .

[6]  Alex Waibel,et al.  A framework and toolkit for the construction of multimodal learning interfaces , 1998 .

[7]  Karel Brookhuis,et al.  Limiting speed, towards an intelligent speed adapter (ISA) , 1999 .

[8]  M Akamatsu,et al.  Please Scroll down for Article Ergonomics a Comparison of Tactile, Auditory, and Visual Feedback in a Pointing Task Using a Mouse-type Device , 2022 .

[9]  Gerard Jounghyun Kim,et al.  Increasing the effective egocentric field of view with proprioceptive and tactile feedback , 2004, IEEE Virtual Reality 2004.

[10]  Benjamin A. Clegg,et al.  Interruption Management: The Use of Attention-Directing Tactile Cues , 2005, Hum. Factors.

[11]  Stephen Brewster.  Sonically-enhanced drag and drop , 1998 .

[12]  Svetha Venkatesh,et al.  Representations and Processes in Decision Modelling , 2002 .

[13]  Ronald A. Rensink.  Internal vs. external information in visual perception , 2002, SMARTGRAPH '02.

[14]  Michael L. Brychcy,et al.  Flight Simulation Architecture for Tunnel-in-the-Sky Guidance and Synthetic Vision , 2004, J. Aerosp. Comput. Inf. Commun..

[15]  R. M. Taylor,et al.  Multi-Modal Cockpit Warnings: Pictures. Words. or Both? , 1992 .

[16]  Patrik Andersson.  Perceptual Aspects of Symbol Shapes and Relations in 3D Aircraft Displays , 2002 .

[17]  Joseph Picone,et al.  Effects of displayless navigational interfaces on user prosodics , 2005, Speech Commun..

[18]  Ralph O. Buchal,et al.  Cognitive factors in distributed design , 2002, Comput. Ind..

[19]  Joseph DiVita,et al.  Verification of the Change Blindness Phenomenon While Managing Critical Events on a Combat Information Display , 2004, Hum. Factors.

[20]  Regan L. Mandryk,et al.  Sticky widgets: pseudo-haptic widget enhancements for multi-monitor displays , 2005, CHI Extended Abstracts.

[21]  Nadine B. Sarter,et al.  The Need for Multisensory Interfaces in Support of Effective Attention Allocation in Highly Dynamic Event-Driven Domains: The Case of Cockpit Automation , 2000 .

[22]  C D Wickens,et al.  Processing resource demands of failure detection in dynamic systems. , 1980, Journal of experimental psychology. Human perception and performance.

[23]  Colin Ware,et al.  The Importance of Stereo and Eye-Coupled Perspective for Eye-Hand Coordination in Fish Tank VR , 2004, Presence: Teleoperators & Virtual Environments.

[24]  John Chiasson,et al.  Enhanced Situation Awareness in Sea, Air and Land Environments , 2003 .

[25]  Wendy Plesniak,et al.  Coincident display using haptics and holographic video , 1998, CHI.

[26]  Ronald A. Hess,et al.  Computer-Aided Assessment of Flight Simulator Fidelity , 2002 .

[27]  Jan B F van Erp,et al.  Vibro-Tactile and Visual Asynchronies: Sensitivity and Consistency , 2004, Perception.

[28]  M. Boekaerts.  Individual differences in the use of visual and verbal mediators , 1982 .

[29]  Masaaki Kurosu.  Dual task model - an evaluation model for the complex operation , 1994, CHI Conference Companion.

[30]  Wayne J. Book,et al.  Reach out and touch someone: controlling haptic manipulators near and far , 2004, Annu. Rev. Control..

[31]  C D Wickens,et al.  The Event‐Related Potential as an Index of the Processing Demands of a Complex Target Acquisition Task a , 1984, Annals of the New York Academy of Sciences.

[32]  William R Ercoline,et al.  Effects of three helmet-mounted display symbologies on unusual attitude recognition and recovery. , 2002, Aviation, space, and environmental medicine.

[33]  Jeffrey C. Woldstad,et al.  Multiple Two-Dimensional Displays as an Alternative to Three-Dimensional Displays in Telerobotic Tasks , 2000, Hum. Factors.

[34]  Tomas Sokoler,et al.  Low-Resolution Supplementary Tactile Cues for Navigational Assistance , 2002, Mobile HCI.

[35]  Jeffrey W. McCandless,et al.  Upgrades to the Caution and Warning System of the Space Shuttle , 2003 .

[36]  James A. Larson,et al.  Principles for mujltimodal user inteface desgin , 2003, CHI Extended Abstracts.

[37]  Peter A. Hancock,et al.  Navigation Training in Virtual Environments , 2001 .

[38]  Lieselotte van Leeuwen,et al.  Designing sound tools and toys for blind and visually impaired children , 2004, IDC '04.

[39]  Thomas G. Holzman,et al.  Speech-Audio Interface for Medical Information Management in Field Environments , 2001, Int. J. Speech Technol..

[40]  Mike Hollier,et al.  The significance of cross-modal interaction in audio-visual quality perception , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[41]  Marika Hoedemaeker,et al.  Driver behavior in an emergency situation in the Automated Highway System , 1999 .

[42]  Robert W. Lindeman,et al.  Towards usable VR: an empirical study of user interfaces for immersive virtual environments , 1999, CHI '99.

[43]  J.B.F. van Erp,et al.  Guidelines for the use of vibro-tactile displays in human computer interaction , 2002 .

[44]  Anil K. Raj,et al.  Vibrotactile Displays for Improving Spatial Awareness , 2000 .

[45]  Taysheng Jeng,et al.  A Context Manager for tangible media design presentation: A human-centric interaction approach , 2003 .

[46]  John T. Stasko,et al.  Artistically conveying peripheral information with the InfoCanvas , 2002, AVI '02.

[47]  Arvin Agah,et al.  Multi-Modal Human Interactions with an Intelligent Interface Utilizing Images, Sounds, and Force Feedback , 2001, J. Intell. Robotic Syst..

[48]  S O'Modhrain.  Touch and Go — Designing Haptic Feedback for a Hand-Held Mobile Device , 2004 .

[49]  Georg v. Békésy,et al.  Human Skin Perception of Traveling Waves Similar to Those on the Cochlea , 1955 .

[50]  Eric Ruthruff,et al.  Visual Search in Complex Displays: Factors Affecting Conflict Detection by Air Traffic Controllers , 2000, Hum. Factors.

[51]  H. Kazerooni.  The New Scientist , 1956, Nature.

[52]  A. Edwards.  Extra-ordinary human-computer interaction: interfaces for users with disabilities , 1995 .

[53]  C D Wickens,et al.  Codes and Modalities in Multiple Resources: A Success and a Qualification , 1988, Human factors.

[54]  Julie A. Jacko,et al.  Multimodal feedback: establishing a performance baseline for improved access by individuals with visual impairments , 2002, Assets '02.

[55]  Makoto Sato,et al.  Virtual locomotion system for large-scale virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[56]  William Knight,et al.  Using visual texture for information display , 1995, TOGS.

[57]  Ernesto Arroyo,et al.  Interruptions as multimodal outputs: which are the less disruptive? , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[58]  D V Keyson,et al.  Dynamic cursor gain and tactual feedback in the capture of cursor movements. , 1997, Ergonomics.

[59]  Harold Pashler,et al.  Doing Two Things at the Same Time , 2002 .

[60]  Martin Buss,et al.  First evaluation of a novel tactile display exerting shear force via lateral displacement , 2005, TAP.

[61]  Manfred Tscheligi,et al.  CHI '04 Extended Abstracts on Human Factors in Computing Systems , 2004, CHI 2004.

[62]  H. Smallman,et al.  Segregation of basic colors in an information display. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[63]  David E. Meyer,et al.  Dual-Task Interference and Elementary Mental Mechanisms , 1993 .

[64]  Roy A. Ruddle,et al.  Effects of proprioceptive feedback and environmental characteristics on spatial learning in virtual environments , 2004, Int. J. Hum. Comput. Stud..

[65]  Arthur E. Kirkpatrick,et al.  Interactive touch: haptic interfaces based upon hand movement patterns , 1999, CHI Extended Abstracts.

[66]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[67]  Hajime Otani,et al.  Improving balance by performing a secondary cognitive task. , 2004, British journal of psychology.

[68]  Arie E. Kaufman,et al.  Haptic sculpting of dynamic surfaces , 1999, SI3D.

[69]  Roy A. Ruddle,et al.  Verbal communication during cooperative object manipulation , 2002, CVE '02.

[70]  Harold Pashler,et al.  Perceptual and Central Interference in Dual-Task Performance , 2001 .

[71]  C. Wickens,et al.  Dissociation of Performance and Subjective Measures of Workload , 1988 .

[72]  Xianghong Sun,et al.  In-vehicle navigation information display: Integration of visual and auditory presentation , 2004 .

[73]  Saija Patomäki.  Multimodal interfaces and applications for visually impaired children , 2004, ICMI '04.

[74]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[75]  Nadine B. Sarter,et al.  The effects of display context on the effectiveness of visual onsets for attention capture , 2001, 20th DASC. 20th Digital Avionics Systems Conference (Cat. No.01CH37219).

[76]  Harold Pashler,et al.  Procedural learning: II. Intertrial repetition effects in speeded-choice tasks. , 1991 .

[77]  D R Begault,et al.  Head-Up Auditory Displays for Traffic Collision Avoidance System Advisories: A Preliminary Investigation , 1993, Human factors.

[78]  Angela Chang,et al.  Audio-haptic feedback in mobile phones , 2005, CHI Extended Abstracts.

[79]  Brian F. Goldiez,et al.  A Paradigm Shift in Interactive Computing: Deriving Multimodal Design Principles from Behavioral and Neurological Foundations , 2004, Int. J. Hum. Comput. Interact..

[80]  William B. Albery.  Spatial Orientation Retention Device - Current Status , 2005 .

[81]  Richard Szeliski,et al.  Modeling and analysis of empirical data in collaborative environments , 1992, CACM.

[82]  Lingling Zhang,et al.  Alternative techniques for the efficient acquisition of haptic data , 2001, SIGMETRICS '01.

[83]  Richard B. Ivry,et al.  Task switching and multitask performance. , 2000 .

[84]  Robert S. Bolia,et al.  Aurally Aided Visual Search in Three-Dimensional Space , 1999, Hum. Factors.

[85]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[86]  J. G. Hollands,et al.  Visual Momentum and Task Switching with 2D and 3D Displays of Geographic Terrain , 2003 .

[87]  J. V. Erp,et al.  Vibrotactile in-vehicle navigation system , 2004 .

[88]  Oleg Polovnikov,et al.  Navigation and steering during manual rendezvous with the space station , 2004 .

[89]  Helen Petrie,et al.  Haptic virtual reality for blind computer users , 1998, Assets '98.

[90]  G. J. Laabs,et al.  The effect of divided attention on probe reaction time in multiple-task performance. , 1977, Canadian journal of psychology.

[91]  John Duncan,et al.  Effect of Template Complexity on Visual Search and Dual-Task Performance , 2005, Psychological science.

[92]  Timothy S. Miller,et al.  An insidious Haptic invasion: adding force feedback to the X desktop , 1998, UIST '98.

[93]  Laurence Maloney,et al.  Combining sensory information to improve visualization , 2002, VIS '02.

[94]  Kate J. Garland,et al.  CRT monitors: Do they interfere with learning? , 2004, Behav. Inf. Technol..

[95]  H. Pashler,et al.  Concurrent task effects on memory retrieval , 2003, Psychonomic bulletin & review.

[96]  B. Gibson,et al.  Attraction, Distraction and Action: Multiple Perspectives on Attentional Capture. Advances in Psychology , 2001 .

[97]  Albert Postma,et al.  Multisensory integration mechanisms in haptic space perception , 2004, Experimental Brain Research.

[98]  U. Bronfenbrenner.  Ecological systems theory. , 1992 .

[99]  Hui Tang,et al.  An oral tactile interface for two-way communication , 2000, 1st Annual International IEEE-EMBS Special Topic Conference on Microtechnologies in Medicine and Biology. Proceedings (Cat. No.00EX451).

[100]  Durand R. Begault,et al.  Sensitivity to haptic-audio asynchrony , 2003, ICMI '03.

[101]  D. Damos.  Multiple-task performance , 2020 .

[102]  James L. Crowley,et al.  Multi-modal tracking of faces for video communications , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[103]  Rajit Gadh,et al.  Multi-sensory user interface for a virtual-reality-based computer-aided design system , 1997, Comput. Aided Des..

[104]  I. Brown,et al.  Vision in Vehicles III , 1991 .

[105]  Y. Fukui,et al.  Human shape recognition performance for 3D tactile display , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[106]  Martin Kurze,et al.  TDraw: a computer-based tactile drawing tool for blind people , 1996, Assets '96.

[107]  Dessislava Peeva.  Haptic and audio correlation in user interfaces , 2004 .

[108]  Rainer Malaka,et al.  Device-dependant modality selection for user-interfaces: an empirical study , 2002, IUI '02.

[109]  James C. Bliss,et al.  Optical-to-Tactile Image Conversion for the Blind , 1970 .

[110]  Allison Woodruff,et al.  Guidelines for using multiple views in information visualization , 2000, AVI '00.

[111]  Christopher D. Wickens,et al.  Frames of Reference for the Display of Battlefield Information: Judgment-Display Dependencies , 2000, Hum. Factors.

[112]  Christian H. Bischof,et al.  Haptic Rendering Techniques for the Interactive Exploration of CFD Datasets in Virtual Environments , 2003, IPT/EGVE.

[113]  James A. Ballas,et al.  Perceptual issues for the use of 3D auditory displays in operational environments , 2003, ISICT.

[114]  Sharon L. Oviatt,et al.  Modeling multimodal integration patterns and performance in seniors: toward adaptive processing of individual differences , 2003, ICMI '03.

[115]  F. Toates,et al.  Control Theory in Biology and Experimental Psychology , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[116]  Raja Parasuraman,et al.  Fuzzy Signal Detection Theory: Basic Postulates and Formulas for Analyzing Human and Machine Performance , 2000, Hum. Factors.

[117]  Richard A. McKinley,et al.  Tactile Cueing for Target Acquisition and Identification , 2005 .

[118]  Ryan M. Traylor,et al.  A Haptic Back Display for Attentional and Directional Cueing , 2003 .

[119]  James H Pratt.  Development of cognitive styles and strategies in the visual discrimination of computer displayed graphics: Task characteristics, training and design , 2002 .

[120]  Fionn Murtagh,et al.  Interactive Visual User Interfaces: A Survey , 2003, Artificial Intelligence Review.

[121]  H. Pashler,et al.  Evidence for split attentional foci. , 2000, Journal of Experimental Psychology: Human Perception and Performance.

[122]  Brigitte Röder,et al.  Unimodal and crossmodal effects of endogenous attention to visual and auditory motion , 2004, Cognitive, affective & behavioral neuroscience.

[123]  Judy Edworthy,et al.  The Perceived Urgency of Speech Warnings: Semantics versus Acoustics , 2002, Hum. Factors.

[124]  C. Spence.  Multisensory attention and tactile information-processing , 2002, Behavioural Brain Research.

[125]  M. R. Houck,et al.  The role of attentional resources in automatic detection , 1983, Cognitive Psychology.

[126]  Timothy L. Brown,et al.  Speech-Based Interaction with In-Vehicle Computers: The Effect of Speech-Based E-Mail on Drivers' Attention to the Roadway , 2001, Hum. Factors.

[127]  Frank Biocca,et al.  Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions , 2001, Presence: Teleoperators & Virtual Environments.

[128]  Heath A. Ruff,et al.  Evaluation of Tactile Alerts for Control Station Operation , 2003 .

[129]  Ernesto Arroyo,et al.  Self-adaptive multimodal-interruption interfaces , 2003, IUI '03.

[130]  R. Proctor,et al.  Attention: Theory and Practice , 2003 .

[131]  Andrea Mazzone,et al.  A haptic feedback device based on an active mesh , 2003, VRST '03.

[132]  Avi Parush,et al.  An empirical evaluation of textual display configurations for supervisory tasks , 2004, Behav. Inf. Technol..

[133]  S. Grossberg,et al.  Psychological Review , 2003 .

[134]  Jan B. F. van Erp,et al.  Tactile Navigation Display , 2000, Haptic Human-Computer Interaction.

[135]  D. E. Irwin.  Fixation location and fixation duration as indices of cognitive processing , 2004 .

[136]  C. Spence,et al.  Speech Shadowing While Driving , 2003, Psychological science.

[137]  Wooseob Jeong,et al.  Multimodal bivariate thematic maps: Auditory and haptic display , 2002, ASIST.

[138]  Kenneth D. Forbus,et al.  Sketching for military courses of action diagrams , 2003, IUI '03.

[139]  Leonard Stapleton.  Perceptual attention to contact analogue head-up displays , 1997 .

[140]  Umberto Castiello,et al.  Comparing Effects of 2-D and 3-D Visual Cues During Aurally Aided Target Acquisition , 2004, Hum. Factors.

[141]  Arthur F. Kramer,et al.  Comparison of tactile and visual feedback for a multi-state input mechanism , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[142]  C. Spence,et al.  Tool-use changes multimodal spatial interactions between vision and touch in normal humans , 2002, Cognition.

[143]  Denis Mottet,et al.  Behind Fitts' law: kinematic patterns in goal-directed movements , 2004, Int. J. Hum. Comput. Stud..

[144]  Stephen A. Brewster,et al.  Constructing sonified haptic line graphs for the blind student: first steps , 2000, Assets '00.

[145]  Fred H. Previc,et al.  Nonvisual Spatial Orientation Mechanisms , 2004 .

[146]  K.B.L. Prynne.  Design of visual, audio and tactile interfaces for new vehicle control systems , 1995 .

[147]  William J. Mitchell,et al.  Tactile, spatial interfaces for computer-aided design: superimposing physical media and computation , 2003 .

[148]  Hiroshi Furukawa,et al.  Operator's situation awareness under different levels of automation; evaluations through probabilistic human cognitive simulations , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[149]  Mary Czerwinski,et al.  Business: trends in future Web designs: what's next for the HCI professional? , 1998, INTR.

[150]  Mark H. Draper,et al.  Effects of Image Scale and System Time Delay on Simulator Sickness within Head-Coupled Virtual Environments , 2001, Hum. Factors.

[151]  D R Perrott,et al.  Auditory and visual localization performance in a sequential discrimination task. , 1993, The Journal of the Acoustical Society of America.

[152]  J.B.F. van Erp,et al.  Vibro-Tactile Information Presentation in Automobiles , 2001 .

[153]  John Keller,et al.  Human performance modeling for discrete-event simulation: workload , 2002, Proceedings of the Winter Simulation Conference.

[154]  Jun Rekimoto,et al.  TouchEngine: a tactile display for handheld devices , 2002, CHI Extended Abstracts.

[155]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[156]  D B Boles,et al.  A simultaneous task comparison of differentiated and undifferentiated hemispheric resource theories. , 1998, Journal of experimental psychology. Human perception and performance.

[157]  Alistair D. N. Edwards,et al.  Multiple modalities in adapted interfaces , 1995 .

[158]  Alessandro Orso,et al.  Gammatella: Visualizing Program-Execution Data for Deployed Software , 2004, Inf. Vis..

[159]  D. Tucker,et al.  Localization of Auditory Evoked Potentials Related to Selective Intermodal Attention , 1997, Journal of Cognitive Neuroscience.

[160]  C K Adams,et al.  Two-point threshold as a function of position in the dermatome. , 1966, Journal of comparative and physiological psychology.

[161]  Calle Sjöström,et al.  Using haptics in computer interfaces for blind people , 2001, CHI Extended Abstracts.

[162]  Jon Driver,et al.  Multimodal spatial constraints on tactile selective attention. , 1996 .

[163]  N. Kanwisher,et al.  Functional Magnetic Resonance Imaging Provides New Constraints on Theories of the Psychological Refractory Period , 2004, Psychological science.

[164]  T Dobbins,et al.  The Use of Tactile Navigation Cues In High-Speed Craft Operations , 2003 .

[165]  Christopher D. Wickens,et al.  Frames of Reference for Navigation , 1999 .

[166]  Björn Schuller,et al.  Using multimodal interaction to navigate in arbitrary virtual VRML worlds , 2001, Workshop on Perceptive User Interfaces.

[167]  E. Donchin,et al.  P300 and tracking difficulty: evidence for multiple resources in dual-task performance. , 1980, Psychophysiology.

[168]  Hui Zhang,et al.  Demo: a multi-modal training environment for surgeons , 2003, ICMI '03.

[169]  Chris North,et al.  An ordering of secondary task display attributes , 2002, CHI Extended Abstracts.

[170]  Hans Peter Graf,et al.  Robust recognition of faces and facial features with a multi-modal system , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[171]  A. Murata,et al.  Rate of information processing during simultaneous presentation of auditory and visual information , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[172]  Hendrik A. H. C. van Veen,et al.  Waypoint navigation with a vibrotactile waist belt , 2005, TAP.

[173]  Dan Morris,et al.  Individual audio channels with single display groupware: effects on communication and task strategy , 2004, CSCW.

[174]  Hui Tang,et al.  TWO-WAY COMMUNICATION THROUGH AN ORAL-BASED TACTILE INTERFACE: PRELIMINARY RESULTS , 2001 .

[175]  Chaomei Chen.  Individual differences in a spatial-semantic virtual environment , 2000, J. Am. Soc. Inf. Sci..

[176]  Joachim Meyer,et al.  Use of Warnings in an Attentionally Demanding Detection Task , 2001, Hum. Factors.

[177]  Joseph Lee Rodgers,et al.  Theory development should begin (but not end) with good empirical fits: a comment on Roberts and Pashler (2000). , 2002, Psychological review.

[178]  H. Pashler.  Do response modality effects support multiprocessor models of divided attention? , 1990, Journal of experimental psychology. Human perception and performance.

[179]  Walter Schneider,et al.  Deciding the Existence of a Time-Sharing Ability: A Combined Methodological and Theoretical Approach , 1984 .

[180]  Christopher D. Wickens,et al.  Tactical Displays for Combat Awareness: An Examination of Dimensionality and Frame of Reference Concepts and the Application of Cognitive Engineering , 2000 .

[181]  John M. Reising,et al.  Exploring Techniques for Target Designation Using 3-D Stereo Map Display , 1993 .

[182]  Lars Eriksson,et al.  Vibrotactile and Visual Threat Cueing with High G Threat Intercept in Dynamic Flight Simulation , 2006 .

[183]  Daniel R. Tufano,et al.  Automotive HUDs: The Overlooked Safety Issues , 1997, Hum. Factors.

[184]  R C Bice.  Apparent Movement in Vibrotactile Displays , 1969, Perceptual and motor skills.

[185]  Christopher D. Wickens,et al.  Driving and highway safety. , 2000 .

[186]  Darwin G. Caldwell,et al.  Multi-modal cutaneous tactile feedback , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[187]  Randall Bone,et al.  CDTI ENHANCED FLIGHT RULES. , 2003 .

[188]  Motoyuki Akamatsu,et al.  Movement characteristics using a mouse with tactile and force feedback , 1996, Int. J. Hum. Comput. Stud..

[189]  J. Lorenceau,et al.  Crossmodal integration for perception and action , 2004, Journal of Physiology-Paris.

[190]  M. Paradiso,et al.  Feature-specific effects of selective visual attention , 1995, Vision Research.

[191]  Robert W. Lindeman,et al.  Effectiveness of directional vibrotactile cuing on a building-clearing task , 2005, CHI.

[192]  Christopher D. Wickens,et al.  Task Dependent Differences and Individual Differences in Dual Task Performance , 1980 .

[193]  Nadine B. Sarter,et al.  Good Vibrations: Tactile Feedback in Support of Attention Allocation and Human-Automation Coordination in Event-Driven Domains , 1999, Hum. Factors.

[194]  Marilyn Tremaine.  CHI '01 Extended Abstracts on Human Factors in Computing Systems , 2001, CHI Extended Abstracts.

[195]  Hong Z. Tan,et al.  Perceptual user interfaces: haptic interfaces , 2000, CACM.

[196]  Richard D. Gilson,et al.  Multi-modal information processing for visual workload relief , 1980 .

[197]  Tsuneo Yoshikawa,et al.  Human Skill Transfer Using Haptic Virtual Reality Technology , 1999, ISER.

[198]  Yili Liu,et al.  Use of Computer Graphics and Cluster Analysis in Aiding Relational Judgment , 1992 .

[199]  Walter J. Karplus,et al.  Intelligibility of Speech in a Virtual 3-D Environment , 2002, Hum. Factors.

[200]  Emily Bennett.  Projection augmented models: the effect of haptic feedback on subjective and objective human factors , 2004, ICMI '04.

[201]  Donald L. Fisher,et al.  Steps toward Building Mathematical and Computer Models from Cognitive Task Analyses , 2003, Hum. Factors.

[202]  Daniel C. Asmar,et al.  A robot's spatial perception communicated via human touch , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[203]  D. Madden.  Adult Age Differences in the Attentional Capacity Demands of Visual Search , 1986 .

[204]  James M. Van Verth,et al.  Adding force feedback to graphics systems: issues and solutions , 1996, SIGGRAPH.

[205]  Sandra P. Marshall.  New techniques for evaluating innovative interfaces with eye tracking , 2003, ICMI '03.

[206]  Cagatay Basdogan,et al.  Haptics in virtual environments: taxonomy, research status, and challenges , 1997, Comput. Graph..

[207]  Rupert Ah.  Tactile situation awareness system: proprioceptive prostheses for sensory deficiencies. , 2000 .

[208]  Paul P. Maglio,et al.  Tradeoffs in displaying peripheral information , 2000, CHI.

[209]  Holly Irwin-Chase,et al.  A methodology to control for individual differences in dual-task performance , 2004 .

[210]  Dimitris E. Koulouriotis,et al.  Anamorphosis of fuzzy cognitive maps for operation in ambiguous and multi-stimulus real world environments , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[211]  Alexander Zelinsky,et al.  Visual gesture interfaces for virtual environments , 2002, Interact. Comput..

[212]  Roy Luria,et al.  Increased Control Demand Results in Serial Processing , 2005, Psychological science.

[213]  Stephen R. Gulliver,et al.  Pervasive and standalone computing: the perceptual effects of variable multimedia quality , 2004, Int. J. Hum. Comput. Stud..

[214]  H. Artman,et al.  Team situation assessment and information distribution , 2000, Ergonomics.

[215]  Paula J. Durlach,et al.  Change Blindness and Its Implications for Complex Monitoring and Control Systems Design and Operator Training , 2004, Hum. Comput. Interact..

[216]  Haruki Ueno,et al.  On Tracking of Eye for Human-Robot Interface , 2004, Int. J. Robotics Autom..

[217]  B. F. van Jan,et al.  The Multi-Dimensional Nature of Encoding Tactile and Haptic Interactions: From Psychophysics to Design Guidelines , 2006 .

[218]  Thomas A. Furness,et al.  Unique shared-aperture display with head or target tracking , 2002, Proceedings IEEE Virtual Reality 2002.

[219]  草島 時介.  Visual reading and braille reading : an experimental investigation of the physiology and psychology of visual and tactual reading , 1974 .

[220]  Stephen A. Brewster,et al.  Comparing two haptic interfaces for multimodal graph rendering , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[221]  Hiroshi Ishii,et al.  ComTouch: design of a vibrotactile communication device , 2002, DIS '02.

[222]  P. Goolkasian,et al.  Bimodal format effects in working memory. , 2005, The American journal of psychology.

[223]  Hiroo Iwata.  Haptic screen , 1998, SIGGRAPH '98.

[224]  Melroy E. D'Souza.  The Design of a Visual Display for the Presentation of Statistical Quality Control Information to Operators on the Plant Floor , 1999, Hum. Factors.

[225]  Robert S. Bolia.  Special Issue: Spatial Audio Displays for Military Aviation , 2004 .

[226]  James C. Bliss.  A Relatively High-Resolution Reading Aid for the Blind , 1969 .

[227]  Michael D. Byrne,et al.  Returning Human Factors to an Engineering Discipline: Expanding the Science Base through a New Generation of Quantitative Methods - Preface to the Special Section , 2003, Hum. Factors.

[228]  Mark S. Young,et al.  Malleable Attentional Resources Theory: A New Explanation for the Effects of Mental Underload on Performance , 2002, Hum. Factors.

[229]  C D Wickens,et al.  Assessment of pilot performance and mental workload in rotary wing aircraft. , 1993, Ergonomics.

[230]  Y C Liu,et al.  Comparative study of the effects of auditory, visual and multimodality displays on drivers' performance in advanced traveller information systems , 2001, Ergonomics.

[231]  Andy Cockburn,et al.  Improving the Acquisition of Small Targets , 2004 .

[232]  Kevin B. Bennett,et al.  Configural Display Design Techniques Considered at Multiple Levels of Evaluation , 2001, Hum. Factors.

[233]  V. S. Ellingstad,et al.  Effects of Report Order, Identification Method, and Stimulus Characteristics on Multidimensional Stimulus Identification , 1996, Perceptual and motor skills.

[234]  Franz Freyberger,et al.  Interactive stereo vision telepresence for correct communication of spatial geometry , 2003, Adv. Robotics.

[235]  J. Szewczyk,et al.  Difficulties with the novices' comprehension of the computer-aided design (CAD) interface: Understanding visual representations of CAD tools , 2003 .

[236]  Torbjörn Alm.  How to put the real world into a 3D aircraft display , 2001 .

[237]  L E Marks,et al.  On cross-modal similarity: auditory-visual interactions in speeded discrimination. , 1987, Journal of experimental psychology. Human perception and performance.

[238]  Mandayam A. Srinivasan,et al.  The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments , 1997, Dynamic Systems and Control.

[239]  Brigitte Röder,et al.  Attending to visual or auditory motion affects perception within and across modalities: an event‐related potential study , 2005, The European journal of neuroscience.

[240]  C D Wickens,et al.  Lateral Task Segregation and the Task-Hemispheric Integrity Effect , 1985, Human factors.

[241]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[242]  Yutaka Ishibashi,et al.  The effect of stereoscopic viewing of a virtual space on a networked game using haptic media , 2004, ACE '04.

[243]  Joachim Meyer,et al.  Effects of Warning Validity and Proximity on Responses to Warnings , 2001, Hum. Factors.

[244]  Jason S. McCarley,et al.  Bimodal Displays Improve Speech Comprehension in Environments with Multiple Speakers , 2003, Hum. Factors.

[245]  W. G. Davenport.  Vigilance for simultaneous auditory and vibrotactile signals , 1969 .

[246]  J C Bliss,et al.  Visual and tactile tracking with step commands. NASA CR-623. , 1967, NASA contractor report. NASA CR. United States. National Aeronautics and Space Administration.

[247]  Masaru Miyao,et al.  Required performance of display devices in consideration of visual characteristics of elderly people , 2002 .

[248]  Hendrik A. H. C. van Veen,et al.  Touch down: The effect of artificial touch cues on orientation in microgravity , 2006, Neuroscience Letters.

[249]  Pedro Branco.  Challenges for multimodal interfaces towards anyone anywhere accessibility: a position paper , 2001, WUAUC'01.

[250]  Mary C. Dyson,et al.  How physical text layout affects reading from screen , 2004, Behav. Inf. Technol..

[251]  Kathleen L. Mosier,et al.  Accountability and automation bias , 2000, Int. J. Hum. Comput. Stud..

[252]  Trevor Dobbins,et al.  The Use of Tactile Navigation Displays for the Reduction of Disorientation in Maritime Environments , 2003 .

[253]  Stephen A. Brewster,et al.  The Effective Combination of Haptic and Auditory Textural Information , 2000, Haptic Human-Computer Interaction.

[254]  Peter Bengtsson,et al.  Haptic/graphic interface for in-vehicle comfort functions - a simulator study and an experimental study , 2003, The 2nd IEEE Internatioal Workshop on Haptic, Audio and Visual Environments and Their Applications, 2003. HAVE 2003. Proceedings..

[255]  A. Veltman,et al.  A Tactile Cockpit Instrument to Support Altitude Control , 2003 .

[257]  Jason Williams,et al.  Designing effective haptic interaction: inverted damping , 2003, CHI Extended Abstracts.

[258]  Woodrow Barfield,et al.  Fundamentals of Wearable Computers and Augumented Reality , 2000 .

[259]  Timothy L. White,et al.  Effects of Tactile, Visual, and Auditory Cues About Threat Location on Target Acquisition and Attention to Visual and Auditory Communications , 2006 .

[260]  Bradley M. Davis.  Effects of Tactical Navigation Display Modality on Navigation Performance, Situation Awareness, and Mental Workload , 2006 .

[261]  Michael S. Ambinder,et al.  The Role of Highlighting in Visual Search Through Maps , 2004, Spatial vision.

[262]  Dylan M. Jones,et al.  Auditory Distraction and Short-Term Memory: Phenomena and Practical Implications , 2001, Hum. Factors.

[263]  D. Holding,et al.  Dual-Task Efficiency Throughout the Day , 1991 .

[264]  F. Brooks,et al.  Physiological Reaction as an Objective Measure of Presence in Virtual Environments , 2001 .

[265]  Georg v. Békésy,et al.  Sensations on the Skin Similar to Directional Hearing, Beats, and Harmonics of the Ear , 1957 .

[266]  Gerald M. Long,et al.  Contrast Sensitivity in a Dynamic Environment: Effects of Target Conditions and Visual Impairment , 2002, Hum. Factors.

[267]  Susan J. Lederman,et al.  Virtual peg-in-hole performance using a 6-DOF magnetic levitation haptic device: comparison with real forces and with visual guidance alone , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[268]  Carlo Strapparava,et al.  Multimodal Interaction for Information Access: Exploiting Cohesion , 1997, Comput. Intell..

[269]  Hendrik A. H. C. van Veen,et al.  A Tactile Cockpit Instrument Supports the Control of Self-Motion During Spatial Disorientation , 2006, Hum. Factors.

[270]  Christopher D. Wickens,et al.  The identification and transfer of timesharing skills , 1980 .

[271]  Ray E. Eberts,et al.  Development of mental models by display augmentation , 1988, IEEE Trans. Syst. Man Cybern..

[272]  Wayne J. Book,et al.  Reach out and touch someone: controlling haptic manipulators near and far , 2003 .

[273]  Adrian David Cheok,et al.  An experimental study on the role of software synthesized 3D sound in augmented reality environments , 2004, Interact. Comput..

[274]  Eric Horvitz,et al.  Selective perception policies for guiding sensing and computation in multimodal systems: a comparative analysis , 2003, ICMI '03.

[275]  H. Pashler,et al.  Is dual-task slowing instruction dependent? , 2001, Journal of experimental psychology. Human perception and performance.

[276]  Sharif Razzaque,et al.  Tactile virtual buttons for mobile devices , 2003, CHI Extended Abstracts.

[277]  Seth D. Guikema,et al.  Sensitivity analysis for multi-attribute project selection problems , 2003 .

[278]  D. Scott McCrickard,et al.  Dynamic route descriptions: tradeoffs by usage goals and user characteristics , 2002, SMARTGRAPH '02.

[279]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[280]  O. V. Prinzo,et al.  Pilot's Visual Acquisition of Traffic: Operational Communication From an In-Flight Evaluation of a Cockpit Display of Traffic Information , 2003 .

[281]  Christopher D. Wickens,et al.  Head Up versus Head Down: The Costs of Imprecision, Unreliability, and Visual Clutter on Cue Effectiveness for Display Signaling , 2003, Hum. Factors.

[282]  H. Pashler,et al.  Visual selection mediated by location: Selecting successive visual objects , 1995, Perception & psychophysics.

[283]  A. Wilska.  On the vibrational sensitivity in different regions of the body surface. , 1954, Acta physiologica Scandinavica.

[284]  C. Pleydell-Pearce,et al.  Brain Slow Potential Changes Associated with Visual Monitoring Tasks , 1993 .

[285]  Jörg Krüger,et al.  HapticWalker---a novel haptic foot device , 2005, TAP.

[286]  Rüdiger Dillmann,et al.  Haptic output in multimodal user interfaces , 1997, IUI '97.

[287]  J. Rodgers,et al.  Theory development should begin (but not end) with good empirical fits: a comment on Roberts and Pashler (2000). , 2002, Psychological review.

[288]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[289]  Hiroo Iwata,et al.  Project FEELEX: adding haptic surface to graphics , 2001, SIGGRAPH.

[290]  Jacob Buur,et al.  Interaction Styles: An Aesthetic Sense of Direction in Interface Design , 2003, Int. J. Hum. Comput. Interact..

[291]  Nadia Magnenat-Thalmann,et al.  Multimodal interaction in collaborative virtual environments , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[292]  R R Rosa,et al.  Demand transitions and sustained attention. , 1993, The Journal of general psychology.

[293]  Bert Bras,et al.  A Haptic Assembly and Disassembly Simulation Environment and Associated Computational Load Optimization Techniques , 2001, J. Comput. Inf. Sci. Eng..

[294]  M. Akamatsu.  The influence of combined visual and tactile information on finger and eye movements during shape tracing. , 1992, Ergonomics.

[295]  Ricardo S. Avila,et al.  A haptic interaction method for volume visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[296]  Reply to Rodgers and Rowe (2002) , 2003 .

[297]  Christopher Town.  Fusion of Visual and Ultrasonic Information for Environmental Modelling , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[298]  Joel Myerson,et al.  Interference with spatial working memory: An eye movement is more than a shift of attention , 2004, Psychonomic bulletin & review.

[299]  Pi-Ming Cheng,et al.  DGPS-based lane assist system for transit buses , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[300]  Joel S. Warm,et al.  Target Acquisition with UAVS: Vigilance Displays and Advanced Cueing Interfaces , 2002 .

[301]  Desney S. Tan,et al.  The Infocockpit: providing location and place to aid human memory , 2001, PUI '01.

[302]  Yoshihiro Kawai,et al.  A Support System for the Visually Disabled to Recognize 3D Objects , 1996, MVA.

[303]  Bernice E. Rogowitz,et al.  The psychology of visualization , 1993, VIS '93.

[304]  H. Pashler,et al.  Are there capacity limitations in symmetry perception? , 2004, Psychonomic bulletin & review.

[305]  C D Wickens,et al.  Implications of Graphics Enhancements for the Visualization of Scientific Data: Dimensional Integrality, Stereopsis, Motion, and Mesh , 1994, Human factors.

[306]  Dinesh K. Pai,et al.  The AHI: an audio and haptic interface for contact interactions , 2000, UIST '00.

[307]  R W Cholewiak,et al.  The generation of vibrotactile patterns on a linear array: Influences of body site, time, and presentation mode , 2000, Perception & psychophysics.

[308]  D. Allport,et al.  On the Division of Attention: A Disproof of the Single Channel Hypothesis , 1972, The Quarterly journal of experimental psychology.

[309]  Peter Robinson,et al.  Perception and haptics: towards more accessible computers for motion-impaired users , 2001, PUI '01.

[310]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[311]  Nadine B. Sarter,et al.  Not Now! Supporting Interruption Management by Indicating the Modality and Urgency of Pending Tasks , 2004, Hum. Factors.

[312]  Carl Gutwin,et al.  The Effects of Feedback on Targeting Performance in Visually Stressed Conditions , 2000, Graphics Interface.

[313]  C. Wickens,et al.  Display Formatting in Information Integration and Nonintegration Tasks , 1987 .

[314]  Michael W. Haas,et al.  A Landing Task Investigation Involving Haptics in a Cave Environment , 2001 .

[315]  P. Jolicoeur,et al.  A central capacity sharing model of dual-task performance. , 2003, Journal of experimental psychology. Human perception and performance.

[316]  Stephen A. Brewster,et al.  Hands-on haptics: exploring non-visual visualization using the sense of touch , 2005, CHI EA '05.

[317]  Alex Waibel,et al.  Modeling and Interpreting Multimodal Inputs: A Semantic Integration Approach , 1997 .

[318]  Christopher D. Wickens,et al.  Proximity Compatibility and Information Display: Effects of Color, Space, and Objectness on Information Integration , 1990 .

[319]  R. Campbell,et al.  Audiovisual Integration of Speech Falters under High Attention Demands , 2005, Current Biology.

[320]  Hong Qin,et al.  Virtual clay: a real-time sculpting system with haptic toolkits , 2001, I3D '01.

[321]  C. Frith,et al.  Modulation of human visual cortex by crossmodal spatial attention. , 2000, Science.

[322]  Christine L. MacKenzie,et al.  Auditory, graphical and haptic contact cues for a reach, grasp, and place task in an augmented environment , 2003, ICMI '03.

[323]  Martin Buss,et al.  Distributed PC-based haptic, visual and acoustic telepresence system-experiments in virtual and remote environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[324]  H Pashler,et al.  Repetition blindness: perception or memory failure? , 1995, Journal of experimental psychology. Human perception and performance.

[325]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[326]  Jonathan C. Roberts.  Visualization equivalence for multisensory perception: learning from the visual , 2004 .

[327]  Daniel T. Levin,et al.  Unseen and Unaware: Implications of Recent Research on Failures of Visual Awareness for Human-Computer Interface Design , 2004, Hum. Comput. Interact..

[328]  David E. Kancler,et al.  Evaluation of mobile computing displays , 2000, Defense, Security, and Sensing.

[329]  Catherine M. Burns,et al.  Putting It All Together: Improving Display Integration in Ecological Displays , 2000, Hum. Factors.

[330]  Sungchul Kang,et al.  Multi-modal user interface for teleoperation of ROBHAZ-DT2 field robot system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[331]  Lester C. Loschky,et al.  Gaze-Contingent Multiresolutional Displays: An Integrative Review , 2003, Hum. Factors.

[332]  K O Johnson,et al.  The limit of tactile spatial resolution in humans , 1994, Neurology.

[333]  Z. Kacic,et al.  The design of mobile multimodal communication device - personal navigator , 2001, EUROCON'2001. International Conference on Trends in Communications. Technical Program, Proceedings (Cat. No.01EX439).

[334]  Ed Lantz,et al.  Future directions in visual display systems , 1997, COMG.

[335]  Julie A. Jacko,et al.  Toward achieving universal usability for older adults through multimodal feedback , 2002 .

[336]  Christopher D. Wickens,et al.  Display Formatting Techniques for Improving Situation Awareness in the Aircraft Cockpit , 1991 .

[337]  L. Gugerty.  Situation Awareness During Driving: Explicit and Implicit Knowledge in Dynamic Spatial Memory , 1997 .

[338]  Trevor Darrell,et al.  A virtual mirror interface using real-time robust face tracking , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[339]  Albrecht Schmidt,et al.  Applying wearable sensors to avalanche rescue , 2003, Comput. Graph..

[340]  J. C. Johnston,et al.  Chronometric Evidence for Central Postponement in Temporally Overlapping Tasks , 2003 .

[341]  Timothy Cribbin,et al.  Virtual information space navigation: Evaluating the use of head tracking , 2001, Behav. Inf. Technol..

[342]  R. Marois,et al.  Capacity limits of information processing in the brain , 2005, Trends in Cognitive Sciences.

[343]  Karon E. MacLean,et al.  Haptic techniques for media control , 2001, UIST '01.

[344]  Colin Ware,et al.  Eye-hand co-ordination with force feedback , 2000, CHI.

[345]  Tien-Tsin Wong,et al.  A haptic needle manipulation simulator for chinese acupuncture learning and training , 2004, VRCAI '04.

[346]  C D Wickens,et al.  The Event-Related Brain Potential as an Index of Display-Monitoring Workload , 1980, Human factors.

[347]  J. Driver,et al.  Control of Cognitive Processes: Attention and Performance XVIII , 2000 .

[348]  Robert E. Schlegel,et al.  Tactile Stimulation of the Human Head for Information Display , 1994 .

[349]  Ming C. Lin,et al.  User-centric viewpoint computation for haptic exploration and manipulation , 2001, Proceedings Visualization, 2001. VIS '01..

[350]  Cagatay Basdogan,et al.  Autostereoscopic and haptic visualization for space exploration and mission design , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[351]  Charles C. MacAdam,et al.  Understanding and Modeling the Human Driver , 2003 .

[352]  John Vavrik,et al.  Effect of a Concurrent Auditory Task on Visual Search Performance in a Driving-Related Image-Flicker Task , 2002, Hum. Factors.

[353]  Charles G. Halcomb,et al.  Virtually everything about virtual reality. , 1997 .

[354]  Ingrid M. L. C. Vogels,et al.  Detection of Temporal Delays in Visual-Haptic Interfaces , 2004, Hum. Factors.

[355]  Virpi Roto,et al.  Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI , 2005, CHI.

[356]  Liang Chen,et al.  QuickSet: Multimodal Interaction for Simulation Set-up and Control , 1997, ANLP.

[357]  A J Nash,et al.  P300 and allocation of attention in dual-tasks. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[358]  Georg v. Békésy,et al.  Similarities between hearing and skin sensations. , 1959 .

[359]  Eduardo Salas,et al.  Problem solving performance and display preference for information displays depicting numerical functions , 1988, SGCH.

[360]  Frank Jacob Seagull.  Problems With Auditory Alarms in Anesthesia and Tests of a Proposed Solution: Multimodal Multitask Performance With an Auditory Display , 2001 .

[361]  Philip H. Marsden,et al.  Affective multi-modal interfaces: the case of McGurk effect , 2003, IUI '03.

[362]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[363]  Linda R. Elliott,et al.  Effects of Visual, Auditory, and Tactile Cues on Army Platoon Leader Decision Making , 2005 .

[364]  Lionel Médini,et al.  Reinventing the familiar: exploring an augmented reality design space for air traffic control , 1998, CHI.

[365]  C D Wickens,et al.  The effects of divided attention on information processing in manual tracking. , 1976, Journal of experimental psychology. Human perception and performance.

[366]  Natasha Merat,et al.  Surrogate in-vehicle information systems and driver behaviour: effects of visual and cognitive load in simulated rural driving , 2005 .

[367]  Christopher D. Wickens,et al.  Superimposition, Symbology, Visual Attention, and the Head-Up Display , 1997, Hum. Factors.

[368]  C D Wickens,et al.  Head-Up Displays: Effect of Clutter, Display Intensity, and Display Location on Pilot Performance , 1998 .

[369]  Harvey S. Smallman,et al.  The Use of 2D and 3D Displays for Shape-Understanding versus Relative-Position Tasks , 2001, Hum. Factors.

[370]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[371]  Alex Pentland,et al.  Tactual displays for wearable computing , 2005, Personal Technologies.

[372]  F. Strack,et al.  Approach/Avoidance–Related Motor Actions and the Processing of Affective Stimuli: Incongruency Effects in Automatic Attention Allocation , 2005 .

[373]  Mary C. Whitton,et al.  Effects of Handling Real Objects and Self-Avatar Fidelity on Cognitive Task Performance and Sense of Presence in Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[374]  Gerhard Rigoll,et al.  Evaluating Multimodal Interaction Patterns in Various Application Scenarios , 2003, Gesture Workshop.

[375]  F. Macar,et al.  Effects of attention manipulation on judgments of duration and of intensity in the visual modality , 1997, Memory & cognition.

[376]  Peter Tarasewich,et al.  Testing visual notification cues on a mobile device , 2004, CHI EA '04.

[377]  Dorée D. Seligmann,et al.  Providing assurances in a multimedia interactive environment , 1995, CHI '95.

[378]  Jon Driver,et al.  Cross-modal links in attention between audition, vision, and touch: Implications for interface design , 1997 .

[379]  A. Reinberg,et al.  Differences between left- and right-hand reaction time rhythms: indications of shifts in strategies of human brain activity. , 1997, Brain research. Cognitive brain research.

[380]  C D Wickens,et al.  Multiple Resources, Task-Hemispheric Integrity, and Individual Differences in Time-Sharing , 1981, Human factors.

[381]  Gilbert Cockton,et al.  CHI '03 Extended Abstracts on Human Factors in Computing Systems , 2003, CHI 2003.

[382]  Michael Scott,et al.  Effect of cognitive load on tactor location identification in zero-g , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[383]  James T. Townsend,et al.  Tactile perception of sequentially presented spatial patterns , 1966 .

[384]  Jack M. Loomis,et al.  Limited Field of View of Head-Mounted Displays Is Not the Cause of Distance Underestimation in Virtual Environments , 2004, Presence: Teleoperators & Virtual Environments.

[385]  Joachim Meyer,et al.  Why Better Operators Receive Worse Warnings , 2002, Hum. Factors.

[386]  G. Hirzinger,et al.  Flexible multimodal telepresent assembly using a generic interconnection framework , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[387]  Stephen Brewster,et al.  Using non-speech sound to overcome information overload , 1997 .

[388]  Yutaka Ishibashi,et al.  Inter-stream synchronization between haptic media and voice in collaborative virtual environments , 2004, MULTIMEDIA '04.

[389]  H. Pashler,et al.  Dual-task interference with equal task emphasis: Graded capacity sharing or central postponement? , 2003, Perception & psychophysics.

[390]  A. F. Rovers,et al.  HIM: a framework for haptic instant messaging , 2004, CHI EA '04.

[391]  Ivan Poupyrev,et al.  Haptic feedback for pen computing: directions and strategies , 2004, CHI EA '04.

[392]  Kevin B. Bennett,et al.  An Empirical Comparison of Alternative Methodologies for the Evaluation of Configural Displays , 2000, Hum. Factors.

[393]  Daniel V. McGehee,et al.  Collision Warning Timing, Driver Distraction, and Driver Response to Imminent Rear-End Collisions in a High-Fidelity Driving Simulator , 2002, Hum. Factors.

[394]  Graham A. Murrell,et al.  Combination of evidence in a probabilistic visual search and detection task , 1977 .

[395]  Cristiana Cavina-Pratesi,et al.  Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time , 2002, Experimental Brain Research.

[396]  Metin Sitti,et al.  Teleoperated touch feedback from the surfaces at the nanoscale: modeling and experiments , 2003 .

[397]  Marilyn Rose McGee.  A haptically enhanced scrollbar : Force-Feedback as a means of reducing the problems associated with scrolling , 1999 .

[398]  H. Pashler.  Dual-task interference and elementary mental mechanisms , 1993 .

[399]  Lucy Y. Pao,et al.  Synergistic visual/haptic rendering modes for scientific visualization , 2004, IEEE Computer Graphics and Applications.

[400]  R. A. Gargan,et al.  Multimodal response planning: an adaptive rule based approach , 1988, CHI '88.

[401]  Sion Jennings,et al.  Time Delays in Visually Coupled Systems During Flight Test and Simulation , 2004 .

[402]  Jan W. H. Schnupp,et al.  The detection of multisensory stimuli in an orthogonal sensory space , 2005, Experimental Brain Research.

[403]  F A GELDARD,et al.  Some neglected possibilities of communication. , 1960, Science.

[404]  J. Ells,et al.  Combining Letter-Matching and Tone Discrimination: Evidence of Automatic Perceptual and Spatial Congruity Effects , 1993 .

[405]  Masami Kobayashi,et al.  Telexistence cockpit for humanoid robot control , 2003, Adv. Robotics.

[406]  Albrecht Schmidt,et al.  Using an autonomous cube for basic navigation and input , 2003, ICMI '03.

[407]  Peter A. Hancock,et al.  Effects of critical information saliency on task performance: application of ecological information augmentation in a cockpit display of traffic information , 2001 .

[408]  Keith Nesbitt,et al.  Using force feedback for multi-sensory display , 2001, Proceedings Second Australasian User Interface Conference. AUIC 2001.

[409]  Christopher M. Schlick,et al.  A study of audio and visual context switch indicators in a multirobot navigation task , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[410]  Joshua D. Hoffman,et al.  Collision warning design to mitigate driver distraction , 2004, CHI.

[411]  齋藤 大輔,et al.  Tactile-visual cross-modal shape matching : A functional MRI study , 2003 .

[412]  Kay M. Stanney,et al.  Deriving haptic design guidelines from human physiological, psychophysical, and neurological foundations , 2004, IEEE Computer Graphics and Applications.

[413]  Emily Bennett,et al.  The effect touching a projection augmented model has on perception and object-presence , 2005, CHI Extended Abstracts.

[414]  C. Wickens,et al.  Workload transition: Implications for individual and team performance. , 1993 .

[415]  John Kenneth Salisbury,et al.  Making graphics physically tangible , 1999, CACM.

[416]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[417]  M. Akamatsu.  Touch with a mouse-a mouse type interface device with tactile and force display , 1994, Proceedings of 1994 3rd IEEE International Workshop on Robot and Human Communication.

[418]  Daniel Gopher,et al.  Control Theory Measures of Tracking as Indices of Attention Allocation Strategies , 1977 .

[419]  James E. Sheedy,et al.  Filters on computer displays – effects on legibility, performance and comfort , 2003, Behav. Inf. Technol..

[420]  J. Driver,et al.  Audiovisual links in endogenous covert spatial attention. , 1996, Journal of experimental psychology. Human perception and performance.

[421]  Alistair Furnell,et al.  Understanding Multisensory Integration for Pilot Spatial Orientation , 2004 .

[422]  Brian P. Bailey,et al.  If not now, when?: the effects of interruption at different moments within task execution , 2004, CHI.

[423]  T Meiser.  [Memory advantage of performed actions: comments on multimodal memory theory]. , 2000, Zeitschrift fur experimentelle Psychologie : Organ der Deutschen Gesellschaft fur Psychologie.

[424]  Lisa F. Weinstein,et al.  Use of Nontraditional Flight Displays for the Reduction of Central Visual Overload in the Cockpit , 1992 .

[425]  P. Bach-y-Rita.  Tactile Sensory Substitution Studies , 2004, Annals of the New York Academy of Sciences.

[426]  Cagatay Basdogan,et al.  An experimental study on the role of touch in shared virtual environments , 2000, TCHI.

[427]  Martin Buss,et al.  A systems theoretical model for human perception in multimodal presence systems , 2001 .

[428]  Josef van Genabith,et al.  Visual Salience and Reference Resolution in Simulated 3-D Environments , 2004, Artificial Intelligence Review.

[429]  Richard M. Crowder,et al.  A non-tactile sensor for seam tracking and vision applications , 1994 .

[430]  Joel S. Warm,et al.  The Effects of Signal Salience and Caffeine on Performance, Workload, and Stress in an Abbreviated Vigilance Task , 2000, Hum. Factors.

[431]  Andrea H. Mason,et al.  Reaching movements to augmented and graphic objects in virtual environments , 2001, CHI.

[432]  Robin J. Burgess-Limerick,et al.  Visual Display Height , 2000, Hum. Factors.

[433]  A. Friedman,et al.  Dividing attention within and between hemispheres: testing a multiple resources approach to limited-capacity information processing. , 1982, Journal of experimental psychology. Human perception and performance.

[434]  M. Ernst,et al.  Feeling what you hear: auditory signals can modulate tactile tap perception , 2005, Experimental Brain Research.

[435]  T D Wickens,et al.  When further learning fails: stability and change following repeated presentation of text. , 2000, British journal of psychology.

[436]  Nadine B. Sarter,et al.  Multimodal Communication In Support of Coordinative Functions in Human-Machine Teams , 2001 .

[437]  Amin Zandvakili,et al.  Adaptation to spiral motion: global but not local motion detectors are modulated by attention , 2005, Vision Research.

[438]  THE HAGUE-THE NETHERLANDS , 2022 .

[439]  Christopher D. Wickens,et al.  Object versus space-based models of visual attention: Implications for the design of head-up displays , 1995 .

[440]  Richard D. Gilson,et al.  Behavioral Influences of Proximal Alarms , 2001, Hum. Factors.

[441]  Mary L. Cummings,et al.  The Need for Command and Control Instant Message Adaptive Interfaces: Lessons Learned from Tactical Tomahawk Human-in-the-Loop Simulations , 2004, Cyberpsychology Behav. Soc. Netw..

[442]  Arthur D. Fisk,et al.  Learning to Use a Home Medical Device: Mediating Age-Related Differences with Training , 2002, Hum. Factors.

[443]  R. Riener,et al.  Phantom-based multimodal interactions for medical education and training: the Munich knee joint simulator , 2004, IEEE Transactions on Information Technology in Biomedicine.

[444]  S. Medvedev,et al.  Mechanisms of Selective Attention during Competitive Discrimination of Visual and Auditory Verbal Information: Positron Emission Tomography and Cortical Evoked Potential Studies , 2003, Human Physiology.

[445]  Sara B. Kiesler,et al.  Calling while driving: effects of providing remote traffic context , 2005, CHI.

[446]  D. L. Reich,et al.  Application of Fuzzy Functions for Visual Presentation of Medical Data , 2004, Journal of Medical Systems.

[447]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[448]  J. Shi,et al.  Adding haptic feedback to engineering simulation , 2003, ISICT.

[449]  Koji Tsukada,et al.  ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation , 2004, UbiComp.

[450]  Herbert A. Colle,et al.  Spatial Orientation in 3-D Desktop Displays: Using Rooms for Organizing Information , 2003, Hum. Factors.

[451]  Roope Raisamo,et al.  Experiences on haptic interfaces for visually impaired young children , 2004, ICMI '04.

[452]  Masatake Higashi,et al.  Application of haptic navigation to modify free-form surfaces through specified points and curves , 2002, SMA '02.

[453]  Harold Pashler,et al.  Reply to Rodgers and Rowe , 2002 .

[454]  Christopher M. Smith.  Human factors in haptic interfaces , 1997, CROS.

[455]  J. V. Van Erp,et al.  Presenting directions with a vibrotactile torso display , 2005, Ergonomics.

[456]  Gary S. Robinson,et al.  A New Class of Auditory Warning Signals for Complex Systems: Auditory Icons , 1999, Hum. Factors.

[457]  Linda R. Elliott,et al.  Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis , 2006, ICMI '06.

[458]  Hiroo Iwata.  Full-Surround Image Display Technologies , 2004, International Journal of Computer Vision.

[459]  Carolyn M. Sommerich,et al.  Effects of Computer Monitor Viewing Angle and Related Factors on Strain, Performance, and Preference Outcomes , 2001, Hum. Factors.

[460]  H Pashler,et al.  Dual-task interference and the cerebral hemispheres. , 1993, Journal of experimental psychology. Human perception and performance.

[461]  William V. Baxter,et al.  Physically based virtual painting , 2004, CACM.

[462]  Ben Challis.  Design principles for non-visual interaction , 2000, CHI Extended Abstracts.

[463]  J.B.F. van Erp,et al.  Tactile Torso Display as Countermeasure to Reduce Night Vision Goggles Induced Drift , 2003 .

[464]  Kirsten Rassmus-Gröhn,et al.  Supporting presence in collaborative environments by haptic force feedback , 2000, TCHI.

[465]  T. Salthouse,et al.  Division of attention: Age differences on a visually presented memory task , 1984, Memory & cognition.

[466]  J.B.F. van Erp,et al.  Vibrotactile waypoint navigation at sea and in the air : two case studies , 2004 .

[467]  Donald Fucci,et al.  A Preliminary Report of Oral Tactile Sensation and Responses to Delayed Auditory Feedback , 1988, Perceptual and motor skills.

[468]  Ivan Poupyrev,et al.  Tactile interfaces for small touch screens , 2003, UIST '03.

[469]  Young Woo Sohn,et al.  Serial Presentation of Computer Graphics: Training Effects and Strategy Development for Analytic and Holistic Cognitive Styles , 2003 .

[470]  Christopher D. Wickens,et al.  Target Cuing in Visual Search: The Effects of Conformality and Display Location on the Allocation of Visual Attention , 1999, Hum. Factors.

[471]  Michael A. Kraut,et al.  Object Activation in Semantic Memory from Visual Multimodal Feature Input , 2002, Journal of Cognitive Neuroscience.

[472]  Michael Stonebraker,et al.  VIDA: (Visual Information Density Adjuster) , 1999, CHI EA '99.

[473]  S. Charles,et al.  10 - Crossmodal Attentional Capture: A Controversy Resolved? , 2001 .

[474]  Susumu Horiguchi,et al.  Tele-Handshake: Cooperative Shared Haptic Virtual Environment , 2001 .

[475]  Thomas J. Overbye,et al.  Human Factors Aspects of Power System Visualizations: An Empirical Investigation , 2002 .

[476]  C. Cornoldi,et al.  Modality-specific Auditory Imaging and the Interactive Imagery Effect , 1997 .

[477]  Bir Bhanu,et al.  Moving Humans Detection Based on Multi-Modal Sensor Fusion , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[478]  Patrick Bourke,et al.  A General Factor Involved in Dual-task Performance Decrement , 1996 .

[479]  R. Bowen Loftin,et al.  Multisensory perception: beyond the visual in visualization , 2003, Comput. Sci. Eng..

[480]  Christopher D. Wickens,et al.  Attentional Filtering in the Design of Electronic Map Displays: A Comparison of Color Coding, Intensity Coding, and Decluttering Techniques , 2001, Hum. Factors.

[481]  B. J. Fogg,et al.  HandJive: a device for interpersonal haptic entertainment , 1998, CHI.

[482]  Scott Brenner Brave.  Tangible interfaces for remote communication and collaboration , 1998 .

[483]  Arthur F. Kramer,et al.  A multilevel input system with force-sensitive elements , 2001, Int. J. Hum. Comput. Stud..

[484]  Wooseob Jeong,et al.  Multimodal Geographic Information Systems: Adding Haptic and Auditory Display , 2003, J. Assoc. Inf. Sci. Technol..

[485]  Joseph Cohn,et al.  Virtual Technologies and Environments for Expeditionary Warfare Training (panel) , 2002, VR.

[486]  Mark W. Becker,et al.  Volatile visual representations: Failing to detect changes in recently processed information , 2002, Psychonomic bulletin & review.

[487]  S. Bagnara,et al.  The management of human errors in user-centered design , 1996, SGCH.

[488]  Hong Z. Tan,et al.  Development of a wearable haptic display for situation awareness in altered-gravity environment: some initial findings , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[489]  Anoop Gupta,et al.  Designing and deploying an information awareness interface , 2002, CSCW '02.

[490]  Ivar Oswalt.  Technology trends in military simulation , 1995, WSC '95.

[491]  Darren Leigh,et al.  Haptic pen: a tactile feedback stylus for touch screens , 2004, UIST '04.

[492]  Philip R. Cohen,et al.  Unification-based multimodal integration , 1997 .

[493]  Joel S. Warm,et al.  Evaluating Adaptive Multisensory Displays for Target Localization in a Flight Task , 2004 .

[494]  Alan C. Brady,et al.  Results from a Tactile Array on the Fingertip , 2003 .

[495]  K S Seidler,et al.  Information access in a dual-task context: testing a model of optimal strategy selection. , 1997, Journal of experimental psychology. Applied.

[496]  Christian Bauckhage,et al.  Combining speech and haptics for intuitive and efficient navigation through image databases , 2003, ICMI '03.

[497]  Lars Eriksson,et al.  Uni- and Bimodal Threat Cueing with Vibrotactile and 3D Audio Technologies in a Combat Vehicle , 2006 .

[498]  Christopher D. Wickens,et al.  Two- and Three-Dimensional Displays for Aviation: A Theoretical and Empirical Comparison , 1993 .

[499]  Glenn A. Martin,et al.  Haptic enhancements for collaborative scenarios in virtual environment , 2003, SIGGRAPH '03.

[500]  Tetsuri Inoue.  VDT eyeglasses—multifocal lenses for near distance use , 2002 .

[501]  K. T. Petersen,et al.  Modeling and evaluation of multimodal perceptual quality , 1997 .

[502]  Dong-Soo Kwon,et al.  Shape retaining chain linked model for real-time volume haptic rendering , 2002, Symposium on Volume Visualization and Graphics, 2002. Proceedings. IEEE / ACM SIGGRAPH.

[503]  Lonny L. Chu.  User performance and haptic design issues for a force-feedback sound editing interface , 2002, CHI Extended Abstracts.

[504]  Mark D. Lee,et al.  Multichannel Auditory Search: Toward Understanding Control Processes in Polychotic Auditory Listening , 2001, Hum. Factors.

[505]  Andy Cockburn,et al.  Multimodal feedback for the acquisition of small targets , 2005, Ergonomics.

[506]  S. B. Hutton,et al.  The effects of dividing attention on smooth pursuit eye tracking , 2005, Experimental Brain Research.

[507]  Dominic W. Massaro,et al.  A framework for evaluating multimodal integration by humans and a role for embodied conversational agents , 2004, ICMI '04.

[508]  Shirley Gregor,et al.  Explanations from knowledge-based systems and cooperative problem solving: an empirical study , 2001, Int. J. Hum. Comput. Stud..

[509]  Martin Eimer,et al.  Can attention be directed to opposite locations in different modalities? An ERP study , 1999, Clinical Neurophysiology.

[510]  John R. Anderson,et al.  Partitioning Visual Displays Aids Task-Directed Visual Search , 2004, Hum. Factors.

[511]  I. Scott MacKenzie,et al.  A comparison of three selection techniques for touchpads , 1998, CHI.

[512]  Koert van Mensvoort,et al.  What you see is what you feel: exploiting the dominance of the visual over the haptic domain to simulate force-feedback with cursor displacements , 2002, DIS '02.

[513]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[514]  Reinhard Männer,et al.  Haptic Display for a Virtual Reality Simulator for Flexible Endoscopy , 2002, EGVE.

[515]  Peng Liu,et al.  Voice activity detection using visual information , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[516]  Craig S. Miller,et al.  Modeling Information Navigation: Implications for Information Architecture , 2004, Hum. Comput. Interact..

[517]  Atsushi Ikeda,et al.  Fundamental study on human interface of narrow road drive assist system based on drivers’ cognitive process , 2003 .

[518]  Ming Ouhyoung,et al.  Head motion and latency compensation on localization of 3D sound in virtual reality , 1997, VRST '97.

[519]  C. Koch,et al.  Visual Search and Dual Tasks Reveal Two Distinct Attentional Resources , 2004, Journal of Cognitive Neuroscience.

[520]  John R. Anderson,et al.  Artitioning Visual Displays: Directing the Path of Visual Search , 2002 .

[521]  Martin Eimer,et al.  Crossmodal links in spatial attention between vision, audition, and touch: evidence from event-related brain potentials , 2001, Neuropsychologia.

[522]  Wolfgang Minker,et al.  Safety and operating issues for mobile human-machine interfaces , 2003, IUI '03.

[523]  Scott Watter.  Parallel Response Selection in Dual -Tasks , 2003 .

[524]  Yasuhiro Kanto.  A Prototype Tactile Mouse for GUI Presentation , 2003 .

[525]  Christopher D. Wickens,et al.  Pilot Maneuver Choice and Workload in Free Flight , 2002, Hum. Factors.

[526]  Trevor Darrell,et al.  A multi-modal approach for determining speaker location and focus , 2003, ICMI '03.

[527]  H. Pashler,et al.  Graded capacity-sharing in dual-task interference? , 1994, Journal of experimental psychology. Human perception and performance.

[528]  Hui Chen,et al.  Haptic-dependent navigation & interaction of hybrid virtual models , 2004, VRCAI '04.

[529]  Dimitris N. Metaxas,et al.  Feel the "fabric": an audio-haptic interface , 2003, SCA '03.

[530]  Robert S. Bolia,et al.  Asymmetric Performance in the Cocktail Party Effect: Implications for the Design of Spatial Audio Displays , 2001, Hum. Factors.

[531]  Paul Bach-y-Rita,et al.  Tactile displays , 1995 .

[532]  Kay M. Stanney,et al.  Toward Systematic Control of Cybersickness , 2004, Presence: Teleoperators & Virtual Environments.

[533]  J.B.F. van Erp,et al.  ISO's work on tactile and haptic interaction guidelines , 2006 .

[534]  K. S. Park,et al.  A simple vision-based head tracking method for eye-controlled human/computer interface , 2001, Int. J. Hum. Comput. Stud..

[535]  Hong Z. Tan,et al.  Tactile change detection , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[536]  A. A. Collins,et al.  Spatial Factors in Vibrotactile Pattern Perception , 2003 .

[537]  Ephraim P. Glinert,et al.  An experiment into the use of auditory cues to reduce visual workload , 1989, CHI '89.

[538]  Susumu Tachi,et al.  Electrocutaneous Display with Receptor Selective Stimulations , 2002 .

[539]  Christopher D. Wickens,et al.  TIME-SHARING REVISITED: TEST OF A COMPONENTIAL MODEL FOR THE ASSESSMENT OF INDIVIDUAL DIFFERENCES , 1986 .

[540]  H. Pashler.  Divided attention: Storing and classifying briefly presented objects , 1994, Psychonomic bulletin & review.

[541]  T Z Strybel,et al.  Aurally Aided Visual Search in the Central Visual Field: Effects of Visual Load and Visual Enhancement of the Target , 1991, Human factors.

[542]  E. Donchin,et al.  Performance of concurrent tasks: a psychophysiological analysis of the reciprocity of information-processing resources. , 1983, Science.

[543]  J.B.F. van Erp.  Tactile Displays in Virtual Environments , 2001 .

[544]  Ming C. Lin,et al.  A perceptually-inspired force model for haptic texture rendering , 2004, APGV '04.

[545]  Colin Ware,et al.  Linking focus and context in three-dimensional multiscale environments , 2004 .

[546]  Jens Alfredson,et al.  Improvement of tactical situation awareness with colour-coded horizontal-situation displays in combat aircraft , 1999 .

[547]  M. Woollacott,et al.  Attentional demands and postural control: the effect of sensory context. , 2000, The journals of gerontology. Series A, Biological sciences and medical sciences.

[548]  Sharon L. Oviatt,et al.  When do we interact multimodally?: cognitive load and multimodal communication patterns , 2004, ICMI '04.

[549]  Jun Rekimoto.  ThumbSense: automatic input mode sensing for touchpad-based interactions , 2003, CHI Extended Abstracts.

[550]  Sharon L. Oviatt,et al.  Ten myths of multimodal interaction , 1999, Commun. ACM.

[551]  Darwin G. Caldwell,et al.  Tactile perception and its application to the design of multi-modal cutaneous feedback systems , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[552]  J L Bradshaw,et al.  Attention and Hemispheric Differences in Reaction Time during Simultaneous Audio-Visual Tasks , 1973, The Quarterly journal of experimental psychology.

[553]  Ian Oakley,et al.  Putting the feel in ’look and feel‘ , 2000, CHI.

[554]  Dennis R. Wixon,et al.  CHI '02 Extended Abstracts on Human Factors in Computing Systems , 2002, CHI 2002.

[555]  Pheng-Ann Heng,et al.  Direct haptic rendering of isosurface by intermediate representation , 2000, VRST '00.

[556]  W. Barfield,et al.  The use of icons, earcons, and commands in the design of an online hierarchical menu , 1991 .

[557]  Christopher D Wickens,et al.  Processing Resources in Attention, Dual Task Performance, and Workload Assessment. , 1981 .

[558]  Sharon L. Oviatt,et al.  Individual differences in multimodal integration patterns: what are they and why do they exist? , 2005, CHI.

[559]  F. Mussa-Ivaldi,et al.  Brain–machine interfaces: computational demands and clinical needs meet basic neuroscience , 2003, Trends in Neurosciences.

[560]  Karin Coninx,et al.  Multisensory interaction metaphors with haptics and proprioception in virtual environments , 2004, NordiCHI '04.

[561]  Zenzi M. Griffin,et al.  Why Look? Reasons for Eye Movements Related to Language Production. , 2004 .

[562]  H. Pashler,et al.  Repetition priming in visual search: Episodic retrieval, not feature priming , 2004, Memory & cognition.

[563]  Li Hsieh,et al.  Visual event detection during simulated driving: Identifying the neural correlates with functional neuroimaging , 2004 .

[564]  Erin Piateski,et al.  Vibrotactile pattern recognition on the arm and torso , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[565]  Thad Starner,et al.  An overview of the international symposium on wearable computers 1998 , 2000, SGCH.

[566]  Jan Noyes,et al.  Navigation Aids: Effects on Crew Workload and Performance , 2000 .

[567]  I. Marsic,et al.  Natural communication with information systems , 2000, Proceedings of the IEEE.

[568]  C D Wickens.  PILOT ACTIONS AND TASKS: SELECTIONS, EXECUTION, AND CONTROL. IN: PRINCIPLES AND PRACTICE OF AVIATION PSYCHOLOGY , 2003 .

[569]  Christopher Town.  Goal-directed visual inference for multi-modal analysis and fusion , 2003 .

[570]  Chris North,et al.  Secondary Task Display Attributes - Optimizing Visualizations for Cognitive Task Suitability and Interference Avoidance , 2002, VisSym.

[571]  Neville A. Stanton,et al.  Alarm-initiated activities: an analysis of alarm handlingby operators using text-based alarm systems in supervisory control systems , 1995 .

[572]  Braden J. McGrath,et al.  Tactile Situation Awareness System Flight Demonstration , 2004 .

[573]  D. S. Alles,et al.  Information Transmission by Phantom Sensations , 1970 .

[574]  H. Pashler.  The Psychology of Attention , 1997 .

[575]  Roger J. Hubbold,et al.  Collaborative stretcher carrying: a case study , 2002, EGVE.

[576]  Harold Pashler,et al.  Expectation and repetition effects in searching for featural singletons in very brief displays , 2005, Perception & psychophysics.

[577]  Jacek Gwizdka,et al.  Individual differences and task-based user interface evaluation: a case study of pending tasks in email , 2004, Interact. Comput..

[578]  Runar Ostnes,et al.  Colour rivalry limits the application of the anaglyph method as the viewer VISUALISATION TECHNIQUES : AN OVERVIEW – PART 2 , 2022 .

[579]  Peter C.-H. Cheng,et al.  Modeling the Effect of Task and Graphical Representation on Response Latency in a Graph Reading Task , 2003, Hum. Factors.

[580]  Girish Prabhu,et al.  IN-VEHICLE NAVIGATION DISPLAYS : A HUMAN ATTENTION AND INFORMATION PROCESSING MODEL , 1995 .

[581]  Thenkurussi Kesavadas,et al.  The Effect of Display Modality on Decision-Making with Uncertainty , 2003 .

[582]  Adelbert W. Bronkhorst,et al.  Application of a Three-Dimensional Auditory Display in a Flight Task , 1996, Hum. Factors.

[583]  James T. Townsend,et al.  Information available In brief tactile presentations , 1966 .

[584]  J. M. McGuirl,et al.  Presenting in-flight icing information: a comparison of visual and tactile cues , 2001, 20th DASC. 20th Digital Avionics Systems Conference (Cat. No.01CH37219).

[585]  Hong Z. Tan,et al.  Force constancy and its effect on haptic perception of virtual surfaces , 2005, TAP.

[586]  Lucy Y. Pao,et al.  Shock and vortex visualization using a combined visual/Haptic interface , 2000 .

[587]  Ian Oakley,et al.  Solving multi-target haptic problems in menu interaction , 2001, CHI Extended Abstracts.

[588]  Vincent Hayward,et al.  The pantograph: a large workspace haptic device for multimodal human computer interaction , 1994, CHI '94.

[589]  Stephen A. Brewster,et al.  Assessing haptic properties for data representation , 2003, CHI Extended Abstracts.

[590]  Arthur M. Ryan,et al.  Multimodal Measures of Mental Workload during Dual-Task Performance: Energetic Demands of Cognitive Processes , 1992 .

[591]  C D Wickens,et al.  Principles of S-C-R Compatibility with Spatial and Verbal Tasks: The Role of Display-Control Location and Voice-Interactive Display-Control Interfacing , 1984, Human factors.

[592]  Shumin Zhai,et al.  Characterizing computer input with Fitts' law parameters-the information and non-information aspects of pointing , 2004, Int. J. Hum. Comput. Stud..

[593]  Hiroyuki Shinoda,et al.  Selectively Stimulating Skin Receptors for Tactile Display , 1998, IEEE Computer Graphics and Applications.

[594]  Julie A. Jacko,et al.  The effects of multimodal feedback on older adults' task performance given varying levels of computer experience , 2004, Behav. Inf. Technol..

[595]  Charlotte Thralls,et al.  An Interview with Edward R. Tufte , 2004 .

[596]  Tohru Ifukube,et al.  Auditory and tactile interfaces for representing the visual effects on the web , 2002, ASSETS.

[597]  Terry C Lansdown,et al.  Individual differences during driver secondary task performance: verbal protocol and visual allocation findings. , 2002, Accident; analysis and prevention.

[598]  Atsuo Murata,et al.  Evaluation of Shoulder Muscular Fatigue Induced During VDT Tasks , 2003, Int. J. Hum. Comput. Interact..

[599]  Nadine B. Sarter,et al.  Why Pilots Miss the Green Box: How Display Context Undermines Attention Capture , 2004 .

[600]  Kevin B. Bennett,et al.  The Potential for Misinterpretation Considered More Globally: A Response to Vicente and Ethier , 2000, Hum. Factors.

[601]  Richard Corbett,et al.  AROMA: ambient awareness through olfaction in a messaging application , 2004, ICMI '04.

[602]  A. A. Collins,et al.  Vibrotactile localization on the arm: Effects of place, space, and age , 2003, Perception & psychophysics.

[603]  Ann Blandford,et al.  Situation awareness in emergency medical dispatch , 2004, Int. J. Hum. Comput. Stud..

[604]  Alex Pentland,et al.  A wearable haptic navigation guidance system , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[605]  Yung-Ching Liu,et al.  Effects of Taiwan in-vehicle cellular audio phone system on driving performance , 2003 .

[606]  J.G.A.J. van der Vorst,et al.  Discrete Event Simulation , 2007 .

[607]  David Shinar,et al.  Imperfect In-Vehicle Collision Avoidance Warning Systems Can Aid Drivers , 2004, Hum. Factors.

[608]  Anoop K. Sinha,et al.  Capturing user tests in a multimodal, multidevice informal prototyping tool , 2003, ICMI '03.

[609]  Timothy Cribbin,et al.  Mapping semantic information in virtual space: dimensions, variance and individual differences , 2000, Int. J. Hum. Comput. Stud..

[610]  Esther Schindler.  New sensations , 2003, NTWK.

[611]  Michael A. Goodrich,et al.  Semiotics and mental models: modeling automobile driver behavior , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[612]  Régine Kolinsky,et al.  Attention-Dependent Changes of Activation and Connectivity in Dichotic Listening , 2002, NeuroImage.

[613]  M. Bergamasco,et al.  The Haptic Desktop: a novel 2D multimodal device , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[614]  Da-Shin Wang,et al.  Does Isolating a Visual Element Call Attention to It? Results of an Eye-tracking Investigation of the Effects of Isolation on Emphasis , 2005 .

[615]  Lorna M. Brown,et al.  Non-visual information display using tactons , 2004, CHI EA '04.

[616]  Kamran Iqbal,et al.  A multi-modal virtual environment with text-independent real-time speaker identification , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[617]  Patrick Langdon,et al.  Multiple haptic targets for motion-impaired computer users , 2003, CHI '03.

[618]  Steve Benford,et al.  Collaborative virtual environments , 2001, CACM.

[619]  Yanqing Wang,et al.  The role of contextual haptic and visual constraints on object manipulation in virtual environments , 2000, CHI.

[620]  S. Bredin.  Attention demands across extended practice of a bimanual coordination task , 2004 .

[621]  Susan J. Lederman,et al.  Using Tactile Features to Help Functionally Blind Individuals Denominate Banknotes , 2002, Hum. Factors.

[622]  H. Pashler,et al.  Spontaneous allocation of visual attention: Dominant role of uniqueness , 2001, Psychonomic bulletin & review.

[623]  H Pashler,et al.  Making two responses to a single object: implications for the central attentional bottleneck. , 1992, Journal of experimental psychology. Human perception and performance.

[624]  C D Wickens,et al.  Task-hemispheric integrity in dual task performance. , 1982, Acta psychologica.

[625]  Alex Pentland,et al.  Perceptual user interfaces: perceptual intelligence , 2000, CACM.

[626]  Christophe Ramstein,et al.  Combining haptic and braille technologies: design issues and pilot study , 1996, Assets '96.

[627]  Mustapha Mouloua,et al.  Human Performance, Situation Awareness and Automation. Current Research and Trends. Volume 1 , 2004 .

[628]  Wai Yu,et al.  Automatic Online Haptic Graph Construction , 2002 .

[629]  N I Durlach,et al.  Multidimensional tactile displays: identification of vibratory intensity, frequency, and contactor area. , 1987, The Journal of the Acoustical Society of America.

[630]  John Kenneth Salisbury,et al.  Large haptic topographic maps: marsview and the proxy graph algorithm , 2003, I3D '03.

[631]  Louise Venables,et al.  The influence of task demand and learning on the psychophysiological response. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[632]  Gary E. Burnett,et al.  On-the-move destination entry for vehicle navigation systems: Unsafe by any means? , 2004, Behav. Inf. Technol..

[633]  Myra P. van Esch-Bussemakers,et al.  User walkthrough of multimodal access to multidimensional databases , 2004, ICMI '04.

[634]  J. Kirman.  Tactile communication of speech: a review and an analysis. , 1973, Psychological bulletin.

[635]  Tsutomu Miyasato,et al.  A palmtop display for dextrous manipulation with haptic sensation , 1996, CHI.

[636]  Stephen Brewster,et al.  Feeling Rough: Multimodal Perception of Virtual Roughness , 2001 .

[637]  Tetsuya Miyoshi,et al.  Trade-off relationship between width and depth of visual information processing in measurement of functional visual field , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[638]  Gavriel Salvendy,et al.  Handbook of human factors. , 1987 .

[639]  Janet Finlay,et al.  Understanding visual influence in graph design through temporal and spatial eye movement characteristics , 2004, Interact. Comput..

[640]  Andrea C. Pierno,et al.  Effects of increasing visual load on aurally and visually guided target acquisition in a virtual environment. , 2005, Applied ergonomics.

[641]  Christopher D. Wickens,et al.  Driving and Side Task Performance: The Effects of Display Clutter, Separation, and Modality , 2004, Hum. Factors.

[642]  Christopher D. Wickens,et al.  Pathway HUDs: Are They Viable? , 2001, Hum. Factors.

[643]  D. R. Broome,et al.  Advanced telerobotic controller , 1994, Proceedings of OCEANS'94.

[644]  Ian Oakley,et al.  Tilt to scroll: evaluating a motion based vibrotactile mobile interface , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[645]  Dan Morris,et al.  Alternative "vision": a haptic and auditory assistive device , 2003, CHI Extended Abstracts.

[646]  Mary C. Whitton,et al.  Effects of handling real objects and avatar fidelity on cognitive task performance in virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[647]  S. Gronlund,et al.  Situation Awareness , 2006 .

[648]  Aude Dufresne,et al.  Touching and hearing GUI's: design issues for the PC-Access system , 1996, Assets '96.

[649]  Mayank Srivastava,et al.  The virtual haptic back for palpatory training , 2004, ICMI '04.

[650]  D. Gopher,et al.  Attention and performance XVII: Cognitive regulation of performance: Interaction of theory and application. , 1999 .

[651]  Antonella De Angeli,et al.  Visual display, pointing, and natural language: the power of multimodal interaction , 1998, AVI '98.

[652]  Dick de Waard,et al.  The measurement of drivers' mental workload , 1996 .

[653]  Tara Matthews,et al.  A toolkit for managing user attention in peripheral displays , 2004, UIST '04.

[654]  Martin Buss,et al.  Multi-modal sensory feedback based on a mathematical model of human perception , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[655]  Joel S. Warm,et al.  Multimodal displays for target localization in a flight task , 1999 .

[656]  Woo-seob Jeong.  Exploratory user study of haptic and auditory display for multimodal geographical information systems , 2001, CHI Extended Abstracts.

[657]  Jean Underwood,et al.  Visual attention while driving: sequences of eye fixations made by experienced and novice drivers , 2003, Ergonomics.

[658]  Alessandro De Gloria,et al.  Using 3D Sound to Improve the Effectiveness of the Advanced Driver Assistance Systems , 2002, Personal and Ubiquitous Computing.

[659]  Thomas W. Calvert,et al.  Moticons: : detection, distraction and task , 2003, Int. J. Hum. Comput. Stud..

[660]  Darwin G. Caldwell,et al.  Enhanced tactile feedback (tele-taction) using a multi-functional sensory system , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[661]  野間 春生,et al.  Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 参加報告 , 1997 .

[662]  David L. Hall,et al.  Multi-Sensory, Multi-Modal Concepts for Information Understanding , 2004 .

[663]  J.B.F. van Erp,et al.  Application of tactile displays in sports : where to, how and when to move , 2006 .

[664]  H. Pashler,et al.  Detecting conjunctions of color and form: Reassessing the serial search hypothesis , 1987, Perception & psychophysics.

[665]  Cecilia R. Aragon,et al.  Improving aviation safety with information visualization: a flight simulation study , 2005, CHI.

[666]  John Kenneth Salisbury,et al.  Haptic rendering: programming touch interaction with virtual objects , 1995, I3D '95.

[667]  Kenneth R. Boff,et al.  Engineering data compendium : human perception and performance , 1988 .

[668]  C D Wickens,et al.  Dual-task performance and the hick-hyman law of choice reaction time. , 1977, Journal of motor behavior.

[669]  Davide Rocchesso,et al.  Sounding Objects , 2003, IEEE Multim..

[670]  Filomena Ferrucci,et al.  Handy: A New Interaction Device for Vehicular Information Systems , 2004, Mobile HCI.

[671]  Hendrik A. H. C. van Veen,et al.  Tactile Information Presentation in the Cockpit , 2000, Haptic Human-Computer Interaction.

[672]  Pitu B. Mirchandani.  An Auditory Display in a Dual-Axis Tracking Task , 1972, IEEE Trans. Syst. Man Cybern..

[673]  Jan B F van Erp,et al.  Cross-modal visual and vibrotactile tracking. , 2004, Applied ergonomics.

[674]  Tom Diethe,et al.  HUMAN PERFORMANCE, SITUATION AWARENESS AND AUTOMATION: CURRENT RESEARCH AND TRENDS, VOL 2 , 2004 .

[675]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[676]  Jan Noyes,et al.  A Holistic Approach to the Introduction of Automatic Speech Recognition Technology in Ground Combat Vehicles , 2004 .

[677]  Christopher D. Wickens,et al.  Effects of Data-Link Modality and Display Redundancy on Pilot Performance: An Attentional Perspective , 2003 .

[678]  R T Verrillo,et al.  Effect of spatial parameters on the vibrotactile threshold. , 1966, Journal of experimental psychology.

[679]  Mark T. Maybury,et al.  Research in multimedia and multimodal parsing and generation , 1995, Artificial Intelligence Review.

[680]  Leonardo Franco,et al.  Generalization properties of modular networks: implementing the parity function , 2001, IEEE Trans. Neural Networks.

[681]  Simen Hagen,et al.  Designing a collaborative virtual environment for introducing pupils to complex subject matter , 2004, NordiCHI '04.

[682]  Patrick Ragert,et al.  Improving human haptic performance in normal and impaired human populations through unattended activation-based learning , 2005, TAP.

[683]  C. Wickens.  Attention and skilled performance. , 1989 .

[684]  P. M. Jaekl,et al.  Perceptual stability during head movement in virtual reality , 2002, Proceedings IEEE Virtual Reality 2002.

[685]  Robert E. Kraut,et al.  The use of visual information in shared visual spaces: informing the development of virtual co-presence , 2002, CSCW '02.

[686]  Allison Druin,et al.  Single display groupware: a model for co-present collaboration , 1999, CHI '99.

[687]  H. Pashler,et al.  Processing bottlenecks in dual-task performance: Structural limitation or strategic postponement? , 2001, Psychonomic bulletin & review.

[688]  Anthony J. Hornof,et al.  Cognitive Strategies for the Visual Search of Hierarchical Computer Displays , 2004, Hum. Comput. Interact..

[689]  Robert F Erbacher,et al.  Multidimensional data visualization , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[690]  Harold Pashler,et al.  Symmetry detection and visual attention: a “binary-map” hypothesis , 2002, Vision Research.

[691]  H Pashler,et al.  Shifting visual attention and selecting motor responses: distinct attentional mechanisms. , 1991, Journal of experimental psychology. Human perception and performance.

[692]  Hui Chen,et al.  Real-time haptic sculpting in virtual volume space , 2002, VRST '02.

[693]  Dv David Keyson,et al.  Touch in user interface navigation , 1997 .

[694]  John T. Stasko,et al.  Establishing tradeoffs that leverage attention for utility: empirically evaluating information display in notification systems , 2003, Int. J. Hum. Comput. Stud..

[695]  T. Salthouse,et al.  Divided attention abilities in young and old adults. , 1982, Journal of experimental psychology. Human perception and performance.

[696]  C. Spence,et al.  What role does multisensory integration play in the visuotactile perception of texture? , 2003, International Journal of Psychophysiology.

[697]  Christian B. Carstens,et al.  Tactile Guidance for Land Navigation , 2006 .

[698]  C. Ross Ethier,et al.  Why Fluid Dynamics Matters for Display Design in Process Control: Commentary on Bennett and Malek , 2000, Hum. Factors.

[699]  Christoph M. Hoffmann,et al.  Enhanced battlefield visualization for situation awareness , 2003, Comput. Graph..

[700]  James R. Miller,et al.  Conference Companion on Human Factors in Computing Systems , 1995, CHI 1995.

[701]  Alessandro Saffiotti,et al.  Fuzzy anchoring , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[702]  Jukka Saarinen,et al.  Visual Search for Grouped versus Ungrouped Icons in a Computer Interface , 2000, Hum. Factors.

[703]  Stephen A. Brewster,et al.  Haptic perception of virtual roughness , 2001, CHI Extended Abstracts.

[704]  Louis B. Rosenberg.  Design of a virtual rigid surface: haptic/audio registration , 1994, CHI '94.

[705]  Christopher D. Wickens,et al.  Situation Awareness and Workload in Aviation , 2002 .

[706]  A. D. Fisk,et al.  Age-related differences in dual-task visual search: are performance gains retained? , 2000, The journals of gerontology. Series B, Psychological sciences and social sciences.

[707]  H. Pashler,et al.  Visual attention and stimulus identification. , 1985, Journal of experimental psychology. Human perception and performance.

[708]  Justin G. Hollands,et al.  LCD versus CRT Displays: A Comparison of Visual Search Performance for Colored Symbols , 2002, Hum. Factors.

[709]  J. Bush.  The effect of event rate on sustained attention and stress states in a simultaneous vigilance task paradigm , 2002 .

[710]  A. Bonnel,et al.  Divided attention between simultaneous auditory and visual signals , 1998, Perception & psychophysics.

[711]  Pieter Padmos,et al.  Image parameters for driving with indirect viewing systems , 2003, Ergonomics.

[712]  D J Newman,et al.  A tactile display for international space station (ISS) extravehicular activity (EVA). , 2000, Aviation, space, and environmental medicine.

[713]  Jack Tigh Dennerlein,et al.  Forearm Electromyographic Changes With the Use of a Haptic Force-Feedback Computer Mouse , 2006, Hum. Factors.

[714]  Ed Lantz,et al.  The future of virtual reality: head mounted displays versus spatially immersive displays (panel) , 1996, SIGGRAPH.

[715]  Robert S. Allison,et al.  Effects of network delay on a collaborative motor task with telehaptic and televisual feedback , 2004, VRCAI '04.

[716]  C W Johnson.  Impact of working environments upon human-machine dialogues: a formal logic for the integrated specification of physical and cognitive ergonomic constraints on user interface design. , 1996, Ergonomics.

[717]  Herbert A. Colle,et al.  Double Trade-off Curves with Different Cognitive Processing Combinations: Testing the Cancellation Axiom of Mental Workload Measurement Theory , 1999, Hum. Factors.

[718]  H. Pashler,et al.  Central bottleneck influences on the processing stages of word production. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[719]  P. Haggard.  Look and feel , 2001, Trends in Cognitive Sciences.

[720]  William V. Baxter,et al.  Haptic interaction with fluid media , 2004, Graphics Interface.

[721]  Desney S. Tan,et al.  With similar visual angles, larger displays improve spatial performance , 2003, CHI '03.

[722]  Ravindra S. Goonetilleke,et al.  Target-Directed Head Movements in a Head-Coupled Virtual Environment: Predicting the Effects of Lags Using Fitts' Law , 1999, Hum. Factors.

[723]  Jack Tigh Dennerlein,et al.  Force-feedback improves performance for steering and combined steering-targeting tasks , 2000, CHI.

[724]  William Kosnik,et al.  Perceptual Impact of an Animated Holographic Stereogram , 2003 .

[725]  C D Wickens,et al.  Processing of stimulus properties: evidence for dual-task integrality. , 1985, Journal of experimental psychology. Human perception and performance.

[726]  Christopher D. Wickens,et al.  Display Signaling in Augmented Reality: Effects of Cue Reliability and Image Realism on Attention Allocation and Trust Calibration , 2001, Hum. Factors.

[727]  C D Wickens.  AVIATION DISPLAYS. IN: PRINCIPLES AND PRACTICE OF AVIATION PSYCHOLOGY , 2003 .

[728]  James L. Szalma,et al.  The Vigilance Decrement Reflects Limitations in Effortful Attention, Not Mindlessness , 2003, Hum. Factors.

[729]  Penelope M. Sanderson,et al.  Anesthesia Alarms in Context: An Observational Study , 2001, Hum. Factors.

[730]  Christopher D. Wickens,et al.  Electronic Map Evaluation in Simulated Visual Meteorological Conditions , 1997 .

[731]  Motoyuki Akamatsu,et al.  A multi-modal mouse with tactile and force feedback , 1994, Int. J. Hum. Comput. Stud..

[732]  Jeff K. Caird,et al.  Age Differences in Visual Search for Traffic Signs During a Simulated Conversation , 2004, Hum. Factors.

[733]  Davide Rocchesso,et al.  Audio effects to enhance spatial information displays , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[734]  Susan J. Lederman,et al.  Relative performance using haptic and/or touch-produced auditory cues in a remote absolute texture identification task , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[735]  Andrew J. Nevis,et al.  Advantages of three-dimensional electro-optic imaging sensors , 2003, SPIE Defense + Commercial Sensing.

[736]  John T. Stasko,et al.  Personalized Peripheral Information Awareness Through Information Art , 2004, UbiComp.

[737]  R W Remington,et al.  A dual-task investigation of automaticity in visual word processing. , 2000, Journal of experimental psychology. Human perception and performance.

[738]  Risto Näsänen,et al.  Effects of luminance and colour contrast on the search of information on display devices , 2003 .

[739]  Harvey S. Smallman,et al.  On the usefulness of basic colour coding in an information display , 1993 .

[740]  Marieke Hendrikje Martens,et al.  EFFECTS OF SPEECH VERSUS TACTILE DRIVER SUPPORT MESSAGES ON DRIVING BEHAVIOUR AND WORKLOAD , 2001 .

[741]  Mitchell E. Tyler,et al.  A Tongue-Based Tactile Display for Portrayal of Environmental Characteristics , 2003 .

[742]  P. Fitts.  Engineering psychology. , 1958, Annual review of psychology.

[743]  Michelle Fleury,et al.  Visual Context and the Control of Movements through Video Display , 2001, Hum. Factors.

[744]  C. Wickens,et al.  Visual scanning and pilot expertise: the role of attentional flexibility and mental model development. , 1997, Aviation, space, and environmental medicine.

[745]  Christian F. Doeller,et al.  Selection and consolidation of objects and actions , 2005, Psychological research.

[746]  I. Scott MacKenzie,et al.  A comparison of two input methods for keypads on mobile devices , 2004, NordiCHI '04.

[747]  Adelbert W. Bronkhorst,et al.  Effectiveness of 3-D Audio for Warnings in the Cockpit , 2004 .

[748]  Amy C. Bradshaw,et al.  Effects of an Online Visual Procedure on Task Completion, Time, and Attitude , 2003 .

[749]  Makoto Sato,et al.  Multi-modal haptic device for large-scale virtual environments , 2000, ACM Multimedia.

[750]  Steve Benford,et al.  Coping with inconsistency due to network delays in collaborative virtual environments , 1999, VRST '99.

[751]  Daniel Pack,et al.  Real Time Operating Systems: A Visual Simulator , 2004 .

[752]  Anatole Lécuyer,et al.  Can haptic feedback improve the perception of self-motion in virtual reality? , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[753]  H. Pashler.  Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[754]  B. Goettl,et al.  Integrated displays and the perception of graphical data. , 1991, Ergonomics.

[755]  Judy M. Vance,et al.  PHANToM haptic device implemented in a projection screen virtual environment , 2003, IPT/EGVE.

[756]  Nadine Sarter,et al.  2. Multimodal information presentation in support of human-automation communication and coordination , 2002 .

[757]  Dan C. Popescu,et al.  A model for efficient and accurate interaction with elastic objects in haptic virtual environments , 2003, GRAPHITE '03.

[758]  Blake Hannaford,et al.  Stable haptic interaction with virtual environments , 1999, IEEE Trans. Robotics Autom..

[759]  Norman W. Bray,et al.  Approaches to cognitive system simulation: architectures and animations , 2000, Proceedings 33rd Annual Simulation Symposium (SS 2000).

[760]  C. D. Wickens,et al.  Tracking performance under time sharing conditions with a digit processing task: A feedback control theory analysis. [attention sharing effect on operator performance] , 1975 .

[761]  Richard D. Gilson,et al.  Vibrotactile masking: Some spatial and temporal aspects , 1969 .

[762]  D R Begault,et al.  Three-dimensional audio versus head-down traffic alert and collision avoidance system displays. , 1996, The International journal of aviation psychology.

[763]  David Shinar,et al.  Effects of an In-Vehicle Collision Avoidance Warning System on Short- and Long-Term Driving Performance , 2002, Hum. Factors.

[764]  P. Hancock,et al.  Stress, Workload, and Fatigue , 2009 .

[765]  R. Baddeley,et al.  Multisensory temporal order judgments: When two locations are better than one , 2003, Perception & psychophysics.

[766]  A. Kazdin.  Encyclopedia of psychology , 1984 .

[767]  M. A. Gan,et al.  Holographic information-display system for an automobile , 1995 .

[768]  Stephen A. Brewster,et al.  Correcting menu usability problems with sound , 1999, Behav. Inf. Technol..

[769]  Dinesh Manocha,et al.  Six degree-of-freedom haptic display of polygonal models , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[770]  Angelo Arleo,et al.  Combining Multimodal Sensory Input for Spatial Learning , 2002, ICANN.

[771]  Richard D. Gilson,et al.  Vibrotactile masking: Effects of multiple maskers , 1969 .

[772]  J Meyer,et al.  Performance with tables and graphs: effects of training and a Visual Search Model , 2000, Ergonomics.

[773]  A. Kheddar,et al.  I-TOUCH: a generic multimodal framework for industry virtual prototyping , 2004, IEEE Conference on Robotics and Automation, 2004. TExCRA Technical Exhibition Based..

[774]  Virginio Cantoni.  Human and Machine Perception , 1997, Springer US.

[775]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[776]  Jan B.F. van Erp,et al.  Validation of Principles for Tactile Navigation Displays , 2006 .

[777]  C. Wickens.  Engineering psychology and human performance, 2nd ed. , 1992 .

[778]  Jean-Claude Martin,et al.  Developing Multimodal Interfaces: A Theoretical Framework and Guided Propagation Networks , 1995, Multimodal Human-Computer Communication.

[779]  S. Hillyard,et al.  Intra-modal and cross-modal spatial attention to auditory and visual stimuli. An event-related brain potential study. , 1999, Brain research. Cognitive brain research.

[780]  Nancy J. Cooke,et al.  Advances in Human Performance and Cognitive Engineering Research , 2002 .

[781]  John T. Stasko,et al.  Is a Picture Worth a Thousand Words? An Evaluation of Information Awareness Displays , 2004, Graphics Interface.

[782]  Diane Lindwarm Alonso.  The effects of individual differences in spatial visualization ability on dual-task performance , 1998 .

[783]  J.B.F. van Erp,et al.  A multi-purpose tactile vest for astronauts in the international space station , 2003 .

[784]  Arthur D. Fisk,et al.  Age-Related Performance in a Multiple-Task Environment , 1999, Hum. Factors.

[785]  William W. Gaver,et al.  Using speech and audio in the interface (abstract) , 1995, CHI '95.

[786]  Trevor Darrell,et al.  Articulatory features for robust visual speech recognition , 2004, ICMI '04.

[787]  Santosh Nair,et al.  Using virtual reality technology for aircraft visual inspection training: presence and comparison studies. , 2002, Applied ergonomics.

[788]  Linda G. Pierce,et al.  The Perceived Utility of Human and Automated Aids in a Visual Detection Task , 2002, Hum. Factors.

[789]  B. Röder,et al.  Attention to motion enhances processing of both visual and auditory stimuli: an event-related potential study. , 2004, Brain research. Cognitive brain research.

[790]  Roy Kalawsky,et al.  Old theories, new technologies: cumulative clutter effects using augmented reality , 1999, 1999 IEEE International Conference on Information Visualization (Cat. No. PR00210).

[791]  P. Roland,et al.  Interference between two concurrent tasks is associated with activation of overlapping fields in the cortex. , 1997, Brain research. Cognitive brain research.

[792]  Anthony Hoogs,et al.  Multi-modal fusion for video understanding , 2001, Proceedings 30th Applied Imagery Pattern Recognition Workshop (AIPR 2001). Analysis and Understanding of Time Varying Imagery.

[793]  Jeff K. Caird,et al.  Visual Search for Traffic Signs: The Effects of Clutter, Luminance, and Aging , 2001, Hum. Factors.

[794]  B G Bardy,et al.  Visual Cues and Attention Demand in Locomotor Positioning , 1991, Perceptual and motor skills.

[795]  L Henry,et al.  Human Skills (2nd ed.). , 1990 .

[796]  Timothy L. White,et al.  Effects of Visual and Auditory Cues About Threat Location on Target Acquisition and Attention to Auditory Communications , 2005 .

[797]  Trevor Darrell,et al.  MULTIMODAL INTERFACES THAT Flex, Adapt, and Persist , 2004 .

[798]  Thore Schmidt-Tjarksen,et al.  Psychological Theory in Haptic Interface Design: Initial Steps Towards an Interacting Cognitive Subsystems (ICS) Approach , 2001 .

[799]  T. Duka,et al.  Hemispheric lateralisation in a manual–verbal task combination: the role of modality and gender , 2000, Neuropsychologia.

[800]  H. Pashler.  Attentional Limitations in Doing Two Tasks at the Same Time , 1992 .

[801]  H Pashler,et al.  Processing stages in overlapping tasks: evidence for a central bottleneck. , 1984, Journal of experimental psychology. Human perception and performance.

[802]  Anthony P Tvaryanas,et al.  Visual scan patterns during simulated control of an uninhabited aerial vehicle (UAV). , 2004, Aviation, space, and environmental medicine.

[803]  D. Leutner,et al.  Assessment of Cognitive Load in Multimedia Learning with Dual-Task Methodology: Auditory Load and Modality Effects , 2004 .

[804]  Ian MacColl,et al.  User interface correctness , 1997, CROS.

[805]  A H Rupert.  An instrumentation solution for reducing spatial disorientation mishaps. , 2000, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[806]  Cristy Ho.  Using spatial warning signals to capture a driver's visual attention , 2004, ICMI '04.

[807]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[808]  H S Vitense,et al.  Multimodal feedback: an assessment of performance and mental workload , 2003, Ergonomics.

[809]  C. Eriksen,et al.  Allocation of attention in the visual field. , 1985, Journal of experimental psychology. Human perception and performance.

[810]  Eric Horvitz,et al.  Foreground and background interaction with sensor-enhanced mobile devices , 2005, TCHI.

[811]  J. C. Johnston,et al.  Attention and performance. , 2001, Annual review of psychology.

[812]  J. E. Korteling,et al.  Effects of Head-Slaved and Peripheral Displays on Lane-Keeping Performance and Spatial Orientation , 1999, Hum. Factors.

[813]  Martin Kurze,et al.  Rendering drawings for interactive haptic perception , 1997, CHI.

[814]  David F. Wourms,et al.  Status Update of Alternative Control and Display Technologies, Volume 1 , 2001 .

[815]  Paul Noland Rose.  The effects of auditory noise on a peripheral visual task in a dual task paradigm , 1991 .

[816]  Knut Hartmann,et al.  Illustrative shadows: integrating 3D and 2D information displays , 2003, IUI '03.

[817]  Martin Buss,et al.  Benefits of combined active stereo vision and haptic telepresence , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[818]  Linda R. Elliott,et al.  The benefits of multimodal information: a meta-analysis comparing visual and visual-tactile feedback , 2006, ICMI '06.

[819]  LuJian,et al.  Visual object－oriented application for lane following on intelligent highway system , 2003 .

[820]  Sharon L. Oviatt,et al.  Unification-based Multimodal Integration , 1997, ACL.

[821]  D Burns,et al.  A dual-task analysis of detection accuracy for the case of high target-distractor similarity: Further evidence for independent processing , 1979, Perception & psychophysics.

[822]  Philippe A. Palanque,et al.  A model-based approach for real-time embedded multimodal systems in military aircrafts , 2004, ICMI '04.

[823]  Robert S. Bolia,et al.  A multi-layer visual display for air battle managers: Effects of depth and transparency on performance and workload in a dual-task scenario , 2004 .

[824]  Christophe Ramstein,et al.  Adaptive user interfaces with force feedback , 1996, CHI 1996.

[825]  H Pashler,et al.  Cross-dimensional interaction and texture segregation , 1988, Perception & psychophysics.

[826]  James A. Landay,et al.  Can you see what i hear?: the design and evaluation of a peripheral sound display for the deaf , 2003, CHI '03.

[827]  Satoshi Nakamura,et al.  Audio-visual speech translation with automatic lip syncqronization and face tracking based on 3-D head model , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[828]  Eric H. Schumacher.  Independent concurrent processing in dual-task performance: Evidence for adaptive executive control of task scheduling. , 1998 .

[829]  H. Pashler,et al.  Attention capacity and task difficulty in visual search , 2005, Cognition.

[830]  D. Wickens,et al.  Lack of memory for nonattended items in dichotic listening. , 1976, Journal of experimental psychology. Human learning and memory.

[831]  Ann M. Bisantz,et al.  Measuring the Fit between Human Judgments and Automated Alerting Algorithms: A Study of Collision Detection , 2003, Hum. Factors.

[832]  Holly E. Hancock,et al.  An Evaluation of Warning Habits and Beliefs across the Adult Life Span , 2001, Hum. Factors.

[833]  Yacine Bellik,et al.  A framework to manage multimodal fusion of events for advanced interactions within Virtual Environments , 2002, EGVE.

[834]  Sharon L. Oviatt,et al.  Perceptual user interfaces: multimodal interfaces that process what comes naturally , 2000, CACM.

[835]  Christopher D. Wickens,et al.  Commanders' Display of Terrain Information: Manipulations of Display Dimensionality and Frame of Reference to Support Battlefield Visualization. , 1999 .

[836]  Roberta L. Klatzky,et al.  Stated Preferences for Components of a Personal Guidance System for Nonvisual Navigation , 2004 .

[837]  Brad A. Myers,et al.  Text entry from power wheelchairs: edgewrite for joysticks and touchpads , 2004, Assets '04.

[838]  J. Williams,et al.  Haptic chameleon: a new concept of shape-changing user interface controls with force feedback , 2004, CHI EA '04.

[839]  Peter R. Stopher,et al.  Visualising trips and travel characteristics from GPS data , 2003 .

[840]  Rakesh Gupta,et al.  Experiments Using Multimodal Virtual Environments in Design for Assembly Analysis , 1997, Presence: Teleoperators & Virtual Environments.

[841]  Nadine B. Sarter,et al.  Multimodal information presentation in support of timesharing and effective interruption management , 2001, 20th DASC. 20th Digital Avionics Systems Conference (Cat. No.01CH37219).

[842]  Robert W. Lindeman,et al.  Effective Vibrotactile Cueing in a Visual Search Task , 2003, INTERACT.

[843]  Angus H. Rupert,et al.  VIBROTACTILE CUEING AS A MASTER CAUTION SYSTEM FOR VISUAL MONITORING , 2002 .

[844]  P. McLeod.  A Dual Task Response Modality Effect: Support for Multiprocessor Models of Attention , 1977 .

[845]  Pierre Jolicoeur,et al.  Cross-modal attentional deficits in processing tactile stimulation , 2001, Perception & psychophysics.

[846]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[847]  Nadine B. Sarter,et al.  Peripheral Visual Feedback: A Powerful Means of Supporting Effective Attention Allocation in Event-Driven, Data-Rich Environments , 2001, Hum. Factors.

[848]  Laurent Romary,et al.  Referring to objects with spoken and haptic modalities , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[849]  R. Cholewiak,et al.  Vibrotactile localization on the abdomen: Effects of place and space , 2004, Perception & psychophysics.

[850]  B. Postle,et al.  Effects of verbal and nonverbal interference on spatial and object visual working memory , 2005, Memory & cognition.

[851]  Christopher D. Wickens,et al.  Attentional Models of Multitask Pilot Performance Using Advanced Display Technology , 2003, Hum. Factors.

[852]  Yukio Fukui,et al.  Development of a force and torque hybrid display "GyroCubeStick" , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[853]  C D Wickens,et al.  Visual scanning with or without spatial uncertainty and divided and selective attention. , 1992, Acta psychologica.

[854]  Paul M. Taylor,et al.  An investigation into different visual/tactual feedback modes for a virtual object manipulation task , 2004, VRCAI '04.

[855]  Earl Hunt,et al.  Spatial Representations of Virtual Mazes: The Role of Visual Fidelity and Individual Differences , 2001, Hum. Factors.

[856]  Bernhard Hommel,et al.  Visual attention and manual response selection: Distinct mechanisms operating on the same codes , 2002 .

[857]  Gerald L. Lohse,et al.  The role of working memory on graphical information processing , 1997, Behav. Inf. Technol..

[858]  Kenneth Mark Bryden.  Military keynote: military-based virtual systems engineering , 2002, WSC '02.

[859]  Harold Pashler,et al.  Chapter 2 Attention and Visual Perception : Analyzing Divided Attention , 2002 .

[860]  W. Brouwer,et al.  Age differences in divided attention in a simulated driving task. , 1988, Journal of gerontology.

[861]  D. Leutner,et al.  Assessment of cognitive load in multimedia learning using dual-task methodology. , 2002, Experimental psychology.

[862]  Christopher D. Wickens,et al.  Virtual reality and education , 1992, [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics.

[863]  Mario J. Enriquez,et al.  A pneumatic tactile alerting system for the driving environment , 2001, PUI '01.

[864]  J. Mullennix,et al.  Automaticity and the detection of speech , 1992, Memory & cognition.