Systematic design for task related multimedia interfaces

Abstract Multimedia interfaces are currently created primarily by intuition. Development of a method for analysis and design of multimedia presentation interfaces is described. The study investigates task based information analysis, persistence of information, selection attention and concurrency in presentation. The method gives an agenda of issues, diagrams and techniques for specification, with guidelines for media selection and presentation scripting. Use of the method is illustrated with an example interface from a shipboard emergency management system.

[1]  Robert N. Kraft,et al.  The role of cutting in the evaluation and retention of film. , 1986 .

[2]  Gavriel Salomon,et al.  Internalization of filmic schematic operations in interaction with learners' aptitudes. , 1974 .

[3]  Neville A. Stanton,et al.  Can speech be used for alarm displays in ‘process control’ type tasks? , 1992 .

[4]  J Stoeckert,et al.  Picture memory: recognizing added and deleted details. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[5]  Hans Hörmann,et al.  The influence of general and specific verbal labels on the recognition of labeled and unlabeled parts of pictures , 1978 .

[6]  W. Winn.  7 The Design and Use of Instructional Graphics , 1989 .

[7]  Malcolm L. Fleming,et al.  Designing Pictorial/Verbal Instruction: Some Speculative Extensions from Research to Practice , 1987 .

[8]  Ray Eberts,et al.  Comparison of Speech and Pictorial Displays in a Cockpit Environment , 1987 .

[9]  James L. Alty,et al.  The Design of Multimedia Interfaces for Process Control , 1992 .

[10]  Harold R. Booher,et al.  Relative Comprehensibility of Pictorial Information and Printed Words in Proceduralized Instructions , 1975 .

[11]  C D Wickens,et al.  Compatibility and Resource Competition between Modalities of Input, Central Processing, and Output , 1983, Human factors.

[12]  Julian Hochberg,et al.  Representation of motion and space in video and cinematic displays , 1986 .

[13]  Robert W. Swezey,et al.  Effects of Instructional Strategy and Motion Presentation Conditions on the Acquisition and Transfer of Electromechanical Troubleshooting Skill , 1991 .

[14]  John Long,et al.  Conceptions of the discipline of HCI: craft, applied science, and engineering , 1989 .

[15]  Patricia Baggett,et al.  Role of temporal overlap of visual and auditory material in forming dual media associations. , 1984 .

[16]  Eduard H. Hovy,et al.  On the Knowledge Underlying Multimedia Presentations , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[17]  C Carello,et al.  Static Depiction of Movement , 1986, Perception.

[18]  D. Navon,et al.  Role of outcome conflict in dual-task interference. , 1987, Journal of experimental psychology. Human perception and performance.

[19]  H. F. Brandt.  The psychology of seeing. , 1947, The Columbia optometrist.

[20]  Mark T. Maybury,et al.  Planning Multimedia Explanations Using Communicative Acts , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[21]  William C. Mann,et al.  Rhetorical Structure Theory: Toward a functional theory of text organization , 1988 .

[22]  Ray Waddington,et al.  Task-Related Knowledge Structures: Analysis, Modelling and Application , 1988, BCS HCI.

[23]  Ok-Choon Park,et al.  Instructional conditions for using dynamic visual displays: a review , 1992 .

[24]  R. Becklen,et al.  Selective looking and the noticing of unexpected events , 1983 .

[25]  W Hirst,et al.  On the representation of events: a study of orientation, recall, and recognition. , 1989, Journal of experimental psychology. General.

[26]  George R. Bieger,et al.  The Information Content of Picture-Text Instructions , 1985 .

[27]  T. Grimes,et al.  Mild auditory-visual dissonance in television news may exceed viewer attentional capacity , 1991 .

[28]  M. Posner,et al.  Visual dominance: an information-processing account of its origins and significance. , 1976, Psychological review.