Review: An Object-oriented Taxonomy of Medical Data Presentations

A variety of methods have been proposed for presenting medical data visually on computers. Discussion of and comparison among these methods have been hindered by a lack of consistent terminology. A taxonomy of medical data presentations based on object-oriented user interface principles is presented. Presentations are divided into five major classes-list, table, graph, icon, and generated text. These are subdivided into eight subclasses with simple inheritance and four subclasses with multiple inheritance. The various subclasses are reviewed and examples are provided. Issues critical to the development and evaluation of presentations are also discussed.

[1]  Fleming Mg.  Design of a high resolution image cytometer with open software architecture. , 1996 .

[2]  E. Tufte,et al.  Graphical summary of patient status , 1994, The Lancet.

[3]  G Carenini,et al.  Generating patient-specific interactive natural language explanations. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[4]  Pillarisetti Sg.  Surgical pathology report in the era of desktop publishing. , 1993 .

[5]  C D Wickens,et al.  The perceptual interaction of graphical attributes: Configurality, stimulus homogeneity, and object integration , 1990, Perception & psychophysics.

[6]  M Lee,et al.  Cat 6 mo increases symptoms: online physician charting and more. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[7]  Heather D. Pfeiffer,et al.  Conceptual Structures: Theory and Implementation , 1993, Lecture Notes in Computer Science.

[8]  D. Park,et al.  Memory for pictures, words, and spatial location in older adults: evidence for pictorial superiority. , 1983, Journal of gerontology.

[9]  J C Klimczak,et al.  Getting around in a large nomenclature file: browsing SNOMED international. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[10]  T Timmers,et al.  SmaCS: smart classification system for the design, maintenance and use of complex terminologies. Application in pediatric cardiology. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[11]  T A Pryor,et al.  Rationale for the Arden Syntax. , 1994, Computers and biomedical research, an international journal.

[12]  A Kushniruk,et al.  Analysis of medical decision making: a cognitive perspective on medical informatics. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[13]  C M Newton.  An interactive graphics information system for familial data. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[14]  Stephen B. Johnson,et al.  From multimodal sublanguages to medical data presentations , 1997 .

[15]  Nan C. Shu,et al.  Visual Programming: Perspectives and Approaches , 1989, IBM Syst. J..

[16]  Paul L. Fine.  The Wards: An Introduction to Clinical Clerkships , 1994 .

[17]  M. Giger,et al.  Computer vision and artificial intelligence in mammography. , 1994, AJR. American journal of roentgenology.

[18]  C E Kahn,et al.  Graphical knowledge presentation in a MUMPS-based decision-support system. , 1993, Computer methods and programs in biomedicine.

[19]  D P Connelly,et al.  A system for graphical display of clinical laboratory data. , 1982, American journal of clinical pathology.

[20]  W G Cole,et al.  Human Performance Evaluation of a Metaphor Graphic Display for Respiratory Data , 1994, Methods of Information in Medicine.

[21]  Frances Talaska Fischbach.  Documenting care : communication, the nursing process and documentation standards , 1991 .

[22]  Steven F. Roth,et al.  Data characterization for intelligent graphics presentation , 1990, CHI '90.

[23]  T A Pryor,et al.  A computer method for visual presentation and programmed evaluation of labor. , 1991, Obstetrics and gynecology.

[24]  Michael Sellers,et al.  Designing for demanding users , 1994, INTR.

[25]  Greg C. Elvers,et al.  A comparison of the augmented bar display and the object display , 1995 .

[26]  片岡 幸雄.  中国対外貿易機構の変遷-3-(1-2) , 1995 .

[27]  John F. Sowa,et al.  Conceptual Structures: Information Processing in Mind and Machine , 1983 .

[28]  John J. Bertin,et al.  The semiology of graphics , 1983 .

[29]  Naomi Sager,et al.  Syntactic formatting of science information , 1972, AFIPS '72 (Fall, part II).

[30]  Sergio Orefice,et al.  A methodology and interactive environment for iconic language design , 1994, Int. J. Hum. Comput. Stud..

[31]  Ivo W. Molenaar.  Displaying statistical information—ergonomic considerations , 1988 .

[32]  O Ratib.  From multimodality digital imaging to multimedia patient record. , 1994, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[33]  G. Lockhead.  Effects of dimensional redundancy on visual discrimination. , 1966, Journal of experimental psychology.

[34]  D. Bouwhuis,et al.  The Structure of Multimodal Dialogue , 1989 .

[35]  Douglas J. Gillan,et al.  Minimalism and the Syntax of Graphs , 1994 .

[36]  John F. Sowa,et al.  Conceptual Structures: Current Practices , 1994, Lecture Notes in Computer Science.

[37]  Gerald L. Lohse,et al.  A Cognitive Model for Understanding Graphical Perception , 1993, Hum. Comput. Interact..

[38]  S G Pillarisetti.  Surgical pathology report in the era of desktop publishing. , 1993, Archives of pathology & laboratory medicine.

[39]  L Regan,et al.  Flux analysis of microbial metabolic pathways using a visual programming environment. , 1995, Journal of biotechnology.

[40]  J A Lott,et al.  Use of chernoff faces to follow trends in laboratory data , 1990, Journal of clinical laboratory analysis.

[41]  George Hripcsak,et al.  Research Paper: Knowledge-based Approaches to the Maintenance of a Large Controlled Medical Terminology , 1994, J. Am. Medical Informatics Assoc..

[42]  Richard Kittredge,et al.  Sublanguage : studies of language in restricted semantic domains , 1982 .

[43]  K Daye,et al.  Medication history display and evaluation. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[44]  M J Horowitz,et al.  Psyclops: an exploratory graphical system for clinical research and education. , 1993, Psychiatry.

[45]  P. Meehl,et al.  Configural scoring. , 1950, Journal of consulting psychology.

[46]  E S Gelsema,et al.  A computer program for the multivariate and graphical monitoring of acid-base data in an intensive care unit. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[47]  Peter W. Eklund,et al.  Conceptual structures: current research and practice , 1992 .

[48]  Harold W. Thimbleby,et al.  User interface design , 1990, ACM Press Frontier Series.

[49]  M F Lesser.  GIFIC. A graphical interface for intensive care. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[50]  Astrid M. van Ginneken,et al.  Research Paper: Evaluation of Reporting Based on Descriptional Knowledge , 1995, J. Am. Medical Informatics Assoc..

[51]  Richard D. Judge,et al.  Methods of clinical examination : a physiologic approach , 1974 .

[52]  W. R. Garner,et al.  Integrality of stimulus dimensions in various types of information processing , 1970 .

[53]  J. Boyle.  A visual environment for the manipulation and integration of JAVA beans , 1998, Bioinform..

[54]  J Starren,et al.  Description generation of abnormal densities found in radiographs. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[55]  L K Harding,et al.  Reporting simplified colonic transit studies using radionuclides: clinician friendly reports. , 1995, Gut.

[56]  D A Bluemke,et al.  An automated radiology reporting system that uses HyperCard. , 1993, AJR. American journal of roentgenology.

[57]  W Giere,et al.  Multi-dimensional Visualisation of Laboratory Findings and Functional Test Results for Analysing the Clinical Course of Disease in Medicine , 1995, Methods of Information in Medicine.

[58]  S. Joy Mountford,et al.  The Art of Human-Computer Interface Design , 1990 .

[59]  S Wang,et al.  An intelligent interactive simulator of clinical reasoning in general surgery. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[60]  John W. Esch.  Graphical displays and polymorphism , 1992 .

[61]  W. Cleveland,et al.  Graphics and Human Information Processing: A Review of Five Books@@@Semiology of Graphs.@@@Graphical Methods for Data Analysis.@@@Mapping Information.@@@Statistical Graphics.@@@The Visual Display of Quantitative Information. , 1985 .

[62]  Neil M. Davis,et al.  Medical Abbreviations: 24,000 Conveniences at the Expense of Communications and Safety , 2002 .

[63]  Leo G. M. Noordman,et al.  Visual presentation of text: the process of reading from a psycholinguistic perspective , 1988 .

[64]  J. Elmore,et al.  Variability in radiologists' interpretations of mammograms. , 1994, The New England journal of medicine.

[65]  Herbert S. Chase,et al.  Conceptual Modeling Techniques for Online Curriculum Design , 1997, AMIA.

[66]  George R. S. Weir,et al.  Human Computer Interaction and Complex Systems , 1991 .

[67]  David F. Lobach,et al.  Structuring clinical practice guidelines in a relational database model for decision support on the Internet , 1997, AMIA.

[68]  V. Spitzer,et al.  The visible human male: a technical report. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[69]  David M. Mark,et al.  Cognitive and Linguistic Aspects of Geographic Space: New Perspectives on Geographic Information Research , 1991 .

[70]  S. Balachandar,et al.  Knowledge Visualization from Conceptual Structures , 1994, ICCS.

[71]  R A Greenes,et al.  Evaluation of UltraSTAR: performance of a collaborative structured data entry system. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[72]  G. Chapman,et al.  [Medical decision making]. , 1976, Lakartidningen.

[73]  Dianne C. Berry,et al.  Object displays and control of dynamic systems , 1994 .

[74]  K. F. R. Schiller,et al.  Practical Gastrointestinal Endoscopy , 1983 .

[75]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[76]  C. Melody Carswell,et al.  Integral, Configural, and Unitary Graphs , 1988 .

[77]  Michael D. Gould,et al.  Elicitation of Spatial Language to Support Cross-Cultural Geographic Information Systems , 1991 .

[78]  Christopher D. Wickens,et al.  Display Proximity in Multicue Information Integration: The Benefits of Boxes , 1988 .

[79]  W G Cole,et al.  Three Graphic Representations to Aid Bayesian Inference , 1988, Methods of Information in Medicine.

[80]  Herman Chernoff,et al.  The Use of Faces to Represent Points in k- Dimensional Space Graphically , 1973 .

[81]  Newton Cm.  An interactive graphics information system for familial data. , 1992 .

[82]  Harold I. Litt,et al.  Application of the Visual Chart in an Ambulatory OB-GYN Clinic , 1995 .

[83]  K B Bennett,et al.  Graphical Displays: Implications for Divided Attention, Focused Attention, and Problem Solving , 1992, Human factors.

[84]  Thomas Erickson,et al.  Working with interface metaphors , 1995 .

[85]  Barbara B Minckley,et al.  Methods of Clinical Examination: A Physiologic Approach , 1975 .

[86]  E H Shortliffe,et al.  Graphical Access to Medical Expert Systems: I. Design of a Knowledge Engineer’s Interface , 1986, Methods of Information in Medicine.

[87]  Nigel O'Farrell,et al.  AIDS AND ACADEMIC BOYCOTTS , 1989, The Lancet.

[88]  K Kuhn,et al.  Structured data collection and knowledge-based user guidance for abdominal ultrasound reporting. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[89]  B Preiss,et al.  UVAL-MED a universal visual associative language for medicine. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[90]  J O Hoeke,et al.  Graphical Non-Linear Representation of Multi-Dimensional Laboratory Measurements in their Clinical Context , 1991, Methods of Information in Medicine.

[91]  Otto Neurath,et al.  International Picture Language , 1936 .

[92]  David M. Gaba,et al.  Situation Awareness in Anesthesiology , 1995, Hum. Factors.

[93]  A. Giuliano,et al.  The prevalence of carcinoma in palpable vs impalpable, mammographically detected lesions. , 1991, AJR. American journal of roentgenology.

[94]  Steven K. Feiner,et al.  Visualizing n-dimensional virtual worlds with n-vision , 1990, I3D '90.

[95]  P C Tang,et al.  Major issues in user interface design for health professional workstations: summary and recommendations. , 1994, International journal of bio-medical computing.

[96]  Jr. Donald W. Miller.  Dynamic Data Icons: Graphical Display of Uterine Cervical Cytologic Exams, Diagnostic Studies, and Treatments , 1995 .

[97]  Kathleen McKeown,et al.  Tailoring Explanations for the User , 1985, IJCAI.

[98]  Alan F. Blackwell,et al.  Visual programming: the outlook from academia and industry , 1997, ESP '97.

[99]  Andrew Sears,et al.  Layout Appropriateness: A Metric for Evaluating User Interface Widget Layout , 1993, IEEE Trans. Software Eng..

[100]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[101]  L M Fagan,et al.  Semantic visualization of oncology knowledge sources. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[102]  L. Elting,et al.  Is a Picture Worth a Thousand Medical Words? A Randomized Trial of Reporting Formats for Medical Research Data , 1991, Methods of Information in Medicine.

[103]  René Jorna,et al.  A comparison of presentation and representation: linguistic and pictorial , 1988 .

[104]  David Harel,et al.  On visual formalisms , 1988, CACM.

[105]  Mary Anne Buttigieg,et al.  Object Displays Do Not Always Support Better Integrated Task Performance , 1989 .

[106]  L M Fagan,et al.  Graphical access to medical expert systems: V. Integration with continuous-speech recognition. , 1993, Methods of information in medicine.

[107]  E Winograd,et al.  Aging and the picture superiority effect in recall. , 1982, Journal of gerontology.

[108]  M. Lafortune,et al.  The radiological report: what is useful for the referring physician? , 1988, Canadian Association of Radiologists journal = Journal l'Association canadienne des radiologistes.

[109]  Kevin Mullet,et al.  Designing Visual Interfaces , 1996, SGCH.

[110]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[111]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[112]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[113]  B. Goettl,et al.  Integrated displays and the perception of graphical data. , 1991, Ergonomics.

[114]  Floris L. van Nes,et al.  The legibility of visual display texts , 1988 .

[115]  B Preiss,et al.  Concept graphics: a language for medical knowledge. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[116]  Casimir A. Kulikowski,et al.  Iconic Reporting: A New Way of Communicating Radiological Findings , 1995 .

[117]  Stephen M. Kosslyn,et al.  Graphics and Human Information Processing: A Review of Five Books , 1985 .

[118]  Robert E. Horn,et al.  Visual Language: Global Communication for the 21st Century , 1998 .

[119]  M. G. Fleming.  Design of a high resolution image cytometer with open software architecture. , 1996, Analytical cellular pathology : the journal of the European Society for Analytical Cellular Pathology.

[120]  Elizabeth J. Casey.  Visual Display Representation of Multidimensional Systems: The Effect of System Structure: And Display Integrality , 1987 .

[121]  Kevin B. Bennett,et al.  Improving the Effectiveness of Configural Displays through Mapped Emergent Features and Color-Coded Graphical Elements , 1991 .

[122]  Yvonne Rogers,et al.  Icons at the Interface: Their Usefulness , 1989, Interact. Comput..

[123]  P J Lynch,et al.  Hypermedia techniques for diagnostic imaging instruction: videodisk echocardiography encyclopedia. , 1989, Radiology.

[124]  D Enlander.  Computerised graphic representation of clinical chemistry results. , 1981, Journal of clinical pathology.

[125]  R A Greenes,et al.  Form-based clinical input from a structured vocabulary: initial application in ultrasound reporting. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[126]  Michel Wermelinger,et al.  An X-Windows Toolkit for Knowledge Acquisition and Representation Based on Conceptual Structures , 1992, Workshop on Conceptual Graphs.

[127]  Geoffrey S. Hubona,et al.  Evaluating system design features , 1996, Int. J. Hum. Comput. Stud..

[128]  S S Stevens,et al.  On the Theory of Scales of Measurement. , 1946, Science.

[129]  J Starren,et al.  Notations for high efficiency data presentation in mammography. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[130]  Karen Richardson.  Documenting Care: Communication, the Nursing Process and Documentation Standards , 1992 .

[131]  J. Church.  Endoscopy of the colon, rectum, and anus , 1995 .

[132]  Ken Arnold,et al.  The Java Programming Language , 1996 .

[133]  E Schubert,et al.  A pathologist-designed imaging system for anatomic pathology signout, teaching, and research. , 1994, Seminars in diagnostic pathology.