Supporting cognition in systems biology analysis: findings on users' processes and design implications

BackgroundCurrent usability studies of bioinformatics tools suggest that tools for exploratory analysis support some tasks related to finding relationships of interest but not the deep causal insights necessary for formulating plausible and credible hypotheses. To better understand design requirements for gaining these causal insights in systems biology analyses a longitudinal field study of 15 biomedical researchers was conducted. Researchers interacted with the same protein-protein interaction tools to discover possible disease mechanisms for further experimentation.ResultsFindings reveal patterns in scientists' exploratory and explanatory analysis and reveal that tools positively supported a number of well-structured query and analysis tasks. But for several of scientists' more complex, higher order ways of knowing and reasoning the tools did not offer adequate support. Results show that for a better fit with scientists' cognition for exploratory analysis systems biology tools need to better match scientists' processes for validating, for making a transition from classification to model-based reasoning, and for engaging in causal mental modelling.ConclusionAs the next great frontier in bioinformatics usability, tool designs for exploratory systems biology analysis need to move beyond the successes already achieved in supporting formulaic query and analysis tasks and now reduce current mismatches with several of scientists' higher order analytical practices. The implications of results for tool designs are discussed.

[1]  Matthew Suderman,et al.  Tools for visually exploring biological networks , 2007, Bioinform..

[2]  N. Lavie Perceptual load as a necessary condition for selective attention. , 1995, Journal of experimental psychology. Human perception and performance.

[3]  Naren Ramakrishnan,et al.  Algorithms for Storytelling , 2006, IEEE Transactions on Knowledge and Data Engineering.

[4]  Susan Bell Trickett,et al.  Extracting Explicit and Implict Information from Complex Visualizations , 2002, Diagrams.

[5]  Peter Tarczy-Hornoch,et al.  qualitative study of the implementation of a ioinformatics tool in a biological research laboratory , 2007 .

[6]  Bin Liu,et al.  Michigan Molecular Interactions (MiMI): putting the jigsaw puzzle together , 2006, Nucleic Acids Res..

[7]  Elaine G. Toms,et al.  Developing a protocol for bioinformatics analysis: An integrated information behavior and task analysis approach: Research Articles , 2005 .

[8]  L. B. Cebik Reorienting Rhetoric: The Dialectic of List and Story , 1994 .

[9]  William R. Hersh,et al.  A Survey of Current Work in Biomedical Text Mining , 2005 .

[10]  A. Barabasi,et al.  Human disease classification in the postgenomic era: A complex systems approach to human pathobiology , 2007, Molecular systems biology.

[11]  Ben Shneiderman,et al.  Knowledge Discovery in High Dimensional Data: Case Studies and a User Survey for an Information Visualization Tool , 2005 .

[12]  K. Holyoak,et al.  The Cambridge handbook of thinking and reasoning , 2005 .

[13]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[14]  Ahmed Seffah,et al.  Refining the Usability Engineering Toolbox: Lessons Learned from a User Study on a Visualization Tool , 2007, USAB.

[15]  Evelyn Fox Keller,et al.  Making sense of life : explanation in developmental biology , 1999 .

[16]  B. Latour Pandora's Hope: Essays on the Reality of Science Studies , 1999 .

[17]  Carole A. Goble,et al.  A classification of tasks in bioinformatics , 2001, Bioinform..

[18]  Marcelo Dascal,et al.  The Conceptual Unity of Aristotle's Rhetoric , 2001 .

[19]  K. Dunbar The Cognitive Basis of Science: Understanding the role of cognition in science: the Science as Category framework , 2002 .

[20]  Ben Shneiderman,et al.  Knowledge discovery in high-dimensional data: case studies and a user survey for the rank-by-feature framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[21]  Ramin Homayouni,et al.  Collaborative development of the Arrowsmith two node search interface designed for laboratory investigators , 2006, Journal of biomedical discovery and collaboration.

[22]  John Stasko,et al.  BEST PAPER: A Knowledge Task-Based Framework for Design and Evaluation of Information Visualizations , 2004 .

[23]  Chris North,et al.  An insight-based methodology for evaluating bioinformatics visualizations , 2005, IEEE Transactions on Visualization and Computer Graphics.

[24]  Jean Scholtz,et al.  Beyond Usability: Evaluation Aspects of Visual Analytic Environments , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[25]  Jim Blythe,et al.  The Effect of Graph Layout on Inference from Social Network Data , 1995, GD.

[26]  Catherine M. Burns,et al.  Putting It All Together: Improving Display Integration in Ecological Displays , 2000, Hum. Factors.

[27]  S. Stich,et al.  The cognitive basis of science , 2002 .

[28]  Andrew Cumming,et al.  Animated Interval Scatter-Plot Views for the Exploratory Analysis of Large-Scale Microarray Time-Course Data , 2005, Inf. Vis..

[29]  Dat Tran,et al.  Applying Task Analysis to Describe and Facilitate Bioinformatics Tasks , 2004, MedInfo.

[30]  Elaine Toms,et al.  Developing a protocol for bioinformatics analysis: An integrated information behavior and task analysis approach , 2005, J. Assoc. Inf. Sci. Technol..

[31]  Allan Kuchinsky,et al.  Biological storytelling: a software tool for biological information organization based upon narrative structure , 2002 .

[32]  J. Gregory Trafton,et al.  Turning pictures into numbers: extracting and generating information from complex visualizations , 2000, Int. J. Hum. Comput. Stud..

[33]  Susan Bell Trickett,et al.  Toward a Comprehensive Model of Graph Comprehension: Making the Case for Spatial Cognition , 2006, Diagrams.

[34]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[35]  Chris North,et al.  Visualizing Biological Pathways: Requirements Analysis, Systems Evaluation and Research Agenda , 2005, Inf. Vis..

[36]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[37]  S. Kraemer Steps to an Ecology of Mind: Gregory Bateson , 1993, British Journal of Psychiatry.

[38]  Geoffrey P. Goodwin,et al.  Reasoning about the Relations between Relations , 2006, Quarterly journal of experimental psychology.

[39]  N. Nersessian The Cognitive Basis of Science: The cognitive basis of model-based reasoning in science , 2002 .