Inside the Mind of a Medicinal Chemist: The Role of Human Bias in Compound Prioritization during Drug Discovery

Medicinal chemists’ “intuition” is critical for success in modern drug discovery. Early in the discovery process, chemists select a subset of compounds for further research, often from many viable candidates. These decisions determine the success of a discovery campaign, and ultimately what kind of drugs are developed and marketed to the public. Surprisingly little is known about the cognitive aspects of chemists’ decision-making when they prioritize compounds. We investigate 1) how and to what extent chemists simplify the problem of identifying promising compounds, 2) whether chemists agree with each other about the criteria used for such decisions, and 3) how accurately chemists report the criteria they use for these decisions. Chemists were surveyed and asked to select chemical fragments that they would be willing to develop into a lead compound from a set of ∼4,000 available fragments. Based on each chemist’s selections, computational classifiers were built to model each chemist’s selection strategy. Results suggest that chemists greatly simplified the problem, typically using only 1–2 of many possible parameters when making their selections. Although chemists tended to use the same parameters to select compounds, differing value preferences for these parameters led to an overall lack of consensus in compound selections. Moreover, what little agreement there was among the chemists was largely in what fragments were undesirable. Furthermore, chemists were often unaware of the parameters (such as compound size) which were statistically significant in their selections, and overestimated the number of parameters they employed. A critical evaluation of the problem space faced by medicinal chemists and cognitive models of categorization were especially useful in understanding the low consensus between chemists.

[1]  Lin-Li Li,et al.  RASA: A Rapid Retrosynthesis-Based Scoring Method for the Assessment of Synthetic Accessibility of Drug-like Molecules , 2011, J. Chem. Inf. Model..

[2]  W Patrick Walters,et al.  What do medicinal chemists actually make? A 50-year retrospective. , 2011, Journal of medicinal chemistry.

[3]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[4]  Simon J F Macdonald,et al.  Factors determining the selection of organic reactions by medicinal chemists and the use of these reactions in arrays (small focused libraries). , 2010, Angewandte Chemie.

[5]  David Rogers,et al.  Extended-Connectivity Fingerprints , 2010, J. Chem. Inf. Model..

[6]  T. Ritchie,et al.  The impact of aromatic ring count on compound developability--are too many aromatic rings a liability in drug design? , 2009, Drug discovery today.

[7]  Stefan M. Herzog,et al.  Fast and frugal heuristics: Tools of social rationality. , 2009 .

[8]  C. Humblet,et al.  Escape from flatland: increasing saturation as an approach to improving clinical success. , 2009, Journal of medicinal chemistry.

[9]  Michèle N Schulz,et al.  Recent progress in fragment-based lead discovery. , 2009, Current opinion in pharmacology.

[10]  H. Timmerman,et al.  Medicinal Chemistry Teaching and Training: A Continuous Adaptation , 2009, ChemMedChem.

[11]  Gianni Chessari,et al.  From fragment to clinical candidate--a historical perspective. , 2009, Drug discovery today.

[12]  Jack R. Collins,et al.  Examining the significance of fingerprint-based classifiers , 2008, BMC Bioinformatics.

[13]  M. Congreve,et al.  Recent developments in fragment-based drug discovery. , 2008, Journal of medicinal chemistry.

[14]  S. Weller Cultural Consensus Theory: Applications and Frequently Asked Questions , 2007 .

[15]  A. Dijksterhuis,et al.  On the benefits of thinking unconsciously: Unconscious thought can increase post-choice satisfaction , 2006 .

[16]  Meir Glick,et al.  Streamlining lead discovery by aligning in silico and high-throughput screening. , 2006, Current opinion in chemical biology.

[17]  J. S. Carey,et al.  Analysis of the reactions used for the preparation of drug candidate molecules. , 2006, Organic & biomolecular chemistry.

[18]  Douglas L. Medin,et al.  Folkbiology of freshwater fish , 2006, Cognition.

[19]  P. Krogsgaard‐Larsen,et al.  Medicinal chemistry education: what is needed and where is it going? , 2005 .

[20]  Edgar Jacoby,et al.  Library design for fragment based screening. , 2005, Current topics in medicinal chemistry.

[21]  John Steele,et al.  Drug-like properties: guiding principles for design - or chemical prejudice? , 2004, Drug discovery today. Technologies.

[22]  A. Dijksterhuis Think different: the merits of unconscious thought in preference development and decision making. , 2004, Journal of personality and social psychology.

[23]  Michael S Lajiness,et al.  Assessment of the consistency of medicinal chemists in reviewing sets of compounds. , 2004, Journal of medicinal chemistry.

[24]  R. Desimone,et al.  Privileged structures: applications in drug discovery. , 2004, Combinatorial chemistry & high throughput screening.

[25]  Sian L. Beilock,et al.  Haste does not always make waste: Expertise, direction of attention, and speed versus accuracy in performing sensorimotor skills , 2004, Psychonomic bulletin & review.

[26]  Joseph G. Johnson,et al.  Take The First: Option-generation and resulting choices , 2003 .

[27]  Yutaka Endo,et al.  Development of a Method for Evaluating Drug-Likeness and Ease of Synthesis Using a Data Set in Which Compounds Are Assigned Scores Based on Chemists' Intuition , 2003, J. Chem. Inf. Comput. Sci..

[28]  Joseph S. Verducci,et al.  A Modification of the Jaccard–Tanimoto Similarity Index for Diverse Selection of Chemical Compounds Using Binary Strings , 2002, Technometrics.

[29]  Tudor I. Oprea Current trends in lead discovery: Are we looking for the appropriate properties? , 2002, J. Comput. Aided Mol. Des..

[30]  Edward B. Royzman,et al.  Negativity Bias, Negativity Dominance, and Contagion , 2001 .

[31]  E. Salas,et al.  Linking Expertise and Naturalistic Decision Making , 2001 .

[32]  J J Baldwin,et al.  Prediction of drug absorption using multivariate statistics. , 2000, Journal of medicinal chemistry.

[33]  Kristina Luthman,et al.  Polar Molecular Surface Properties Predict the Intestinal Absorption of Drugs in Humans , 1997, Pharmaceutical Research.

[34]  T. R. Stewart,et al.  The Importance of the Task in Analyzing Expert Judgment , 1997 .

[35]  D. Medin,et al.  Categorization and Reasoning among Tree Experts: Do All Roads Lead to Rome? , 1997, Cognitive Psychology.

[36]  Pat Langley,et al.  Induction of Selective Bayesian Classifiers , 1994, UAI.

[37]  Timothy D. Wilson,et al.  Introspecting about Reasons can Reduce Post-Choice Satisfaction , 1993 .

[38]  J. Shanteau Competence in experts: The role of task characteristics , 1992 .

[39]  J. Shanteau How much information does an expert use? Is it relevant? , 1992 .

[40]  Igor Kononenko,et al.  Semi-Naive Bayesian Classifier , 1991, EWSL.

[41]  Timothy D. Wilson,et al.  Thinking too much: introspection can reduce the quality of preferences and decisions. , 1991, Journal of personality and social psychology.

[42]  J. Shanteau Psychological characteristics and strategies of expert decision makers , 1988 .

[43]  H. Hoffman,et al.  Unconscious acquisition of complex procedural knowledge. , 1987 .

[44]  D. Medin,et al.  Family resemblance, conceptual cohesiveness, and category construction , 1987, Cognitive Psychology.

[45]  W. Batchelder,et al.  Culture as Consensus: A Theory of Culture and Informant Accuracy , 1986 .

[46]  L. Barsalou Ideals, central tendency, and frequency of instantiation as determinants of graded structure in categories. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[47]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[48]  J. Shanteau,et al.  Livestock judges: How much information can an expert use? , 1978 .

[49]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[50]  Ebbe B. Ebbesen,et al.  Decision Making and Information Integration in the Courts: The Setting of Bail , 1975 .

[51]  H. J. Einhorn Expert judgment: Some necessary conditions and an example. , 1974 .

[52]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[53]  A. Tversky,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[54]  P. Slovic Analyzing the expert judge: A descriptive study of a stockbroker's decision process. , 1969 .

[55]  L. R. Goldberg Simple models or simple processes? Some research on clinical judgments. , 1968, The American psychologist.

[56]  P. Slovic,et al.  An analysis-of-variance model for the assessment of configural cue utilization in clinical judgment. , 1968, Psychological bulletin.

[57]  H. A. Wallace,et al.  What is in the Corn Judge's Mind?1 , 1923 .

[58]  Gerd Gigerenzer,et al.  Homo Heuristicus: Why Biased Minds Make Better Inferences , 2009, Top. Cogn. Sci..

[59]  E. Ebbesen,et al.  Decision Making and Information Integration in the Courts : The Setting of Bail , 2007 .

[60]  L. Breiman Random Forests , 2001, Machine Learning.

[61]  Chao Chen,et al.  Using Random Forest to Learn Imbalanced Data , 2004 .

[62]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[63]  Ola Engkvist,et al.  Prediction of CNS Activity of Compound Libraries Using Substructure Analysis , 2003, J. Chem. Inf. Comput. Sci..

[64]  D. Goldstein,et al.  How good are simple heuristics , 1999 .

[65]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[66]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[67]  L. Mitscher,et al.  Vocational training for medicinal chemists: views from industry. , 1996, European journal of medicinal chemistry.

[68]  J. Topliss,et al.  Chapter 33. Educating Medicinal Chemists , 1995 .

[69]  Lawrence W. Barsalou,et al.  Deriving Categories to Achieve Goals , 1991 .

[70]  K. Vohs,et al.  Case Western Reserve University , 1990 .

[71]  L. J. Chapman,et al.  Illusory correlation as an obstacle to the use of valid psychodiagnostic signs. , 1969, Journal of abnormal psychology.