Pigeons (Columba livia) as Trainable Observers of Pathology and Radiology Breast Cancer Images

Pathologists and radiologists spend years acquiring and refining their medically essential visual skills, so it is of considerable interest to understand how this process actually unfolds and what image features and properties are critical for accurate diagnostic performance. Key insights into human behavioral tasks can often be obtained by using appropriate animal models. We report here that pigeons (Columba livia)—which share many visual system properties with humans—can serve as promising surrogate observers of medical images, a capability not previously documented. The birds proved to have a remarkable ability to distinguish benign from malignant human breast histopathology after training with differential food reinforcement; even more importantly, the pigeons were able to generalize what they had learned when confronted with novel image sets. The birds’ histological accuracy, like that of humans, was modestly affected by the presence or absence of color as well as by degrees of image compression, but these impacts could be ameliorated with further training. Turning to radiology, the birds proved to be similarly capable of detecting cancer-relevant microcalcifications on mammogram images. However, when given a different (and for humans quite difficult) task—namely, classification of suspicious mammographic densities (masses)—the pigeons proved to be capable only of image memorization and were unable to successfully generalize when shown novel examples. The birds’ successes and difficulties suggest that pigeons are well-suited to help us better understand human medical image perception, and may also prove useful in performance assessment and development of medical imaging hardware, image processing, and image analysis tools.

[1]  Martin Fieder,et al.  Categorical learning in pigeons: the role of texture and shape in complex static stimuli , 1999, Vision Research.

[2]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[3]  Darel E. Heitkamp,et al.  Real view radiology-impact on search patterns and confidence in radiology education. , 2014, Academic radiology.

[4]  Toru Shimizu,et al.  Avian Visual Behavior and the Organization of the Telencephalon , 2010, Brain, Behavior and Evolution.

[5]  Ludwig Huber,et al.  Natural Categorization through Multiple Feature Learning in Pigeons , 2000, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[6]  Michael H. Brill,et al.  Evaluation of targets for color calibrating digital images from an optical bright‐field transmission microscope , 2015 .

[7]  Elizabeth A. Krupinski,et al.  Compressing pathology whole-slide images using a human and model observer evaluation , 2012, Journal of pathology informatics.

[8]  E. Krupinski,et al.  Anniversary paper: evaluation of medical imaging systems. , 2008, Medical physics.

[9]  Karla K. Evans,et al.  If You Don’t Find It Often, You Often Don’t Find It: Why Some Cancers Are Missed in Breast Cancer Screening , 2013, PloS one.

[10]  Thom Verhave,et al.  The pigeon as a quality-control inspector. , 1966 .

[11]  P. Schyns,et al.  Nonaccidental Properties Underlie Shape Recognition in Mammalian and Nonmammalian Vision , 2007, Current Biology.

[12]  A. N. Bowers,et al.  Visual circuits of the avian telencephalon: evolutionary implications , 1999, Behavioural Brain Research.

[13]  Jason Karamchandani,et al.  Mammographic microcalcifications and breast cancer tumorigenesis: a radiologic-pathologic analysis , 2011, BMC Cancer.

[14]  Elizabeth A. Krupinski,et al.  Teleradiology: current perspectives , 2014 .

[15]  M. Wakita,et al.  Pigeons' discrimination of paintings by Monet and Picasso. , 1995, Journal of the experimental analysis of behavior.

[16]  Edward A. Wasserman,et al.  Conceptual Behavior in Pigeons : Categorization of Both Familiar and Novel Examples From Four Classes of Natural and Artificial Stimuli , 2009 .

[17]  Fabian A. Soto,et al.  Visual object categorization in birds and primates: Integrating behavioral, neurobiological, and computational evidence within a “general process” framework , 2011, Cognitive, Affective, & Behavioral Neuroscience.

[18]  S. Orel,et al.  BI-RADS categorization as a predictor of malignancy. , 1999, Radiology.

[19]  Yun-Han Huang,et al.  Development and utilization of a web-based application as a robust radiology teaching tool (radstax) for medical student anatomy teaching. , 2015, Academic radiology.

[20]  György Horvath,et al.  Human Ovarian Carcinomas Detected by Specific Odor , 2008, Integrative cancer therapies.

[21]  R. F. Wagner,et al.  Assessment of medical imaging and computer-assist systems: lessons from recent experience. , 2002, Academic radiology.

[22]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[23]  Melanie Grunwald,et al.  Foundations Of Image Science , 2016 .

[24]  Using giant African pouched rats to detect tuberculosis in human sputum samples: 2010 findings , 2011, The Pan African medical journal.

[25]  Wei-Chung Cheng,et al.  Consistency and Standardization of Color in Medical Imaging: a Consensus Report , 2014, Journal of Digital Imaging.

[26]  Aaron P Blaisdell,et al.  Capacity and limits of associative memory in pigeons , 2005, Psychonomic bulletin & review.

[27]  Xavier Robin,et al.  pROC: an open-source package for R and S+ to analyze and compare ROC curves , 2011, BMC Bioinformatics.

[28]  M. Kumar,et al.  Olfactory detection of prostate cancer by dogs sniffing urine: A step forward in early diagnosis , 2011 .

[29]  Kyle J Myers,et al.  Evaluating imaging and computer-aided detection and diagnosis devices at the FDA. , 2012, Academic radiology.

[30]  Muhammad A. J. Qadri,et al.  The Analysis of Visual Cognition in Birds: Implications for Evolution, Mechanism, and Representation , 2015 .

[31]  S. Shamshuddin,et al.  Use of OsiriX in developing a digital radiology teaching library. , 2014, Clinical radiology.

[32]  Ronald S Weinstein,et al.  Reconciliation of diverse telepathology system designs. Historic issues and implications for emerging markets and new applications , 2012, APMIS : acta pathologica, microbiologica, et immunologica Scandinavica.

[33]  Fabian A. Soto,et al.  Mechanisms of object recognition: what we have learned from pigeons , 2014, Front. Neural Circuits.

[34]  E. Krupinski,et al.  Visual scanning patterns of radiologists searching mammograms. , 1996, Academic radiology.

[35]  D S Blough,et al.  Pigeon perception of letters of the alphabet. , 1982, Science.

[36]  Richard Levenson,et al.  Putting the "more" back in morphology: spectral imaging and image analysis in the service of pathology. , 2008, Archives of pathology & laboratory medicine.

[37]  R. Cook,et al.  Pigeon same-different concept learning with multiple stimulus classes. , 1997, Journal of experimental psychology. Animal behavior processes.

[38]  William Hendee,et al.  The Handbook of Medical Image Perception and Techniques. , 2010, Medical physics.

[39]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[40]  Leyre Castro,et al.  Figure-ground assignment in pigeons: Evidence for a figural benefit , 2006, Perception & psychophysics.

[41]  A. Poling,et al.  Using giant African pouched rats to detect tuberculosis in human sputum samples: 2009 findings. , 2010, The American journal of tropical medicine and hygiene.

[42]  I. Biederman,et al.  Recognition-by-components: A bird's eye view. , 2012 .

[43]  Elizabeth A. Krupinski,et al.  Human Factors and Human-Computer Considerations in Teleradiology and Telepathology , 2014, Healthcare.