Determining the scale of image patches using a deep learning approach

Detecting the scale of histopathology images is important because it allows to exploit various sources of information to train deep learning (DL) models to recognise biological structures of interest. Large open access databases with images exist, such as The Cancer Genome Atlas (TCGA) and PubMed Central but very few models can use such datasets because of the variability of the data in color and scale and a lack of metadata. In this article, we present and compare two deep learning architectures, to detect the scale of histopathology image patches. The approach is evaluated on a patch dataset from whole slide images of the prostate, obtaining a Cohen's kappa coefficient of 0.9897 in the classification of patches with a scale of 5×, 10× and 20×. The good results represent a first step towards magnification detection in histopathology images that can help to solve the problem on more heterogeneous data sources.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Sven Koitka,et al.  Traditional Feature Engineering and Deep Learning Approaches at Medical Classification Task of ImageCLEF 2016 , 2016, CLEF.

[3]  Juho Kannala,et al.  Deep learning for magnification independent breast cancer histopathology image classification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[4]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[5]  Henning Müller,et al.  The Medical Image Retrieval Task , 2010, ImageCLEF.

[6]  Liron Pantanowitz,et al.  Relationship between magnification and resolution in digital pathology systems , 2013, Journal of pathology informatics.

[7]  Sameer Antani,et al.  Creating a classification of image types in the medical literature for visual categorization , 2012, Other Conferences.

[8]  George Lee,et al.  Evaluating stability of histomorphometric features across scanner and staining variations: prostate cancer diagnosis from whole slide images , 2016, Journal of medical imaging.

[9]  Henning Müller,et al.  Evaluating performance of biomedical image retrieval systems - An overview of the medical image retrieval task at ImageCLEF 2004-2013 , 2015, Comput. Medical Imaging Graph..

[10]  Arnav Bhavsar,et al.  Breast Cancer Histopathological Image Classification: Is Magnification Important? , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[11]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Stefano Bromuri,et al.  Overview of the medical tasks in ImageCLEF 2016 , 2016 .