A New Pairwise Deep Learning Feature For Environmental Microorganism Image Analysis

Environmental microorganism (EM) offers a high-efficient, harmless, and low-cost solution to environmental pollution. They are used in sanitation, monitoring, and decomposition of environmental pollutants. However, this depends on the proper identification of suitable microorganisms. In order to fasten, low the cost, increase consistency and accuracy of identification, we propose the novel pairwise deep learning features to analyze microorganisms. The pairwise deep learning features technique combines the capability of handcrafted and deep learning features. In this technique we, leverage the Shi and Tomasi interest points by extracting deep learning features from patches which are centered at interest points’ locations. Then, to increase the number of potential features that have intermediate spatial characteristics between nearby interest points, we use Delaunay triangulation theorem and straight-line geometric theorem to pair the nearby deep learning features. The potential of pairwise features is justified on the classification of EMs 1 Corresponding author: Chen Li Email address: lichen201096@hotmail.com (Chen Li )

[1]  E. Priya,et al.  Automated object and image level classification of TB images using support vector neural network classifier , 2016 .

[2]  Wu Peng,et al.  Harris Scale Invariant Corner Detection Algorithm Based on the Significant Region , 2016 .

[3]  Jianfang Dou,et al.  Image matching based local Delaunay triangulation and affine invariant geometric constraint , 2014 .

[4]  Ioannis Pratikakis,et al.  Bag of spatio-visual words for context inference in scene classification , 2013, Pattern Recognit..

[5]  Silvio Savarese,et al.  Discriminative Object Class Models of Appearance and Shape by Correlatons , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Chen Li,et al.  Environmental microorganism classification using conditional random fields and deep convolutional neural networks , 2018, Pattern Recognit..

[7]  Hamid Soltanian-Zadeh,et al.  Medical image registration using sparse coding of image patches , 2016, Comput. Biol. Medicine.

[8]  Manuel Flores,et al.  Fingerprint verification methods using delaunay triangulations , 2017, Int. Arab J. Inf. Technol..

[9]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[10]  Aydin Kaya,et al.  Classification of radiolarian fossil images with deep learning methods , 2018, 2018 26th Signal Processing and Communications Applications Conference (SIU).

[11]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Gang Hua,et al.  Integrated feature selection and higher-order spatial feature extraction for object categorization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Roy Sterritt,et al.  Swarms and Swarm Intelligence , 2007, Computer.

[14]  W. R. Sam Emmanuel,et al.  Automated identification of mycobacterium bacillus from sputum images for tuberculosis diagnosis , 2019, Signal Image Video Process..

[15]  Qunlan Zhou,et al.  Role and functions of beneficial microorganisms in sustainable aquaculture. , 2009, Bioresource technology.

[16]  Chen Li,et al.  A survey for the applications of content-based microscopic image analysis in microorganism classification domains , 2019, Artificial Intelligence Review.

[17]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Stanislaw Osowski,et al.  Computerized classification system for the identification of soil microorganisms , 2015 .

[19]  Tsuhan Chen,et al.  Efficient Kernels for identifying unbounded-order spatial features , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Tao Jiang,et al.  Environmental Microbiological Content-Based Image Retrieval System Using Internal Structure Histogram , 2015, CORES.

[21]  Tony Lindeberg,et al.  Scale Selection Properties of Generalized Scale-Space Interest Point Detectors , 2012, Journal of Mathematical Imaging and Vision.

[22]  Shin'ichi Satoh,et al.  Building Compact Local Pairwise Codebook with Joint Feature Space Clustering , 2010, ECCV.

[23]  Jamil Ahmad,et al.  On Feature based Delaunay Triangulation for Palmprint Recognition , 2016, ArXiv.

[24]  Chen Li,et al.  Classification of environmental microorganisms in microscopic images using shape features and support vector machines , 2013, 2013 IEEE International Conference on Image Processing.

[25]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[26]  Tao Jiang,et al.  Content-Based Microscopic Image Retrieval of Environmental Microorganisms Using Multiple Colour Channels Fusion , 2016 .

[27]  Hao Xu,et al.  A Review of Clustering Methods in Microorganism Image Analysis , 2020 .

[28]  Yi Hong Wang.  Research on Segmentation of Protozoan and Metazoan Image in Microscopic Examination of Activated Sludge , 2013 .

[29]  Dong Nie,et al.  A deep framework for bacterial image segmentation and classification , 2015, BCB.

[30]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[31]  Cordelia Schmid,et al.  A maximum entropy framework for part-based texture and object recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[32]  Y. Pachepsky,et al.  Identification and enumeration of cyanobacteria species using a deep neural network , 2020 .

[33]  Philippe Kahane,et al.  Activations of deep convolutional neural networks are aligned with gamma band activity of human visual cortex , 2017, Communications Biology.

[34]  Amin Sarafraz,et al.  Automated plankton image analysis using convolutional neural networks , 2018, Limnology and Oceanography: Methods.

[35]  Shin'ichi Satoh,et al.  Compact correlation coding for visual object categorization , 2011, 2011 International Conference on Computer Vision.

[36]  Anna Plichta,et al.  Deep learning approach to bacterial colony classification , 2017, PloS one.

[37]  Sameer Antani,et al.  Visualization and Interpretation of Convolutional Neural Network Predictions in Detecting Pneumonia in Pediatric Chest Radiographs , 2018, Applied sciences.

[38]  Stefano Soatto,et al.  Proximity Distribution Kernels for Geometric Context in Category Recognition , 2007, 2007 IEEE 11th International Conference on Computer Vision.