DeepStomata: Facial Recognition Technology for Automated Stomatal Aperture Measurement

Stomata are an attractive model for studying the physiological responses of plants to various environmental stimuli1–3. Of the morphological parameters that represent the degree of stomatal opening, the length of the minor axis of the stomatal pore (the stomatal aperture) has been most commonly used to dissect the molecular basis of its regulation. Measuring stomatal apertures is time consuming and labour intensive, preventing their use in large-scale studies. Here, we completely automated this process by developing a program called DeepStomata, which combines stomatal region detection and pore isolation by image segmentation. The former, which comprises histograms of oriented gradients (HOG)-based stomatal detection and the convolutional neural network (CNN)-based classification of open/closed-state stomata, acts as an efficient conditional branch in the workflow to selectively quantify the pores of open stomata. An analysis of batches of images showed that the accuracy of our automated aperture measurements was equivalent to that of manual measurements, however had higher sensitivity (i,e., lower false negative rate) and the process speed was at least 80 times faster. The outstanding performance of our proposed method for automating a laborious and repetitive task will allow researchers to focus on deciphering complex phenomena.

[1]  Davis E. King Max-Margin Object Detection , 2015, ArXiv.

[2]  Shin-Ichiro Inoue,et al.  Identification and Characterization of Compounds that Affect Stomatal Movements , 2018, Plant & cell physiology.

[3]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[4]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Mg-chelatase I subunit 1 and Mg-protoporphyrin IX methyltransferase affect the stomatal aperture in Arabidopsis thaliana , 2014, Journal of Plant Research.

[6]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  M. Moshelion,et al.  The evolution of the role of ABA in the regulation of water-use efficiency: From biochemical mechanisms to stomatal conductance. , 2016, Plant science : an international journal of experimental plant biology.

[9]  Tomoshi Otsuki,et al.  Active learning framework with iterative clustering for bioimage classification , 2012, Nature Communications.

[10]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Shin-Ichiro Inoue,et al.  A Raf-like protein kinase BHP mediates blue light-dependent stomatal opening , 2017, Scientific Reports.

[15]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[16]  S. Assmann,et al.  Light regulation of stomatal movement. , 2007, Annual review of plant biology.

[17]  Shin-Ichiro Inoue,et al.  Mg-chelatase H subunit affects ABA signaling in stomatal guard cells, but is not an ABA receptor in Arabidopsis thaliana , 2011, Journal of Plant Research.

[18]  J. Schroeder,et al.  GUARD CELL SIGNAL TRANSDUCTION. , 2003, Annual review of plant physiology and plant molecular biology.

[19]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[20]  Mahadev Satyanarayanan,et al.  OpenFace: A general-purpose face recognition library with mobile applications , 2016 .

[21]  A. Girbes,et al.  Is mortality rate what it is all about in congestive heart failure? , 1995, The Lancet.

[22]  Oren Z. Kraus,et al.  Machine learning and computer vision approaches for phenotypic profiling , 2017, The Journal of cell biology.

[23]  S. He,et al.  Plant stomata: a checkpoint of host immunity and pathogen virulence. , 2010, Current opinion in biotechnology.

[24]  Shin-Ichiro Inoue,et al.  Immunohistochemical detection of blue light-induced phosphorylation of the plasma membrane H+-ATPase in stomatal guard cells. , 2011, Plant & cell physiology.