Computer vision-based method for monitoring grain quantity change in warehouses

ABSTRACT Regularly checking the quantity of stored grain in warehouses is essential for the grain safety of a country. However, current manual inspection ways fail to get real-time measurement results and require spending a lot of manpower and resources. In this paper, we proposed a computer vision-based method to automatically monitor the change in grain quantity of a granary. The proposed method was motivated from the observation that warehouse managers can use a camera to remotely monitor the grain security of a granary, which determines whether grain quantity is reduced by checking the distance between the grain surface and the grain loading line at the outlet of a granary. To this end, images were first captured by a camera, and a two-level spatial constraints-based SVM classifier was learned to detect the grain surface and the grain loading line of the images. During the test phase, the detected result of a test image obtained by SVM was further refined by GrabCut with higher order potentials to get the more accurate segmentation result. Finally, the area between the grain surface and the grain loading line was calculated, and then compared with the previous measured one to determine whether the grain surface had dropped. The experiment results validate the effectiveness of the two-level spatial constraints SVM and the strategy for monitoring the change in grain quantity.

[1]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Guangwen Yang,et al.  An EnKF-based scheme to optimize hyper-parameters and features for SVM classifier , 2017, Pattern Recognit..

[3]  Ignacio Algredo-Badillo,et al.  Eggshell deformation detection applying computer vision , 2019, Comput. Electron. Agric..

[4]  Xiang Zhang,et al.  Superpixel-Based Spatiotemporal Saliency Detection , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Chih-Hung Wu,et al.  A Novel hybrid genetic algorithm for kernel function and parameter optimization in support vector regression , 2009, Expert Syst. Appl..

[6]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[7]  Václav Hlavác,et al.  Multi-class support vector machine , 2002, Object recognition supported by user interaction for service robots.

[8]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Sankar K. Pal,et al.  Segmentation of multispectral remote sensing images using active support vector machines , 2004, Pattern Recognit. Lett..

[10]  Vincenzo Chiofalo,et al.  Fusion of electronic nose, electronic tongue and computer vision for animal source food authentication and quality assessment – A review , 2017 .

[11]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[12]  Lei Zhang,et al.  A subregion division based multi-objective evolutionary algorithm for SVM training set selection , 2020, Neurocomputing.

[13]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[14]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[15]  Stefano Soatto,et al.  Class segmentation and object localization with superpixel neighborhoods , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  E. Yiğit,et al.  Machine learning based quantity measurement method for grain silos , 2020 .

[17]  Jian Zhao,et al.  Locally linear SVMs based on boundary anchor points encoding , 2019, Neural Networks.

[18]  Lei Li,et al.  Unsupervised color-texture segmentation based on multiscale quaternion Gabor filters and splitting strategy , 2013, Signal Process..

[19]  Baba C. Vemuri,et al.  A Quaternion Framework for Color Image Smoothing and Segmentation , 2011, International Journal of Computer Vision.

[20]  Md. Sultan Mahmud,et al.  Development of an artificial cloud lighting condition system using machine vision for strawberry powdery mildew disease detection , 2019, Comput. Electron. Agric..

[21]  Nabil Zerrouki,et al.  Vision-based fall detection system for improving safety of elderly people , 2017, IEEE Instrumentation & Measurement Magazine.

[22]  Enes Yigit.  A novel compressed sensing based quantity measurement method for grain silos , 2018, Comput. Electron. Agric..

[23]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Rommel M. Barbosa,et al.  Recognition of organic rice samples based on trace elements and support vector machines , 2016 .

[25]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Zhongyi Hu,et al.  A PSO and pattern search based memetic algorithm for SVMs parameters optimization , 2013, Neurocomputing.

[27]  Elling Ruud Øye,et al.  Robust classification approach for segmentation of blood defects in cod fillets based on deep convolutional neural networks and support vector machines and calculation of gripper vectors for robotic processing , 2017, Comput. Electron. Agric..

[28]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Philip H. S. Torr,et al.  Higher Order Conditional Random Fields in Deep Neural Networks , 2015, ECCV.

[30]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[31]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Yingjie Tian,et al.  Joint Ranking SVM and Binary Relevance with Robust Low-Rank Learning for Multi-Label Classification , 2019, Neural Networks.

[33]  Ting Wang,et al.  Color image segmentation using pixel wise support vector machine classification , 2011, Pattern Recognit..

[34]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  P. Vithu,et al.  Machine vision system for food grain quality evaluation: A review , 2016 .

[36]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[37]  Yun Zhang,et al.  Incorporating Adaptive Local Information Into Fuzzy Clustering for Image Segmentation , 2015, IEEE Transactions on Image Processing.

[38]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[40]  Feiping Nie,et al.  SVM based multi-label learning with missing labels for image annotation , 2018, Pattern Recognit..

[41]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[42]  Wen Zhang,et al.  A review on weed detection using ground-based machine vision and image processing techniques , 2019, Comput. Electron. Agric..

[43]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..