A novel and high precision tomato maturity recognition algorithm based on multi-level deep residual network

Since the existing tomato picking system uses multispectral sensors, color and other passive sensors for tomato detection and recognition, its detection range is very small, anti-interference ability is also weak, and tomato maturity detection cannot be performed accurately in real-time. How to detect tomato information from the massive image data obtained from tomato picking equipment and improve the recognition accuracy is a challenging research topic at home and abroad. This paper proposes an improved DenseNet deep neural network architecture, and uses it to solve the detection problems of maturity tomato in complex images. In order to enhance the accuracy of feature propagation and reduce the amount of stored data, a structured sparse operation is proposed. By dividing the network convolution kernel into multiple groups, the unimportant parameter connections in each group are gradually reduced during the network training process. In addition, since the dataset constructed in the field of tomato picking has imbalance, we introduce the Focal loss function to identify the tomato in the classification layer so as to enhance the accuracy of the final classification prediction of the tomato detection system. A large number of qualitative and quantitative experiments show that our improved network in this paper is superior to other existing deep models in terms of detection rate and FPPI, and its computational complexity is lower than that of DenseNet algorithm 18% under the same hardware and software configuration.

[1]  Ling Shao,et al.  RGB-D datasets using microsoft kinect or similar sensors: a survey , 2017, Multimedia Tools and Applications.

[2]  Nader Sadegh,et al.  Autonomous Leaf Picking Using Deep Learning and Visual-Servoing , 2016 .

[3]  Yann LeCun,et al.  Convolutional neural networks applied to house numbers digit classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[4]  Sang Cheol Kim,et al.  A Robust Deep-Learning-Based Detector for Real-Time Tomato Plant Diseases and Pests Recognition , 2017, Sensors.

[5]  Wataru Shimoda,et al.  CNN-Based Food Image Segmentation Without Pixel-Wise Annotation , 2015, ICIAP Workshops.

[6]  A. Enis Çetin,et al.  Computer vision based method for real-time fire and flame detection , 2006, Pattern Recognit. Lett..

[7]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Marimuthu Palaniswami,et al.  Smoke detection in video using wavelets and support vector machines , 2009 .

[9]  Guan Gui,et al.  Deep Learning Based Improved Classification System for Designing Tomato Harvesting Robot , 2018, IEEE Access.

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Martial Hebert,et al.  From Red Wine to Red Tomato: Composition with Context , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Tri Listyorini,et al.  A prototype fire detection implemented using the internet og things and fuzzy logic , 2018 .

[13]  Gernot A. Fink,et al.  Deep Neural Network based Human Activity Recognition for the Order Picking Process , 2017, iWOAR.

[14]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[15]  Elmer P. Dadios,et al.  Application of fuzzy logic in recognition of tomato fruit maturity in smart farming , 2016, 2016 IEEE Region 10 Conference (TENCON).

[16]  Kuan-Ting Yu,et al.  Multi-view self-supervised deep learning for 6D pose estimation in the Amazon Picking Challenge , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Abdelouahab Moussaoui,et al.  Deep Learning for Tomato Diseases: Classification and Symptoms Visualization , 2017, Appl. Artif. Intell..

[18]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Sven Behnke,et al.  NimbRo picking: Versatile part handling for warehouse automation , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Masayuki Inaba,et al.  3D object segmentation for shelf bin picking by humanoid with deep learning and occupancy voxel grid map , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[21]  Nikolaos Grammalidis,et al.  Spatio-Temporal Flame Modeling and Dynamic Texture Analysis for Automatic Video-Based Fire Detection , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Yuita Arum Sari,et al.  Tomato ripeness clustering using 6-means algorithm based on v-channel otsu segmentation , 2017, 2017 5th International Symposium on Computational and Business Intelligence (ISCBI).

[23]  Chao-Ho Chen,et al.  An early fire-detection method based on image processing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[24]  김성진,et al.  Fire detection system , 2008 .

[25]  Jian Wang,et al.  Automatic detection of forest fire disturbance based on dynamic modelling from MODIS time-series observations , 2018 .