Autonomous tomato harvesting robotic system in greenhouses: deep learning classification

Solanum lycopersicum or generally known as tomato came from countries of South America and has been growing in many tropical countries and its healthy nutrients in tomato becomes one of the food demand by the locals in Malaysia when their lifestyle shifted to more concern for healthy food. Since export value and production has increased for the past few years, a vast amount of labours considered for the fruit-picking process. Hence, farmers are now preferring to look for automation to replace labour problems and high cost that they are facing. To pick a correct fruit within clusters, a harvesting robot requires guidance so that it can detect a fruit accurately. In this study, a new classification algorithm using deep learning specifically convolution neural network to classify the image is either a tomato or not tomato and next, the image is classified into either a ripe or unripe tomato. Furthermore, there are two classification neural networks which are tomato or not tomato and ripe and unripe tomato. Each network consists of 600 training data and 33 testing data. The accuracies that obtained from network 1 (tomato or not tomato) and network 2 (ripe or unripe tomato) are 76.366% and 98.788% respectively.

[1]  Simon X. Yang,et al.  Ripe Tomato Recognition and Localization for a Tomato Harvesting Robotic System , 2009, 2009 International Conference of Soft Computing and Pattern Recognition.

[2]  Liang Gong,et al.  Dual-arm Robot Design and Testing for Harvesting Tomato in Greenhouse , 2016 .

[3]  Masayuki Inaba,et al.  Development of an autonomous tomato harvesting robot with rotational plucking gripper , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Y. Ying,et al.  A recognition algorithm for occluded tomatoes based on circle regression , 2013, 2013 6th International Congress on Image and Signal Processing (CISP).

[5]  Yibin Ying,et al.  Tests of a recognition algorithm for clustered tomatoes based on mathematical morphology , 2013, 2013 6th International Congress on Image and Signal Processing (CISP).

[6]  Alias Radam,et al.  Good agricultural practices (GAP) of tomatoes in Malaysia: Evidences from Cameron Highlands , 2012 .

[7]  L. Yang,et al.  A fruit recognition method for automatic harvesting , 2007, 2007 14th International Conference on Mechatronics and Machine Vision in Practice.

[8]  Shweta Srivastava,et al.  Tomato-A Natural Medicine and Its Health Benefits , 2012 .

[9]  C. E. Schertz,et al.  Basic Considerations in Mechanizing Citrus Harvest , 1968 .

[10]  Mohammed El-Abd,et al.  A cherry-tomato harvesting robot , 2017, 2017 18th International Conference on Advanced Robotics (ICAR).

[11]  Zhen Li,et al.  Design and test of tomatoes harvesting robot , 2015, 2015 IEEE International Conference on Information and Automation.

[12]  F. E. Sistler,et al.  Robotics and intelligent machines in agriculture , 1987, IEEE J. Robotics Autom..

[13]  Man Zhang,et al.  Mature Tomato Fruit Detection Algorithm Based on improved HSV and Watershed Algorithm , 2018 .