An Embedded Real-Time Red Peach Detection System Based on an OV7670 Camera, ARM Cortex-M4 Processor and 3D Look-Up Tables

This work proposes the development of an embedded real-time fruit detection system for future automatic fruit harvesting. The proposed embedded system is based on an ARM Cortex-M4 (STM32F407VGT6) processor and an Omnivision OV7670 color camera. The future goal of this embedded vision system will be to control a robotized arm to automatically select and pick some fruit directly from the tree. The complete embedded system has been designed to be placed directly in the gripper tool of the future robotized harvesting arm. The embedded system will be able to perform real-time fruit detection and tracking by using a three-dimensional look-up-table (LUT) defined in the RGB color space and optimized for fruit picking. Additionally, two different methodologies for creating optimized 3D LUTs based on existing linear color models and fruit histograms were implemented in this work and compared for the case of red peaches. The resulting system is able to acquire general and zoomed orchard images and to update the relative tracking information of a red peach in the tree ten times per second.

[1]  Ahmad Ihsan Mohd Yassin,et al.  Monitoring of Watermelon Ripeness Based on Fuzzy Logic , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[2]  Salviano F. S. P. Soares,et al.  Automatic detection of bunches of grapes in natural environment from color images , 2012, J. Appl. Log..

[3]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[4]  C. A. Gunawardena,et al.  A spot-type defect detection and colour identification system for agricultural produce , 1991, Proceedings IECON '91: 1991 International Conference on Industrial Electronics, Control and Instrumentation.

[5]  José Blasco,et al.  The application of a fast algorithm for the classification of olives by machine vision , 2000 .

[6]  Shyan-Ming Yuan,et al.  A Vision-Based Driver Nighttime Assistance and Surveillance System Based on Intelligent Image Sensing Techniques and a Heterogamous Dual-Core Embedded System Architecture , 2012, Sensors.

[7]  Peter Lee,et al.  An FPGA implementation of a flexible, parallel image processing architecture suitable for embedded vision systems , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[8]  José Luis Lázaro,et al.  Efficient Smart CMOS Camera Based on FPGAs Oriented to Embedded Image Processing , 2011, Sensors.

[9]  Yuchou Chang,et al.  Color quantization and image analysis for automated fruit quality evaluation , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[10]  M. Recce,et al.  Vision and neural control for an orange harvesting robot , 1996, Proceedings of International Workshop on Neural Networks for Identification, Control, Robotics and Signal/Image Processing.

[11]  Marcel Tresanchez,et al.  Definition of Linear Color Models in the RGB Vector Color Space to Detect Red Peaches in Orchard Images Taken under Natural Illumination , 2012, Sensors.

[12]  Aboelmagd Noureldin,et al.  FPGA-Based Real-Time Embedded System for RISS/GPS Integrated Navigation , 2011, Sensors.

[13]  G. E. Miles,et al.  Locating melons for robotic harvesting using structured light , 1992 .

[14]  David C. Slaughter,et al.  Color Vision in Robotic Fruit Harvesting , 1987 .

[15]  José Blasco,et al.  Multispectral inspection of citrus in real-time using machine vision and digital signal processors , 2002 .

[16]  Hongwen Li,et al.  A Study of Broccoli Grading System Based on Machine Vision and Neural Networks , 2007, 2007 International Conference on Mechatronics and Automation.

[17]  Anthony Rowe,et al.  CMUcam3: An Open Programmable Embedded Vision Sensor , 2007 .

[18]  Dongsheng Wang,et al.  Machine Vision Based Image Analysis for the Estimation of Pear External Quality , 2009, 2009 Second International Conference on Intelligent Computation Technology and Automation.

[19]  Sanjiv Singh,et al.  Yield estimation in vineyards by visual grape detection , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  LinLin Shen,et al.  Embedded Palmprint Recognition System Using OMAP 3530 , 2012, Sensors.

[21]  H S Lee,et al.  Objective measurement of red grapefruit juice color. , 2000, Journal of agricultural and food chemistry.

[22]  L. J. Clark,et al.  Colour identification and quality inspection system for agricultural produce , 1990, Proceedings of the 33rd Midwest Symposium on Circuits and Systems.

[23]  Yoshinobu Yamamoto,et al.  Embedded vision system for mobile robot navigation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[24]  Michel Dufaut,et al.  A vision system for mobile robot navigation , 1994, Robotica.

[25]  X. Sun,et al.  A Digital Image Method for Measuring and Analyzing Color Characteristics of Various Color Scores of Beef , 2009, 2009 2nd International Congress on Image and Signal Processing.

[26]  Huimin Lu,et al.  A Modified Color Look-Up Table Segmentation Method for Robot Soccer , 2007 .