Colour Analysis of Strawberries on a Real Time Production Line

A novel system has been designed where colour analysis algorithms facilitate grading ripeness of packed strawberries on a fast-paced production line. The Strawberry quality system acquires images at the rate of 2punnets/s, and feeds the images to the two algorithms. Using CIELAB and HSV colourspaces, both underripe and overripe colour features are analysed resulting in F1 scores of 94.7% and 90.6% respectively, when measured on multiple defect samples. The single defect class results scored 80.1% and 77.1%. The algorithms total time for the current hardware configuration is 121ms maximum and 80ms average, which is well below the required time window of 500ms. 105, 542 punnets have been assessed by the algorithm and has rejected 4, 952 in total (4.9%), helping to ensure the quality of the product being shipped to customers and avoiding costly returns.

[1]  Xu Liming,et al.  Automated strawberry grading system based on image processing , 2010 .

[2]  C. Forney,et al.  Development of Aroma Volatiles and Color during Postharvest Ripening of `Kent' Strawberries , 1995 .

[3]  José Blasco,et al.  In-line sorting of irregular potatoes by using automated computer-based machine vision system , 2012 .

[4]  Bundit Jarimopas,et al.  An experimental machine vision system for sorting sweet tamarind , 2008 .

[5]  Zou Xiaobo,et al.  In-line detection of apple defects using three color cameras system , 2010 .

[6]  Kerry B. Walsh,et al.  Non-invasive assessment of pineapple and mango fruit quality using near infra-red spectroscopy , 1997 .

[7]  R. Lu,et al.  Measurement of the optical properties of fruits and vegetables using spatially resolved hyperspectral diffuse reflectance imaging technique , 2008 .

[8]  Jun Zhao,et al.  On-tree fruit recognition using texture properties and color data , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Junhong Wang,et al.  Dynamic extreme learning machine for data stream classification , 2017, Neurocomputing.

[10]  Panitnat Yimyam,et al.  3D reconstruction and feature extraction for agricultural produce grading , 2016, 2016 8th International Conference on Knowledge and Smart Technology (KST).

[11]  Ning Wang,et al.  Studies on banana fruit quality and maturity stages using hyperspectral imaging , 2012 .

[12]  Renfu Lu,et al.  Integrated spectral and image analysis of hyperspectral scattering data for prediction of apple fruit firmness and soluble solids content , 2011 .

[13]  Denis Stajnko,et al.  Original papers: Detecting fruits in natural scenes by using spatial-frequency based texture analysis and multiview geometry , 2011 .

[14]  José Blasco,et al.  Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features , 2009 .

[15]  Yankun Peng,et al.  Hyperspectral Scattering for Assessing Peach Fruit Firmness , 2004 .

[16]  José Blasco,et al.  Machine Vision System for Automatic Quality Grading of Fruit , 2003 .

[17]  Vincent Leemans,et al.  Regular ArticleAE—Automation and Emerging Technologies: On-line Fruit Grading according to their External Quality using Machine Vision , 2002 .

[18]  P. Baranowski,et al.  Supervised classification of bruised apples with respect to the time after bruising on the basis of hyperspectral imaging data , 2013 .

[19]  Satoshi Yamamoto,et al.  Development of a Stationary Robotic Strawberry Harvester with a Picking Mechanism that Approaches the Target Fruit from Below , 2014 .

[20]  Xudong Sun,et al.  Nondestructive measurement of internal quality of Nanfeng mandarin fruit by charge coupled device near infrared spectroscopy , 2010 .

[21]  Daniel E. Guyer,et al.  Near-infrared hyperspectral reflectance imaging for detection of bruises on pickling cucumbers , 2006, Computers and Electronics in Agriculture.

[22]  Weikang Gu,et al.  Computer vision based system for apple surface defect detection , 2002 .

[23]  C. Glasbey,et al.  Automatic fruit recognition and counting from multiple images , 2014 .

[24]  Kenta Shigematsu,et al.  Evaluation of a strawberry-harvesting robot in a field test , 2010 .

[25]  Yongsheng Gao,et al.  A Method to Create Stable Lighting and Remove Specular Reflections for Vision Systems , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[26]  Fabrizio Angiulli,et al.  Fast condensed nearest neighbor rule , 2005, ICML.

[27]  Yang Tao,et al.  Design and testing of an automated high-throughput computer vision guided waterjet knife strawberry calyx removal machine , 2017 .

[28]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Barbara Gouble,et al.  Rapid and non-destructive analysis of apricot fruit quality using FT-near-infrared spectroscopy. , 2009 .

[30]  Michael Recce,et al.  Video Grading of Oranges in Real-Time , 2004, Artificial Intelligence Review.