Detection of orchard citrus fruits using a monocular machine vision-based method for automatic fruit picking applications

Abstract Due to the variable illumination conditions and occlusion produced by neighbouring fruits and other background participants, vision systems are important in accurately and reliably detecting mature citrus in natural orchard environments for automatic fruit picking applications. A robust citrus fruit detection method based on a monocular vision system was proposed. An adaptive enhanced red and green chromatic map was generated from an illumination-compensated image, which was obtained using block-based local homomorphic filtering. Otsu thresholding, morphology operation, marker-controlled watershed transform and convex hull operation methods were then used in combination to locate potential citrus regions from the chromatic map. Local texture information was extracted from the potential regions using local binary patterns and fed to a histogram intersection kernel-based support vector machine to make the final decision. The performance of the proposed method was evaluated on 127 test images captured in two citrus orchards on both sunny and cloudy days. Under strict PASCAL criteria, the recall rate of correctly detected citrus was greater than 0.86, with 13 false detections.