Multiple honey bees tracking and trajectory modeling

The current context of biodiversity loss is particularly marked by the Colony Collapse Disorder (CCD) of honeybees due to multiple causes, toxicological, parasitic and viral. The beekeeper has to face these difficulties in order to maintain the population of bees to save the species but also to make its exploitation profitable. According studies, one can understand what is happening inside the hive by observing what is going on outside. In this context, we propose to individually capture by video the flight trajectories of bees and then characterize the pace of the global activity in front of the hive to infer observations that will be consolidated and made available to apicultural data scientists. Thus bee are detected and tracked using image and video processing methods, then the trajectory are modeled. Then, from the extracted data outcome of the videos, curves are fitted as the ideal trajectories of each bee path in order to study and classify their behaviors. Thus, for each tracked bee, the points of extracted centered positions are time-ordered approximated on a plan. The chosen method interpolates the abscissae separately from the ordinates as time-dependent functions before plotting the parametric curve for each bee path individually. Thus, the abscissae as the ordinates are interpolated using cubic splines. The consecutive points to be interpolated are connected by polynomials of degree three. The first and second derivatives of these polynomials must be connected too. This allows the curve to look more natural by avoiding tingling and convexity discontinuities. Finally, it represents the continuity of the speed of the bees too. Experiments on synthetic and real videos show precise detections of the bee paths. Looking forward, through the collected data, the bee behavior could be understood by using machine learning and the semi supervised method must be one way to proceed.

[1]  Rahul Sukthankar,et al.  Video Monitoring of Honey Bee Colonies at the Hive Entrance , 2008 .

[2]  V. Kulyukin In Situ Omnidirectional Vision-Based Bee Counting Using 1 D Haar Wavelet Spikes , 2022 .

[3]  W. Werner Polynomial interpolation: Lagrange versus Newton , 1984 .

[4]  Gao Shang,et al.  Cubic spline interpolation on new condition , 2011 .

[5]  X. Briottet,et al.  Shadow detection in very high spatial resolution aerial images: A comparative study , 2013 .

[6]  T. Schmickl,et al.  Development of a New Method to Track Multiple Honey Bees with Complex Behaviors on a Flat Laboratory Arena , 2014, PloS one.

[7]  Mikkel Kragh Hansen,et al.  Automatic behaviour analysis system for honeybees using computer vision , 2016, Comput. Electron. Agric..

[8]  Petra Gomez-Krämer,et al.  Detecting and tracking honeybees in 3D at the beehive entrance using stereo vision , 2013, EURASIP J. Image Video Process..

[9]  Zdenka Babic,et al.  POLLEN BEARING HONEY BEE DETECTION IN HIVE ENTRANCE VIDEO RECORDED BY REMOTE EMBEDDED SYSTEM FOR POLLINATION MONITORING , 2016 .

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Lloyd N. Trefethen,et al.  Barycentric Lagrange Interpolation , 2004, SIAM Rev..

[12]  Gary R. Bradski,et al.  Real time face and object tracking as a component of a perceptual user interface , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[13]  François Pfister,et al.  Bee Hive Traffic Monitoring by Tracking Bee Flight Paths , 2018, VISIGRAPP.

[14]  Rahman Tashakkori,et al.  Image processing for honey bee hive health monitoring , 2015, SoutheastCon 2015.

[15]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.