Optimal Threshold and LoG Based Feature Identification and Tracking of Bat Flapping Flight

Flapping flight observed in bats offers a promising model for bio-inspiration of small air vehicles because of their high maneuverability, load carrying capacity, and energy efficiency. However, the flight mechanics of bats is very complex due to the highly articulated wing skeleton and the anisotropic, internally-actuated wing membrane. As a result of these complexities, the shape of bat wings can deform quickly and substantially which causes periodic occlusions and large baseline nonlinear deformations of point trajectories in image space. Tracking these points in image space is difficult because the resolution of the images (720 1280) and the frame rate (120Hz) used in these experiments are substantially lower than those used historically. This paper presents a computational approach that utilizes a novel combination of Laplacian-of-Gaussian (LoG) filtering and optimal threshold segmentation to locate markers in images. Using images from 32 cameras, our technique achieved an average hit rate of 83%, with an average false rate of 12%. Our algorithm is shown to perform better than other techniques, including those based on SIFT or LoG filtering alone. In addition to the improved feature detection algorithm, optical flow based tracking is bootstrapped with a spatially recursive unscented Kalman filter to track the identified points during state estimation. The spatially recursive estimator returns as many or more correct correspondences when compared to the standard unscented Kalman filter.

[1]  Tomonari Furukawa,et al.  Trajectory Estimation of Bat Flight Using a Multi-View Camera System , 2015 .

[2]  R. Vasiu,et al.  Background Modeling and Foreground Detection via a Reconstructive and Discriminative Subspace Learning Approach , 2012 .

[3]  Soon-Jo Chung,et al.  Bat Bot (B2), a biologically inspired flying machine , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[5]  Shu Hong-ping A method and application of image segmentation based on gray-level optimum threshold , 2003 .

[6]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[7]  Danesh K. Tafti,et al.  Effect of Wing Flexibility on Lift and Thrust Production in Flapping Flight , 2010 .

[8]  S. D. Yanowitz,et al.  A new method for image segmentation , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[9]  Edel B. García Reyes,et al.  A Novel Approach to Robust Background Subtraction , 2009, CIARP.

[10]  Ezequiel López-Rubio,et al.  Stochastic approximation for background modelling , 2011, Comput. Vis. Image Underst..

[11]  Andrew Kurdila,et al.  Recursive Bayesian Estimation of Bat Flapping Flight Using Kinematic Trees , 2016 .

[12]  Anders Hedenström,et al.  High-speed stereo DPIV measurement of wakes of two bat species flying freely in a wind tunnel , 2009 .

[13]  Larry S. Davis,et al.  Background Updating for Visual Surveillance , 2005, ISVC.

[14]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[15]  Joseph W Bahlman,et al.  Design and characterization of a multi-articulated robotic bat wing , 2013, Bioinspiration & biomimetics.

[16]  Hongbin Wang,et al.  Regularized online Mixture of Gaussians for background subtraction , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[17]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[18]  Gabriel Taubin,et al.  3D reconstruction of bat flight kinematics from sparse multiple views , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).