Motion visualization and estimation for flapping wing systems

Studies of fluid-structure interactions associated with flexible structures such as flapping wings require the capture and quantification of large motions of bodies that may be opaque. As a case study, motion capture of a free flying Manduca sexta, also known as hawkmoth, is considered by using three synchronized high-speed cameras. A solid finite element (FE) representation is used as a reference body and successive snapshots in time of the displacement fields are reconstructed via an optimization procedure. One of the original aspects of this work is the formulation of an objective function and the use of shadow matching and strain-energy regularization. With this objective function, the authors penalize the projection differences between silhouettes of the captured images and the FE representation of the deformed body. The process and procedures undertaken to go from high-speed videography to motion estimation are discussed, and snapshots of representative results are presented. Finally, the captured free-flight motion is also characterized and quantified.

[1]  T. Poggio,et al.  Ill-Posed Problems and Regularization Analysis in Early Vision , 1984 .

[2]  Demetri Terzopoulos,et al.  On Matching Deformable Models to Images , 1987, Topical Meeting on Machine Vision.

[3]  Christopher Koehler,et al.  3D reconstruction and analysis of wing deformation in free-flying dragonflies , 2012, Journal of Experimental Biology.

[4]  Gordon J. Berman,et al.  Automated hull reconstruction motion tracking (HRMT) applied to sideways maneuvers of free-flying insects , 2009, Journal of Experimental Biology.

[5]  Yang Yu,et al.  Deformable models with sparsity constraints for cardiac motion analysis , 2014, Medical Image Anal..

[6]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[7]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[8]  Bruce G. Baumgart,et al.  Geometric modeling for computer vision. , 1974 .

[9]  A. Ibrahimbegovic.  Nonlinear Solid Mechanics , 2009 .

[10]  Pascal Fua,et al.  Model driven edge detection , 1990, Machine Vision and Applications.

[11]  Ron Kikinis,et al.  Registration of 3D Intraoperative MR Images of the Brain Using a Finite Element Biomechanical Model , 2001, IEEE Trans. Medical Imaging.

[12]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[13]  Laurent D. Cohen,et al.  Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[15]  Timothy Fitzgerald,et al.  Nonlinear Fluid-Structure Interactions in Flapping Wing Systems , 2013 .

[16]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[17]  Anthony N. Palazotto,et al.  A Structural Dynamic Analysis of a Manduca Sexta Forewing , 2010 .

[18]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[19]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[20]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yohan Payan,et al.  A fast and robust patient specific Finite Element mesh registration technique: Application to 60 clinical cases , 2010, Medical Image Anal..

[22]  T. Hedrick,et al.  Three-dimensional flow and lift characteristics of a hovering ruby-throated hummingbird , 2014, Journal of The Royal Society Interface.

[23]  Jasbir S. Arora,et al.  Introduction to Optimum Design , 1988 .

[24]  Demetri Terzopoulos,et al.  Multilevel computational processes for visual surface reconstruction , 1983, Comput. Vis. Graph. Image Process..

[25]  Suchuan Dong,et al.  BDF-like methods for nonlinear dynamic analysis , 2010, J. Comput. Phys..

[26]  Rajat Mittal,et al.  Hawkmoth flight stability in turbulent vortex streets , 2013, Journal of Experimental Biology.

[27]  Dimitris N. Metaxas,et al.  Constrained deformable superquadrics and nonrigid motion tracking , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Christophe Geuzaine,et al.  Gmsh: A 3‐D finite element mesh generator with built‐in pre‐ and post‐processing facilities , 2009 .

[29]  Tyson L Hedrick,et al.  Software techniques for two- and three-dimensional kinematic measurements of biological and biomimetic systems , 2008, Bioinspiration & biomimetics.

[30]  Athanasios C. Antoulas,et al.  Approximation of Large-Scale Dynamical Systems , 2005, Advances in Design and Control.

[31]  B. Balachandran,et al.  Influence of flexibility on the aerodynamic performance of a hovering wing , 2009, Journal of Experimental Biology.