Real-Time Feedback-Controlled Robotic Fish for Behavioral Experiments With Fish Schools Use of cyber-physical robotic fish to study fish-school behavior is proposed in this paper; each robotic fish gets video feedback from the fish group and its environment.

Integrating robotic agents into animal groups creates significant opportunities for advancing experimental investigations of collective animal behavior. In the case of fish schooling, new insights into processes such as collective deci- sion making and leadership have been made in recent expe- riments in which live fish were interacting with robotic fish driven along preplanned paths. We introduce a new cyber- physical implementation that enables robotic fish to use real- time feedback to control their motion in response to live fish and other environmental features. Each robotic fish is magne- tically connected to, and thus moved by, a wheeled robot underneath the tank. Real-time image processing of a video stream from an overhead camera provides measurements of both the robotic fish and the live fish moving together in the tank. Feedback responses computed from these measurements are communicated to the robotic fish using Bluetooth. We show results of demonstrations and discuss possibilities that our im- plementation affords for new kinds of behavioral experiments with fish schools.

[1]  Naomi Ehrich Leonard,et al.  Collective Motion, Sensor Networks, and Ocean Sampling , 2007, Proceedings of the IEEE.

[2]  J. Godin,et al.  Context-dependent group size choice in fish , 2004, Animal Behaviour.

[3]  T. Pitcher,et al.  The sensory basis of fish schools: Relative roles of lateral line and vision , 1980, Journal of comparative physiology.

[4]  G. Theraulaz,et al.  Analyzing fish movement as a persistent turning walker , 2009, Journal of mathematical biology.

[5]  Steven V. Viscido,et al.  Individual behavior and emergent properties of fish schools: a comparison of observation and theory , 2004 .

[6]  P. Webb,et al.  Strike tactics of Esox. , 1980, Canadian journal of zoology.

[7]  S. Strogatz.  From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators , 2000 .

[8]  Paul J. B. Hart,et al.  Quorum decision-making facilitates information transfer in fish shoals , 2008, Proceedings of the National Academy of Sciences.

[9]  I. Couzin,et al.  Self-Organization and Collective Behavior in Vertebrates , 2003 .

[10]  Michael H. Dickinson,et al.  Multi-camera real-time three-dimensional tracking of multiple flying animals , 2010, Journal of The Royal Society Interface.

[11]  Richard J. Prokop,et al.  A survey of moment-based techniques for unoccluded object representation and recognition , 1992, CVGIP Graph. Model. Image Process..

[12]  J. Munkres.  ALGORITHMS FOR THE ASSIGNMENT AND TRANSIORTATION tROBLEMS* , 1957 .

[13]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[14]  L. Edelstein-Keshet,et al.  Complexity, pattern, and evolutionary trade-offs in animal aggregation. , 1999, Science.

[15]  R. Sepulchre,et al.  Oscillator Models and Collective Motion , 2007, IEEE Control Systems.

[16]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[17]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[18]  Rune Vabø,et al.  An individual based model of fish school reactions: predicting antipredator behaviour as observed in nature , 1997 .

[19]  Jens Krause,et al.  DENSITY DEPENDENCE AND NUMEROSITY IN FRIGHT STIMULATED AGGREGATION BEHAVIOUR OF SHOALING FISH , 1995 .

[20]  Sachit Butail,et al.  3D reconstruction of fish schooling kinematics from underwater video , 2010, 2010 IEEE International Conference on Robotics and Automation.

[21]  Pietro Perona,et al.  High-throughput Ethomics in Large Groups of Drosophila , 2009, Nature Methods.

[22]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[23]  F Mondada,et al.  Social Integration of Robots into Groups of Cockroaches to Control Self-Organized Choices , 2007, Science.

[24]  Frank Dellaert,et al.  An MCMC-Based Particle Filter for Tracking Multiple Interacting Targets , 2004, ECCV.

[25]  W. Hamilton.  Geometry for the selfish herd. , 1971, Journal of theoretical biology.

[26]  Iain D. Couzin,et al.  A novel method for investigating the collective behaviour of fish: introducing ‘Robofish’ , 2010, Behavioral Ecology and Sociobiology.

[27]  R. R. Krausz.  Living in Groups , 2013 .

[28]  Chun-Jen Chen,et al.  A linear-time component-labeling algorithm using contour tracing technique , 2004, Comput. Vis. Image Underst..

[29]  Mario Fernando Montenegro Campos,et al.  Particle Filter-Based Predictive Tracking for Robust Fish Counting , 2005, XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05).

[30]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[31]  Richard James,et al.  Modelling density‐dependent fish shoal distributions in the laboratory and field , 2005 .

[32]  Ivo D. Dinov,et al.  Expectation Maximization and Mixture Modeling Tutorial , 2008 .

[33]  Geoffrey Parker,et al.  Cooperation under predation risk: experiments on costs and benefits , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[34]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[35]  I. Couzin.  Collective cognition in animal groups , 2009, Trends in Cognitive Sciences.

[36]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[37]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[38]  Maurizio Porfiri,et al.  Free-Locomotion of Underwater Vehicles Actuated by Ionic Polymer Metal Composites , 2010, IEEE/ASME Transactions on Mechatronics.

[39]  I. Couzin,et al.  Inferring the structure and dynamics of interactions in schooling fish , 2011, Proceedings of the National Academy of Sciences.