Where is my mate ?-Real-time 3-D fish tracking for interactive mate-choice experiments

Virtual 3-D fish stimulus animations are a powerful tool in fish behaviour research. Besides the option to increase standardisation of such experiments it opens the possibility to change stimulus’ morphology or colouration. The next evolution step in virtual stimulus animations is the ability of interaction between live and virtual fish. Since the virtual stimulus fish can not see its live counterpart and consequently can not interact with it, such systems require a reliable real-time tracking of the live fish. In this paper we present an easy-to handle method for fully-automatic real-time 3-D tracking of fish. The method was already tested in practice successfully.

[1]  Pawel Romanczuk,et al.  RoboFish: increased acceptance of interactive robotic fish with realistic eyes and natural motion patterns by live Trinidadian guppies , 2016, Bioinspiration & biomimetics.

[2]  Waleed Al-Nuaimy,et al.  Real-time 3D fish tracking and behaviour analysis , 2015, 2015 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT).

[3]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[4]  Wei Weng,et al.  Catadioptric stereo-vision system for the real-time monitoring of 3D behavior in aquatic animals , 2007, Physiology & Behavior.

[5]  Sachit Butail,et al.  Three-dimensional reconstruction of the fast-start swimming kinematics of densely schooling fish , 2012, Journal of The Royal Society Interface.

[6]  Mario Fernando Montenegro Campos,et al.  Particle Filter-Based Predictive Tracking for Robust Fish Counting , 2005, XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05).

[7]  Lars Kuhnert,et al.  Calibration and 3D ground truth data generation with orthogonal camera-setup and refraction compensation for aquaria in real-time , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[8]  Joseph A. Brown,et al.  A new technique to gather 3-D spatial information using a single camera , 2005 .

[9]  Sachit Butail,et al.  Putting the fish in the fish tank: Immersive VR for animal behavior experiments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Pascal Poncin,et al.  Video multitracking of fish behaviour: a synthesis and future perspectives , 2013 .

[11]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Wei Yan,et al.  Automated interactive video playback for studies of animal communication. , 2011, Journal of visualized experiments : JoVE.

[13]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..