Abnormal Water Quality Monitoring Based on Visual Sensing of Three-Dimensional Motion Behavior of Fish

In the context of the problem of water pollution, the movement characteristics and patterns of fish under normal water quality and abnormal water quality are clearly different. This paper proposes a biological water quality monitoring method combining three-dimensional motion trajectory synthesis and integrated learning. The videos of the fish movement are captured by two cameras, and the Kuhn-Munkres (KM) algorithm is used to match the target points of the fish body. The Kalman filter is used to update the current state and find the optimal tracking position as the tracking result. The Kernelized Correlation Filters (KCF) algorithm compensates the targets that are lost in the tracking process and collision or occlusion in the movement process, reducing the errors caused by illumination, occlusion and water surface fluctuation effectively. This algorithm can directly obtain the target motion trajectory, avoiding the re-extraction from the centroid point in the image sequence, which greatly improves the efficiency. In order to avoid the one-sidedness of the two-dimensional trajectory, the experiment combines the pixel coordinates of different perspectives into three-dimensional trajectory pixel coordinates, so as to provide a more authentic fish swimming trajectory. We then select a representative positive and negative sample data set; the number of data sets should have symmetry. The base classifier capable of identifying different water quality is obtained by training. Finally, support vector machine(SVM), eXtreme Gradient Boosting (XGBoost) and pointnet based classifiers are combined into strong classifiers through integrated learning. The experimental results show that the integrated learning model can reflect the water quality effectively and accurately under the three-dimensional trajectory pixel coordinates of fish, and the recognition rate of water quality is above 95%.

[1]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[2]  Michael Nguyen,et al.  A novel 3D method of locomotor analysis in adult zebrafish: Implications for automated detection of CNS drug-evoked phenotypes , 2015, Journal of Neuroscience Methods.

[3]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  MengChu Zhou,et al.  Group Role Assignment via a Kuhn–Munkres Algorithm-Based Solution , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[6]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[7]  Amaury Lendasse,et al.  Online fish tracking with portable smart device for ocean observatory network , 2017, OCEANS 2017 – Anchorage.

[8]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[9]  Rong Liu,et al.  A method for real-time measurement of respiratory rhythms in medaka (Oryzias latipes) using computer vision for water quality monitoring. , 2014, Ecotoxicology and environmental safety.

[10]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[11]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Chia-Cheng Liu,et al.  Real-time monitoring of water quality using temporal trajectory of live fish , 2010, Expert Syst. Appl..

[13]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[17]  Cheol-Min Kim,et al.  Real-time Motion Generating Method for Artificial Fish , 2007 .

[18]  Chong H. Ahn,et al.  State-of-the-art lab chip sensors for environmental water monitoring , 2011 .

[19]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Robert B. Fisher,et al.  A filtering mechanism for normal fish trajectories , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[21]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[22]  H. Robbins A Stochastic Approximation Method , 1951 .

[23]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Addisson Salazar,et al.  Multiclass Alpha Integration of Scores from Multiple Classifiers , 2019, Neural Computation.

[25]  Ian Dennis Longstaff,et al.  A pattern recognition approach to understanding the multi-layer perception , 1987, Pattern Recognit. Lett..

[26]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Song Han,et al.  Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding , 2015, ICLR.

[28]  Xin Li,et al.  Transformation Networks for Target-Oriented Sentiment Classification , 2018, ACL.

[29]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).