Real-Time Perception and Positioning for Creature Picking of an Underwater Vehicle

This study addresses the ability of an underwater vehicle-manipulator system (UVMS) to perceive submarine creatures in the complex undersea environment. A real-time system for Submarine Creature Perception and Positioning (SCPP) based on a binocular vision system is proposed. In particular, we adopt a new Four-Corner Neighborhood Matching Method (FCNMM) to obtain specific target positions. A Fusion Correction Mechanism (FCM) is added to the Kernelized correlation filter (KCF) tracking algorithm to improve tracking performance. Furthermore, SCPP is applied in our UVMS platform to perform seafloor creature picking at the Zhangzidao seafood farm in Dalian, China. The experimental results show the feasibility and robustness of the SCPP system.

[1]  Zhiqiang Miao,et al.  Consensus With Persistently Exciting Couplings and Its Application to Vision-Based Estimation , 2019, IEEE Transactions on Cybernetics.

[2]  Pascal Fua,et al.  LF-Net: Learning Local Features from Images , 2018, NeurIPS.

[3]  Ethan Rublee,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[4]  Iasonas Kokkinos,et al.  Discriminative Learning of Deep Convolutional Feature Point Descriptors , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Hyun Myung,et al.  Vision-based object detection and tracking for autonomous navigation of underwater robots , 2012 .

[6]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Jiri Matas,et al.  Working hard to know your neighbor's margins: Local descriptor learning loss , 2017, NIPS.

[9]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[10]  Weinan Chen,et al.  A Comparison of CNN-Based and Hand-Crafted Keypoint Descriptors , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[11]  Yu Wang,et al.  Grasping Marine Products With Hybrid-Driven Underwater Vehicle-Manipulator System , 2020, IEEE Transactions on Automation Science and Engineering.

[12]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[13]  Haiyan Zhao,et al.  Joint Localization and Tracking Design for AUV With Asynchronous Clocks and State Disturbances , 2019, IEEE Transactions on Vehicular Technology.

[14]  Scott A. Brandt,et al.  Visual tracking for intelligent vehicle-highway systems , 1996 .

[15]  Jiri Matas,et al.  A Novel Performance Evaluation Methodology for Single-Target Trackers , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Fei-Yue Wang,et al.  MFR-CNN: Incorporating Multi-Scale Features and Global Information for Traffic Object Detection , 2018, IEEE Transactions on Vehicular Technology.

[17]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[18]  Yu Wang,et al.  Underwater Bioinspired Propulsion: From Inspection to Manipulation , 2020, IEEE Transactions on Industrial Electronics.

[19]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[20]  Michael C. Nechyba,et al.  A vision system for intelligent mission profiles of micro air vehicles , 2004, IEEE Transactions on Vehicular Technology.

[21]  Yu Wang,et al.  Prediction-Based Seabed Terrain Following Control for an Underwater Vehicle-Manipulator System , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[22]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[23]  Jun Zhang,et al.  Path Planning for Autonomous Underwater Vehicles: An Ant Colony Algorithm Incorporating Alarm Pheromone , 2019, IEEE Transactions on Vehicular Technology.

[24]  Stefano Caselli,et al.  Investigation of Vision-Based Underwater Object Detection with Multiple Datasets , 2015 .

[25]  Liang-Gee Chen,et al.  Survey on Block Matching Motion Estimation Algorithms and Architectures with New Results , 2006, J. VLSI Signal Process..

[26]  Xinyu Wu,et al.  Image-based visual servoing of helical microswimmers for arbitrary planar path following at low reynolds numbers , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Changyun Wen,et al.  Real-Time Event-Triggered Object Tracking in the Presence of Model Drift and Occlusion , 2019, IEEE Transactions on Industrial Electronics.

[28]  Min Tan,et al.  Floating Autonomous Manipulation of the Underwater Biomimetic Vehicle-Manipulator System: Methodology and Verification , 2018, IEEE Transactions on Industrial Electronics.

[29]  Zhe Chen,et al.  A Binocular Vision System for Underwater Target Detection , 2013 .

[30]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[31]  Christof Koch,et al.  Detection and tracking of objects in underwater video , 2004, CVPR 2004.

[32]  Li Wen,et al.  A Real-time and Unsupervised Advancement Scheme for Underwater Machine Vision , 2017, 2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER).

[33]  Bo Li,et al.  Local Feature Descriptor for Image Matching: A Survey , 2019, IEEE Access.

[34]  Robert B. Fisher,et al.  Detecting, Tracking and Counting Fish in Low Quality Unconstrained Underwater Videos , 2008, VISAPP.

[35]  Junzhi Yu,et al.  Development of an Underwater Manipulator and Its Free-Floating Autonomous Operation , 2016, IEEE/ASME Transactions on Mechatronics.

[36]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Ben Wang,et al.  Dynamic Morphology and Swimming Properties of Rotating Miniature Swimmers With Soft Tails , 2019, IEEE/ASME Transactions on Mechatronics.

[38]  Rui Caseiro,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence High-speed Tracking with Kernelized Correlation Filters , 2022 .

[39]  H. Saito,et al.  3D shape measurement of underwater objects using motion stereo , 1995, Proceedings of IECON '95 - 21st Annual Conference on IEEE Industrial Electronics.