Design and Implementation of an Assistive Real-Time Red Lionfish Detection System for AUV/ROVs

In recent years, the Pterois Volitans, also known as the red lionfish, has become a serious threat by rapidly invading US coastal waters. Being a fierce predator, having no natural predator, being adaptive to different habitats, and being with high reproduction rates, the red lionfish has enervated current endeavors to control their population. This paper focuses on the first steps to reinforce these efforts by employing autonomous vehicles. To that end, an assistive underwater robotic scheme is designed to aid spear-hunting divers to locate and more efficiently hunt the lionfish. A small-sized, open source ROV with an integrated camera is programmed using Deep Learning methods to detect red lionfish in real time. Dives are restricted to a certain depth range, time, and air supply. The ROV program is designed to allow the divers to locate the red lionfish before each dive, so that they can plan their hunt to maximize their catch. Lightweight, portability, user-friendly interface, energy efficiency, and low cost of maintenance are some advantages of the proposed scheme. The developed system’s performance is examined in areas currently invaded by the red lionfish in the Gulf of Mexico. The ROV has shown success in detecting the red lionfish with high confidence in real time.

[1]  Eric R. Buhle,et al.  A hotspot of non-native marine fishes: evidence for the aquarium trade as an invasion pathway , 2004 .

[2]  Paula E. Whitfield,et al.  Mitochondrial cytochrome b analysis reveals two invasive lionfish species with strong founder effects in the western Atlantic , 2007 .

[3]  F Ali,et al.  The role of volunteer divers in lionfish research and control in the Caribbean , 2013 .

[4]  Y. LeCun,et al.  Learning methods for generic object recognition with invariance to pose and lighting , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[5]  J. Lines,et al.  An automatic image-based system for estimating the mass of free-swimming fish , 2001 .

[6]  Md. Moniruzzaman,et al.  Deep Learning on Underwater Marine Object Detection: A Survey , 2017, ACIVS.

[7]  D. Simberloff,et al.  BIOTIC INVASIONS: CAUSES, EPIDEMIOLOGY, GLOBAL CONSEQUENCES, AND CONTROL , 2000 .

[8]  J. Morris,et al.  Feeding ecology of invasive lionfish (Pterois volitans) in the Bahamian archipelago , 2009, Environmental Biology of Fishes.

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  L. Chaves,et al.  Photo-identification as a simple tool for studying invasive lionfish Pterois volitans populations. , 2016, Journal of fish biology.

[11]  Paula E. Whitfield,et al.  The western Pacific red lionfish, Pterois volitans (Scorpaenidae), in Florida: Evidence for reproduction and parasitism in the first exotic marine fish established in state waters , 2006 .

[12]  Jonathan A. Hare,et al.  Abundance estimates of the Indo-Pacific lionfish Pterois volitans/miles complex in the Western North Atlantic , 2006, Biological Invasions.

[13]  Muhammad Imran Malik,et al.  Automatic fish species classification in underwater videos: exploiting pre-trained deep neural network models to compensate for limited labelled data , 2018 .

[14]  Stuart Robson,et al.  The accuracy and precision of underwater measurements of length and maximum body depth of southern bluefin tuna (Thunnus maccoyii) with a stereo-video camera system , 2003 .

[15]  D. Pimentel,et al.  Update on the environmental and economic costs associated with alien-invasive species in the United States , 2005 .

[16]  Mohamed Elawady,et al.  Sparse Coral Classification Using Deep Convolutional Neural Networks , 2015, ArXiv.

[17]  Isabelle M. Côté,et al.  Invasive Lionfish Drive Atlantic Coral Reef Fish Declines , 2012, PloS one.

[18]  Mark A. Albins,et al.  Worst case scenario: potential long-term effects of invasive predatory lionfish (Pterois volitans) on Atlantic and Caribbean coral-reef communities , 2011, Environmental Biology of Fishes.

[19]  E. Grosholz,et al.  Global Invasions of Marine and Estuarine Habitats by Non-Indigenous Species: Mechanisms, Extent, and Consequences' , 1997 .

[20]  Xiu Li,et al.  When underwater imagery analysis meets deep learning: A solution at the age of big visual data , 2015, OCEANS 2015 - MTS/IEEE Washington.

[21]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Andrew B. Barbour,et al.  Mangrove use by the invasive lionfish Pterois volitans , 2010 .

[23]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[24]  H. Mooney,et al.  Invasive species, ecosystem services and human well-being. , 2009, Trends in ecology & evolution.

[25]  Mark A. Albins,et al.  Invasive Indo-Pacific lionfish Pterois volitans reduce recruitment of Atlantic coral-reef fishes , 2008 .

[26]  Changshui Zhang,et al.  DeepFish: Accurate underwater live fish recognition with a deep architecture , 2016, Neurocomputing.

[27]  Robert B. Fisher,et al.  Detecting, Tracking and Counting Fish in Low Quality Unconstrained Underwater Videos , 2008, VISAPP.

[28]  Jie Ma,et al.  Underwater Object Detection Based on Gravity Gradient , 2010, IEEE Geoscience and Remote Sensing Letters.

[29]  Leon Bennun,et al.  Horizon scan of global conservation issues for 2011. , 2011, Trends in ecology & evolution.

[30]  Pamela J. Schofield,et al.  Geographic extent and chronology of the invasion of non-native lionfish (Pterois volitans (Linnaeus 1758) and P. miles (Bennett 1828)) in the Western North Atlantic and Caribbean Sea , 2009 .

[31]  Pratap Tokekar,et al.  Tracking Aquatic Invaders: Autonomous Robots for Monitoring Invasive Fish , 2013, IEEE Robotics & Automation Magazine.