Shark Detection from Aerial Imagery Using Region-Based CNN, a Study

Shark attacks have been a very sensitive issue for Australians and many other countries. Thus, providing safety and security around beaches is very fundamental in the current climate. Safety for both human beings and underwater creatures (sharks, whales, etc.) in general is essential while people continue to visit and use the beaches heavily for recreation and sports. Hence, an efficient, automated and real-time monitoring approach on beaches for detecting various objects (e.g. human activities, large fish, sharks, whales, surfers, etc.) is necessary to avoid unexpected casualties and accidents. The use of technologies such as drones and machine learning techniques are promising directions in such challenging circumstances. This paper investigates the potential of Region-based Convolutional Neural Networks (R-CNN) for detecting various marine objects, and Sharks in particular. Three network architectures namely Zeiler and Fergus (ZF), Visual Geometry Group (VGG16), and VGG_M were considered for analysis and identifying their potential. A dataset consisting of 3957 video frames were used for experiments. VGG16 architecture with faster-R-CNN performed better than others, with an average precision of 0.904 for detecting Sharks.

[1]  Christopher G. Lowe,et al.  A Review of Shark Control in Hawaii with Recommendations for Future Research , 1994 .

[2]  G. Cliff,et al.  Sharks caught in the protective gill nets off KwaZulu-Natal, South Africa. 8. The Great hammerhead shark Sphyrna mokarran (Rüppell) , 1995 .

[3]  G. Cliff,et al.  CHAPTER 32 – Catches of White Sharks in KwaZulu–Natal, South Africa and Environmental Influences , 1996 .

[4]  S.F.J. Dudley,et al.  A comparison of the shark control programs of New South Wales and Queensland (Australia) and KwaZulu-Natal (South Africa) , 1997 .

[5]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[6]  Ivan Lee,et al.  Shark detection using optical image data from a mobile aerial platform , 2010, 2010 25th International Conference of Image and Vision Computing New Zealand.

[7]  Victor M. Peddemors,et al.  Decadal trends in shark catches and effort from the New South Wales, Australia, Shark Meshing Program 1950–2010 , 2011 .

[8]  Danny Gibbins,et al.  A Simple Deformable Model for Shark Recognition , 2011, 2011 Canadian Conference on Computer and Robot Vision.

[9]  John G. West,et al.  Changing patterns of shark attacks in Australian waters , 2011 .

[10]  Frederic Maire,et al.  Automated marine mammal detection from aerial imagery , 2013, 2013 OCEANS - San Diego.

[11]  Charlie Huveneers,et al.  Australian and U.S. News Media Portrayal of Sharks and Their Conservation , 2013, Conservation biology : the journal of the Society for Conservation Biology.

[12]  Frédéric Maire,et al.  Detection of dugongs from unmanned aerial vehicles , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  G. T. Shrivakshan An analysis of SOBEL and GABOR image filters for identifying fish , 2013, 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering.

[14]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[15]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[16]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[18]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[19]  Jon Schoonmaker,et al.  Automated detection of marine animals using multispectral imaging , 2014, 2014 Oceans - St. John's.

[20]  Matthew C. Ives,et al.  Experimental Evaluation of Shark Detection Rates by Aerial Observers , 2014, PloS one.

[21]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[23]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[24]  Charlie Huveneers,et al.  How Close is too Close? The Effect of a Non-Lethal Electric Shark Deterrent on White Shark Behaviour , 2016, PloS one.