HABNet: Machine Learning, Remote Sensing Based Detection and Prediction of Harmful Algal Blooms

This paper describes the application of machine learning techniques to develop a state-of-the-art detection and prediction system for spatiotemporal events found within remote sensing data; specifically, Harmful Algal Bloom events (HABs). We propose an HAB detection system based on: a ground truth historical record of HAB events, a novel spatiotemporal datacube representation of each event (from MODIS and GEBCO bathymetry data) and a variety of machine learning architectures utilising state-of-the-art spatial and temporal analysis methods based on Convolutional Neural Networks (CNNs), Long Short-Term Memory (LSTM) components together with Random Forest and Support Vector Machine (SVM) classification methods. This work has focused specifically on the case study of the detection of Karenia Brevis Algae (K. brevis) HAB events within the coastal waters of Florida (over 2850 events from 2003 to 2018; an order of magnitude larger than any previous machine learning detection study into HAB events). The development of multimodal spatiotemporal datacube data structures and associated novel machine learning methods give a unique architecture for the automatic detection of environmental events. Specifically, when applied to the detection of HAB events it gives a maximum detection accuracy of 91% and a Kappa coefficient of 0.81 for the Florida data considered. A HAB forecast system was also developed where a temporal subset of each datacube was used to predict the presence of a HAB in the future. This system was not significantly less accurate than the detection system being able to predict with 86% accuracy up to 8 days in the future.

[1]  P. R. Hill Audio and Speech Processing with MATLAB , 2018 .

[2]  M. Matthews A current review of empirical procedures of remote sensing in inland and near-coastal transitional waters , 2011 .

[3]  Richard P. Stumpf,et al.  Evaluation of the use of SeaWiFS imagery for detecting Karenia brevis harmful algal blooms in the eastern Gulf of Mexico , 2004 .

[4]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[5]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[6]  Surya S. Durbha,et al.  Ensemble Methodology Using Multistage Learning for Improved Detection of Harmful Algal Blooms , 2012, IEEE Geoscience and Remote Sensing Letters.

[7]  A. Morel Optical modeling of the upper ocean in relation to its biogenous matter content (case I waters) , 1988 .

[8]  Peter I. Miller,et al.  SeaWiFS discrimination of harmful algal bloom evolution , 2006 .

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[11]  K. Steidinger,et al.  Biologic and Hydrographic Aspects of Red Tides , 1981 .

[12]  Colin Greatwood,et al.  Visual Localisation and Individual Identification of Holstein Friesian Cattle via Deep Learning , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[13]  D. Kapoor General bathymetric chart of the oceans (GEBCO) , 1981 .

[14]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[15]  Jun Zhao,et al.  Exploring the potential of optical remote sensing for oil spill detection in shallow coastal waters--a case study in the Arabian Gulf. , 2014, Optics express.

[16]  T. Wynne,et al.  An evaluation of remote sensing techniques for enhanced detection of the toxic dinoflagellate, Karenia brevis , 2009 .

[17]  Joyce J. Evans,et al.  A fish kill of massive proportion in Kuwait Bay, Arabian Gulf, 2001: the roles of bacterial disease, harmful algae, and eutrophication. , 2002 .

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Jin Yu,et al.  Harmful algal blooms prediction with machine learning models in Tolo Harbour , 2014, 2014 International Conference on Smart Computing.

[20]  C. McClain A decade of satellite ocean color observations. , 2009, Annual review of marine science.

[21]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Nantheera Anantrasirichai,et al.  Machine Learning Techniques for Detecting Slow, Sustained Deformation in InSAR Time Series. , 2019 .

[24]  R. P. Stumpf,et al.  Relating spectral shape to cyanobacterial blooms in the Laurentian Great Lakes , 2008 .

[25]  F. Al-Yamani,et al.  Phytoplankton ecology in the waters between Shatt AI-Arab and Straits of Hormuz, Arabian Gulf: A review , 1998 .

[26]  Surya S. Durbha,et al.  A Machine Learning Based Spatio-Temporal Data Mining Approach for Detection of Harmful Algal Blooms in the Gulf of Mexico , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[29]  Bin Yang,et al.  SBNet: Sparse Blocks Network for Fast Inference , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Porter Hoagland,et al.  The Economic Effects of Harmful Algal Blooms , 2006 .

[31]  Fawzi Nashashibi,et al.  Sparse and Dense Data with CNNs: Depth Completion and Semantic Segmentation , 2018, 2018 International Conference on 3D Vision (3DV).

[32]  Thomas Brox,et al.  Sparsity Invariant CNNs , 2017, 2017 International Conference on 3D Vision (3DV).

[33]  Patricia M. Glibert,et al.  First record of a fish-killing Gymnodinium sp. bloom in Kuwait Bay, Arabian Sea: chronology and potential causes , 2001 .

[34]  André Morel,et al.  In-water and remote measurements of ocean color , 1980 .

[35]  D. Townsend,et al.  Satellite-measured phytoplankton variability in the Gulf of Maine , 2003 .

[36]  Tian,et al.  An Integrated Web-Based System for the Monitoring and Forecasting of Coastal Harmful Algae Blooms: Application to Shenzhen City, China , 2019, Journal of Marine Science and Engineering.

[37]  Weilong Song,et al.  Learning-Based Algal Bloom Event Recognition for Oceanographic Decision Support System Using Remote Sensing Data , 2015, Remote. Sens..

[38]  Jennifer P. Cannizzaro,et al.  A novel technique for detection of the toxic dinoflagellate, Karenia brevis, in the Gulf of Mexico from remotely sensed ocean color data , 2008 .

[39]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[40]  Zhongping Lee,et al.  Use of hyperspectral remote sensing reflectance for detection and assessment of the harmful alga, Karenia brevis. , 2006, Applied optics.

[41]  H. Dierssen Perspectives on empirical approaches for ocean color remote sensing of chlorophyll in a changing climate , 2010, Proceedings of the National Academy of Sciences.

[42]  A. Zeileis,et al.  Danger: High Power! – Exploring the Statistical Properties of a Test for Random Forest Variable Importance , 2008 .

[43]  M. Moradi,et al.  Red tide detection in the Strait of Hormuz (east of the Persian Gulf) using MODIS fluorescence data , 2012 .

[44]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[46]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[47]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Lora E Fleming,et al.  Satellite remote sensing of harmful algal blooms: A new multi-algorithm method for detecting the Florida Red Tide (Karenia brevis). , 2010, Harmful algae.

[49]  L. Prieur,et al.  Analysis of variations in ocean color1 , 1977 .

[50]  S. Phinn,et al.  A review of ocean color remote sensing methods and statistical techniques for the detection, mapping and analysis of phytoplankton blooms in coastal and open oceans , 2014 .

[51]  F. D’Ortenzio,et al.  Year‐to‐year variability of the phytoplankton bloom in the southern Adriatic Sea (1998–2000): Sea‐viewing Wide Field‐of‐view Sensor observations and modeling study , 2003 .

[52]  Timothy S. Moore,et al.  A class-based approach to characterizing and mapping the uncertainty of the MODIS ocean chlorophyll product , 2009 .

[53]  M. Temimi,et al.  Monitoring HABs in the shallow Arabian Gulf using a qualitative satellite-based index , 2016 .

[54]  Richard P. Stumpf,et al.  MONITORING KARENIA BREVIS BLOOMS IN THE GULF OF MEXICO USING SATELLITE OCEAN COLOR IMAGERY AND OTHER DATA , 2003 .

[55]  F. Gohin,et al.  Satellite and in situ observations of a late winter phytoplankton bloom, in the northern Bay of Biscay , 2003 .

[56]  H. Ghedira,et al.  Monitoring red tide with satellite imagery and numerical models: a case study in the Arabian Gulf. , 2014, Marine pollution bulletin.

[57]  R. Stumpf,et al.  Adjustment of ocean color sensor calibration through multi-band statistics. , 2010, Optics express.