Error Detection of Ocean Depth Series Data with Area Partitioning and Using Sliding Window

In the ocean around the world, depth series ocean data of temperature and salinity have being measured. However, it is difficult to discriminate the errors from the normal data since the variation of ocean areas are different. In this research, using hierarchical clustering, we partitioned the ocean into some areas so that the ocean data have the same variation in each area. Then, transforming the ocean data into sets of sliding windows in consideration of depth series, we applied some anomaly detection methodologies. Finally, we succeeded in assigning high anomaly scores on errors that seemed to be normal.

[1]  Sridhar Ramaswamy,et al.  Efficient algorithms for mining outliers from large data sets , 2000, SIGMOD '00.

[2]  Gregory C. Johnson,et al.  In Situ Data Biases and Recent Ocean Heat Content Variability , 2009 .

[3]  Diane J. Cook,et al.  Graph-based anomaly detection , 2003, KDD '03.

[4]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[5]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[6]  Osmar R. Zaïane,et al.  Time series contextual anomaly detection for detecting market manipulation in stock market , 2015, 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[7]  Ken-ichi Fukui,et al.  Error detection of oceanic observation data using sequential labeling , 2015, 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[8]  Sanjay Chawla,et al.  Mining for Outliers in Sequential Databases , 2006, SDM.

[9]  Chang-Tien Lu,et al.  Spatial Weighted Outlier Detection , 2006, SDM.

[10]  Ashok N. Srivastava,et al.  Nonlinear gated experts for time series: discovering regimes and avoiding overfitting , 1995, Int. J. Neural Syst..

[11]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[12]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[13]  Shashi Shekhar,et al.  Detecting graph-based spatial outliers: algorithms and applications (a summary of results) , 2001, KDD '01.