Water characterization and early contamination detection in highly varying stochastic background water, based on Machine Learning methodology for processing real-time UV-Spectrophotometry.

Water is a resource that affects every aspect of life. Intentional (terrorist or wartime events) or accidental water contamination events could have a tremendous impact on public health, behavior and morale. Quick detection of such events can mitigate their effects and reduce the potential damage. Continuous on-line monitoring is the first line of defense for reducing contamination associated damage. One of the available tools for such detection is the UV-absorbance spectrophotometry, where the absorbance spectra are compared against a set of normal and contaminated water fingerprints. However, as there are many factors at play that affect this comparison, it is an elusive and tedious task. Further, the comparison against a set of known fingerprints is futile when the water in the supply system are a mix, with varying proportions, of water from different sources, which differ significantly in their physicochemical characteristics. This study presents a new scheme for early detection of contamination events through UV absorbance under unknown routine conditions. The detection mechanism is based on a new affinity measure, Fitness, and a procedure similar to Gram based amplification, which result in a flexible mechanism to alert if a contamination is present. The method was shown to be most effective when applied to a set of comprehensive experiments, which examined the absorbance of various contaminants in drinking water in lab and real-life configurations. Four datasets, which contained real readings from either laboratory experiments or monitoring station of an operational water supply system were used. To extend the testbed even further, an artificial dataset, simulating a vast array of proportions between specific water sources is also presented. The results show, that for all datasets, high detection rates, while maintaining low levels of false alarms, were obtained by the algorithm.

[1]  Roy C. Haught,et al.  On–Line water quality parameters as indicators of distribution system contamination , 2007 .

[2]  Gary Winston,et al.  A tap water turbidity crisis in Tel Aviv, Israel, due to technical failure: toxicological and risk management issues. , 2003, International journal of hygiene and environmental health.

[3]  Barak Fishbain,et al.  Prediction of Bacterial Contamination Outbursts in Water Wells through Sparse Coding , 2017, Scientific Reports.

[4]  G Langergraber,et al.  Time-resolved delta spectrometry: a method to define alarm parameters from spectral data. , 2004, Water science and technology : a journal of the International Association on Water Pollution Research.

[5]  B. Fishbain,et al.  Contamination Detection of Water with Varying Routine Backgrounds by UV-Spectrophotometry , 2018, Journal of Water Resources Planning and Management.

[6]  M. H. Hodge,et al.  Confusion matrix analysis of single and multidimensional auditory displays. , 1962, Journal of experimental psychology.

[7]  Steven C. Allgeier,et al.  Optimizing operational reliability of the Cincinnati contamination warning system , 2011 .

[8]  Jian Zhang,et al.  Online Monitoring of Water-Quality Anomaly in Water Distribution Systems Based on Probabilistic Principal Component Analysis by UV-Vis Absorption Spectroscopy , 2014 .

[9]  I. Miettinen,et al.  Contaminated water caused the first outbreak of giardiasis in Finland, 2007: A descriptive study , 2010, Scandinavian journal of infectious diseases.

[10]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[11]  Mark Gibson,et al.  Technologies and Techniques for Early Warning Systems to Monitor and Evaluate Drinking Water Quality: A State-of-the-Art Review , 2005 .

[12]  Avi Ostfeld,et al.  Comparison of two multivariate classification models for contamination event detection in water quality time series , 2015 .

[13]  Peter H. Gleick,et al.  Water and terrorism , 2006 .

[14]  Dibo Hou,et al.  Detection of water-quality contamination events based on multi-sensor fusion using an extented Dempster–Shafer method , 2013 .

[15]  Avi Ostfeld,et al.  Event detection in water distribution systems from multivariate water quality time series. , 2012, Environmental science & technology.

[16]  Avi Ostfeld,et al.  A Coupled Decision Trees Bayesian Approach for Water Distribution Systems Event Detection , 2012 .

[17]  C. Moldaenke,et al.  Detection of chemical threat agents in drinking water by an early warning real‐time biomonitor , 2003, Environmental toxicology.

[18]  Dan Kroll,et al.  OPERATIONAL AND LABORATORY VERIFICATION TESTING OF A HEURISTIC ON-LINE WATER MONITORING SYSTEM FOR SECURITY , 2007 .

[19]  Katherine A. Klise,et al.  Event Detection from Water Quality Time Series , 2007 .

[20]  B. H. Tangena,et al.  A Novel Approach for Early Warning of Drinking Water Contamination Events , 2011 .

[21]  Avi Ostfeld,et al.  A dynamic thresholds scheme for contaminant event detection in water distribution systems. , 2013, Water research.

[22]  Avi Ostfeld,et al.  A coupled classification - evolutionary optimization model for contamination event detection in water distribution systems. , 2014, Water research.