SEGMENTATION OF ENVIRONMENTAL TIME LAPSE IMAGE SEQUENCES FOR THE DETERMINATION OF SHORE LINES CAPTURED BY HAND-HELD SMARTPHONE CAMERAS

Abstract. The relevance of globally environmental issues gains importance since the last years with still rising trends. Especially disastrous floods may cause in serious damage within very short times. Although conventional gauging stations provide reliable information about prevailing water levels, they are highly cost-intensive and thus just sparsely installed. Smartphones with inbuilt cameras, powerful processing units and low-cost positioning systems seem to be very suitable wide-spread measurement devices that could be used for geo-crowdsourcing purposes. Thus, we aim for the development of a versatile mobile water level measurement system to establish a densified hydrological network of water levels with high spatial and temporal resolution. This paper addresses a key issue of the entire system: the detection of running water shore lines in smartphone images. Flowing water never appears equally in close-range images even if the extrinsics remain unchanged. Its non-rigid behavior impedes the use of good practices for image segmentation as a prerequisite for water line detection. Consequently, we use a hand-held time lapse image sequence instead of a single image that provides the time component to determine a spatio-temporal texture image. Using a region growing concept, the texture is analyzed for immutable shore and dynamic water areas. Finally, the prevalent shore line is examined by the resultant shapes. For method validation, various study areas are observed from several distances covering urban and rural flowing waters with different characteristics. Future work provides a transformation of the water line into object space by image-to-geometry intersection.

[1]  Guangxue Yue,et al.  The Study on An Application of Otsu Method in Canny Operator , 2009 .

[2]  Hans-Gerd Maas,et al.  AN AUTONOMOUS IMAGE BASED APPROACH FOR DETECTING GLACIAL LAKE OUTBURST FLOODS , 2014 .

[3]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  W. Cleveland.  Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[7]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[8]  Hui Zhang,et al.  Water Extraction in High Resolution Remote Sensing Image Based on Hierarchical Spectrum and Shape Features , 2014 .

[9]  Yun Zhang,et al.  Optimisation of building detection in satellite images by combining multispectral classification and texture filtering , 1999 .

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  B. Gao.  NDWI—A normalized difference water index for remote sensing of vegetation liquid water from space , 1996 .

[12]  Robert F. Murphy,et al.  Application of temporal texture features to automated analysis of protein subcellular locations in time series fluorescence microscope images , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[13]  Danilo Schneider,et al.  Photogrammetric determination of spatio-temporal velocity fields at Glaciar San Rafael in the Northern Patagonian Icefield , 2010 .

[14]  Yong Xu,et al.  Dynamic texture classification using dynamic fractal analysis , 2011, 2011 International Conference on Computer Vision.

[15]  Amandeep Verma.  Identification of Land and Water Regions in a Satellite Image : A Texture Based Approach , 2011 .

[16]  Gulcan Sarp,et al.  Water body extraction and change detection using time series: A case study of Lake Burdur, Turkey , 2017 .

[17]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[18]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[19]  Constantino Carlos Reyes-Aldasoro,et al.  Image Segmentation and Compression using Neural Networks , 2000 .

[20]  Rasmus Fensholt,et al.  Automated Water Extraction Index: A new technique for surface water mapping using Landsat imagery , 2014 .

[21]  Timothy A. Warner,et al.  Forest Type Mapping using Object-specific Texture Measures from Multispectral Ikonos Imagery: Segmentation Quality and Image Classification Issues , 2009 .

[22]  R. Krishna,et al.  Image Segmentation and Region Growing Algorithm , 2012 .

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Randal C. Nelson,et al.  Qualitative recognition of motion using temporal texture , 1992, CVGIP Image Underst..

[25]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2004, International Journal of Computer Vision.

[27]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[28]  T. Warner,et al.  SCALE AND TEXTURE IN DIGITAL IMAGE CLASSIFICATION , 2002 .

[29]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[30]  M. Kröhnert,et al.  AUTOMATIC WATERLINE EXTRACTION FROM SMARTPHONE IMAGES , 2016 .

[31]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[32]  S.B. Serpico,et al.  Classification of optical high resolution images in urban environment using spectral and textural information , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[33]  Loong Fah Cheong,et al.  Synergizing spatial and temporal texture , 2002, IEEE Trans. Image Process..

[34]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.