An image engineering approach to analysing mobile mapping data

Vehicle-based mobile mapping systems capture co-registered imagery and 3D point cloud information over hundreds of kilometres of transport corridor. Methods for extracting information from these large datasets are labour intensive. These need to be easily congured by non-expert users to process images and develop new workows. Image Engineering provides a framework to combine known image processing, image analysis an image understanding methods into powerful applications. Such a system was built using Orange an open source toolkit for machine learning onto which image processing, visualisation and data acquisition methods were added. The system presented here enable users who are not programmers to manage image data and to customise their analyses by combining common data analysis tools to t their needs. Case studies are provided to demonstrate the utility of the system. Co-registered imagery and depth data of urban transport corridors provided by the Earthmine dataset and laser ranging systems are used.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Yujin Zhang An Overview of Image and Video Segmentation in the Last 40 Years , 2006 .

[3]  Miha Štajdohar,et al.  Interactive network exploration with Orange , 2013 .

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  Fred L. Drake,et al.  The Python Language Reference Manual , 1999 .

[6]  J. Canny A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[8]  Uwe Fink Empirical Studies Of Programmers Second Workshop , 2016 .

[9]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.

[10]  Brad A. Myers,et al.  Taxonomies of visual programming and program visualization , 1990, J. Vis. Lang. Comput..

[11]  Paul L. Rosin A simple method for detecting salient regions , 2009, Pattern Recognit..

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Elliot Soloway,et al.  Empirical Studies of Programmers: Second Workshop , 1991 .

[14]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[17]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[18]  LeeTai Sing Image Representation Using 2D Gabor Wavelets , 1996 .

[19]  Dennis Koelma,et al.  A visual programming interface for an image processing environment , 1994, Pattern Recognit. Lett..

[20]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[22]  Matti Pietikäinen,et al.  Local Binary Pattern Descriptors for Dynamic Texture Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[23]  Sabine Süsstrunk,et al.  Salient Region Detection and Segmentation , 2008, ICVS.

[24]  Brad A. Myers,et al.  Demonstrational interfaces: A step beyond direct manipulation , 1992, Computer.

[25]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[26]  Geoff A. W. West,et al.  Use of Multiple Low Level Features to Find Interesting Regions , 2014, ICPRAM.

[27]  Blaz Zupan,et al.  Orange: From Experimental Machine Learning to Interactive Data Mining , 2004, PKDD.

[28]  G. West,et al.  Using depth maps to find interesting regions , 2014, 2014 IEEE REGION 10 SYMPOSIUM.

[29]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[30]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[31]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.