Stochastic Modeling of Trees in Forest Environments

Our article deals with the detection and model generation of complex objects with curvilinear parts, like trees, with stochastic relaxation. The proposed algorithm can rely on any initial estimation of object parts as a probability map (like those generated by Gaussian mixture models or neural networks) and can model the relation of randomly sampled parts resulting in a structural representation of whole objects. Semantic segmentation by convolutional neural networks or the pose estimation with deep learning of object parts can predict the possible areas or positions of interest, but in many cases, a higher representation of structures is needed for further (e.g., shape or connectivity) analysis. The model validation of such data is straightforward for objects with known structure (like the human body or other rigid things) but tough for such complex objects like trees in forest environments. In our approach, the possible configurations of structures are generated by a marked point process while the optimal state is achieved by a solver based on reversible jump Markov chain Monte Carlo dynamics. The model generator relaxation method itself is unsupervised, no training is required, and our analyses show it has satisfactory stability, regarding detection accuracy, against changing its parameters. Besides giving the theoretical background and algorithmic steps, we present numerical evaluations on three datasets: synthetic trees, another of natural images with different species of trees in various forest environments, and the third is of road maps. The analyzed examples show that our approach, contrary to previous thin line detectors, can handle thin and thick objects.

[1]  Josiane Zerubia,et al.  Satellite image classification using a modified Metropolis dynamics , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Guido Gerig,et al.  Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1998, Medical Image Anal..

[3]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[4]  Josiane Zerubia,et al.  Two Markov point processes for simulating line networks , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[5]  Guoyou Wang,et al.  Chinese license plate character segmentation using multiscale template matching , 2016, J. Electronic Imaging.

[6]  Josiane Zerubia,et al.  Markov Random Fields in Image Segmentation , 2012, Found. Trends Signal Process..

[7]  Pascal Fua,et al.  Reconstructing Evolving Tree Structures in Time Lapse Sequences by Enforcing Time-Consistency , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Andrea Prati,et al.  An Accurate System for Fashion Hand-Drawn Sketches Vectorization , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[9]  Vijayan K. Asari,et al.  The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches , 2018, ArXiv.

[10]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[12]  Yu Liu,et al.  A review of semantic segmentation using deep neural networks , 2017, International Journal of Multimedia Information Retrieval.

[13]  Jiang Liu,et al.  Topology Reconstruction of Tree-Like Structure in Images via Structural Similarity Measure and Dominant Set Clustering , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Bernt Schiele,et al.  Robust Object Detection with Interleaved Categorization and Segmentation , 2008, International Journal of Computer Vision.

[15]  Martin Pincus,et al.  Letter to the Editor - A Monte Carlo Method for the Approximate Solution of Certain Types of Constrained Optimization Problems , 1970, Oper. Res..

[16]  Dieter Fox,et al.  Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objects , 2018, CoRL.

[17]  László Czúni,et al.  Low- and High-level Methods for Tree Segmentation , 2019, 2019 10th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS).

[18]  Guillaume Bouchard,et al.  Hierarchical part-based visual object categorization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[20]  Roberto Cipolla,et al.  Feature-based human face detection , 1997, Image Vis. Comput..

[21]  Josiane Zerubia,et al.  A Connected-Tube MPP Model for Object Detection with Application to Materials and Remotely-Sensed Images , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[22]  Daniel P. Huttenlocher,et al.  Spatial priors for part-based recognition using statistical models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  François Yvon,et al.  Learning the Structure of Variable-Order CRFs: a finite-state perspective , 2017, EMNLP.

[24]  Gustavo Carneiro,et al.  Sparse Flexible Models of Local Features , 2006, ECCV.

[25]  Siwei Lyu,et al.  Multi-Scale Supervised Network for Human Pose Estimation , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[26]  Gilles Celeux,et al.  EM procedures using mean field-like approximations for Markov model-based image segmentation , 2003, Pattern Recognit..

[27]  Tomaso A. Poggio,et al.  Example-Based Object Detection in Images by Components , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Attila Börcs,et al.  A MARKED POINT PROCESS MODEL FOR VEHICLE DETECTION IN AERIAL LIDAR POINT CLOUDS , 2012 .

[29]  Josiane Zerubia,et al.  A marked point process model for tree crown extraction in plantations , 2005, IEEE International Conference on Image Processing 2005.

[30]  Jian Yao,et al.  RoadNet: Learning to Comprehensively Analyze Road Networks in Complex Urban Scenes From High-Resolution Remotely Sensed Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Martin A. Fischler,et al.  The Representation and Matching of Pictorial Structures , 1973, IEEE Transactions on Computers.

[32]  Max W. K. Law,et al.  Three Dimensional Curvilinear Structure Detection Using Optimally Oriented Flux , 2008, ECCV.

[33]  Jan Flusser,et al.  Blur Invariant Template Matching Using Projection onto Convex Sets , 2019, CAIP.

[34]  Paul A. Viola,et al.  Fast Multi-view Face Detection , 2003 .

[35]  Csaba Benedek,et al.  An Embedded Marked Point Process Framework for Three-Level Object Population Analysis , 2017, IEEE Transactions on Image Processing.

[36]  Josiane Zerubia,et al.  Marked point process in image analysis , 2002, IEEE Signal Process. Mag..

[37]  Daniel P. Huttenlocher,et al.  Pictorial Structures for Object Recognition , 2004, International Journal of Computer Vision.