A Fuzzy Spatial Relationship Graph for Point Clouds Using Bounding Boxes

Three dimensional point cloud data sets are easy to acquire and manipulate, but are often too large to process directly for embedded real-time applications. The spatial information in a point cloud can be represented in a variety of reduced forms, such as voxel grids, Gaussian mixture models, or spatial semantic structures. In this article, we show how a segmented point cloud can be represented as a spatial relationship graph using bounding boxes and triangular fuzzy numbers. This model is a lightweight encoding of the relative distance and direction between objects, and can be used to describe and query for particular spatial configurations using linguistic terms in a multicriteria framework. We show how this approach can be applied on a hand-segmented subset of the NPM3D data set with several illustrative examples. The work herein has useful applications in many applied domains, such as human-robot interaction with unmanned aerial systems.

[1]  P. Matsakis,et al.  The use of force histograms for affine-invariant relative position description , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Tim Oates,et al.  Identifying spatial relations in images using convolutional neural networks , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[3]  Marjorie Skubic,et al.  Sketch-based navigation for mobile robots , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[4]  Gabriel J. Brostow,et al.  Digging Into Self-Supervised Monocular Depth Estimation , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[5]  Ozy Sjahputera,et al.  Linguistic description of relative positions in images , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Fuxin Li,et al.  PointConv: Deep Convolutional Networks on 3D Point Clouds , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Leonidas J. Guibas,et al.  KPConv: Flexible and Deformable Convolution for Point Clouds , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[8]  Jean-Emmanuel Deschaud,et al.  Paris-Lille-3D: A large and high-quality ground-truth urban point cloud dataset for automatic segmentation and classification , 2017, Int. J. Robotics Res..

[9]  François Goulette,et al.  Paris-Lille-3D: A large and high-quality ground-truth urban point cloud dataset for automatic segmentation and classification , 2017, Int. J. Robotics Res..

[10]  Xuning Yang,et al.  Reactive Collision Avoidance Using Real-Time Local Gaussian Mixture Model Maps , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Pascal Matsakis,et al.  A First Algorithm to Calculate Force Histograms in the Case of 3D Vector Objects , 2014, ICPRAM.

[12]  Marjorie Skubic,et al.  Extracting navigation states from a hand-drawn map , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).