Fuzzy logic and histogram of normal orientation-based 3D keypoint detection for point clouds

Abstract Point cloud processing has gained consideration for 3D object recognition and classification tasks. In this context, an important task is to detect the distinct and repeatable 3D keypoints. Many 3D keypoint detectors with low repeatability and distinctiveness have been proposed. The detection of highly repeatable and distinct keypoints is still an open problem. To address this issue, we propose a fuzzy logic and Histogram of Normal Orientation (HoNO)-based 3D keypoint detection scheme for Point Cloud (PC) data. To measure saliency, we exploit the structure of the PC and compute the eigenvalues of the covariance matrix and the HoNO to measure saliency. The histogram (HoNO) salient value is computed by the kurtosis values, which estimate the spread of the histogram. From the kurtosis and smallest eigenvalues, we compute the difference of the kurtosis values and the difference of the smallest eigenvalues of the query point against all the neighbouring points. The difference of kurtosis values and difference of smallest eigenvalues are applied to a fuzzy rule-based scheme for the keypoints detection. We compare the proposed algorithm with the state-of-the-art 3D keypoint detectors on five benchmark datasets. Experimental results demonstrate the superior performance of the proposed detector on most of the benchmark datasets both in terms of absolute and relative repeatability.

[1]  Yu Zhong,et al.  Intrinsic shape signatures: A shape descriptor for 3D object recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[2]  Terry Caelli,et al.  Computation of Surface Geometry and Segmentation Using Covariance Techniques , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Benjamin Bustos,et al.  Harris 3D: a robust extension of the Harris operator for interest point detection on 3D meshes , 2011, The Visual Computer.

[4]  Federico Tombari,et al.  Performance Evaluation of 3D Keypoint Detectors , 2012, International Journal of Computer Vision.

[5]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[6]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[7]  Hisao Ishibuchi,et al.  Effect of rule weights in fuzzy rule-based classification systems , 2001, IEEE Trans. Fuzzy Syst..

[8]  Paul Checchin,et al.  Performance evaluation of 3D keypoint detectors for time-of-flight depth data , 2016, 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[9]  Martial Hebert,et al.  Multi-scale interest regions from unorganized point clouds , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Chitra Dorai,et al.  COSMOS - A Representation Scheme for 3D Free-Form Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Radu Horaud,et al.  Surface feature detection and description with applications to mesh matching , 2009, CVPR.

[12]  Hui Chen,et al.  3D free-form object recognition in range images using local surface patches , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[13]  Federico Tombari,et al.  Learning to Detect Good 3D Keypoints , 2017, International Journal of Computer Vision.

[14]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Mohammed Bennamoun,et al.  On the Repeatability and Quality of Keypoints for Local Feature-based 3D Object Retrieval from Cluttered Scenes , 2009, International Journal of Computer Vision.

[16]  Federico Tombari,et al.  Learning a Descriptor-Specific 3D Keypoint Detector , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[17]  Weisi Lin,et al.  Detecting keypoint sets on 3D point clouds via Histogram of Normal Orientations , 2016, Pattern Recognit. Lett..

[18]  Mohammed Bennamoun,et al.  Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered Scenes , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Federico Tombari,et al.  Performance Evaluation of 3D Keypoint Detectors , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[20]  Federico Tombari,et al.  Object Recognition in 3D Scenes with Occlusions and Clutter by Hough Voting , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[21]  Umberto Castellani,et al.  Sparse points matching by combining 3D mesh saliency with statistical descriptors , 2008, Comput. Graph. Forum.

[22]  Ziyan Wu,et al.  End-to-End Learning of Keypoint Detector and Descriptor for Pose Invariant 3D Matching , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  T. Ross Fuzzy Logic with Engineering Applications , 1994 .

[24]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.