Web-based Video-Assisted Point Cloud Annotation for ADAS validation

This paper introduces a web application for point cloud annotation that is used in the advanced driver assistance systems field. Apart from the point cloud viewer, the web tool has an object viewer and a timeline to define the attributes of the annotations and a video viewer to validate the point cloud annotations with the corresponding video images. The paper also describes several strategies we followed to obtain annotations correctly and quickly: (i) memory management and rendering of large-scale point clouds, (ii) coherent combination of video images and annotations, (iii) content synchronization in all parts of the application and (iv) automatic annotation before and during the annotation task of the user.

[1]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Sanja Fidler,et al.  Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++ , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[3]  Brian Danchilla,et al.  Three.js Framework , 2012 .

[4]  Renato Pajarola,et al.  An efficient multi-resolution framework for high quality interactive rendering of massive point clouds using multi-way kd-trees , 2012, The Visual Computer.

[5]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[6]  Aleksey S. Boyko,et al.  Efficient interfaces for accurate annotation of 3D point clouds , 2015 .

[7]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[8]  Wei Li,et al.  R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection , 2017, ArXiv.

[9]  Amar Ramdane-Cherif,et al.  Machine Learning Techniques in ADAS: A Review , 2018, 2018 International Conference on Advances in Computing and Communication Engineering (ICACCE).

[10]  Michael Himmelsbach,et al.  Fusing vision and LIDAR - Synchronization, correction and occlusion reasoning , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[11]  Jürgen Döllner,et al.  Out-of-Core Visualization of Classified 3D Point Clouds , 2015 .

[12]  Claus Scheiblauer,et al.  Potree : Rendering Large Point Clouds in Web , 2016 .

[13]  Wenyi Zhao,et al.  Alignment of continuous video onto 3D point clouds , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Christian Steger,et al.  Review of LiDAR Sensor Data Acquisition and Compression for Automotive Applications , 2018, Proceedings.