A Method of Generating Measurable Panoramic Image for Indoor Mobile Measurement System

This paper designs a technique route to generate high-quality panoramic image with depth information, which involves two critical research hotspots: fusion of LiDAR and image data and image stitching. For the fusion of 3D points and image data, since a sparse depth map can be firstly generated by projecting LiDAR point onto the RGB image plane based on our reliable calibrated and synchronized sensors, we adopt a parameter self-adaptive framework to produce 2D dense depth map. For image stitching, optimal seamline for the overlapping area is searched using a graph-cuts-based method to alleviate the geometric influence and image blending based on the pyramid multi-band is utilized to eliminate the photometric effects near the stitching line. Since each pixel is associated with a depth value, we design this depth value as a radius in the spherical projection which can further project the panoramic image to the world coordinate and consequently produces a high-quality measurable panoramic image. The purposed method is tested on the data from our data collection platform and presents a satisfactory application prospects.

[1]  Li Li,et al.  Optimal seamline detection for multiple image mosaicking via graph cuts , 2016 .

[2]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[3]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Cristiano Premebida,et al.  Pedestrian detection combining RGB and dense LIDAR data , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Cheng-Ming Huang,et al.  Efficient Image Stitching of Continuous Image Sequence With Image and Seam Selections , 2015, IEEE Sensors Journal.

[6]  László Neumann,et al.  Image Blending Techniques and their Application in Underwater Mosaicing , 2014, SpringerBriefs in Computer Science.

[7]  Zhaobin Wang,et al.  Review on image-stitching techniques , 2020, Multimedia Systems.

[8]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[9]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[10]  Ruizhi Chen,et al.  A Stereo Dual-Channel Dynamic Programming Algorithm for UAV Image Stitching , 2017, Sensors.

[11]  Eckehard G. Steinbach,et al.  6DOF decoupled roto-translation alignment of large-scale indoor point clouds , 2017, Comput. Vis. Image Underst..

[12]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Wei Zhang,et al.  A Unified Framework for Street-View Panorama Stitching , 2016, Sensors.

[14]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[15]  Sharath Pankanti,et al.  Adaptive as-natural-as-possible image stitching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Yao Wang,et al.  Color-Guided Depth Recovery From RGB-D Data Using an Adaptive Autoregressive Model , 2014, IEEE Transactions on Image Processing.

[17]  Roland Siegwart,et al.  A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[18]  Long Chen,et al.  A novel way to organize 3D LiDAR point cloud as 2D depth map height map and surface normal map , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[19]  Youchuan Wan,et al.  Automatic determination of seamlines for aerial image mosaicking based on vector roads alone , 2013 .

[20]  Horst Bischof,et al.  Image Guided Depth Upsampling Using Anisotropic Total Generalized Variation , 2013, 2013 IEEE International Conference on Computer Vision.

[21]  Qingquan Li,et al.  Transforming a 3-D LiDAR Point Cloud Into a 2-D Dense Depth Map Through a Parameter Self-Adaptive Framework , 2017, IEEE Transactions on Intelligent Transportation Systems.