Dynamic mosaicking: combining A* algorithm with fractional Brownian motion for an optimal seamline detection

Image mosaicking is a combination of algorithms that use two or several images to create a single image. The resulting mosaic is a representation of a scene of the used images with a larger field of vision. However, since dynamic objects can exist in the overlap regions of these images, ghosting and parallax effects appear, therefore poor results are obtained. To overcome these unwanted effects and to achieve better results, a new method is presented in this paper. This approach uses a new way to detect dynamic objects in the common areas by using a fractional Brownian motion with a predetermined similarity function instead of a noise function, the Zero Normalized Cross Correlation. Thus, it will ensure that a map is created with each pixel having a unique value based on their surroundings even in homogeneous areas. Furthermore, this new approach combines the previously computed map with the machine learning algorithm A* for a fast and efficient way to find an optimal seamline. Consequently, the obtained experimental results were compared with different methods and better results were obtained as can be seen by a better quality seamline measure, a result mosaic without any artifacts and a faster computation time.

[1]  Umesh C. Pati,et al.  Image mosaicing: A deeper insight , 2019, Image Vis. Comput..

[2]  Saadeddine Laaroussi,et al.  Dynamic mosaicking: region-based method using edge detection for an optimal seamline , 2019, Multimedia Tools and Applications.

[3]  Li Li,et al.  Seamline network generation based on foreground segmentation for orthoimage mosaicking , 2019 .

[4]  Zhong Qu,et al.  An algorithm of image mosaic based on binary tree and eliminating distortion error , 2019, PloS one.

[5]  Ming Li,et al.  Improved Seam-Line Searching Algorithm for UAV Image Mosaic with Optical Flow , 2018, Sensors.

[6]  Saadeddine Laaroussi,et al.  A dynamic mosaicking method based on histogram equalization for an improved seamline , 2018 .

[7]  Li Li,et al.  Guided color consistency optimization for image mosaicking , 2018 .

[8]  Wei Zhang,et al.  Optimal seamline detection in dynamic scenes via graph cuts for image mosaicking , 2017, Machine Vision and Applications.

[9]  Gian Luca Foresti,et al.  Real-Time Incremental and Geo-Referenced Mosaicking by Small-Scale UAVs , 2017, ICIAP.

[10]  Venkat P. Patil,et al.  Impact of selecting image feature detection method for development of panorama under different light conditions , 2017, 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI).

[11]  Jasmin Velagić,et al.  Aerial image mosaicing approach based on feature matching , 2017, 2017 International Symposium ELMAR.

[12]  Guang-Zhong Yang,et al.  Autonomous scanning for endomicroscopic mosaicing and 3D fusion , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Aziz Baataoui,et al.  Image mosaicing using voronoi diagram , 2016, Multimedia Tools and Applications.

[14]  Feng Duan,et al.  Dynamic image stitching for moving object , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[15]  K. Satori,et al.  Image Mosaicing Using a Self-Calibration Camera , 2015 .

[16]  Aykut Erdem,et al.  The State of the Art in HDR Deghosting: A Survey and Evaluation , 2015, Comput. Graph. Forum.

[17]  Qinghua Zhou,et al.  Seamline Determination Based on Segmentation for Urban Image Mosaicking , 2014, IEEE Geoscience and Remote Sensing Letters.

[18]  Shengping Zhang,et al.  Dynamic image mosaic via SIFT and dynamic programming , 2013, Machine Vision and Applications.

[19]  Yong Ju Cho,et al.  Quantitative quality assessment of stitched panoramic images , 2012 .

[20]  Pejman Tahmasebi,et al.  Multiple-point geostatistical modeling based on the cross-correlation functions , 2012, Computational Geosciences.

[21]  Le Yu,et al.  Towards the automatic selection of optimal seam line locations when merging optical remote-sensing images , 2012 .

[22]  Gregory Dudek,et al.  Image stitching with dynamic elements , 2009, Image Vis. Comput..

[23]  Luo Juan,et al.  A comparison of SIFT, PCA-SIFT and SURF , 2009 .

[24]  Federico Tombari,et al.  Markerless Augmented Reality Using Image Mosaics , 2008, ICISP.

[25]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[26]  Radu Horaud,et al.  Motion Panoramas , 2004, Comput. Animat. Virtual Worlds.

[27]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[28]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[29]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[30]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[31]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[33]  Martin Kerschner,et al.  Seamline detection in colour orthoimage mosaicking by use of twin snakes , 2001 .

[34]  Pradeep K. Khosla,et al.  Motion detection and segmentation using image mosaics , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[35]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[36]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[37]  Nils J. Nilsson,et al.  Correction to "A Formal Basis for the Heuristic Determination of Minimum Cost Paths" , 1972, SGAR.

[38]  B. Mandelbrot,et al.  Fractional Brownian Motions, Fractional Noises and Applications , 1968 .

[39]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..