An Improved SURF in Image Mosaic Based on Deep Learning

Image mosaic is widely used in the machine vision and various projects, the mosaic image may sometimes in malformed, which is impossible to be predicted when it occurs, with the Speed-up Robust Feature (SURF). In order to get successful mosaic images at most of the time with SURF, an improved SURF based on deep learning with Convolutional Neural Network (CNN) is proposed in this paper. The improved SURF can feedback the mosaic procession by re-stitching the images automatically after eliminating the bad deformed one by the judging of the results through deep learning, and output the better, which free-data area of black will be continue to be detected and then be restored with the nearest neighbor interpolation, and finally outputs the ideal image. The experiment shows that the improved SURF can eliminate the deformed mosaic as effectively and can improve the mosaic as efficiency, and get the final perfect mosaic images all the time.

[1]  Junzo Watada,et al.  Panoramic image mosaic based on SURF algorithm using OpenCV , 2015, 2015 IEEE 9th International Symposium on Intelligent Signal Processing (WISP) Proceedings.

[2]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[3]  Yiming Li,et al.  Recent advances in omnidirectional video coding for virtual reality: Projection and evaluation , 2018, Signal Process..

[4]  Tong Ma,et al.  A novel retinal vessel extraction method based on dynamic scales allocation , 2017, 2017 2nd International Conference on Image, Vision and Computing (ICIVC).

[5]  E HintonGeoffrey,et al.  ImageNet classification with deep convolutional neural networks , 2017 .

[6]  Chang Liu,et al.  A 3D Dual Path U-Net of Cancer Segmentation Based on MRI , 2018, 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC).

[7]  Yonghua Jiang,et al.  Stitching images of dual-cameras onboard satellite , 2017 .

[8]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[9]  Shuguang Li,et al.  Research on an Image Mosaic Algorithm Based on Improved ORB Feature Combined with SURF , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[10]  Fei Lei,et al.  A fast method for image mosaic based on SURF , 2014, 2014 9th IEEE Conference on Industrial Electronics and Applications.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Umesh C. Pati,et al.  A novel technique for mosaicing of medical images , 2014, 2014 Annual IEEE India Conference (INDICON).