Reinforcement Learning for Enhanced Content Based Video Frame Retrieval System in Low Resolution Videos

Over the past two decades, evolutional advancement took place in the field of computer, communication and multimedia technologies which led to the production of massive video data production and large image repositories. This research focuses on the video frame retrieval using popular feature extraction method of computer vision called Speeded Up Robust Features (SURF) and Reinforcement Learning (RL) based Point of Interest (POI) calculation and frame reduction. The proposed method uses the concept of Content-Based-Image-Retrieval (CBIR) which retrieves similar images from the collection of large image databases. In video processing, a challenging task is to remove redundant frames as most of the videos have 30 Frames per Second (FPS). This research study consists of the removal of redundant frames and retrieving of similar frames from remaining non-redundant frames based on a query image. Validation for the proposed scheme has been achieved by simulating the system for a standard dataset as well as videos captured ourselves. The results depict the efficacy of the system and provide a platform for benchmarking.

[1]  Bruce A. Draper,et al.  Introduction to the Bag of Features Paradigm for Image Classification and Retrieval , 2011, ArXiv.

[2]  S. Padmavathi,et al.  Feature detection for color images using SURF , 2017, 2017 4th International Conference on Advanced Computing and Communication Systems (ICACCS).

[3]  Shintaro Izumi,et al.  Architectural Study of HOG Feature Extraction Processor for Real-Time Object Detection , 2012, 2012 IEEE Workshop on Signal Processing Systems.

[4]  Abdolreza Rashno,et al.  Content-based image retrieval with color and texture features in neutrosophic domain , 2017, 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA).

[5]  S. Govindarajulu,et al.  A Comparison of SIFT, PCA-SIFT and SURF , 2012 .

[6]  Mitisha Narottambhai Patel,et al.  A Survey on Feature Extraction Techniques for Shape based Object Recognition , 2016 .

[7]  Wensheng Zou,et al.  Content-Based Image Retrieval using color and edge direction features , 2010, 2010 2nd International Conference on Advanced Computer Control.

[8]  Zhang Yanli,et al.  The research of video tracking based on improved SIFT algorithm , 2016, 2016 IEEE International Conference on Mechatronics and Automation.

[9]  Hamid R. Tizhoosh,et al.  A reinforcement agent for threshold fusion , 2008, Appl. Soft Comput..

[10]  Luo Juan,et al.  A comparison of SIFT, PCA-SIFT and SURF , 2009 .

[11]  A. K. Pal,et al.  Content based image retrieval using statistical features of color histogram , 2015, 2015 3rd International Conference on Signal Processing, Communication and Networking (ICSCN).

[12]  Xiaolong Ma,et al.  Global Reinforcement Learning in Neural Networks , 2007, IEEE Transactions on Neural Networks.

[13]  Monica Goyal,et al.  A Research Paper on Content Based Image Retrieval System using Improved SVM Technique , 2014 .

[14]  Maurício Pamplona Segundo,et al.  Automating 3D reconstruction pipeline by surf-based alignment , 2012, 2012 19th IEEE International Conference on Image Processing.

[15]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[16]  Javier A. Barria,et al.  Reinforcement Learning for Resource Allocation in LEO Satellite Networks , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  M. Emre Celebi,et al.  Improving the performance of k-means for color quantization , 2011, Image Vis. Comput..

[18]  Bhosale Swapnali,et al.  FEATURE EXTRACTION USING SURF ALGORITHM FOR OBJECT RECOGNITION , 2014 .

[19]  Muhammad Shoaib,et al.  Detection and classification of the breast abnormalities in Digital Mammograms via Linear Support Vector Machine , 2018, 2018 IEEE 4th Middle East Conference on Biomedical Engineering (MECBME).

[20]  Ah-Hwee Tan,et al.  Self-Organizing Neural Architectures and Cooperative Learning in a Multiagent Environment , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  J. Batlle,et al.  A behavior-based scheme using reinforcement learning for autonomous underwater vehicles , 2005, IEEE Journal of Oceanic Engineering.

[22]  Tapas K. Das,et al.  A Multiresolution Analysis-Assisted Reinforcement Learning Approach to Run-by-Run Control , 2007, IEEE Transactions on Automation Science and Engineering.

[23]  Sung Wook Baik,et al.  An efficient computerized decision support system for the analysis and 3D visualization of brain tumor , 2018, Multimedia Tools and Applications.