Multimedia image and video retrieval based on an improved HMM

In today's information age, information is gathered from text and more complex media, such as images, audio, and video. Among these data sources, the rapid growth of video information has led to it to gradually become the main source of information in people's lives. Video information is characterized by many kinds of information, complex forms, and a low degree of structure. Therefore, effectively classifying, managing and retrieving video information has become a difficult problem to solve. In this paper, an improved crow search algorithm is used to process video images, and the information entropy is used to extract the key frames, which reduces the computation burden of each frame feature calculation and feature contrast process, thus shortening the key frame detection time. Then, all the feature sets are extracted and used as input for an HMM according to the observed sequence $$O = O_{1} ,O_{2} ,O_{3} , \cdot \cdot \cdot ,O_{T}$$ of the input image or video data and the initial model parameters $$\lambda = (\pi ,A,B)$$ . According to the training rules, the model parameters are repeatedly adjusted and modified, and the new model $$\overline{\lambda }$$ is constructed step by step to realize the retrieval of multimedia images and videos. The experimental results show that the method has obvious advantages in terms of the retrieval time and retrieval effect and provides new ideas for multimedia image and video retrieval.

[1]  B. Saleena,et al.  Multi-modal features and correlation incorporated Naive Bayes classifier for a semantic-enriched lecture video retrieval system , 2018 .

[2]  V. S. K. Reddy,et al.  High-Performance Video Retrieval Based on Spatio-Temporal Features , 2018 .

[3]  Zahid Mehmood,et al.  Content-Based Image Retrieval Based on Visual Words Fusion Versus Features Fusion of Local and Global Features , 2018 .

[4]  Mohit Kumar,et al.  Analytical fuzzy approach to biological data analysis , 2017, Saudi journal of biological sciences.

[5]  Shumin Zhang,et al.  Generation of Soliton Bursts With Flexibly Controlled Pulse Intervals Based on the Dispersive Fourier-Transform Technique , 2019, IEEE Journal of Selected Topics in Quantum Electronics.

[6]  George Awad,et al.  On Influential Trends in Interactive Video Retrieval: Video Browser Showdown 2015–2017 , 2018, IEEE Transactions on Multimedia.

[7]  Young-Koo Lee,et al.  Video Retrieval Based on Image Queries Using THOG for Augmented Reality Environments , 2018, 2018 IEEE International Conference on Big Data and Smart Computing (BigComp).

[8]  Yunde Jia,et al.  Heterogeneous Hashing Network for Face Retrieval Across Image and Video Domains , 2019, IEEE Transactions on Multimedia.

[9]  Azra Nasreen,et al.  Analysis of Video Content Through Object Search Using SVM Classifier , 2018 .

[10]  Saeid Nahavandi,et al.  Parallel deep solutions for image retrieval from imbalanced medical imaging archives , 2018, Appl. Soft Comput..

[11]  Rakcinpha Hatibaruah,et al.  An Efficient Multiscale Wavelet Local Binary Pattern for Biomedical Image Retrieval , 2018 .

[12]  Partha Pratim Roy,et al.  Local Neighborhood Intensity Pattern: A new texture feature descriptor for image retrieval , 2017, Expert Syst. Appl..

[13]  Mark W. Woolrich,et al.  Short timescale abnormalities in the states of spontaneous synchrony in the functional neural networks in Alzheimer's disease , 2018, NeuroImage: Clinical.

[14]  Xirong Li,et al.  Predicting Visual Features From Text for Image and Video Caption Retrieval , 2017, IEEE Transactions on Multimedia.

[15]  Weiping Zhang,et al.  Fuzzy theoretic approach to signals and systems: Static systems , 2017, Inf. Sci..

[16]  John See,et al.  Vehicle Semantics Extraction and Retrieval for Long-Term Carpark Video Surveillance , 2018, MMM.

[17]  Savvas A. Chatzichristofis,et al.  CoMo: a scale and rotation invariant compact composite moment-based descriptor for image retrieval , 2019, Multimedia Tools and Applications.

[18]  Linlin Liu,et al.  Sitcom-star-based clothing retrieval for video advertising: a deep learning framework , 2018, Neural Computing and Applications.

[19]  Ken Tomiyama,et al.  KANSEI GENERATOR USING HMM FOR VIRTUAL KANSEI IN CARETAKER SUPPORT ROBOT , 2009 .

[20]  Xiaochun Cao,et al.  CUNet: A Compact Unsupervised Network For Image Classification , 2018, IEEE Transactions on Multimedia.

[21]  R. Menaka,et al.  Computer-aided detection and characterization of stroke lesion – a short review on the current state-of-the art methods , 2018 .

[22]  Gwangil Jeon,et al.  Content Based Image Retrieval by Using Color Descriptor and Discrete Wavelet Transform , 2018, Journal of Medical Systems.

[23]  Jayaprakash Suraj Nandiganahalli,et al.  Automation Intent Inference Using the GFHMM for Flight Deck Mode Confusion Detection , 2018 .