User Adaptive Video Summarization

Video Summarization shortens a video content by extracting the most significant part from it and presenting the extracted contents in a summarized form that maybe a collection of keyframes or key shots in temporal sequence. In the recent past, various techniques have been suggested for automatic summarization of videos. It has been observed that summarization of videos is a subjective task and the traditional approaches of summarization though, are capable of generating generic summaries but are often incapable of generating the most appropriate and customized summary as desired by the user. A user intuitive and adaptive approach enables to summarize the video as per the preference of the user. In this paper, we discuss various frameworks for generating a user preference-based summary from a video. We explore the possible approaches and techniques available for generating a user adaptive video summary and present a comparative analysis of the techniques to provide an insight to the researchers working in this area.

[1]  M. Ahmad,et al.  An Effective Video Summarization Framework Based on the Object of Interest Using Deep Learning , 2022, Mathematical Problems in Engineering.

[2]  Jiwen Lu,et al.  Learning multiscale hierarchical attention for video summarization , 2022, Pattern Recognit..

[3]  Sheng-hua Zhong,et al.  Deep hierarchical LSTM networks with attention for video summarization , 2022, Comput. Electr. Eng..

[4]  Cláudio T. Silva,et al.  IntentVizor: Towards Generic Query Guided Interactive Video Summarization , 2021, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  C. Bhatnagar,et al.  Automatic Caption Generation via Attention Based Deep Neural Network Model , 2021, 2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO).

[6]  Charul Bhatnagar,et al.  A survey of recent work on video summarization: approaches and techniques , 2021, Multimedia Tools and Applications.

[7]  Charul Bhatnagar,et al.  Image Conditioned Keyframe-Based Video Summarization Using Object Detection , 2020, ArXiv.

[8]  Jaspal Subhlok,et al.  Visual Summarization of Lecture Video Segments for Enhanced Navigation , 2020, 2020 IEEE International Symposium on Multimedia (ISM).

[9]  Zijian Zhang,et al.  Query-Biased Self-Attentive Network for Query-Focused Video Summarization , 2020, IEEE Transactions on Image Processing.

[10]  Waqar Ali,et al.  Content-Aware Summarization of Broadcast Sports Videos: An Audio–Visual Feature Extraction Approach , 2020, Neural Processing Letters.

[11]  Priyanka Sharma,et al.  Survey of Compressed Domain Video Summarization Techniques , 2019, ACM Comput. Surv..

[12]  Xuelong Li,et al.  Video Summarization With Attention-Based Encoder–Decoder Networks , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Heuiseok Lim,et al.  A semantic-based video scene segmentation using a deep neural network , 2019, J. Inf. Sci..

[14]  Binsu C. Kovoor,et al.  Towards genre-specific frameworks for video summarisation: A survey , 2019, J. Vis. Commun. Image Represent..

[15]  Sung Wook Baik,et al.  Movie scene segmentation using object detection and set theory , 2019, Int. J. Distributed Sens. Networks.

[16]  Sung Wook Baik,et al.  Personalized Movie Summarization Using Deep CNN-Assisted Facial Expression Recognition , 2019, Complex..

[17]  Xuelong Li,et al.  Query-aware sparse coding for web multi-video summarization , 2019, Inf. Sci..

[18]  Michael Kampffmeyer,et al.  Deep Reinforcement Learning for Query-Conditioned Video Summarization , 2019, Applied Sciences.

[19]  Naokazu Yokoya,et al.  Summarization of User-Generated Sports Video by Using Deep Action Recognition Features , 2017, IEEE Transactions on Multimedia.

[20]  Boqing Gong,et al.  Query-Focused Video Summarization: Dataset, Evaluation, and a Memory Network Based Approach , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Luc Van Gool,et al.  Query-adaptive Video Summarization via Quality-aware Relevance Estimation , 2017, ACM Multimedia.

[22]  Vania Bogorny,et al.  Toward Abnormal Trajectory and Event Detection in Video Surveillance , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Mubarak Shah,et al.  Improved scene identification and object detection on egocentric vision of daily activities , 2017, Comput. Vis. Image Underst..

[24]  Guoliang Lu,et al.  Unsupervised, efficient and scalable key-frame selection for automatic summarization of surveillance videos , 2017, Multimedia Tools and Applications.

[25]  Yong Jae Lee,et al.  Predicting Important Objects for Egocentric Video Summarization , 2015, International Journal of Computer Vision.

[26]  Chinh T. Dang,et al.  Heterogeneity Image Patch Index and Its Application to Consumer Video Summarization , 2014, IEEE Transactions on Image Processing.

[27]  Vilas Naik,et al.  Entropy Based Fuzzy C Means Clustering and Key Frame Extraction for Sports Video Summarization , 2014, 2014 Fifth International Conference on Signal and Image Processing.

[28]  Muhammad Shakir,et al.  Video Summarization: Techniques and Classification , 2012, ICCVG.

[29]  Wei-Ta Chu,et al.  Editing by Viewing: Automatic Home Video Summarization by Viewing Behavior Analysis , 2011, IEEE Transactions on Multimedia.

[30]  Nicu Sebe,et al.  Exploiting facial expressions for affective video summarisation , 2009, CIVR '09.

[31]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[32]  Tiecheng Liu,et al.  Summarization of Visual Content in Instructional Videos , 2007, IEEE Transactions on Multimedia.