Mobile media communication, processing, and analysis: A review of recent advances

In this paper, we review recent advances in mobile media communication, processing, and analysis. To identify the opportunities and challenges in fast growing mobile media computing, we discuss several emerging topics including mobile visual search, retargeting, mobile video streaming, and cloud based mobile media computing. According to the infrastructure of mobile devices vs. servers, we come up with essential concerns in mobile media computing such as wireless bandwidth consumption, mobile energy saving, media adaptation for better quality of services, the computational load shift from mobiles to servers, etc. With booming mobile Apps on diverse media consumption, it is envisioned that mobile media research and development is bringing about significant achievements in traditional topics of communication, processing, and analytics.

[1]  Chia-Wen Lin,et al.  Maintaining Temporal Coherence in Video Retargeting Using Mosaic-Guided Scaling , 2011, IEEE Transactions on Image Processing.

[2]  Berna Erol,et al.  Paper-Based Augmented Reality , 2007, 17th International Conference on Artificial Reality and Telexistence (ICAT 2007).

[3]  Kui Gao,et al.  Real-Time Scheduling for Scalable Video Coding Streaming System , 2006, 2006 IEEE Sarnoff Symposium.

[4]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[5]  Qi Tian,et al.  Salient region detection and its application to video retargeting , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[6]  Aggelos K. Katsaggelos,et al.  Optimized Bit Extraction Using Distortion Modeling in the Scalable Extension of H.264/AVC , 2009, IEEE Transactions on Image Processing.

[7]  Jun Sun,et al.  On Rate-Distortion Modeling and Extraction of H.264/SVC Fine-Granular Scalable Video , 2009, IEEE Trans. Circuits Syst. Video Technol..

[8]  Bernd Girod,et al.  Mobile Visual Search , 2011, IEEE Signal Processing Magazine.

[9]  Bernd Girod,et al.  CHoG: Compressed histogram of gradients A low bit-rate feature descriptor , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  O. Sorkine,et al.  Motion-based video retargeting with optimized crop-and-warp , 2010, ACM Trans. Graph..

[12]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..

[13]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[14]  Aljoscha Smolic,et al.  Algorithm and VLSI architecture for real-time 1080p60 video retargeting , 2012, EGGH-HPG'12.

[15]  Jun Sun,et al.  Optimized bit extraction of SVC exploiting linear error model , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[16]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[17]  Thomas Wiegand,et al.  Mobile Video Transmission Using Scalable Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  L. A. Grieco,et al.  A scheduling strategy for P2P-TV systems using Scalable Video Coding , 2010, 2010 IEEE Globecom Workshops.

[19]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[20]  Markus Gross,et al.  A system for retargeting of streaming video , 2009, SIGGRAPH 2009.

[21]  Olga Sorkine-Hornung,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH Asia '08.

[22]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[23]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[24]  Berna Erol,et al.  HOTPAPER: multimedia interaction with paper using mobile phones , 2008, ACM Multimedia.

[25]  H. Seidel,et al.  Motion-aware temporal coherence for video resizing , 2009, SIGGRAPH 2009.

[26]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[27]  Hans-Peter Seidel,et al.  Motion-aware temporal coherence for video resizing , 2009, ACM Trans. Graph..

[28]  Markus H. Gross,et al.  A system for retargeting of streaming video , 2009, ACM Trans. Graph..

[29]  Michael Gleicher,et al.  Video retargeting: automating pan and scan , 2006, MM '06.

[30]  Chonho Lee,et al.  A survey of mobile cloud computing: architecture, applications, and approaches , 2013, Wirel. Commun. Mob. Comput..

[31]  Bernd Girod,et al.  Tree Histogram Coding for Mobile Image Matching , 2009, 2009 Data Compression Conference.

[32]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[33]  Stéphane Pateux,et al.  Optimized Rate-Distortion Extraction With Quality Layers in the Scalable Extension of H.264/AVC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Mathias Wien,et al.  Real-Time System for Adaptive Video Streaming Based on SVC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Jonathan J. Hull,et al.  Icandy: a tangible user interface for itunes , 2008, CHI Extended Abstracts.

[36]  Bernd Girod,et al.  Compression of image patches for local feature extraction , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[37]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Bernd Girod,et al.  Transform coding of image feature descriptors , 2009, Electronic Imaging.

[39]  Wen Gao,et al.  Location Discriminative Vocabulary Coding for Mobile Landmark Search , 2012, International Journal of Computer Vision.

[40]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[41]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[42]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .