Ieee Ipas'14: International Image Processing Applications and Systems Conference 2014 Image Processing on Mobile Devices: an Overview

Image processing technology has grown significantly over the past decade. Its application on low-power mobile devices has been the interest of a wide research group related to newly emerging contexts such as augmented reality, visual search, object recognition, and so on. With the emergence of general-purpose computing on embedded GPUs and their programming models like OpenGL ES 2.0 and OpenCL, mobile processors are gaining a more parallel computing capability. Thereby, the adaptation of these advancements for accelerating mobile image processing algorithms has become actually an important topical issue. In this paper, our interest is based on reviewing recent challenging tasks related to mobile image processing using both serial and parallel computing approaches in several emerging application contexts.

[1]  Marc Pollefeys,et al.  Handling Urban Location Recognition as a 2D Homothetic Problem , 2010, ECCV.

[2]  Dieter Schmalstieg,et al.  Real-Time Detection and Tracking for Augmented Reality on Mobile Phones , 2010, IEEE Transactions on Visualization and Computer Graphics.

[3]  N. A. Abdul Rahim,et al.  RGB-H-CbCr skin colour model for human face detection , 2006 .

[4]  Huizhong Chen,et al.  Robust text detection in natural images with edge-enhanced Maximally Stable Extremal Regions , 2011, 2011 18th IEEE International Conference on Image Processing.

[5]  Riri Fitri Sari,et al.  CLOUD COMPUTING SERVICES IN MOBILE DEVICES USING ANDROID FACE DETECTOR API AND REST COMMUNICATION , 2013 .

[6]  Keiji Yanai,et al.  Real-Time Mobile Food Recognition System , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Brian Hayes,et al.  What Is Cloud Computing? , 2019, Cloud Technologies.

[8]  Xianglong Liu,et al.  Search by mobile image based on visual and spatial consistency , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[9]  Chien-Hsing Chou,et al.  Implementation of Parallel Computing FAST Algorithm on Mobile GPU , 2014 .

[10]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[11]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[12]  Giovanni Maria Farinella,et al.  On the performances of computer vision algorithms on mobile platforms , 2012, Electronic Imaging.

[13]  Xin Chen,et al.  City-scale landmark identification on mobile devices , 2011, CVPR 2011.

[14]  Joseph R. Cavallaro,et al.  Computer Vision Accelerators for Mobile Systems based on OpenCL GPGPU Co-Processing , 2014, J. Signal Process. Syst..

[15]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[16]  Bernd Girod,et al.  CHoG: Compressed histogram of gradients A low bit-rate feature descriptor , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Florent Perronnin,et al.  Large-scale image categorization with explicit data embedding , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Ilias Maglogiannis,et al.  A Fast Mobile Face Recognition System for Android OS Based on Eigenfaces Decomposition , 2010, AIAI.

[19]  Rongrong Ji,et al.  Active query sensing for mobile location search , 2011, ACM Multimedia.

[20]  Kwang-Ting Cheng,et al.  Using mobile GPU for general-purpose computing – a case study of face recognition on smartphones , 2011, Proceedings of 2011 International Symposium on VLSI Design, Automation and Test.

[21]  Keiji Yanai,et al.  FoodCam: A Real-Time Mobile Food Recognition System Employing Fisher Vector , 2014, MMM.

[22]  Keiji Yanai,et al.  FoodCam: A real-time food recognition system on a smartphone , 2015, Multimedia Tools and Applications.

[23]  Natasha Gelfand,et al.  SURFTrac: Efficient tracking and continuous object recognition using local feature descriptors , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Bernd Girod,et al.  Comparison of local feature descriptors for mobile visual search , 2010, 2010 IEEE International Conference on Image Processing.

[25]  Gang Yang,et al.  A Real-Time Face Recognition System for Android Smart Phone , 2013 .

[26]  Huizhong Chen,et al.  Mobile visual search using image and text features , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[27]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[28]  A. Joseph,et al.  Skin color segmentation in mobile platform , 2010, 2010 IEEE Symposium on Industrial Electronics and Applications (ISIEA).

[29]  In Kyu Park,et al.  Implementation and Optimization of Image Processing Algorithms on Embedded GPU , 2012, IEICE Trans. Inf. Syst..

[30]  David W. Murray,et al.  Parallel Tracking and Mapping on a camera phone , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[31]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[32]  Jyrki Leskela,et al.  OpenCL embedded profile prototype in mobile device , 2009, 2009 IEEE Workshop on Signal Processing Systems.

[33]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[34]  Vladimir Kolmogorov,et al.  Spatially coherent clustering using graph cuts , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[35]  Chung-Chih Hung,et al.  −65dBHD3 CMOS tunable OTA with mobility reduction compensation , 2011, Proceedings of 2011 International Symposium on VLSI Design, Automation and Test.

[36]  Miao Liao,et al.  Real-time Global Stereo Matching Using Hierarchical Belief Propagation , 2006, BMVC.

[37]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[39]  Rajkumar Buyya,et al.  Cloud Computing Principles and Paradigms , 2011 .

[40]  John D. Owens,et al.  GPU Computing , 2008, Proceedings of the IEEE.

[41]  Sungdae Cho,et al.  Implementation and optimization of image processing algorithms on handheld GPU , 2010, 2010 IEEE International Conference on Image Processing.

[42]  Subhadip Basu,et al.  Segmentation of Camera Captured Business Card Images for Mobile Devices , 2011, ArXiv.

[43]  Joseph R. Cavallaro,et al.  Accelerating computer vision algorithms using OpenCL framework on the mobile GPU - A case study , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[44]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[45]  Keiji Yanai,et al.  Real-time mobile recipe recommendation system using food ingredient recognition , 2012, IMMPD '12.

[46]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[47]  Lin Sun,et al.  Performance characterization and acceleration of Optical Character Recognition on handheld platforms , 2010, IEEE International Symposium on Workload Characterization (IISWC'10).

[48]  In Kyu Park,et al.  Design and optimization of image processing algorithms on mobile GPU , 2011, SIGGRAPH '11.

[49]  Honggang Zhang,et al.  A foreground segmentation method for mobile image retrieval system , 2012, 2012 3rd IEEE International Conference on Network Infrastructure and Digital Content.

[50]  Linda G. Shapiro,et al.  Fast interactive image segmentation by discriminative clustering , 2010, MCMC '10.

[51]  Chong-Ho Choi,et al.  Selective generation of Gabor features for fast face recognition on mobile devices , 2013, Pattern Recognit. Lett..

[52]  Stefano Soatto,et al.  Learning and matching multiscale template descriptors for real-time detection, localization and tracking , 2011, CVPR 2011.

[53]  Xin Yang,et al.  Accelerating SURF detector on mobile devices , 2012, ACM Multimedia.

[54]  Huizhong Chen,et al.  Combining image and text features: a hybrid approach to mobile book spine recognition , 2011, ACM Multimedia.

[55]  Stefan Schlechtweg,et al.  Non-photorealistic computer graphics: modeling, rendering, and animation , 2002 .

[56]  Zhen Fang,et al.  Accelerating mobile augmented reality on a handheld platform , 2009, 2009 IEEE International Conference on Computer Design.

[57]  Kurt Konolige,et al.  CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching , 2008, ECCV.

[58]  Yang Wang,et al.  JIGSAW: interactive mobile visual search with multimodal queries , 2011, ACM Multimedia.

[59]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  R. Zabih,et al.  Spatially coherent clustering using graph cuts , 2004, CVPR 2004.

[61]  Xin Yang,et al.  LDB: An ultra-fast feature for scalable Augmented Reality on mobile devices , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[62]  Olli Silvén,et al.  Accelerating image recognition on mobile devices using GPGPU , 2011, Electronic Imaging.

[63]  Kari Pulli,et al.  Real-time computer vision with OpenCV , 2012, Commun. ACM.

[64]  Seung-Jae Lee,et al.  Parallelization and Optimization of Feature Detection Algorithms on Embedded GPU , 2014 .

[65]  J. Roy,et al.  Understanding Web services , 2001 .

[66]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  Seth Hall,et al.  GPU-based Image Analysis on Mobile Devices , 2011, ArXiv.

[68]  Dieter Schmalstieg,et al.  ARToolKitPlus for Pose Trackin on Mobile Devices , 2007 .

[69]  Dieter Schmalstieg,et al.  Real-time panoramic mapping and tracking on mobile phones , 2010, 2010 IEEE Virtual Reality Conference (VR).

[70]  Tomas Akenine-Möller,et al.  Graphics Processing Units for Handhelds , 2008, Proc. IEEE.

[71]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Bin Chen,et al.  A fast face recognition system on mobile phone , 2012, 2012 International Conference on Systems and Informatics (ICSAI2012).

[73]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[74]  Bruno Motta de Carvalho,et al.  Real Time Interactive Image Segmentation Using User Indicated Real-World Seeds , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[75]  Daniel González-Jiménez,et al.  Built-in face recognition for smart photo sharing in mobile devices , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[76]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[77]  Joseph R. Cavallaro,et al.  A fast and efficient sift detector using the mobile GPU , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[78]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[79]  Huizhong Chen,et al.  Mobile visual search on printed documents using text and low bit-rate features , 2011, 2011 18th IEEE International Conference on Image Processing.

[80]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[81]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[82]  Horst W. Haussecker,et al.  An Augmented Reality Tourist Guide on Your Mobile Devices , 2010, MMM.

[83]  Zhen Fang,et al.  Performance characterization and optimization of mobile augmented reality on handheld platforms , 2009, 2009 IEEE International Symposium on Workload Characterization (IISWC).

[84]  Guy-Richard Kayombya,et al.  SIFT feature extraction on a Smartphone GPU using OpenGL ES2.0 , 2010 .

[85]  Xudong Jiang,et al.  A fast and accurate cascade subspace face/eye detector on mobile devices , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[86]  K. K. More,et al.  Interactive Multimodal Visual Search on Mobile Device , 2015 .

[87]  Jaeyoung Kim,et al.  Implementation of image processing and augmented reality programs for smart mobile device , 2011, Proceedings of 2011 6th International Forum on Strategic Technology.

[88]  Dieter Schmalstieg,et al.  Multiple target detection and tracking with guaranteed framerates on mobile phones , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[89]  Dieter Schmalstieg,et al.  History and Future of Tracking for Mobile Phone Augmented Reality , 2009, 2009 International Symposium on Ubiquitous Virtual Reality.

[90]  Gerhard Reitmayr,et al.  A GPGPU accelerated descriptor for mobile devices , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[91]  T. Yung Kong,et al.  Simultaneous fuzzy segmentation of multiple objects , 2003, Discret. Appl. Math..

[92]  Dieter Schmalstieg,et al.  Pose tracking from natural features on mobile phones , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[93]  Andrew Zisserman,et al.  Efficient Additive Kernels via Explicit Feature Maps , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[94]  J. Canny.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[95]  Bernd Girod,et al.  Mobile Visual Search , 2011, IEEE Signal Processing Magazine.

[96]  Yang Wang,et al.  Interactive Multimodal Visual Search on Mobile Device , 2013, IEEE Transactions on Multimedia.