A hybrid approach to offloading mobile image classification

Current mobile devices are unable to execute complex vision applications in a timely and power efficient manner without offloading some of the computation. This paper examines the tradeoffs that arise from executing some of the workload onboard and some remotely. Feature extraction and matching play an essential role in image classification and have the potential to be executed locally. Along with advances in mobile hardware, understanding the computation requirements of these applications is essential to realize their full potential in mobile environments. We analyze the ability of a mobile platform to execute feature extraction and matching, and prediction workloads under various scenarios. The best configuration for optimal runtime (11% faster) executes feature extraction with a GPU onboard and offloads the rest of the pipeline. Alternatively, compressing and sending the image over the network achieves lowest data transferred (2.5× better) and lowest energy usage (3.7× better) than the next best option.

[1]  Deborah Estrin,et al.  Energy-Efficient Image Compression for Resource-Constrained Platforms , 2009, IEEE Transactions on Image Processing.

[2]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[4]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[5]  Xu Chen,et al.  COMET: Code Offload by Migrating Execution Transparently , 2012, OSDI.

[6]  Silvio Savarese,et al.  EFFEX: An embedded processor for computer vision based feature extraction , 2011, 2011 48th ACM/EDAC/IEEE Design Automation Conference (DAC).

[7]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[8]  Alec Wolman,et al.  MAUI: making smartphones last longer with code offload , 2010, MobiSys '10.

[9]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1992 .

[10]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[12]  王伟,et al.  Google Glass：解放双手 , 2013 .

[13]  Feng Qian,et al.  A close examination of performance and power characteristics of 4G LTE networks , 2012, MobiSys '12.

[14]  Sujit Dey,et al.  Adaptive image compression for wireless multimedia communication , 2001, ICC 2001. IEEE International Conference on Communications. Conference Record (Cat. No.01CH37240).