Fast PDE-Based Image Analysis in Your Pocket

The increasing computing power of modern smartphones opens the door for interesting mobile image analysis applications. In this paper, we explore the arising possibilities but also discuss remaining challenges by implementing linear and nonlinear diffusion filters as well as basic variational optic flow approaches on a modern Android smartphone. To achieve low runtimes, we present a fast method for acquiring images from the built-in camera and focus on efficient solution strategies for the arising partial differential equations (PDEs): Linear diffusion is realised by approximating a Gaussian convolution by means of an iterated box filter. For nonlinear diffusion and optic flow estimation we use the recent fast explicit diffusion (FED) solver. Our experiments on a recent smartphone show that linear/nonlinear diffusion filters can be applied in realtime/near-realtime to images of size 176×144. Computing optic flow fields of a similar resolution requires some seconds, while achieving a reasonable quality.

[1]  Sheng Liang,et al.  Java Native Interface: Programmer's Guide and Reference , 1999 .

[2]  Dieter Schmalstieg,et al.  Multiple target detection and tracking with guaranteed framerates on mobile phones , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[3]  Dieter Schmalstieg,et al.  Real-time panoramic mapping and tracking on mobile phones , 2010, 2010 IEEE Virtual Reality Conference (VR).

[4]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[5]  Reto Meier Professional Android Application Development , 2008 .

[6]  ANDROID PLATFORM,et al.  Distributed Mobile Computer Vision and Applications on the Android Platform , 2009 .

[7]  G. Koepfler,et al.  A morphological scheme for mean curvature motion and applications to anisotropic diffusion and motion of level sets , 1995 .

[8]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[9]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[10]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[11]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Axel Pinz,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[13]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[14]  Étienne Dupuis Optimizing YUV-RGB Color Space Conversion Using Intel ’ s SIMD Technology , 2003 .

[15]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[16]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[17]  William M. Wells,et al.  Efficient Synthesis of Gaussian Filters by Cascaded Uniform Filters , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Joachim Weickert,et al.  From Box Filtering to Fast Explicit Diffusion , 2010, DAGM-Symposium.