An effective and efficient approximate two-dimensional dynamic programming algorithm for supporting advanced computer vision applications

Abstract Dynamic programming is a popular optimization technique, developed in the 60’s and still widely used today in several fields for its ability to find global optimum. Dynamic Programming Algorithms (DPAs) can be developed in many dimension. However, it is known that if the DPA dimension is greater or equal to two, the algorithm is an NP complete problem. In this paper we present an approximation of the fully two-dimensional DPA (2D-DPA) with polynomial complexity. Then, we describe an implementation of the algorithm on a recent parallel device based on CUDA architecture. We show that our parallel implementation presents a speed-up of about 25 with respect to a sequential implementation on an Intel I7 CPU. In particular, our system allows a speed of about ten 2D-DPA executions per second for 85 × 85 pixels images. Experiments and case studies support our thesis.

[1]  Peter J. Stuckey,et al.  Lock-free parallel dynamic programming , 2010, J. Parallel Distributed Comput..

[2]  Margrit Betke,et al.  Global optimization for coupled detection and data association in multiple object tracking , 2016, Comput. Vis. Image Underst..

[3]  Maguelonne Teisseire,et al.  Natural Language Processing and Information Systems , 2014, Lecture Notes in Computer Science.

[4]  岩本 誠一.  On Bynamic Programming , 1992 .

[5]  Alfredo Cuzzocrea,et al.  Data warehousing and OLAP over big data: current challenges and future research directions , 2013, DOLAP '13.

[6]  André Csillaghy,et al.  A computer vision approach to mining big solar data , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[7]  Weidong Huang,et al.  Evaluating esthetics for user-sketched layouts of clustered graphs with known clustering information , 2016, J. Vis. Lang. Comput..

[8]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[9]  Vadim Mottl,et al.  Pattern recognition in interrelated data: the problem, fundamental assumptions, recognition algorithms , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[10]  Leila Ribeiro,et al.  User interfaces metamodel based on graphs , 2016, J. Vis. Lang. Comput..

[11]  Kang Zhang,et al.  Enabling decision trend analysis with interactive scatter plot matrices visualization , 2016, J. Vis. Lang. Comput..

[12]  Ramin Zabih,et al.  Dynamic Programming and Graph Algorithms in Computer Vision , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ramesh C. Jain,et al.  Using Dynamic Programming for Solving Variational Problems in Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Oscar E. Ruiz,et al.  Realtime Dense Stereo Matching with Dynamic Programming in CUDA , 2009, CEIG.

[15]  Yiannis Kompatsiaris,et al.  Activity detection using Sequential Statistical Boundary Detection (SSBD) , 2016, Comput. Vis. Image Underst..

[16]  Miguel Angel Ferrer-Ballester,et al.  Interdigital palm region for biometric identification , 2016, Comput. Vis. Image Underst..

[17]  Alex Waibel,et al.  Readings in speech recognition , 1990 .

[18]  Seiichi Uchida,et al.  An Efficient Two-Dimensional Warping Algorithm , 1999 .

[19]  Enzo Mumolo.  Spectral domain texture analysis for speech enhancement , 2002, Pattern Recognit..

[20]  Alfredo Cuzzocrea,et al.  Hand-OLAP: a system for delivering OLAP services on handheld devices , 2003, The Sixth International Symposium on Autonomous Decentralized Systems, 2003. ISADS 2003..

[21]  Alberto Fernández Villán,et al.  A Real-Time Big Data Architecture for Glasses Detection Using Computer Vision Techniques , 2015, 2015 3rd International Conference on Future Internet of Things and Cloud.

[22]  Olga Veksler,et al.  Stereo correspondence by dynamic programming on a tree , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Masaki Nakagawa,et al.  'Online recognition of Chinese characters: the state-of-the-art , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Gonzalo Navarro,et al.  A guided tour to approximate string matching , 2001, CSUR.

[25]  Pattern recognition in interrelated data: the problem, fundamental assumptions, recognition algorithms , 2004, ICPR 2004.

[26]  Birger Andersson,et al.  Natural Language Processing and Information Systems , 2003, Lecture Notes in Computer Science.

[27]  Alfredo Cuzzocrea.  Analytics over Big Data: Exploring the Convergence of DataWarehousing, OLAP and Data-Intensive Cloud Infrastructures , 2013, 2013 IEEE 37th Annual Computer Software and Applications Conference.

[28]  Koji Nakano,et al.  Accelerating the Dynamic Programming for the Optimal Polygon Triangulation on the GPU , 2012, ICA3PP.

[29]  Seiichi Uchida,et al.  SURVEY PAPER Special Section on Document Image Understanding and Digital Documents A Survey of Elastic Matching Techniques for Handwritten Character Recognition , 2005 .

[30]  Minglun Gong,et al.  Real-Time Stereo Matching Using Orthogonal Reliability-Based Dynamic Programming , 2007, IEEE Transactions on Image Processing.

[31]  Yunhao Liu,et al.  Big Data: A Survey , 2014, Mob. Networks Appl..

[32]  Simon R. Arridge,et al.  A survey of hierarchical non-linear medical image registration , 1999, Pattern Recognit..

[33]  Edward Angel,et al.  Dynamic programming for noncausal problems , 1981 .

[34]  Mehmet A. Orgun,et al.  Classifying high dimensional data by interactive visual analysis , 2016, J. Vis. Lang. Comput..

[35]  Roberto Pieraccini,et al.  Dynamic planar warping for optical character recognition , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[36]  Cheng Lei,et al.  Region-Tree Based Stereo Using Dynamic Programming Optimization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[37]  James She,et al.  Connection Discovery Using Big Data of User-Shared Images in Social Media , 2015, IEEE Transactions on Multimedia.

[38]  Alfredo Cuzzocrea,et al.  On Managing Very Large Sensor-Network Data Using Bigtable , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[39]  Marc Berthod,et al.  Subpixel contour matching using continuous dynamic programming , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Pietro Perona,et al.  Continuous dynamic time warping for translation-invariant curve alignment with applications to signature verification , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[41]  Andrew W. Fitzgibbon,et al.  Interactive Feature Tracking using K-D Trees and Dynamic Programming , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[42]  Seiichi Uchida,et al.  A monotonic and continuous two-dimensional warping based on dynamic programming , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[43]  Daniel Keysers,et al.  Elastic image matching is NP-complete , 2003, Pattern Recognit. Lett..

[44]  Hermann Ney,et al.  Deformation Models for Image Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Robert Giegerich,et al.  GPU Parallelization of Algebraic Dynamic Programming , 2009, PPAM.

[46]  Wu-chun Feng,et al.  Optimizing Dynamic Programming on Graphics Processing Units via Adaptive Thread-Level Parallelism , 2011, 2011 IEEE 17th International Conference on Parallel and Distributed Systems.

[47]  Yaokai Feng,et al.  Analytical Dynamic Programming Tracker , 2010, ACCV.

[48]  Anil K. Jain,et al.  FVC2002: Second Fingerprint Verification Competition , 2002, Object recognition supported by user interaction for service robots.

[49]  Tianzi Jiang,et al.  A modified Gabor filter design method for fingerprint image enhancement , 2003, Pattern Recognit. Lett..

[50]  Ling Shao,et al.  Recognising occluded multi-view actions using local nearest neighbour embedding , 2016, Comput. Vis. Image Underst..

[51]  Ross T. Smith,et al.  Situated Analytics: Demonstrating immersive analytical tools with Augmented Reality , 2016, J. Vis. Lang. Comput..

[52]  Jing Wang,et al.  Spatio-temporal texture modelling for real-time crowd anomaly detection , 2016, Comput. Vis. Image Underst..