Towards a General Abstraction through Sequences of Conceptual Operations

Computer vision is a complex field which can be challenging for those outside the research community to apply in the real world. To address this we present a novel formulation for the abstraction of computer vision problems above algorithms, as part of our OpenVL framework. We have created a set of fundamental operations which form a basis from which we can build up descriptions of computer vision methods. We use these operations to conceptually define the problem, which we can then map into algorithm space to choose an appropriate method to solve the problem. We provide details on three of our operations, Match, Detect and Solve, and subsequently demonstrate the flexibility of description these three offer us. We describe various vision problems such as image registration and tracking through the sequencing of our operations and discuss how these may be extended to cover a larger range of tasks, which in turn may be used analogously to a graphics shader language.

[1]  Sidney S. Fels,et al.  Mapping the Problem Space of Image Registration , 2011, 2011 Canadian Conference on Computer and Robot Vision.

[2]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  Tom Davis,et al.  Opengl programming guide: the official guide to learning opengl , 1993 .

[4]  Sidney S. Fels,et al.  Hive: A distributed system for vision processing , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[5]  Leon G. Higley,et al.  Forensic Entomology: An Introduction , 2009 .

[6]  Sidney S. Fels,et al.  Towards a computer vision shader language , 2011, SIGGRAPH '11.

[7]  Paul Hudak,et al.  FVision: A Declarative Language for Visual Tracking , 2001, PADL.

[8]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[9]  Sidney S. Fels,et al.  Vision System Development through Separation of Management and Processing , 2009, 2009 11th IEEE International Symposium on Multimedia.

[10]  Joe L. Mundy,et al.  The development of the Image Understanding Environment , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Konstantinos Konstantinides,et al.  The Khoros software development environment for image and signal processing , 1994, IEEE Trans. Image Process..

[12]  Joseph L. Mundy The Image Understanding Environment Program , 1995, IEEE Expert.

[13]  A. Fitzgibbon Stochastic rigidity: image registration for nowhere-static scenes , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[14]  Giorgio Panin,et al.  Model-based Visual Tracking: The OpenTL Framework , 2011 .

[15]  Jerry L. Prince,et al.  Stochastic formulations of optical flow algorithms under variable brightness conditions , 1995, Proceedings., International Conference on Image Processing.

[16]  Marinette Revenu,et al.  Borg: A Knowledge-Based System for Automatic Generation of Image Processing Programs , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  J.D. Day,et al.  The OSI reference model , 1983 .

[18]  Stochastic Rigidity: Image Registration for Nowhere-Static Scenes , 2001, ICCV.

[19]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[20]  Sidney S. Fels,et al.  A Conceptual Structure for Computer Vision , 2011, 2011 Canadian Conference on Computer and Robot Vision.

[21]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[22]  David G. Lowe,et al.  Vista: a software environment for computer vision research , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Sidney S. Fels,et al.  Uniform access to the cameraverse , 2010, ICDSC '10.

[24]  Takashi Matsuyama,et al.  SIGMA: A Framework for Image Understanding - Integration of Bottom-Up and Top-Down Analysis , 1985, IJCAI.

[25]  システムソフトエンジニアリング OpenGL programming guide(日本語版) : the official guide to learning OpenGL, release 1 , 1993 .