BESSI: an experimentation system for vision module evaluation

In past years, the complexity of computer vision software systems has grown considerably. As in other software development areas, there is a need for accurate descriptions of system behavior in practical situations. One element is software documentation, another more important one is the performance for various data inputs. These descriptions are essential for maintainability and successful application of software in the long term. We present an experimentation system for the evaluation of computer vision modules. The system is capable of collecting data, executing experiments and analysing the generated data. In the paper the architecture of BESSI is discussed and the system is illustrated by an example.

[1]  Robert M. Haralick,et al.  Performance Characterization in Computer Vision , 1993, BMVC.

[2]  John Rasure,et al.  The Khoros Application Development Environment , 1994 .

[3]  Robert M. Haralick.  Performance Characterization in Computer Vision , 1992, BMVC.

[4]  Michael Stonebraker.  The Miro DBMS , 1993, SIGMOD '93.

[5]  D.A. Reed,et al.  An Integrated Compilation and Performance Analysis Environment for Data Parallel Programs , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[6]  D.A. Reed,et al.  Scalable performance analysis: the Pablo performance analysis environment , 1993, Proceedings of Scalable Parallel Libraries Conference.

[7]  Arnold W. M. Smeulders,et al.  Systems for map recognition: methods engineering , 1995 .

[8]  Joe L. Mundy,et al.  The development of the Image Understanding Environment , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  David A. Wood,et al.  Cache profiling and the SPEC benchmarks: a case study , 1994, Computer.

[10]  Robert M. Haralick,et al.  A quantitative methodology for analyzing the performance of detection algorithms , 1993, 1993 (4th) International Conference on Computer Vision.

[11]  Carolyn Turbyfill,et al.  A retrospective on the Wisconsin Benchmark , 1994 .

[12]  Donald J. Gerson,et al.  RADIUS phase II: the RADIUS test-bed system , 1996, Other Conferences.

[13]  Eben M. Haber,et al.  Bulletin of the Technical Committee on Data Engineering Special Issue on Scientific Databases Conference and Journal Notices Editorial Board Editor-in-chief Tc Executive Committee Important Membership Message Electronic Enrollment Procedure Alternative Enrollment Procedure the Evolution of the Bulle , 2022 .

[14]  Thomas S. Huang,et al.  Performance of computer vision algorithms , 1994 .

[15]  Martin Kersten,et al.  Calibration of a DBMS using the Software Testpilot , 1995 .