Tiny GAs for image processing applications

The expedience of today's image-processing applications is no longer based on the performance of a single algorithm alone. These systems appear to be complex frameworks with a lot of sub-tasks that are solved by specific algorithms, adaptation procedures, data handling, scheduling, and parameter choices. The venture of using computational intelligence (CI) in such a context, thus, is not a matter of a single approach. Among the great choice of techniques to inject CI in an image-processing framework, the primary focus of this presentation will be on the usage of so-called tiny-GAs. This stands for an evolutionary procedure with low efforts, i.e. small population size (like 10 individuals), little number of generations, and a simple fitness. Obviously, this is not suitable for solving highly complex optimization tasks, but the primary interest here is not the best individual's fitness, but the fortune of the algorithm and its population, which has just escaped the Monte-Carlo domain after random initialization. That this approach can work in practice will be demonstrated by means of selected image-processing applications, especially in the context of linear regression and line fitting; evolutionary post processing of various clustering results, in order to select a most suitable one by similarity; and classification by the fitness values obtained after a few generations

[1]  Tomoharu Nagao,et al.  Automatic construction of tree-structural image transformation using genetic programming , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[2]  Stefano Rizzi,et al.  Topological clustering of maps using a genetic algorithm , 1995, Pattern Recognit. Lett..

[3]  Christian Roux,et al.  Registration of 3-D images by genetic optimization , 1995, Pattern Recognit. Lett..

[4]  Farhad Samadzadegan,et al.  Automatic 3D object recognition and reconstruction based on neuro-fuzzy modelling , 2005 .

[5]  Jeng-Shyang Pan,et al.  Genetic watermarking based on transform-domain techniques , 2004, Pattern Recognit..

[6]  Yaodong Wang,et al.  Detection of geometric shapes by the combination of genetic algorithm and subpixel accuracy , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[7]  Tomoharu Nagao,et al.  Automatic construction of image transformation processes using genetic algorithm , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[8]  Ja-Chen Lin,et al.  Image hiding by optimal LSB substitution and genetic algorithm , 2001, Pattern Recognit..

[9]  C. A. Coello Coello,et al.  Evolutionary multi-objective optimization: a historical view of the field , 2006, IEEE Computational Intelligence Magazine.

[10]  Suman K. Mitra,et al.  Technique for fractal image compression using genetic algorithm , 1998, IEEE Trans. Image Process..

[11]  Dietmar Saupe,et al.  Evolutionary fractal image compression , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[12]  D. E. Goldberg,et al.  Genetic Algorithms in Search, Optimization & Machine Learning , 1989 .

[13]  Shinji Watanabe,et al.  Effects of Bayesian predictive classification using variational Bayesian posteriors for sparse training data in speech recognition , 2005, INTERSPEECH.

[14]  Masaaki Nagata,et al.  Efficient Decoding for Statistical Machine Translation with a Fully Expanded WFST Model , 2004, EMNLP.

[15]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[16]  Atsushi Nakamura,et al.  Generalized fast on-the-fly composition algorithm for WFST-based speech recognition , 2005, INTERSPEECH.

[17]  Essam A. El-Kwae,et al.  Edge detection in medical images using a genetic algorithm , 1998, IEEE Transactions on Medical Imaging.

[18]  Katrin Franke,et al.  The influence of physical and biomechanical processes on the ink trace. Methodological foundations for the forensic analysis of signatures , 2005 .

[19]  Erik McDermott,et al.  Discriminative Training for Speech Recognition , 1997 .

[20]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[21]  Naonori Ueda,et al.  Variational bayesian estimation and clustering for speech recognition , 2004, IEEE Transactions on Speech and Audio Processing.

[22]  Minglun Gong,et al.  Genetic-Based Stereo Algorithm and Disparity Map Evaluation , 2002, International Journal of Computer Vision.

[23]  Suchendra M. Bhandarkar,et al.  An edge detection technique using genetic algorithm-based optimization , 1994, Pattern Recognit..

[24]  Jarmo T. Alander,et al.  An Indexed Bibliography of Genetic Algorithms , 1995 .

[25]  Qiang Ji,et al.  Camera calibration with genetic algorithms , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[26]  Dimitri Van De Ville,et al.  Noise reduction by fuzzy image filtering , 2003, IEEE Trans. Fuzzy Syst..

[27]  Mario Köppen,et al.  Genetic Algorithm Based Heuristic Measure for Pattern Similarity in Kirlian Photographs , 2001, EvoWorkshops.

[28]  Edwin R. Hancock,et al.  Recognising building patterns using matched filters and genetic search , 1998 .

[29]  Hagai Attias,et al.  Inferring Parameters and Structure of Latent Variable Models by Variational Bayes , 1999, UAI.

[30]  Takaaki Hori,et al.  Speech summarization using weighted finite-state transducers , 2003, INTERSPEECH.

[31]  Jin-Jang Leou,et al.  Detection and concealment of transmission errors in MPEG-2 images-a genetic algorithm approach , 1999, IEEE Trans. Circuits Syst. Video Technol..

[32]  Jerzy W. Bala,et al.  Visual routine for eye detection using hybrid genetic architectures , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[33]  Cedric Nishan Canagarajah,et al.  Genetic stereo matching using complex conjugate wavelet pyramids , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[34]  Chang-Tsun Li,et al.  Unsupervised texture segmentation using multiresolution hybrid genetic algorithm , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[35]  Lawrence Carin,et al.  Genetic Algorithm Wavelet Design for Signal Classification , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[37]  Mario Köppen,et al.  Concurrent Application of Genetic Algorithm in Pattern Recognition , 2003, HIS.

[38]  Claudio De Stefano,et al.  Exploiting reliability for dynamic selection of classi .ers by means of genetic algorithms , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[39]  Ki-Sang Hong,et al.  Road detection in spaceborne SAR images using a genetic algorithm , 2002, IEEE Trans. Geosci. Remote. Sens..

[40]  Miki Haseyama,et al.  A genetic-algorithm based quantization method for fractal image coding , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[41]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[42]  Luiz Eduardo Soares de Oliveira,et al.  Feature selection using multi-objective genetic algorithms for handwritten digit recognition , 2002, Object recognition supported by user interaction for service robots.

[43]  Philippe Andrey,et al.  Unsupervised image segmentation using a distributed genetic algorithm , 1994, Pattern Recognit..

[44]  Mohamed S. Kamel,et al.  A genetic algorithm for the estimation of ridges in fingerprints , 1999, IEEE Trans. Image Process..

[45]  Christophe Garcia,et al.  Convolutional face finder: a neural architecture for fast and robust face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Mario Köppen,et al.  A System for the Automated Evaluation of Invoices , 1996, DAS.

[47]  Stephen Marshall,et al.  Parallel genetic algorithms in the optimization of morphological filters: a general design tool , 1997, J. Electronic Imaging.

[48]  Joshua D. Knowles,et al.  Bounded archiving using the lebesgue measure , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[49]  Shigeru Katagiri,et al.  String-level MCE for continuous phoneme recognition , 1997, EUROSPEECH.

[50]  Una-May O'Reilly,et al.  Genetic Programming II: Automatic Discovery of Reusable Programs. , 1994, Artificial Life.

[51]  Biing-Hwang Juang,et al.  Pattern recognition using a family of design algorithms based upon the generalized probabilistic descent method , 1998, Proc. IEEE.

[52]  Naonori Ueda,et al.  Bayesian model search for mixture models based on optimizing variational bounds , 2002, Neural Networks.

[53]  Hiromitsu Yamada,et al.  Automatic acquisition of hierarchical mathematical morphology procedures by genetic algorithms , 1999, Image Vis. Comput..

[54]  Katrin Franke,et al.  Fuzzy-Pareto-Dominance Driven Multiobjective Genetic Algorithm , 2003 .

[55]  Shigeru Katagiri,et al.  Minimum classification error for large scale speech recognition tasks using weighted finite state transducers , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[56]  Jonathan Le Roux,et al.  Discriminative Training for Large-Vocabulary Speech Recognition Using Minimum Classification Error , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[57]  Tomoharu Nagao,et al.  Automatic construction of tree-structural image transformations using genetic programming , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[58]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[59]  Shinji Watanabe,et al.  Acoustic Model Adaptation Based on Coarse/Fine Training of Transfer Vectors Using Directional Statistics , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[60]  Shinji Watanabe,et al.  Automatic determination of acoustic model topology using variational Bayesian estimation and clustering for large vocabulary continuous speech recognition , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[61]  M. Anastasio,et al.  Multiobjective genetic optimization of diagnostic classifiers with implications for generating receiver operating characteristic curves , 1999, IEEE Transactions on Medical Imaging.

[62]  S. Sengupta,et al.  Robust camera parameter estimation using genetic algorithm , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[63]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[64]  Michael C. Fairhurst,et al.  Optimisation of multiple classifier systems using genetic algorithms , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[65]  P.W.M. Tsang,et al.  Genetic algorithm for model-based matching of projected images of three-dimensional objects , 2003 .

[66]  Byung Ro Moon,et al.  Hybrid Genetic Algorithms for Feature Selection , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[67]  Takaaki Hori,et al.  Fast on-the-fly composition for weighted finite-state transducers in 1.8 million-word vocabulary continuous speech recognition , 2004, INTERSPEECH.

[68]  Shinji Watanabe,et al.  Speech Recognition Based on Student's t-Distribution Derived from Total Bayesian Framework , 2006, IEICE Trans. Inf. Syst..