A Novel Methodology for Measuring the Abstraction Capabilities of Image Recognition Algorithms

Creating a widely excepted model on the measure of intelligence became inevitable due to the existence of an abundance of different intelligent systems. Measuring intelligence would provide feedback for the developers and ultimately lead us to create better artificial systems. In the present paper, we show a solution where learning as a process is examined, aiming to detect pre-written solutions and separate them from the knowledge acquired by the system. In our approach, we examine image recognition software by executing different transformations on objects and detect if the software was resilient to it. A system with the required intelligence is supposed to become resilient to the transformation after experiencing it several times. The method is successfully tested on a simple neural network, which is not able to learn most of the transformations examined. The method can be applied to any image recognition software to test its abstraction capabilities.

[1]  Zhen Li,et al.  Towards Better Analysis of Deep Convolutional Neural Networks , 2016, IEEE Transactions on Visualization and Computer Graphics.

[2]  Demis Hassabis,et al.  A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play , 2018, Science.

[3]  Joseph Weizenbaum,et al.  ELIZA—a computer program for the study of natural language communication between man and machine , 1966, CACM.

[4]  P. Caie,et al.  Assessment of Immunological Features in Muscle-Invasive Bladder Cancer Prognosis Using Ensemble Learning , 2021, Cancers.

[5]  José Hernández-Orallo,et al.  Evaluation in artificial intelligence: from task-oriented to ability-oriented measurement , 2017, Artificial Intelligence Review.

[6]  Liangfei Zhang,et al.  Review of Automatic Microexpression Recognition in the Past Decade , 2021, Mach. Learn. Knowl. Extr..

[7]  Panos M. Pardalos,et al.  No Free Lunch Theorem: A Review , 2019, Approximation and Optimization.

[8]  Abdelmalik Taleb-Ahmed,et al.  Past, Present, and Future of Face Recognition: A Review , 2020 .

[9]  Wenbo Guo,et al.  Using Non-invertible Data Transformations to Build Adversarial-Robust Neural Networks , 2016, 1610.01934.

[10]  B. Chandrasekaran,et al.  Design Problem Solving: A Task Analysis , 1990, AI Mag..

[11]  Gunasekaran Manogaran,et al.  Neural Network Based Brain Tumor Detection Using Wireless Infrared Imaging Sensor , 2019, IEEE Access.

[12]  T. R. Sontakke,et al.  Rotation, scale and translation invariant handwritten Devanagari numeral character recognition using general fuzzy neural network , 2007, Pattern Recognit..

[13]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[14]  Lina Yao,et al.  A sensor-based wrist pulse signal processing and lung cancer recognition , 2018, J. Biomed. Informatics.

[15]  A. Tate.  A measure of intelligence , 2012 .

[16]  David H. Wolpert,et al.  What is important about the No Free Lunch theorems? , 2020, Black Box Optimization, Machine Learning, and No-Free Lunch Theorems.

[17]  Monty Newborn,et al.  Kasparov versus Deep Blue - computer chess comes of age , 1996 .

[18]  George Konidaris,et al.  On the necessity of abstraction , 2019, Current Opinion in Behavioral Sciences.

[19]  David L. Dowe,et al.  A computer program capable of passing I.Q. tests , 2008 .

[20]  Maozhen Li,et al.  An analysis of generative adversarial networks and variants for image synthesis on MNIST dataset , 2020, Multimedia Tools and Applications.

[21]  Qiaosong Wang,et al.  Object Recognition in Aerial Images Using Convolutional Neural Networks , 2017, J. Imaging.

[22]  Alessandro Panconesi,et al.  OLIVAW: Mastering Othello with neither Humans nor a Penny , 2021, ArXiv.

[23]  Michele Volpi,et al.  Learning rotation invariant convolutional filters for texture classification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[24]  Andreas M. Kaplan,et al.  A Brief History of Artificial Intelligence: On the Past, Present, and Future of Artificial Intelligence , 2019, California Management Review.

[25]  Shane Legg,et al.  A Collection of Definitions of Intelligence , 2007, AGI.

[26]  Stephan J. Garbin,et al.  Harmonic Networks: Deep Translation and Rotation Equivariance , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Arunesh Kumar Singh,et al.  Load forecasting techniques and methodologies: A review , 2012, 2012 2nd International Conference on Power, Control and Embedded Systems.

[28]  Faouzi Alaya Cheikh,et al.  PedNet: A Spatio-Temporal Deep Convolutional Neural Network for Pedestrian Segmentation , 2018, J. Imaging.

[29]  Matthias Bethge,et al.  Towards the first adversarially robust neural network model on MNIST , 2018, ICLR.

[30]  José Hernández-Orallo,et al.  Measuring universal intelligence: Towards an anytime intelligence test , 2010, Artif. Intell..

[31]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[32]  John Paoli,et al.  Human–computer collaboration for skin cancer recognition , 2020, Nature Medicine.

[33]  A. Taleb-Ahmed,et al.  Past, Present, and Future of Face Recognition: A Review , 2020, Electronics.

[34]  Jeremy Straub,et al.  Initial Work on the Characterization of Additive Manufacturing (3D Printing) Using Software Image Analysis , 2015 .

[35]  Mgr. Tomáš Zemčík.  A Brief History of Chatbots , 2019, DEStech Transactions on Computer Science and Engineering.

[36]  Giovanni Dimauro,et al.  Personal Heart Health Monitoring Based on 1D Convolutional Neural Network , 2021, J. Imaging.