Towards integrating intelligence in electronic skin

Abstract Due to its very peculiar features, the development of e-skin can be effectively tackled using a holistic approach. Starting from the definition of system specifications, the mechanical arrangement of the skin itself needs to be designed and fabricated together with the electronic embedded system, to move towards aspects such as tactile data processing algorithms and the communication channel interface. In this paper we present the design, the implementation and the results on the way of the development of an electronic skin (e-skin) system based on arrays of piezopolymer transducers. Focus of the paper is on both the development of innovative approaches for tactile information processing and electronic system embedding into the e-skin structure. In particular, Machine Learning technologies can provide a powerful tool to tackle the pattern-recognition problems involved in the tactile sensing framework and the ability of processing data represented as N-th order tensor is the key aspect of the presented research, which can be seen as an application of an existing method (Signoretto et al., 2011). The experimental session compares two different implementations of the ML-based framework, which differ in the learning paradigm adopted, namely SVM and ELM (K-ELM). The effectiveness of the adopted pattern-recognition technologies in the classification of touch modalities has been confirmed by addressing two different binary classification problems in an experiment involving 70 participants. The computational requirements for the hardware implementation of the proposed algorithm together with an overview of what exists in the existing literature are finally discussed.

[1]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[2]  R.A. Russell,et al.  A Robotic Opto-tactile Sensor for Assessing Object Surface Texture , 2006, 2006 IEEE Conference on Robotics, Automation and Mechatronics.

[3]  Victor C. M. Leung,et al.  Extreme Learning Machines [Trends & Controversies] , 2013, IEEE Intelligent Systems.

[4]  Maurizio Valle,et al.  A tensor-based approach to touch modality classification by using machine learning , 2015, Robotics Auton. Syst..

[5]  F. Kirchner,et al.  An adaptive sensor foot for a bipedal and quadrupedal robot , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[6]  Marios S. Pattichis,et al.  Pipelined Decision Tree Classification Accelerator Implementation in FPGA (DT-CAIF) , 2015, IEEE Transactions on Computers.

[7]  Liqing Zhang,et al.  Kernelization of Tensor-Based Models for Multiway Data Analysis: Processing of Multidimensional Structured Data , 2013, IEEE Signal Processing Magazine.

[8]  Benjamin C. K. Tee,et al.  25th Anniversary Article: The Evolution of Electronic Skin (E‐Skin): A Brief History, Design Considerations, and Recent Progress , 2013, Advanced materials.

[9]  Paolo Gastaldo,et al.  A Tensor-Based Pattern-Recognition Framework for the Interpretation of Touch Modality in Artificial Skin Systems , 2014, IEEE Sensors Journal.

[10]  Nicu Sebe,et al.  Machine Learning in Computer Vision , 2006, Computational Imaging and Vision.

[11]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[12]  Vuk Vranjkovic,et al.  New architecture for SVM classifier and its application to telecommunication problems , 2011, 2011 19thTelecommunications Forum (TELFOR) Proceedings of Papers.

[13]  Maurizio Valle,et al.  Computational Intelligence Techniques for Tactile Sensing Systems , 2014, Sensors.

[14]  Mari Velonaki,et al.  Interpretation of the modality of touch on an artificial arm covered with an EIT-based sensitive skin , 2012, Int. J. Robotics Res..

[15]  Hari Singh Nalwa,et al.  Ferroelectric Polymers : Chemistry: Physics, and Applications , 1995 .

[16]  Maurizio Valle,et al.  Tactile-Data Classification of Contact Materials Using Computational Intelligence , 2011, IEEE Transactions on Robotics.

[17]  Shigeki Sugano,et al.  Human-robot-contact-state identification based on tactile recognition , 2005, IEEE Transactions on Industrial Electronics.

[18]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[19]  Zhongwei Jiang,et al.  Development of a tactile sensor for Braille pattern recognition: sensor design and simulation , 2005 .

[20]  Zhenan Bao,et al.  Skin-inspired electronic devices , 2014 .

[21]  Shih-Chii Liu,et al.  Neuromorphic sensory systems , 2010, Current Opinion in Neurobiology.

[22]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[23]  Joseph Zambreno,et al.  An FPGA Implementation of the Hestenes-Jacobi Algorithm for Singular Value Decomposition , 2014, 2014 IEEE International Parallel & Distributed Processing Symposium Workshops.

[24]  John A. Rogers,et al.  Inorganic Semiconductors for Flexible Electronics , 2007 .

[25]  Alessandro Sperduti,et al.  Mining Structured Data , 2010, IEEE Computational Intelligence Magazine.

[26]  Maurizio Valle,et al.  Towards prosthetic systems providing comprehensive tactile feedback for utility and embodiment , 2014, 2014 IEEE Biomedical Circuits and Systems Conference (BioCAS) Proceedings.

[27]  G. Metta,et al.  Towards Tactile Sensing System on Chip for Robotic Applications , 2011, IEEE Sensors Journal.

[28]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[29]  Johan A. K. Suykens,et al.  A kernel-based framework to tensorial data analysis , 2011, Neural Networks.

[30]  Qinyu. Zhu Extreme Learning Machine , 2013 .

[31]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[32]  Paolo Gastaldo,et al.  Efficient Digital Implementation of Extreme Learning Machines for Classification , 2012, IEEE Transactions on Circuits and Systems II: Express Briefs.

[33]  Ladislav A. Novak,et al.  Intellectual property core implementation of decision trees , 2009, IET Comput. Digit. Tech..

[34]  Indranil Saha,et al.  journal homepage: www.elsevier.com/locate/neucom , 2022 .

[35]  Jagath C. Rajapakse,et al.  Guest Editors' Introduction to the Special Section: Computational Intelligence Approaches in Computational Biology and Bioinformatics , 2007, TCBB.

[36]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[37]  Gordon Cheng,et al.  Directions Toward Effective Utilization of Tactile Skin: A Review , 2013, IEEE Sensors Journal.

[38]  Daijin Kim,et al.  Tensor-Based AAM with Continuous Variation Estimation: Application to Variation-Robust Face Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Takao Someya,et al.  Building bionic skin , 2013, IEEE Spectrum.

[40]  Mari Velonaki,et al.  Robotics and Autonomous Systems , 2014 .

[41]  Maurizio Valle,et al.  Charge amplifier Design Methodology for PVDF-Based Tactile Sensors , 2013, J. Circuits Syst. Comput..

[42]  Maurizio Valle,et al.  Asynchronous, event-driven readout of POSFET devices for tactile sensing , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[43]  Hongming Zhou,et al.  Extreme Learning Machines [Trends & Controversies] , 2013 .

[44]  Davide Anguita,et al.  A digital architecture for support vector machines: theory, algorithm, and FPGA implementation , 2003, IEEE Trans. Neural Networks.

[45]  Nigel H. Lovell,et al.  A review of tactile sensing technologies with applications in biomedical engineering , 2012 .

[46]  Robert Puers,et al.  Design and implementation of advanced systems in a flexible-stretchable technology for biomedical applications , 2009 .

[47]  A.P.S. Selvadurai,et al.  On Boussinesq's problem , 2001 .

[48]  John E. Moody,et al.  The Effective Number of Parameters: An Analysis of Generalization and Regularization in Nonlinear Learning Systems , 1991, NIPS.

[49]  David Haussler,et al.  What Size Net Gives Valid Generalization? , 1989, Neural Computation.

[50]  Chiara Bartolozzi,et al.  Selective Attention in Multi-Chip Address-Event Systems , 2009, Sensors.

[51]  Andrea Boni,et al.  Low-Power and Low-Cost Implementation of SVMs for Smart Sensors , 2007, IEEE Transactions on Instrumentation and Measurement.

[52]  Srihari Cadambi,et al.  A Massively Parallel FPGA-Based Coprocessor for Support Vector Machines , 2009, 2009 17th IEEE Symposium on Field Programmable Custom Computing Machines.