Experimental Analysis of Deep Echo State Networks for Ambient Assisted Living

The Reservoir Computing (RC) paradigm represents a stateof-the-art methodology for efficient building of recurrent neural networks, which in the last years has proved effective in learning real-world temporal tasks from streams of sensorial data in the Ambient Assisted Living (AAL) domain. Recently, the study of RC networks has been extended to the case of deep architectures, with the introduction of the deep Echo State Network (DeepESN) model. Featured by a layered composition of recurrent units, DeepESNs are inherently able to develop a hierarchically structured representation of temporal information, at the same time preserving the RC characterization of training efficiency. In this paper, we discuss the introduction of the DeepESN approach in the field of AAL. To this aim, we perform a comparative experimental analysis on two real-world benchmark datasets related to inferring the user’s behavior from data streams gathered from the nodes of a wireless sensor network. Results show that DeepESNs outperform standard RC networks with shallow architecture, suggesting a multiple-time scales nature of the involved temporal data and pointing out the great potentiality of the proposed approach in the AAL field.

[1]  Davide Bacciu,et al.  A learning system for automatic Berg Balance Scale score estimation , 2017, Eng. Appl. Artif. Intell..

[2]  Stefano Chessa,et al.  Forecast-Driven Enhancement of Received Signal Strength (RSS)-Based Localization Systems , 2013, ISPRS Int. J. Geo Inf..

[3]  Claudio Gallicchio,et al.  Architectural and Markovian factors of echo state networks , 2011, Neural Networks.

[4]  Stefano Chessa,et al.  Smart Environments and Context-Awareness for Lifestyle Management in a Healthy Active Ageing Framework , 2015, EPIA.

[5]  Claudio Gallicchio,et al.  Randomized Machine Learning Approaches: Recent Developments and Challenges , 2017, ESANN.

[6]  Claudio Gallicchio,et al.  Human activity recognition using multisensor data fusion based on Reservoir Computing , 2016, J. Ambient Intell. Smart Environ..

[7]  Stefano Chessa,et al.  An Experimental Evaluation of Reservoir Computation for Ambient Assisted Living , 2012, WIRN.

[8]  Claudio Gallicchio,et al.  Deep Reservoir Computing: A Critical Analysis , 2016, ESANN.

[9]  Claudio Gallicchio,et al.  Echo State Property of Deep Reservoir Computing Networks , 2017, Cognitive Computation.

[10]  Stefano Chessa,et al.  Robot Localization by Echo State Networks Using RSS , 2013, WIRN.

[11]  Davide Bacciu,et al.  An experimental characterization of reservoir computing in ambient assisted living applications , 2013, Neural Computing and Applications.

[12]  Benjamin Schrauwen,et al.  An experimental unification of reservoir computing methods , 2007, Neural Networks.

[13]  Stefano Chessa,et al.  Detecting Socialization Events in Ageing People: The Experience of the DOREMI Project , 2016, 2016 12th International Conference on Intelligent Environments (IE).

[14]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[15]  Claudio Gallicchio,et al.  Deep reservoir computing: A critical experimental analysis , 2017, Neurocomputing.

[16]  Benjamin Schrauwen,et al.  Reservoir Computing Trends , 2012, KI - Künstliche Intelligenz.

[17]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[18]  Claudio Gallicchio,et al.  Deep Echo State Networks for Diagnosis of Parkinson's Disease , 2018, ESANN.

[19]  Claudio Gallicchio,et al.  Local Lyapunov exponents of deep echo state networks , 2018, Neurocomputing.

[20]  Claudio Gallicchio,et al.  A Reservoir Computing Approach for Balance Assessment , 2015, AALTD@PKDD/ECML.

[21]  Stefano Chessa,et al.  Internet of Robotic Things-Converging Sensing / Actuating , Hypoconnectivity , Artificial Intelligence and IoT Platforms , 2017 .

[22]  Davide Bacciu,et al.  A cognitive robotic ecology approach to self-configuring and evolving AAL systems , 2015, Eng. Appl. Artif. Intell..

[23]  John F. Kolen,et al.  Dynamical Recurrent Networks , 2001 .

[24]  Stefano Chessa,et al.  Robotic Ubiquitous Cognitive Ecology for Smart Homes , 2015, Journal of Intelligent & Robotic Systems.

[25]  Claudio Gallicchio,et al.  Local Lyapunov Exponents of Deep RNN , 2017, ESANN.

[26]  Stefano Chessa,et al.  User Movements Forecasting by Reservoir Computing Using Signal Streams Produced by Mote-Class Sensors , 2011, MOBILIGHT.

[27]  Alessandro Saffiotti,et al.  Learning context-aware mobile robot navigation in home environments , 2014, IISA 2014, The 5th International Conference on Information, Intelligence, Systems and Applications.

[28]  Stefano Chessa,et al.  Reliability and human factors in Ambient Assisted Living environments , 2017, Journal of Reliable Intelligent Environments.

[29]  Claudio Gallicchio,et al.  Deep Echo State Network (DeepESN): A Brief Survey , 2017, ArXiv.

[30]  Stefano Chessa,et al.  Wireless sensor networks: A survey on the state of the art and the 802.15.4 and ZigBee standards , 2007, Comput. Commun..

[31]  Claudio Gallicchio,et al.  Short-term Memory of Deep RNN , 2018, ESANN.

[32]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[33]  Herbert Jaeger,et al.  Optimization and applications of echo state networks with leaky- integrator neurons , 2007, Neural Networks.

[34]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[35]  Claudio Gallicchio,et al.  A Reservoir Computing Approach for Human Gesture Recognition from Kinect Data , 2016, AI*AAL@AI*IA.

[36]  Stefano Chessa,et al.  On the need of machine learning as a service for the internet of things , 2017, IML.

[37]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[38]  Stefan J. Kiebel,et al.  Re-visiting the echo state property , 2012, Neural Networks.

[39]  Davide Bacciu,et al.  A Benchmark Dataset for Human Activity Recognition and Ambient Assisted Living , 2016, ISAmI.