Advances in Signal Processing and Intelligent Recognition Systems

We describe ‘Tidzam’, an application of deep learning that leverages a dense, multimodal sensor network installed at a large wetland restoration performed at Tidmarsh, a 600-acre former industrial-scale cranberry farm in Southern Massachusetts. Wildlife acoustic monitoring is a crucial metric during post-restoration evaluation of the processes, as well as a challenge in such a noisy outdoor environment. This article presents the entire Tidzam system, which has been designed in order to identify in real-time the ambient sounds of weather conditions as well as sonic events such as insects, small animals and local bird species from microphones deployed on the site. This experiment provides insight on the usage of deep learning technology in a real deployment. The originality of this work concerns the system’s ability to construct its own database from local audio sampling under the supervision of human visitors and bird experts.

[1]  A. S. Malik,et al.  Epileptic seizure detection using the singular values of EEG signals , 2013, 2013 ICME International Conference on Complex Medical Engineering.

[2]  Kyogu Lee,et al.  Convolutional Neural Networks with Binaural Representations and Background Subtraction for Acoustic Scene Classification , 2017, DCASE.

[3]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[4]  Benjamin R. Cowan,et al.  "What can i help you with?": infrequent users' experiences of intelligent personal assistants , 2017, MobileHCI.

[5]  Jeffrey M. Voas,et al.  “Alexa, Can I Trust You?” , 2017, Computer.

[6]  Douglas R. Stinson,et al.  Cryptography: Theory and Practice , 1995 .

[7]  Petronella Anbeek,et al.  Probabilistic Brain Tissue Segmentation in Neonatal Magnetic Resonance Imaging , 2008, Pediatric Research.

[8]  Abhishek Kumar,et al.  Machine learning approach for epileptic seizure detection using wavelet analysis of EEG signals , 2014, 2014 International Conference on Medical Imaging, m-Health and Emerging Communication Systems (MedCom).

[9]  Jerome R. Bellegarda,et al.  Spoken Language Understanding for Natural Interaction: The Siri Experience , 2012, Natural Interaction with Robots, Knowbots and Smartphones, Putting Spoken Dialog Systems into Practice.

[10]  Shruti Sannon,et al.  "Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo , 2017, CHI Extended Abstracts.

[11]  P. Shantha Kumar,et al.  PERFORMANCE ANALYSIS OF BRAIN TUMOR DIAGNOSIS BASED ON SOFT COMPUTING TECHNIQUES , 2014 .

[12]  X.P. Guan,et al.  Use of fuzzy similarity index for epileptic seizure prediction , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[13]  Neelam Sharma,et al.  Diagnosis of Vascular Cognitive Impairment Using EEG , 2017 .

[14]  Maheshkumar H. Kolekar,et al.  The role of EEG signal processing in detection of neurocognitive disorders , 2016 .

[15]  M. Chakraborty,et al.  A new method for brain tumor segmentation based on watershed and edge detection algorithms in HSV colour model , 2012, 2012 NATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION SYSTEMS.

[16]  Jill L. Deppe,et al.  Using soundscape recordings to estimate bird species abundance, richness, and composition , 2009 .

[17]  Luis J. Villanueva-Rivera,et al.  Using Automated Digital Recording Systems as Effective Tools for the Monitoring of Birds and Amphibians , 2006 .

[18]  Bijaya K. Panigrahi,et al.  Detection of ictal patterns in electroencephalogram signals using 3D phase trajectories , 2015, 2015 Annual IEEE India Conference (INDICON).

[19]  Zhiliang Zhu,et al.  An image encryption scheme using lightweight bit-level confusion and cascade cross circular diffusion , 2012 .

[20]  Kazuhiro Nakadai,et al.  Bird Song Scene Analysis Using a Spatial-Cue-Based Probabilistic Model , 2017, J. Robotics Mechatronics.

[21]  S. Thelijjagoda,et al.  Project Nethra - an intelligent assistant for the visually disabled to interact with internet services , 2015, 2015 IEEE 10th International Conference on Industrial and Information Systems (ICIIS).

[22]  King Fahd,et al.  Virtual Personal Assistant (VPA) for Mobile Users , 2002 .

[23]  Ning Xu,et al.  Automated epileptic seizure detection in EEGs using increment entropy , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[24]  Ruhi Sarikaya.  An overview of the system architecture and key components The Technology Behind Personal Digital Assistants , 2022 .

[25]  Nitin Tandon,et al.  Data-driven estimation of mutual information using frequency domain and its application to epilepsy , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[26]  Luis A. Guerrero,et al.  Alexa vs. Siri vs. Cortana vs. Google Assistant: A Comparison of Speech-Based Natural User Interfaces , 2017 .