The Internet of Sounds: Convergent Trends, Insights, and Future Directions

Current sound-based practices and systems developed in both academia and industry point to convergent research trends that bring together the field of sound and music Computing with that of the Internet of Things. This article proposes a vision for the emerging field of the Internet of Sounds (IoS), which stems from such disciplines. The IoS relates to the network of Sound Things, i.e., devices capable of sensing, acquiring, processing, actuating, and exchanging data serving the purpose of communicating sound-related information. In the IoS paradigm, which merges under a unique umbrella the emerging fields of the Internet of Musical Things and the Internet of Audio Things, heterogeneous devices dedicated to musical and nonmusical tasks can interact and cooperate with one another and with other things connected to the Internet to facilitate sound-based services and applications that are globally available to the users. We survey the state-of-the-art in this space, discuss the technological and nontechnological challenges ahead of us and propose a comprehensive research agenda for the field.

[1]  Giang T. Nguyen,et al.  Accelerating Industrial IoT Acoustic Data Separation With In-Network Computing , 2023, IEEE Internet of Things Journal.

[2]  L. Turchet,et al.  Towards a Sustainable Internet of Sounds , 2022, Audio Mostly Conference.

[3]  L. Turchet,et al.  Web Semantics: Science, Services and Agents on the World Wide Web Semantic Web of Musical Things: Achieving interoperability in the Internet of Musical Things , 2022 .

[4]  W. Gan,et al.  Multi-channel wireless hybrid active noise control with fixed-adaptive control selection , 2022, Journal of Sound and Vibration.

[5]  L. Turchet,et al.  Blockchain-based internet of musical things , 2022, Blockchain: Research and Applications.

[6]  L. Turchet,et al.  SMIF: A Format for the Offline Exchange of Smart Musical Instruments Configuration and Data , 2021, Journal of The Audio Engineering Society.

[7]  N. Moustakas,et al.  Design Recommendations for a Collaborative Game of Bird Call Recognition Based on Internet of Sound Practices , 2021, Journal of The Audio Engineering Society.

[8]  György Fazekas,et al.  Intelligent Control Method for the Dynamic Range Compressor: A User Study , 2021, Journal of the Audio Engineering Society.

[9]  Le Ngu Nguyen,et al.  Intuitive Privacy from Acoustic Reach: A Case for Networked Voice User-Interfaces , 2021, 2021 ISCA Symposium on Security and Privacy in Speech Communication.

[10]  P. Bouquet,et al.  The Smart Musical Instruments Ontology , 2021, J. Web Semant..

[11]  Emilia Gómez,et al.  Music Emotion Recognition: Toward new, robust standards in personalized and context-sensitive applications , 2021, IEEE Signal Processing Magazine.

[12]  A. Touhafi,et al.  Environmental Sound Recognition on Embedded Systems: From FPGAs to TPUs , 2021, Electronics.

[13]  Nils Peters,et al.  Storage and Authentication of Audio Footage for IoAuT Devices Using Distributed Ledger Technology , 2021, ArXiv.

[14]  A. Sarti,et al.  Experimenting With Adaptive Metronomes in Networked Music Performances! , 2021, Journal of The Audio Engineering Society.

[15]  L. Turchet,et al.  Technical Performance Assessment of the Ableton Link Protocol Over Wi-Fi , 2021, Journal of the Audio Engineering Society.

[16]  Sam Ferguson,et al.  Supporting Creative Practice in Wireless Distributed Sound Installations Given Technical Constraints , 2021, Journal of The Audio Engineering Society.

[17]  Seth Thorn,et al.  Telematic Wearable Music: Remote Ensembles and Inclusive Embodied Education , 2021, Audio Mostly Conference.

[18]  Frederic Font,et al.  SOURCE: a Freesound Community Music Sampler , 2021, Audio Mostly Conference.

[19]  Stavros Ntalampiras,et al.  Automatic acoustic classification of feline sex , 2021, Audio Mostly Conference.

[20]  Flávio Luiz Schiavoni,et al.  Sunflower: an environment for standardized communication of IoMusT , 2021, Audio Mostly Conference.

[21]  Vincent Lostanlen,et al.  Energy Efficiency is Not Enough:Towards a Batteryless Internet of Sounds , 2021, Audio Mostly Conference.

[22]  Curtis Hawthorne,et al.  Sequence-to-Sequence Piano Transcription with Transformers , 2021, ISMIR.

[23]  Bryan Pardo,et al.  Leveraging Hierarchical Structures for Few-Shot Musical Instrument Recognition , 2021, ISMIR.

[24]  Luca Turchet,et al.  Musical Haptic Wearables for Synchronisation of Visually-impaired Performers: a Co-design Approach , 2021, IMX.

[25]  Luca Turchet,et al.  Smart Musical Instruments preset sharing: an ontology-based data access approach , 2021, 2021 IEEE 7th World Forum on Internet of Things (WF-IoT).

[26]  Yohei Kawaguchi,et al.  Description and Discussion on DCASE 2021 Challenge Task 2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring under Domain Shifted Conditions , 2021, DCASE.

[27]  C. Lavandier,et al.  Polyphonic training set synthesis improves self-supervised urban sound classification. , 2021, The Journal of the Acoustical Society of America.

[28]  C. Maina,et al.  Raspberry Pi Based Recording System for Acoustic Monitoring of Bird Species , 2021, 2021 IST-Africa Conference (IST-Africa).

[29]  Emmanouil Benetos,et al.  MusCaps: Generating Captions for Music Audio , 2021, 2021 International Joint Conference on Neural Networks (IJCNN).

[30]  György Fazekas,et al.  Context-Aware Intelligent Mixing Systems , 2021, Journal of The Audio Engineering Society.

[31]  Jan Østergaard,et al.  Low Delay Robust Audio Coding by Noise Shaping, Fractional Sampling, and Source Prediction , 2021, 2021 Data Compression Conference (DCC).

[32]  Andrew Stranieri,et al.  A Survey on the Adoption of Blockchain in IoT: Challenges and Solutions , 2021 .

[33]  Eduardo C. Nunes,et al.  Anomalous Sound Detection with Machine Learning: A Systematic Review , 2021, ArXiv.

[34]  Imran Zualkernan,et al.  An AIoT System for Bat Species Classification , 2021, 2020 IEEE International Conference on Internet of Things and Intelligence System (IoTaIS).

[35]  L. Turchet,et al.  A Comparison of Real-Time Linux-Based Architectures for Embedded Musical Applications , 2021, Journal of the Audio Engineering Society.

[36]  Christian Werner,et al.  UNISON: A Novel System for Ultra-Low Latency Audio Streaming Over the Internet , 2021, 2021 IEEE 18th Annual Consumer Communications & Networking Conference (CCNC).

[37]  Antoine LESIEUR,et al.  Meta-modeling for urban noise mapping. , 2020, The Journal of the Acoustical Society of America.

[38]  Benjamin Matuszewski,et al.  A Web-Based Framework for Distributed Music System Research and Creation , 2020, Journal of the Audio Engineering Society.

[39]  N. Otero,et al.  Ubiquitous Music Ecologies , 2020 .

[40]  Joan Feigenbaum,et al.  Privacy-Preserving XGBoost Inference , 2020, ArXiv.

[41]  György Fazekas,et al.  From Music Ontology towards Ethno-Music-Ontology , 2020, ISMIR.

[42]  X. Serra,et al.  FSD50K: An Open Dataset of Human-Labeled Sound Events , 2020, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[43]  Carlo Fischione,et al.  The Internet of Audio Things: State of the Art, Vision, and Challenges , 2020, IEEE Internet of Things Journal.

[44]  Stephan Sigg,et al.  Acoustic Fingerprints for Access Management in Ad-Hoc Sensor Networks , 2020, IEEE Access.

[45]  Jakob Abeßer,et al.  A study on spoken language identification using deep neural networks , 2020, Audio Mostly Conference.

[46]  Alberto Gianelli,et al.  On making physical the control of audio plugins: the case of the retrologue hardware synthesizer , 2020, Audio Mostly Conference.

[47]  Luca Turchet,et al.  Voice-based interface for accessible soundscape composition: composing soundscapes by vocally querying online sounds repositories , 2020, Audio Mostly Conference.

[48]  Archontis Politis,et al.  Overview and Evaluation of Sound Event Localization and Detection in DCASE 2019 , 2020, IEEE/ACM Transactions on Audio Speech and Language Processing.

[49]  Augusto Sarti,et al.  An Adaptive Metronome Technique for Mitigating the Impact of Latency in Networked Music Performances , 2020, 2020 27th Conference of Open Innovations Association (FRUCT).

[50]  Tychonas Michailidis,et al.  Implementing Remote Audio as a Diagnostics Tool for Maritime Autonomous Surface Ships , 2020, 2020 27th Conference of Open Innovations Association (FRUCT).

[51]  Marco Centenaro,et al.  Towards a 5G Communication Architecture for the Internet of Musical Things , 2020, 2020 27th Conference of Open Innovations Association (FRUCT).

[52]  Oliver Bown,et al.  Transparent Communication Within Multiplicities , 2020, 2020 27th Conference of Open Innovations Association (FRUCT).

[53]  Jürgen Peissig,et al.  Impact of Source Panning on a Global Metronome in Rhythmic Networked Music Performance , 2020, 2020 27th Conference of Open Innovations Association (FRUCT).

[54]  C. Fischione,et al.  Wireless for Machine Learning , 2020, ArXiv.

[55]  Z. Tan,et al.  An Overview of Deep-Learning-Based Audio-Visual Speech Enhancement and Separation , 2020, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[56]  Andrew P. McPherson,et al.  A NIME Of The Times: Developing an Outward-Looking Political Agenda For This Community , 2020, NIME.

[57]  Chris Chafe,et al.  A Deep Learning Approach for Low-Latency Packet Loss Concealment of Audio Signals in Networked Music Performance Applications , 2020, 2020 27th Conference of Open Innovations Association (FRUCT).

[58]  Junichi Yamagishi,et al.  The Privacy ZEBRA: Zero Evidence Biometric Recognition Assessment , 2020, INTERSPEECH.

[59]  Junichi Yamagishi,et al.  Introducing the VoicePrivacy Initiative , 2020, INTERSPEECH.

[60]  Dan Stowell,et al.  Efficient Bird Sound Detection on the Bela Embedded System , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[61]  Fabio Morreale,et al.  "My Library Has Just Been Obliterated": Producing New Norms of Use Via Software Update , 2020, CHI.

[62]  Mathieu Lagrange,et al.  Low-Cost Sensors for Urban Noise Monitoring Networks—A Literature Review , 2020, Sensors.

[63]  Luca Turchet,et al.  Touching the audience: musical haptic wearables for augmented and participatory live music performances , 2020, Personal and Ubiquitous Computing.

[64]  Xavier Serra,et al.  Tensorflow Audio Models in Essentia , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[65]  Xuan Li,et al.  Parallel convolutional processing using an integrated photonic tensor core , 2021, Nature.

[66]  Alessio Brutti,et al.  Compact Recurrent Neural Networks for Acoustic Event Detection on Low-Energy Low-Complexity Platforms , 2020, IEEE Journal of Selected Topics in Signal Processing.

[67]  Shabnam Ghaffarzadegan,et al.  An Ontology-Aware Framework for Audio Event Classification , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[68]  Fausto Giunchiglia,et al.  The Internet of Musical Things Ontology , 2020, J. Web Semant..

[69]  Mark B. Sandler,et al.  20 Years of Automatic Chord Recognition from Audio , 2019, ISMIR.

[70]  Nitesh V. Chawla,et al.  Deep Prototypical Networks for Imbalanced Time Series Classification under Data Scarcity , 2019, CIKM.

[71]  Félix Gontier,et al.  Estimation of the Perceived Time of Presence of Sources in Urban Acoustic Environments Using Deep Learning Techniques , 2019, Acta Acustica united with Acustica.

[72]  Lucas Beyer,et al.  Effect of a Global Metronome on Ensemble Accuracy in Networked Music Performance , 2019 .

[73]  Justin Salamon,et al.  Tricycle: Audio Representation Learning from Sensor Network Data Using Self-Supervision , 2019, 2019 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA).

[74]  Mark B. Sandler,et al.  Approaches in Intelligent Music Production , 2019, Arts.

[75]  Luca Turchet,et al.  Interactive sonification and the IoT: the case of smart sonic shoes for clinical applications , 2019, Audio Mostly Conference.

[76]  Michael Reichmann,et al.  Auditory Augmented Reality for Cyber Physical Production Systems , 2019, Audio Mostly Conference.

[77]  An Braeken,et al.  Evaluation of Classical Machine Learning Techniques towards Urban Sound Recognitionon Embedded Systems , 2019, Applied Sciences.

[78]  Jin Liu,et al.  Deep Learning-Based Reasoning With Multi-Ontology for IoT Applications , 2019, IEEE Access.

[79]  Damián Keller,et al.  The Handy Metaphor: Bimanual, touchless interaction for the internet of musical things , 2019, Journal of New Music Research.

[80]  Keenan Ball,et al.  Persistent near real‐time passive acoustic monitoring for baleen whales from a moored buoy: System description and evaluation , 2019, Methods in Ecology and Evolution.

[81]  Mathieu Barthet,et al.  An ubiquitous smart guitar system for collaborative musical practice , 2019, Journal of New Music Research.

[82]  Oliver Bown,et al.  Facilitating Creative Exploratory Search with Multiple Networked Audio Devices Using HappyBrackets , 2019, NIME.

[83]  Oliver Bown,et al.  Rapid Composition for Networked Devices: HappyBrackets , 2019, Computer Music Journal.

[84]  Zibin Zheng,et al.  Blockchain for Internet of Things: A Survey , 2019, IEEE Internet of Things Journal.

[85]  Isabel Trancoso,et al.  The GDPR & Speech Data: Reflections of Legal and Technology Communities, First Steps towards a Common Understanding , 2019, INTERSPEECH.

[86]  Roger B. Dannenberg,et al.  O2: A Network Protocol for Music Systems , 2019, Wirel. Commun. Mob. Comput..

[87]  Luca Turchet,et al.  Co-Design of Musical Haptic Wearables for Electronic Music Performer's Communication , 2019, IEEE Transactions on Human-Machine Systems.

[88]  Cláudio T. Silva,et al.  The Life of a New York City Noise Sensor Network , 2019, Sensors.

[89]  Oded Nov,et al.  SONYC , 2019, Commun. ACM.

[90]  Simon Dixon,et al.  Automatic Music Transcription: An Overview , 2019, IEEE Signal Processing Magazine.

[91]  Victor C. M. Leung,et al.  Wireless acoustic sensor networks and edge computing for rapid acoustic monitoring , 2019, IEEE/CAA Journal of Automatica Sinica.

[92]  Mehdi Bennis,et al.  Wireless Network Intelligence at the Edge , 2018, Proceedings of the IEEE.

[93]  Thomas Lunner,et al.  Toward EEG-Assisted Hearing Aids: Objective Threshold Estimation Based on Ear-EEG in Subjects With Sensorineural Hearing Loss , 2018, Trends in Hearing.

[94]  Jie Lin,et al.  The AlexNet Moment for Homomorphic Encryption: HCNN, the First Homomorphic CNN on Encrypted Data with GPUs , 2018, IACR Cryptol. ePrint Arch..

[95]  Luca Turchet,et al.  C Minor: a Semantic Publish/Subscribe Broker for the Internet of Musical Things , 2018, 2018 23rd Conference of Open Innovations Association (FRUCT).

[96]  Augusto Sarti,et al.  Investigating Networked Music Performances in Pedagogical Scenarios for the InterMUSIC Project , 2018, 2018 23rd Conference of Open Innovations Association (FRUCT).

[97]  Deborah L. McGuinness,et al.  A Music Theory Ontology , 2018, SAAM@ISWC.

[98]  György Fazekas,et al.  Audio Commons Ontology: A Data Model for an Audio Content Ecosystem , 2018, SEMWEB.

[99]  Tomas Bäckström,et al.  Speech Coding, Speech Interfaces and IOT - Opportunities and Challenges , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[100]  Carlo Fischione,et al.  Internet of Musical Things: Vision and Challenges , 2018, IEEE Access.

[101]  Bob L. Sturm,et al.  Ethical Dimensions of Music Information Retrieval Technology , 2018, Trans. Int. Soc. Music. Inf. Retr..

[102]  Luca Turchet,et al.  Smart Mandolin: autobiographical design, implementation, use cases, and lessons learned , 2018, Audio Mostly Conference.

[103]  Carlo Fischione,et al.  Low-Latency Networking: Where Latency Lurks and How to Tame It , 2018, Proceedings of the IEEE.

[104]  Abeßer Jakob,et al.  A Distributed Sensor Network for Monitoring Noise Level and Noise Sources in Urban Environments , 2018, 2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud).

[105]  Mohammed Atiquzzaman,et al.  Interoperability in Internet of Things: Taxonomies and Open Challenges , 2018, Mobile Networks and Applications.

[106]  Hervé Glotin,et al.  Automatic acoustic detection of birds through deep learning: The first Bird Audio Detection challenge , 2018, Methods in Ecology and Evolution.

[107]  Luca Turchet,et al.  Real-Time Hit Classification in a Smart Cajón , 2018, Front. ICT.

[108]  Eric Drott Music as a Technology of Surveillance , 2018, Journal of the Society for American Music.

[109]  Raghuraman Krishnamoorthi,et al.  Quantizing deep convolutional networks for efficient inference: A whitepaper , 2018, ArXiv.

[110]  György Fazekas,et al.  Live Repurposing of Sounds: MIR Explorations with Personal and Crowdsourced Databases , 2018, NIME.

[111]  Norman Finn,et al.  Introduction to Time-Sensitive Networking , 2018, IEEE Communications Standards Magazine.

[112]  L. Kloepper,et al.  The Chirocopter: A UAV for recording sound and video of bats at altitude , 2018 .

[113]  Adriano Baratè,et al.  Advanced Experience of Music through 5G Technologies , 2018, IOP Conference Series: Materials Science and Engineering.

[114]  Tiago M. Fernández-Caramés,et al.  A Review on the Use of Blockchain for the Internet of Things , 2018, IEEE Access.

[115]  Joshua D. Reiss,et al.  FXive: A Web Platform for Procedural Sound Synthesis , 2018 .

[116]  S. Furui Digital Speech Processing, Synthesis, and Recognition : Synthesis, and Recognition, Second Edition, , 2018 .

[117]  Fabio Viola,et al.  Dynamic Linked Data: A SPARQL Event Processing Architecture , 2018, Future Internet.

[118]  Sylvain Meignier,et al.  An Open-Source Speaker Gender Detection Framework for Monitoring Gender Equality , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[119]  Luca Turchet,et al.  Embodied Interactions with E-Textiles and the Internet of Sounds for Performing Arts , 2018, TEI.

[120]  Thomas C. Schmidt,et al.  RIOT: An Open Source Operating System for Low-End Embedded Devices in the IoT , 2018, IEEE Internet of Things Journal.

[121]  Nick Bryan-Kinns,et al.  LeMo: Supporting Collaborative Music Making in Virtual Reality , 2018, 2018 IEEE 4th VR Workshop on Sonic Interactions for Virtual Environments (SIVE).

[122]  Alan Hanjalic,et al.  One deep music representation to rule them all? A comparative analysis of different representation learning strategies , 2018, Neural Computing and Applications.

[123]  Dan Stowell,et al.  Detection and Classification of Acoustic Scenes and Events , 2015, IEEE Transactions on Multimedia.

[124]  Mianxiong Dong,et al.  Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing , 2018, IEEE Network.

[125]  Nick S. Jones,et al.  Robust, real-time and autonomous monitoring of ecosystems with an open, low-cost, networked device , 2017, bioRxiv.

[126]  C. Lavandier,et al.  An Efficient Audio Coding Scheme for Quantitative and Qualitative Large Scale Acoustic Monitoring Using the Sensor Grid Approach , 2017, Sensors.

[127]  Xavier Serra,et al.  End-to-end Learning for Music Audio Tagging at Scale , 2017, ISMIR.

[128]  Andrés Marín López,et al.  Seamless human-device interaction in the internet of things , 2017, IEEE Transactions on Consumer Electronics.

[129]  Colin Raffel,et al.  Onsets and Frames: Dual-Objective Piano Transcription , 2017, ISMIR.

[130]  Christopher W. Clark,et al.  Long-term passive acoustic recordings track the changing distribution of North Atlantic right whales (Eubalaena glacialis) from 2004 to 2014 , 2017, Scientific Reports.

[131]  György Fazekas,et al.  Bridging Fan Communities and Facilitating Access to Music Archives through Semantic Audio Applications , 2017 .

[132]  K. Horton,et al.  High-intensity urban light installation dramatically alters nocturnal bird migration , 2017, Proceedings of the National Academy of Sciences.

[133]  Mark D. Plumbley,et al.  Computational Analysis of Sound Scenes and Events , 2017 .

[134]  György Fazekas,et al.  A Tutorial on Deep Learning for Music Information Retrieval , 2017, ArXiv.

[135]  Carlo Fischione,et al.  Examples of use cases with Smart Instruments , 2017, Audio Mostly Conference.

[136]  Adriano Baratè,et al.  5G TECHNOLOGY AND ITS APPLICATIONS TO MUSIC EDUCATION , 2017 .

[137]  G. Fitzpatrick,et al.  Design Implications for Technology-Mediated Audience Participation in Live Music , 2017 .

[138]  György Fazekas,et al.  Realising a Layered Digital Library: Exploration and Analysis of the Live Music Archive through Linked Data , 2017, 2017 ACM/IEEE Joint Conference on Digital Libraries (JCDL).

[139]  Gerhard Widmer,et al.  End-to-end musical key estimation using a convolutional neural network , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[140]  Mark Sandler,et al.  The Effects of Noisy Labels on Deep Convolutional Neural Networks for Music Tagging , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[141]  Mahesh K. Marina,et al.  Network Slicing in 5G: Survey and Challenges , 2017, IEEE Communications Magazine.

[142]  Mark Sandler,et al.  Transfer Learning for Music Classification and Regression Tasks , 2017, ISMIR.

[143]  Aren Jansen,et al.  Audio Set: An ontology and human-labeled dataset for audio events , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[144]  Giovanni Zambon,et al.  LIFE DYNAMAP project: The case study of Rome , 2017 .

[145]  Augusto Sarti,et al.  An Overview on Networked Music Performance Technologies , 2016, IEEE Access.

[146]  György Fazekas,et al.  AUFX-O: Novel Methods for the Representation of Audio Processing Workflows , 2016, SEMWEB.

[147]  Petar Popovski,et al.  Delay Minimization in Real-Time Communications With Joint Buffering and Coding , 2016, IEEE Communications Letters.

[148]  Joshua D. Reiss,et al.  Semantic Description of Timbral Transformations in Music Production , 2016, ACM Multimedia.

[149]  Mark Sandler,et al.  Convolutional recurrent neural networks for music classification , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[150]  Mark B. Sandler,et al.  Towards Music Captioning: Generating Music Playlist Descriptions , 2016, ArXiv.

[151]  Dong-Hee Shin,et al.  Voices of the Internet of Things: An Exploration of Multiple Voice Effects in Smart Homes , 2016, HCI.

[152]  Rebecca Fiebrink,et al.  The Global Metronome: Absolute Tempo Sync For Networked Musical Performance , 2016, NIME.

[153]  Marcelo M. Wanderley,et al.  Prynth: A Framework for Self-contained Digital Music Instruments , 2016, CMMR.

[154]  J. Skowronek,et al.  P.1305 - Effect of delays on telemeeting quality , 2016 .

[155]  Quan Zhang,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[156]  Martin Maier,et al.  The tactile internet: vision, recent progress, and open challenges , 2016, IEEE Communications Magazine.

[157]  Norbert Schnell,et al.  Synchronisation for Distributed Audio Rendering over Heterogeneous Devices, in HTML5 , 2016 .

[158]  Fs Thalmann,et al.  The Semantic Music Player: A Smart Mobile Player Based on Ontological Structures and Analytical Feature Metadata , 2016 .

[159]  György Fazekas,et al.  myMoodplay: An interactive mood-based music discovery app , 2016 .

[160]  Florian Thalmann,et al.  The Mobile Audio Ontology: Experiencing Dynamic Music Objects on Mobile Devices , 2016, 2016 IEEE Tenth International Conference on Semantic Computing (ICSC).

[161]  Stefano Squartini,et al.  Wireless Networked Music Performance , 2016 .

[162]  Mark D. Plumbley,et al.  Audio Commons: bringing Creative Commons audio content to the creative industries , 2016 .

[163]  Ricardo Neisse,et al.  Ethical Design in the Internet of Things , 2016, Science and Engineering Ethics.

[164]  Augusto Sarti,et al.  Feature-Based Analysis of the Effects of Packet Delay on Networked Musical Interactions , 2015 .

[165]  Jia-Shing Sheu,et al.  Realization of an Ethernet-based synchronous audio playback system , 2015, Multimedia Tools and Applications.

[166]  Song Han,et al.  Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding , 2015, ICLR.

[167]  Waqar Mahmood,et al.  Internet of multimedia things: Vision and challenges , 2015, Ad Hoc Networks.

[168]  Rolf H. Weber,et al.  Internet of things: Privacy issues revisited , 2015, Comput. Law Secur. Rev..

[169]  Adrian Freed,et al.  Simple Synchronisation for Open Sound Control , 2015, ICMC.

[170]  J. Sueur,et al.  Ecoacoustics: the Ecological Investigation and Interpretation of Environmental Sound , 2015, Biosemiotics.

[171]  Felix Wortmann,et al.  Internet of Things , 2015, Bus. Inf. Syst. Eng..

[172]  Ann Light,et al.  Designing Connected Products: UX for the Consumer Internet of Things , 2015 .

[173]  Andrew P. McPherson,et al.  An Environment for Submillisecond-Latency Audio and Sensor Processing on BeagleBone Black , 2015 .

[174]  Carlo Fischione,et al.  Millimeter Wave Cellular Networks: A MAC Layer Perspective , 2015, IEEE Transactions on Communications.

[175]  Norbert Schnell,et al.  Of Time Engines and Masters An API for Scheduling and Synchronizing the Generation and Playback of Event Sequences and Media Streams for the Web Audio API , 2015 .

[176]  Eleonora Borgia,et al.  The Internet of Things vision: Key features, applications and open issues , 2014, Comput. Commun..

[177]  György Fazekas,et al.  The Open Multitrack Testbed , 2014 .

[178]  Andrew R. Nix,et al.  Making the Most of Wi-Fi: Optimisations for Robust Wireless Live Music Performance , 2014, NIME.

[179]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[180]  Carsten Bormann,et al.  The Constrained Application Protocol (CoAP) , 2014, RFC.

[181]  Dan Stowell,et al.  Automatic large-scale classification of bird sounds is strongly improved by unsupervised feature learning , 2014, PeerJ.

[182]  Sebastian Böck,et al.  Improved musical onset detection with Convolutional Neural Networks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[183]  S. H. Jensen,et al.  Practical design of delta-sigma multiple description audio coding , 2014, EURASIP Journal on Audio, Speech, and Music Processing.

[184]  György Fazekas,et al.  Selection of Audio Features for Music Emotion Recognition Using Production Music , 2014, Semantic Audio.

[185]  Francisco Herrera,et al.  An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics , 2013, Inf. Sci..

[186]  Tim Fingscheidt,et al.  Robust Ultra-Low Latency Soft-Decision Decoding of Linear PCM Audio , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[187]  Xavier Serra,et al.  Freesound technical demo , 2013, ACM Multimedia.

[188]  György Fazekas,et al.  Automatic Ontology Generation for Musical Instruments Based on Audio Analysis , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[189]  György Fazekas,et al.  Semantic models of musical mood: Comparison between crowd-sourced and curated editorial tags , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[190]  Arkady B. Zaslavsky,et al.  Context Aware Computing for The Internet of Things: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[191]  Carlo Drioli,et al.  Networked Performances and Natural Interaction via LOLA: Low Latency High Quality A/V Streaming System , 2013, ECLAP.

[192]  Bhiksha Raj,et al.  Privacy-Preserving Speaker Verification and Identification Using Gaussian Mixture Models , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[193]  György Fazekas,et al.  Knowledge Representation Issues in Audio-Related Metadata Model Design , 2012 .

[194]  Timothy B. Terriberry,et al.  Definition of the Opus Audio Codec , 2012, RFC.

[195]  Eetu Luoma,et al.  Defining an Internet-of-Things Ecosystem , 2012, NEW2AN.

[196]  Östen Axelsson,et al.  Sounding Brighton: practical approaches towards better soundscapes , 2012 .

[197]  György Fazekas,et al.  Music Emotion Recognition: From Content- to Context-Based Models , 2012, CMMR.

[198]  Miguel A. Martínez-Prieto,et al.  Exchange and Consumption of Huge RDF Data , 2012, ESWC.

[199]  Alexander Bertrand,et al.  Applications and trends in wireless acoustic sensor networks: A signal processing perspective , 2011, 2011 18th IEEE Symposium on Communications and Vehicular Technology in the Benelux (SCVT).

[200]  György Fazekas,et al.  Music recommendation for music learning: Hotttabs, a multimedia guitar tutor , 2011 .

[201]  Andreas Hildebrand,et al.  Realtime Linear Audio Distribution Over Networks: A Comparison of Layer 2 and 3 Solutions Using the Example of Ethernet AVB and RAVENNA , 2011 .

[202]  Johannes Hilpert,et al.  MPEG-4 AAC-ELD v2 – The New State of the Art in High Quality Communication Audio Coding , 2011 .

[203]  Rodrigo Roman,et al.  Securing the Internet of Things , 2017, Smart Cards, Tokens, Security and Applications, 2nd Ed..

[204]  Daniel E. Quevedo,et al.  Real-Time Perceptual Moving-Horizon Multiple-Description Audio Coding , 2011, IEEE Transactions on Signal Processing.

[205]  Peter F. Driessen,et al.  The Effects of Network Delay on Tempo in Musical Performance , 2011, Computer Music Journal.

[206]  György Fazekas,et al.  An Overview of Semantic Web Activities in the OMRAS2 Project , 2010 .

[207]  Chris Chafe,et al.  JackTrip: Under the Hood of an Engine for Network Audio , 2010, ICMC.

[208]  Chris Chafe,et al.  Effect of Temporal Separation on Synchronization in Rhythmic Performance , 2010, Perception.

[209]  Victor C. M. Leung,et al.  Enabling technologies for wireless body area networks: A survey and outlook , 2009, IEEE Communications Magazine.

[210]  Christoph Lenzen,et al.  Optimal clock synchronization in networks , 2009, SenSys '09.

[211]  Adrian Freed,et al.  Features and Future of Open Sound Control version 1.1 for NIME , 2009, NIME.

[212]  Leonardo Chiariglione,et al.  Moving Picture Experts Group (MPEG) , 2009, Scholarpedia.

[213]  Jennifer Spenader,et al.  Lexical and Perceptual Grounding of a Sound Ontology , 2007, TSD.

[214]  H. Boley,et al.  Digital Ecosystems: Principles and Semantics , 2007, 2007 Inaugural IEEE-IES Digital EcoSystems and Technologies Conference.

[215]  György Fazekas,et al.  Intelligent Editing of Studio Recordings with the Help of Automatic Music Structure Extraction , 2007 .

[216]  William M. Campbell,et al.  Exploiting Nonacoustic Sensors for Speech Encoding , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[217]  U. Peter Svensson,et al.  Ensemble Hand-Clapping Experiments under the Influence of Delay and Various Acoustic Environments , 2006 .

[218]  Gordana S. Velikic,et al.  Effect of Network Latency on Interactive Musical Performance , 2006 .

[219]  Jesper Jensen,et al.  Perceptual Audio Coding Using N-Channel Lattice Vector Quantization , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[220]  WrightMatthew Open Sound Control: an enabling technology for musical networking , 2005 .

[221]  Bo Luo,et al.  Adaptive Information: Improving Business through Semantic Interoperability, Grid Computing, and Enterprise Integration , 2005, Inf. Process. Manag..

[222]  Vivek K. Goyal,et al.  Robust low-delay audio coding using multiple descriptions , 2005, IEEE Transactions on Speech and Audio Processing.

[223]  Mark B. Sandler,et al.  A tutorial on onset detection in music signals , 2005, IEEE Transactions on Speech and Audio Processing.

[224]  Gyula Simon,et al.  The flooding time synchronization protocol , 2004, SenSys '04.

[225]  Fikret Sivrikaya,et al.  Time synchronization in sensor networks: a survey , 2004, IEEE Network.

[226]  Qun Li,et al.  Global clock synchronization in sensor networks , 2006, IEEE Transactions on Computers.

[227]  A. A. Sawchuk,et al.  From remote media immersion to Distributed Immersive Performance , 2003, ETP '03.

[228]  Daniel P. W. Ellis,et al.  Chord segmentation and recognition using EM-trained hidden markov models , 2003, ISMIR.

[229]  George Tzanetakis,et al.  Musical genre classification of audio signals , 2002, IEEE Trans. Speech Audio Process..

[230]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[231]  Mahadev Satyanarayanan,et al.  Pervasive computing: vision and challenges , 2001, IEEE Wirel. Commun..

[232]  Vivek K. Goyal,et al.  Multiple description perceptual audio coding with correlating transforms , 2000, IEEE Trans. Speech Audio Process..

[233]  Tomohiro Nakatani,et al.  Sound Ontology for Computational Auditory Scence Analysis , 1998, AAAI/IAAI.

[234]  David L. Mills,et al.  Internet time synchronization: the network time protocol , 1991, IEEE Trans. Commun..

[235]  Luca Turchet,et al.  Music Emotion Recognition: Intention of Composers-Performers Versus Perception of Musicians, Non-Musicians, and Listening Machines , 2022, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[236]  Mark B. Sandler,et al.  FifthNet: Structured Compact Neural Networks for Automatic Chord Recognition , 2021, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[237]  Fabio Graziosi,et al.  On the Exploitation of 5G Multi-Access Edge Computing for Spatial Audio in Cultural Heritage Applications , 2021, IEEE Access.

[238]  Stefan Kahl,et al.  BirdNET: A deep learning solution for avian diversity monitoring , 2021, Ecol. Informatics.

[239]  Xavier Serra,et al.  Audio and Music Analysis on the Web using Essentia.js , 2021, Trans. Int. Soc. Music. Inf. Retr..

[240]  Luca Turchet,et al.  Music in Extended Realities , 2021, IEEE Access.

[241]  L. Turchet Cloud-Smart Musical Instrument Interactions: Querying a Large Music Collection with a Smart Guitar , 2020 .

[242]  M. Wanderley,et al.  The Scalability of WiFi for Mobile Embedded Sensor Interfaces , 2020, NIME.

[243]  Ben Loveridge,et al.  Networked Music Performance in Virtual Reality: Current Perspectives , 2020 .

[244]  Eric Crockett,et al.  A Low-Depth Homomorphic Circuit for Logistic Regression Model Training , 2020, IACR Cryptol. ePrint Arch..

[245]  Luca Turchet,et al.  Smart Musical Instruments: Vision, Design Principles, and Future Directions , 2019, IEEE Access.

[246]  Xavier Serra,et al.  The MTG-Jamendo Dataset for Automatic Music Tagging , 2019, ICML 2019.

[247]  Kevin R. Page,et al.  Semantic Web Technology for New Experiences Throughout the Music Production-Consumption Chain , 2019, 2019 International Workshop on Multilayer Music Representation and Processing (MMRP).

[248]  Marcelo M. Wanderley,et al.  A Comparison of Open-Source Linux Frameworks for an Augmented Musical Instrument Implementation , 2019, NIME.

[249]  Anna Xambó,et al.  Exploring Real-time Visualisations to Support Chord Learning with a Large Music Collection , 2018 .

[250]  Benjamin Elizalde,et al.  Sound event classification using ontology-based neural networks , 2018 .

[251]  E. Soler,et al.  On blockchain and its integration with IoT. Challenges and opportunities , 2018, Future Gener. Comput. Syst..

[252]  L. Turchet HARD REAL-TIME ONSET DETECTION OF PERCUSSIVE SOUNDS , 2018 .

[253]  D. Botteldooren,et al.  Early stage sound planning in urban re-development : the Antwerp case study , 2018 .

[254]  Benjamin Matuszewski,et al.  Toward a Web of Audio Things , 2018 .

[255]  Víctor Rodríguez-Doncel,et al.  Overview of the MPEG-21 Media Contract Ontology , 2016, Semantic Web.

[256]  Julián Jaramillo Arango,et al.  The Smartphone Ensemble. Exploring mobile computer mediation in collaborative musical performance , 2016, NIME.

[257]  György Fazekas,et al.  An Ontology for Audio Features , 2016, ISMIR.

[258]  P. Atrey,et al.  Secure Audio Reverberation over Cloud , 2015 .

[259]  György Fazekas,et al.  Design And Evaluation of Onset Detectors using Different Fusion Policies , 2014, ISMIR.

[260]  Aylin Kantarci,et al.  Time Synchronization Based on Slow-Flooding in Wireless Sensor Networks , 2014, IEEE Transactions on Parallel and Distributed Systems.

[261]  Colin B. D. Clark,et al.  Flocking: A Framework for Declarative Music-Making on the Web , 2014, ICMC.

[262]  Andreas Hildebrand,et al.  AES67-2013: AES standard for audio applications of networks - High-performance streaming audio-over-IP interoperability , 2014 .

[263]  Georg Essl,et al.  MoveOSC - Smart Watches in Mobile Music Performance , 2014, ICMC.

[264]  György Fazekas,et al.  SAFE: A System for the Extraction and Retrieval of Semantic Audio Descriptors , 2014 .

[265]  Bryan Pardo,et al.  Social-EQ: Crowdsourcing an Equalization Descriptor Map , 2013, ISMIR.

[266]  Xavier Serra,et al.  Roadmap for Music Information ReSearch , 2013 .

[267]  Matthew Wright,et al.  The Web Browser As Synthesizer And Interface , 2013, NIME.

[268]  Steele Daniel,et al.  THE SENSOR CITY INITIATIVE: COGNITIVE SENSORS FOR SOUNDSCAPE TRANSFORMATIONS , 2013 .

[269]  György Fazekas,et al.  The Audio Effects Ontology , 2013, ISMIR.

[270]  G. Widmer,et al.  MAXIMUM FILTER VIBRATO SUPPRESSION FOR ONSET DETECTION , 2013 .

[271]  Joseph A. Paradiso,et al.  Patchwork: Multi-User Network Control of a Massive Modular Synthesizer , 2012, NIME.

[272]  JoAnn Kuchera-Morin,et al.  Gibber: Live coding audio in the Browser , 2012, ICMC.

[273]  K. Stylianos,et al.  Common Noise Assessment Methods in Europe (CNOSSOS-EU) , 2012 .

[274]  K. Yıldırım CLOCK SYNCHRONIZATION IN WIRELESS SENSOR NETWORKS , 2012 .

[275]  Huajun Chen,et al.  The Semantic Web , 2011, Lecture Notes in Computer Science.

[276]  Erik Wilde,et al.  From the Internet of Things to the Web of Things: Resource-oriented Architecture and Best Practices , 2011, Architecting the Internet of Things.

[277]  György Fazekas,et al.  The Studio Ontology Framework , 2011, ISMIR.

[278]  György Fazekas,et al.  Knowledge Representation Issues in Musical Instrument Ontology Design , 2011, ISMIR.

[279]  Jeremy H. Brown,et al.  How fast is fast enough ? Choosing between Xenomai and Linux for real-time applications , 2010 .

[280]  Alicja Wieczorkowska,et al.  Music Information Retrieval , 2009, Encyclopedia of Data Warehousing and Mining.

[281]  Haijian Sun,et al.  Exploring the role of latency and orchestra placement on the networked performance of a distributed opera , 2009 .

[282]  Robert Hamilton,et al.  Stanford Laptop Orchestra (SLOrk) , 2009, ICMC.

[283]  Christian Werner,et al.  Distributed Network Music Workshop with Soundjack , 2008 .

[284]  Mark B. Sandler,et al.  The Music Ontology , 2007, ISMIR.

[285]  Perry R. Cook,et al.  PLOrk: The Princeton Laptop Orchestra, Year 1 , 2006, ICMC.

[286]  Anssi Klapuri,et al.  Signal Processing Methods for the Automatic Transcription of Music , 2004 .

[287]  Steffen Pauws,et al.  Musical key extraction from audio , 2004, ISMIR.

[288]  Matthew E. P. Davies,et al.  Causal Tempo Tracking of Audio , 2004, ISMIR.

[289]  John F. Sowa,et al.  Knowledge representation: logical, philosophical, and computational foundations , 2000 .

[290]  Kwok Ching Tsui,et al.  The Intelligent Assistant: An Overview , 2000, Intelligent Systems and Soft Computing.

[291]  Takuya Fujishima,et al.  Realtime Chord Recognition of Musical Sound: a System Using Common Lisp Music , 1999, ICMC.

[292]  Roger B. Dannenberg,et al.  Time in Distributed Real-Time Systems , 1999, ICMC.

[293]  Birgit Brüggemeier,et al.  Perceptions and reactions to conversational privacy initiated by a conversational user interface , 2022, Comput. Speech Lang..

[294]  A. Carôt The World’s First Interactive 5G Music Concert: Professional Quality Networked Music Over a Commodity Network Infrastructure , 2022 .