A Wearable, Extensible, Open-Source Platform for Hearing Healthcare Research

Hearing loss is one of the most common conditions affecting older adults worldwide. Frequent complaints from the users of modern hearing aids include poor speech intelligibility in noisy environments and high cost, among other issues. However, the signal processing and audiological research needed to address these problems has long been hampered by proprietary development systems, underpowered embedded processors, and the difficulty of performing tests in real-world acoustical environments. To facilitate existing research in hearing healthcare and enable new investigations beyond what is currently possible, we have developed a modern, open-source hearing research platform, Open Speech Platform (OSP). This paper presents the system design of the complete OSP wearable platform, from hardware through firmware and software to user applications. The platform provides a complete suite of basic and advanced hearing aid features which can be adapted by researchers. It serves web apps directly from a hotspot on the wearable hardware, enabling users and researchers to control the system in real time. In addition, it can simultaneously acquire high-quality electroencephalography (EEG) or other electrophysiological signals closely synchronized to the audio. All of these features are provided in a wearable form factor with enough battery life for hours of operation in the field.

[1]  Julien Penders,et al.  Wearable, Wireless EEG Solutions in Daily Life Applications: What are we Missing? , 2015, IEEE Journal of Biomedical and Health Informatics.

[2]  Lynn Rochester,et al.  Community ambulation in older adults: which internal characteristics are important? , 2010, Archives of physical medicine and rehabilitation.

[3]  Melanie A Ferguson,et al.  Applying the COM-B Model to Assess the Usability of Smartphone-Connected Listening Devices in Adults with Hearing Loss , 2019, Journal of the American Academy of Audiology.

[4]  James M. Kates Modeling the effects of single-microphone noise-suppression , 2017, Speech Commun..

[5]  Bhaskar D. Rao,et al.  A realtime, open-source speech-processing platform for research in hearing loss compensation , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[6]  M A Stone,et al.  Tolerable hearing aid delays. I. Estimation of limits imposed by the auditory path alone using simulated hearing losses. , 1999, Ear and hearing.

[7]  J Agnew,et al.  Just noticeable and objectionable group delays in digital hearing aids. , 2000, Journal of the American Academy of Audiology.

[8]  Brent Ware,et al.  Open source web development with LAMP : using Linux, Apache, MySQL, Perl, and PHP , 2003 .

[9]  Simon Haykin,et al.  Communication Systems , 1978 .

[10]  Harinath Garudadri,et al.  A 678- $\mu$ W Frequency-Modulation-Based ADC With 104-dB Dynamic Range in 44-kHz Bandwidth , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[11]  L. J. Griffiths,et al.  An alternative approach to linearly constrained adaptive beamforming , 1982 .

[12]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[13]  Yu-Hsiang Wu,et al.  A Comparison of Personal Sound Amplification Products and Hearing Aids in Ecologically Relevant Test Environments. , 2018, American journal of audiology.

[14]  Julie E. Greenberg,et al.  Modified LMS algorithms for speech processing with an adaptive noise canceller , 1998, IEEE Trans. Speech Audio Process..

[15]  Todd A. Ricketts,et al.  Modern hearing aids , 2016 .

[16]  P M Zurek,et al.  Evaluation of an adaptive beamforming method for hearing aids. , 1992, The Journal of the Acoustical Society of America.

[17]  N. Peel,et al.  Gait speed as a measure in geriatric assessment in clinical settings: a systematic review. , 2013, The journals of gerontology. Series A, Biological sciences and medical sciences.

[18]  W. Marsden I and J , 2012 .

[19]  J. Kates Principles of Digital Dynamic-Range Compression , 2005, Trends in amplification.

[20]  Yuxuan Ouyang,et al.  22.2 A Rugged Wearable Modular ExG Platform Employing a Distributed Scalable Multi-Channel FM-ADC Achieving 101dB Input Dynamic Range and Motion-Artifact Resilience , 2019, 2019 IEEE International Solid- State Circuits Conference - (ISSCC).

[21]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[22]  Steven P. Hooker,et al.  Mobility and Aging: Transference to Transportation , 2011, Journal of aging research.

[23]  T. Egner,et al.  Foundation and Practice of Neurofeedback for the Treatment of Epilepsy , 2006, Applied psychophysiology and biofeedback.

[24]  Stefano Ermon,et al.  Audio Super Resolution using Neural Networks , 2017, ICLR.

[25]  Akihiko Sugiyama,et al.  Robust Adaptive Beamforming , 2001, Microphone Arrays.

[26]  O. L. Frost,et al.  An algorithm for linearly constrained adaptive array processing , 1972 .

[27]  F Grandori,et al.  A hospital based universal neonatal hearing screening programme using click-evoked otoacoustic emissions , 2001, Scandinavian audiology. Supplementum.

[28]  Marc Moonen,et al.  Fifty Years of Acoustic Feedback Control: State of the Art and Future Challenges , 2011, Proceedings of the IEEE.

[29]  Arthur Boothroyd,et al.  A “Goldilocks” Approach to Hearing Aid Self-Fitting: Ear-Canal Output and Speech Intelligibility Index , 2019, Ear and hearing.

[30]  Syed B. Huq John Goldie An Overview of LVDS Technology , 1996 .

[31]  Jareen Meinzen-Derr,et al.  Pediatric hearing impairment caregiver experience: impact of duration of hearing loss on parental stress. , 2008, International journal of pediatric otorhinolaryngology.

[32]  Bhaskar D. Rao,et al.  Sparsity promoting LMS for adaptive feedback cancellation , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[33]  Francis Kuk,et al.  Vent configurations on subjective and objective occlusion effect. , 2005, Journal of the American Academy of Audiology.

[34]  Arthur Boothroyd,et al.  A "Goldilocks" Approach to Hearing-Aid Self-Fitting: User Interactions. , 2017, American journal of audiology.

[35]  Thomas Lunner,et al.  Toward EEG-Assisted Hearing Aids: Objective Threshold Estimation Based on Ear-EEG in Subjects With Sensorineural Hearing Loss , 2018, Trends in Hearing.

[36]  D. Kemp Stimulated acoustic emissions from within the human auditory system. , 1978, The Journal of the Acoustical Society of America.

[37]  Andre Charland,et al.  Mobile application development , 2011, Commun. ACM.

[38]  Rajesh Gupta,et al.  A Wearable Platform for Research in Augmented Hearing , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[39]  Ching-Hua Lee,et al.  Speech quality and stable gain trade-offs in adaptive feedback cancellation for hearing aids. , 2017, The Journal of the Acoustical Society of America.

[40]  M. Arns,et al.  Neurofeedback as a Treatment Intervention in ADHD: Current Evidence and Practice , 2019, Current Psychiatry Reports.

[41]  Sungho Jo,et al.  Dynamic motion artifact removal using inertial sensors for mobile BCI , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[42]  Francesco Pinciroli,et al.  Apps for Hearing Science and Care. , 2015, American journal of audiology.

[43]  R. Bennett,et al.  Exploring Hearing Aid Problems: Perspectives of Hearing Aid Owners and Clinicians , 2017, Ear and hearing.