Deaf people feeling music rhythm by using a sensing and actuating device

Abstract Quality of life of disabled people in developed societies is one of the main issues to be achieved by evolution of technological solutions as well as obtaining low-cost equipment for achievement this purpose. Some equipment has been developed, and presented, and several studies have been performed about this subject. However, most of them present some gaps that are partially solved in this work. This paper describes a systematic approach and a final prototype for helping deaf people to feel music rhythm. The system hardware includes an audio sensor, two microcontrollers and light and vibrotactile outputs for transmitting the feeling of music rhythm. Also, a software interface has been developed. The prototype has been tested in several institutions that take care of deaf people. About 45 persons tested the equipment and the results achieved are encouraging.

[1]  Isabelle Peretz,et al.  Cochlear implant users move in time to the beat of drum music , 2015, Hearing Research.

[2]  Idoia Palicio,et al.  Bone-anchored hearing device surgery: Linear incision without soft tissue reduction. A prospective study. , 2015 .

[3]  Xabier Altuna,et al.  Cirugía del implante osteointegrado: estudio prospectivo empleando incisión lineal sin reducción de tejido subcutáneo , 2015 .

[4]  Paul Hong,et al.  Decisional Conflict in Parents Considering Bone-Anchored Hearing Devices in Children With Unilateral Aural Atresia , 2015, The Annals of otology, rhinology, and laryngology.

[5]  Aniruddh D. Patel,et al.  UC Office of the President Recent Work Title Synchronization to auditory and visual rhythms in hearing and deaf individuals Permalink , 2014 .

[6]  Yuan-Fang Chou,et al.  The development of a non-surgical direct drive hearing device with a wireless actuator coupled to the tympanic membrane , 2013 .

[7]  A. Reid,et al.  Bone-Anchored Hearing Devices in Children with Unilateral Conductive Hearing Loss: A Patient-Carer Perspective , 2013, The Annals of otology, rhinology, and laryngology.

[8]  Anabel Maler,et al.  Songs for Hands: Analyzing Interactions of Sign Language and Music , 2013 .

[9]  Hiroshi Hosoi,et al.  Benefit of a new hearing device utilizing cartilage conduction. , 2013, Auris, nasus, larynx.

[10]  Yulin Wang,et al.  Designing wearable vibrotactile notifications for information communication , 2016, Int. J. Hum. Comput. Stud..

[11]  Deborah I. Fels,et al.  Composing vibrotactile music: A multi-sensory experience with the emoti-chair , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[12]  Frank A. Russo,et al.  Compensatory Plasticity in the Deaf Brain: Effects on Perception of Music , 2014, Brain sciences.

[13]  Suranga Nanayakkara,et al.  An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair , 2009, CHI.

[14]  C. Röösli,et al.  The Bonebridge: Preclinical evaluation of a new transcutaneously-activated bone anchored hearing device , 2013, Hearing Research.

[15]  Luís Paulo Reis,et al.  Humanized Robot Dancing: Humanoid Motion Retargeting Based in a Metrical Representation of Human Dance Styles , 2011, EPIA.

[16]  James A. Landay,et al.  Can you see what i hear?: the design and evaluation of a peripheral sound display for the deaf , 2003, CHI '03.

[17]  Meinard Mller,et al.  Fundamentals of Music Processing: Audio, Analysis, Algorithms, Applications , 2015 .

[18]  James H. Clark,et al.  Osseointegration and its role in management of hearing loss , 2014 .

[19]  Nick Bryan-Kinns,et al.  How does it feel like? An exploratory study of a prototype system to convey emotion through haptic wearable devices , 2015, 2015 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN).

[20]  Shaun Baker,et al.  Innovation in abutment-free bone-anchored hearing devices in children: Updated results and experience. , 2015, International journal of pediatric otorhinolaryngology.

[21]  M. Profant,et al.  Surgery or implantable hearing devices in children with congenital aural atresia: 25 years of our experience. , 2015, International journal of pediatric otorhinolaryngology.

[22]  Simonetta Monini,et al.  Transcutaneous bone-conduction hearing device: audiological and surgical aspects in a first series of patients with mixed hearing loss , 2013, Acta oto-laryngologica.

[23]  Gaetano Paludetti,et al.  Experience Changes How Emotion in Music Is Judged: Evidence from Children Listening with Bilateral Cochlear Implants, Bimodal Devices, and Normal Hearing , 2015, PloS one.