SignSupport: a limited communication domain mobile aid for a Deaf patient at the pharmacy

This paper discusses a prototype for a communication aid on a mobile phone to support a Deaf person visiting a public hospital pharmacy. The aim is to prevent problems of non-compliance to treatment due to poor communication between a Deaf patient and a pharmacist. We studied the communication exchange between pharmacists and Deaf patients in a pharmacy setting in order to extract the most relevant content exchange between the two parties. A prototype was developed on a mobile phone and iteratively tested using role plays, questionnaires and focus groups with pharmacy students and Deaf participants. The prototype allows pharmacists to input text and make selections that provide detailed medical instructions in signed language to a Deaf patient. The prototype demonstrates the feasibility of encoding a limited communication flow on a mobile device, with carefully sequenced sign language videos that a Deaf patient can watch and understand in order to take medicine correctly.

[1]  Matt Jones,et al.  Mobile Interaction Design , 2006 .

[2]  M. Haywood,et al.  Implementation of wireless-fidelity (Wi-Fi) instruments for rural areas of North Carolina , 2007, Proceedings 2007 IEEE SoutheastCon.

[3]  Antonella Di Stefano,et al.  An expert system for medical diagnosis , 1988, Proceedings of the Symposium on the Engineering of Computer-Based Medical.

[4]  Meryl Glaser,et al.  SoftBridge in action: the first Deaf telephony pilot , 2003 .

[5]  R. Kallet,et al.  How to write the methods section of a research paper. , 2004, Respiratory care.

[6]  P. Maguire,et al.  Key communication skills and how to acquire them , 2002, BMJ : British Medical Journal.

[7]  Richard E. Ladner,et al.  MobileASL:: intelligibility of sign language video as constrained by mobile phone technology , 2006, Assets '06.

[8]  Meryl Glaser,et al.  Telecommunications bridging between deaf and hearing users in South Africa , 2004 .

[9]  Ian Marshall,et al.  The development of language processing support for the ViSiCAST project , 2000, Assets '00.

[10]  Hsinchun Chen,et al.  Introduction to the special issue on decision support in medicine , 2007, Decis. Support Syst..

[11]  John Watkinson,et al.  MPEG Handbook , 2012 .

[12]  Mary R. Power,et al.  Deaf people communicating via SMS, TTY, relay service, fax, and computers in Australia. , 2006, Journal of deaf studies and deaf education.

[13]  Leysia Palen,et al.  Instant messaging in teen life , 2002, CSCW '02.

[14]  Mehrdad Ghaziasgar,et al.  Investigating the feasibility factors of synthetic sign language visualization methods on mobile phones , 2010, SAICSIT '10.

[15]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  Stephen J. Cox,et al.  A Comparison of Active Shape Model and Scale Decomposition Based Features for Visual Speech Recognition , 1998, ECCV.

[17]  Mansoor Sarhadi,et al.  Reconstructing 3D Pose and Motion from a Single Camera View , 1998, BMVC.

[18]  William David Tucker,et al.  Browser-based video communication for deaf people , 2009 .

[19]  Meryl Glaser,et al.  Deaf telephony: community-based co-design , 2011 .

[20]  William David Tucker,et al.  A mobile Deaf-to-hearing communication aid for medical diagnosis , 2010 .

[21]  Debra Aarons,et al.  Inclusion and the Deaf child in South African education , 2002 .

[22]  Xin Liu,et al.  Real Time Large Vocabulary Continuous Sign Language Recognition Based on OP/Viterbi Algorithm , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[23]  Mark Wells,et al.  Tessa, a system to aid communication with deaf people , 2002, ASSETS.

[24]  Debra Aarons,et al.  A Deaf Adult Literacy Collective , 2012 .

[25]  William David Tucker,et al.  Asynchronous video telephony for the Deaf , 2007 .

[26]  Desmond J. (Desmond John) Mary R Bernd Power,et al.  German Deaf People Using Text Communication: Short Message Service, TTY, Relay Services, Fax, and E-mail , 2007, American annals of the deaf.

[27]  Meryl Glaser,et al.  Mobile communication tools for a South African deaf patient in a pharmacy context , 2012 .

[28]  Jeffrey Saul Weisel.  Telephonic communications system for the deaf , 1973 .

[29]  James Connan,et al.  Investigating the Intelligibility of Synthetic Sign Language Visualization Methods on Mobile Phones , 2022 .