Visual perception of content-prioritised sign language video quality.

Video communication systems currently provide poor quality and performance for deaf people using sign language, particularly at low bit rates. Our previous work, involving eye movement tracking experiments and analysis of visual attention mechanisms for sign language, demonstrated a consistent characteristic response which could be exploited to enable optimisation of video coding systems performance by prioritising content for deaf users. This paper describes an experiment designed to test the perceived quality of selectively prioritised video for sign language communication. A series of selectively degraded video clips was shown to individual deaf viewers. Participants subjectively rated the quality of the modified video on a Degradation Category Rating (DCR) scale adapted for sign language users. The results demonstrate the potential to develop content-prioritised coding schemes, based on viewing behaviour, which can reduce bandwidth requirements and provide best quality for the needs of the user. We propose selective quantisation to reduce compression in visually important regions of video images, which require spatial detail for small slow motion detection, and increased compression of regions regarded in peripheral vision where large rapid movements occur in sign language communication.

[1]  Kenneth E. Barner,et al.  Region of interest priority coding for sign language videoconferencing , 1997, Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing.

[2]  G Sandini,et al.  New developments in low-bit rate videotelephony for people who are deaf. , 1997, Journal of speech, language, and hearing research : JSLHR.

[3]  M. Angela Sasse,et al.  Do Users Always Know What's Good For Them? Utilising Physiological Responses to Assess Media Quality , 2000, BCS HCI.

[4]  Iain E. Garden Richardson,et al.  Video telephony for the deaf: analysis and development of an optimised video compression product , 2002, MULTIMEDIA '02.

[5]  Iain E. Garden Richardson,et al.  Gaze tracking and its application to video coding for sign language. , 2003 .

[6]  Patricia Siple,et al.  Visual Constraints for Sign Language Communication , 2013 .

[7]  Cedric Nishan Canagarajah,et al.  A video coding system for sign language communication at low bit rates , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[8]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[9]  Laura J. Muir,et al.  Perception of sign language and its application to visual communications for deaf people. , 2005, Journal of deaf studies and deaf education.

[10]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[11]  Jim Mullin,et al.  New techniques for assessing audio and video quality in real-time interactive communications , 2002 .

[12]  Alexandros Eleftheriadis,et al.  Automatic face location detection and tracking for model-assisted coding of video teleconferencing sequences at low bit-rates , 1995, Signal Process. Image Commun..

[13]  Richard A. Foulds,et al.  Robust region of interest coding for improved sign language telecommunication , 2002, IEEE Transactions on Information Technology in Biomedicine.