Power Saving Strategies for Two-Way , Real-Time Video-Enabled Cellular Phones

Power Saving Strategies for Two-Way, Real-Time Video-Enabled Cellular Phones Jessica Julie Tran Co-Chairs of the Supervisory Committee: Professor Eve A. Riskin Electrical Engineering Professor Richard E. Ladner Computer Science and Engineering MobileASL provides low bandwidth and low complexity software video encoders to enable real-time video conversations on cell phones, therefore allowing people who are deaf to communicate in their native language, American Sign Language. This thesis presents two alternative power saving algorithms that utilize activity recognition to extend battery resources when using MobileASL. The first algorithm, called variable spatial resolution (VSR), adjusts the spatial resolution of transmitted videos. The second algorithm applies a technique called variable frame rate (VFR) and VSR to adjust both frame rate and spatial resolution of transmitted videos. My goals are to implement both power saving algorithms in the MobileASL software program; conduct a battery power study to determine the duration of the battery life while using each algorithm; and conduct a web-based user study to determine if participants could perceive changes in video quality. The battery power study revealed that running MobileASL without any power saving algorithms consumes 99.7% of the phone’s CPU and a full battery charge lasts on average 284 minutes. Implementing VFR or VSR algorithms separately extend the battery life to an average 307 and 306 minutes respectively and lowers the CPU usage to 26% and 32% respectively. Applying VFR and VSR algorithms together extend the battery life to 315 minutes and lower the CPU usage to 10%. The experimental design of the user study was a 2 x 2 within-subjects factorial design. Major findings include discovering a significant VFR*VSR interaction, (F1,15=5.3, p<.05), which led to determining that applying VSR reduces the extent to which participants perceive VFR to induce choppiness. Also, the application of VSR did cause participants to perceive blurry video quality,(F1,15=21.2, p<.003), and participants found the blurriness to be distracting, (F1,15=10.1, p<.01). The battery power study revealed that applying VFR, VSR, and both VFR and VSR all extend the battery life of a cell phone running MobileASL. Applying both VFR and VSR was found to extend the battery life the most. Therefore, the recommendation is for MobileASL to adopt the use of both VFR and VSR algorithms to extend the battery duration of the cell phone.

[1]  Michael S. Landy,et al.  Intelligible encoding of ASL image sequences at extremely low information rates , 1985, Comput. Vis. Graph. Image Process..

[2]  J. K. Caird,et al.  The effect of frame rate and video information redundancy on the perceptual learning of American Sign Language gestures , 1996, CHI Conference Companion.

[3]  Christina L. James,et al.  Text input for mobile devices: comparing model prediction to actual performance , 2001, CHI.

[4]  Richard E. Ladner,et al.  Variable frame rate for low power mobile sign language communication , 2007, Assets '07.

[5]  Cedric Nishan Canagarajah,et al.  Optimized sign language video coding based on eye-tracking analysis , 2003, Visual Communications and Image Processing.

[6]  Marios S. Pattichis,et al.  Foveated video compression with optimal rate control , 2001, IEEE Trans. Image Process..

[7]  E. Klima The signs of language , 1979 .

[8]  Laura J. Muir,et al.  Perception of sign language and its application to visual communications for deaf people. , 2005, Journal of deaf studies and deaf education.

[9]  Iain E. Garden Richardson,et al.  Gaze tracking and its application to video coding for sign language. , 2003 .

[10]  Steven Collins,et al.  WHAT HAPPENS IN TACTILE ASL , 1998 .

[11]  Chris Gniady,et al.  Understanding energy consumption of sensor enabled applications on mobile phones , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  T. Humphries,et al.  A Basic Course in American Sign Language , 1981 .

[13]  Rahul Vanam,et al.  Improved Rate Control and Motion Estimation for H.264 Encoder , 2007, 2007 IEEE International Conference on Image Processing.

[14]  G. Mirus,et al.  American Sign Language in virtual space: Interactions between deaf users of computer-mediated video communication and the impact of technology on language practices , 2003, Language in Society.

[15]  J. Coates,et al.  Turn‐taking patterns in deaf conversation , 2001 .

[16]  Richard E. Ladner,et al.  Activity analysis enabling real-time video communication on mobile phones for deaf users , 2009, UIST '09.

[17]  Barbara Allen,et al.  American Sign Language and End-of-Life Care: Research in the Deaf Community , 2002, HEC forum : an interdisciplinary journal on hospitals' ethical and legal issues.

[18]  Scott J. Richter,et al.  Nearly exact tests in factorial experiments using the aligned rank transform , 1999 .

[19]  Richard E. Ladner,et al.  Activity analysis of sign language video for mobile telecommunication , 2009 .

[20]  Dc Washington,et al.  National Institute for Literacy. , 2008 .