Camera-based Interfaces and Assistive Software for People with Severe Motion Impairments

Intelligent assistive technology can greatly improve the daily lives of peo- ple with severe paralysis, who have limited communication abilities. People with motion impairments often prefer camera-based communication interfaces, because these are customizable, comfortable, and do not require user-borne accessories that could draw attention to their disability. We present an overview of assistive soft- ware that we specifically designed for camera-based interfaces such as the Camera Mouse, which serves as a mouse-replacement input system. The applications in- clude software for text-entry, web browsing, image editing, animation, and music therapy. Using this software, people with severe motion impairments can communi- cate with friends and family and have a medium to explore their creativity.

[1]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[2]  Margrit Betke,et al.  Real Time Eye Tracking and Blink Detection with USB Cameras , 2005 .

[3]  Margrit Betke,et al.  A Human–Computer Interface Using Symmetry Between Eyes to Detect Gaze Direction , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[4]  Margrit Betke,et al.  Camera Canvas: Image Editor for People with Severe Disabilities , 2008 .

[5]  Constantine Stephanidis,et al.  Universal access in the information society , 1999, HCI.

[6]  Margrit Betke,et al.  Empathic painting: interactive stylization through observed emotional state , 2006, NPAR.

[7]  Carl Brown,et al.  Assistive technology computers and persons with disabilities , 1992, CACM.

[8]  Margrit Betke,et al.  Communication via eye blinks and eyebrow raises: video-based human-computer interfaces , 2003, Universal Access in the Information Society.

[9]  M. Betke,et al.  The Camera Mouse: visual tracking of body features to provide computer access for people with severe disabilities , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  C. Stephanidis,et al.  Universal Access in Ambient Intelligence Environments , 2008 .

[11]  Margrit Betke,et al.  Counting Fingers in Real Time: A Webcam-Based Human-Computer Interface with Game Applications , 2003, HCI.

[12]  Margrit Betke,et al.  Evaluation of tracking methods for human-computer interaction , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[13]  Margrit Betke,et al.  Web Mediators for Accessible Browsing , 2006, Universal Access in Ambient Intelligence Environments.

[14]  Margrit Betke,et al.  Active Detection of Eye Scleras in Real Time , 2000 .

[15]  Margrit Betke,et al.  Experiments with a Camera-Based Human-Computer Interface System , 2002 .

[16]  Margrit Betke,et al.  Tracking, analysis, and recognition of human gestures in video , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[17]  Margrit Betke,et al.  EyeKeys: A Real-Time Vision Interface Based on Gaze Detection from a Low-Grade Video Camera , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[18]  Margrit Betke,et al.  Detecting Objects of Variable Shape Structure With Hidden State Shape Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Robert J. K. Jacob,et al.  Eye tracking in advanced interface design , 1995 .

[20]  Margrit Betke,et al.  Symbol design: a user-centered method to design pen-based interfaces and extend the functionality of pointer input devices , 2005, Universal Access in the Information Society.

[21]  Margrit Betke,et al.  Early experiences using visual tracking for computer access by people with profound physical disabilities , 2001, HCI.

[22]  Margrit Betke,et al.  A Customizable Camera-Based Human Computer Interaction System Allowing People with Disabilities Autonomous Hands-Free Navigation of Multiple Computing Tasks , 2006, Universal Access in Ambient Intelligence Environments.

[23]  Margrit Betke,et al.  Fast Head Tilt Detection for Human-Computer Interaction , 2005, ICCV-HCI.

[24]  Margrit Betke,et al.  A Camera-Based Music-Making Tool for Physical Rehabilitation , 2005, Computer Music Journal.