A kinect-based vocational task prompting system for individuals with cognitive impairments

Difficulties in executing daily living tasks hamper the quality of life of many individuals with cognitive impairments who are otherwise physically mobile. With sufficient and appropriate support on the job, many people with developmental disabilities and cognitive impairments are capable of participating in the world of work to various levels. Kinect is used as assistive technology for individuals with cognitive impairments to achieve the goal of performing task steps independently. In a community-based rehabilitation program under the guidance of three job coaches, a task prompting system called Kinempt was designed to assist four participants involving pre-service food preparation training. The study assessed the effectiveness of Kinempt in terms of precision and recall. A follow-up comparative study then evaluated a baseline method and the system of least prompts against the Kinempt system. Results indicate that for participants with cognitive disabilities, acquisition of job skills may be facilitated by use of Kinempt in conjunction with operant conditioning strategies. Our findings suggest that the image recognition technology may be able to facilitate task prompts needed by people with cognitive impairments. Therefore, the system may be helpful for pre-service training while increasing independence in the process of community integration.

[1]  Martin G. Brodwin,et al.  Computer Assistive Technology for People Who Have Disabilities: Computer Adaptations and Modifications , 2004 .

[2]  Yao-Jen Chang,et al.  A novel wayfinding system based on geo-coded qr codes for individuals with cognitive impairments , 2007, Assets '07.

[3]  Yao-Jen Chang,et al.  MOBILE LOCATION-BASED SOCIAL NETWORKING IN SUPPORTED EMPLOYMENT FOR PEOPLE WITH COGNITIVE IMPAIRMENTS , 2010, Cybern. Syst..

[4]  Mark F. O’Reilly,et al.  Comparing Video Prompting to Video Modeling for Teaching Daily Living Skills to Six Adults with Developmental Disabilities , 2006 .

[5]  Toni Van Laarhoven,et al.  Comparison of Three Video-Based Instructional Procedures for Teaching Daily Living Skills to Persons with Developmental Disabilities. , 2006 .

[6]  G. Gelderblom,et al.  Non-use of provided assistive technology devices, a literature overview , 2004 .

[7]  Mike Wu,et al.  Participatory design of an orientation aid for amnesics , 2005, CHI.

[8]  David F. Cihak,et al.  Generalized use of a handheld prompting system. , 2007, Research in developmental disabilities.

[9]  David F. Cihak,et al.  Use of a Handheld Prompting System to Transition Independently Through Vocational Tasks for Students with Moderate and Severe Intellectual Disabilities , 2008 .

[10]  Steven E. Stock,et al.  Enhancing Independent Task Performance for Individuals with Mental Retardation through Use of a Handheld Self-Directed Visual and Audio Prompting System. , 2002 .

[11]  Linda C. Mechling,et al.  Computer-Based Video Instruction to Teach Young Adults with Moderate Intellectual Disabilities to Perform Multiple Step, Job Tasks in a Generalized Setting , 2007 .

[12]  Yao-Jen Chang,et al.  A context aware handheld wayfinding system for individuals with cognitive impairments , 2008, Assets '08.

[13]  Teresa Taber-Doughty,et al.  Considering student choice when selecting instructional strategies: a comparison of three prompting systems. , 2005, Research in developmental disabilities.

[14]  Yao-Jen Chang,et al.  Comparing picture and video prompting in autonomous indoor wayfinding for individuals with cognitive impairments , 2010, Personal and Ubiquitous Computing.

[15]  Gerhard Fischer,et al.  Socio-technical environments supporting people with cognitive disabilities using public transportation , 2005, TCHI.

[16]  Kathleen Bodisch Lynch,et al.  Personal digital assistants as cognitive aids for individuals with severe traumatic brain injury: A community-based trial , 2008, Brain injury.

[17]  P. B. Gold,et al.  Supported employment for people with severe mental illness , 2007, The Lancet.

[18]  Simon Goodwin,et al.  Comparative Mental Health Policy: From Institutional to Community Care , 1997 .

[19]  Henry A. Kautz,et al.  Indoor wayfinding:: developing a functional interface for individuals with cognitive impairments , 2006, Assets '06.

[20]  D G Carroll,et al.  Vocational rehabilitation. , 1968, Maryland state medical journal.

[21]  Roberto Manduchi,et al.  Universal real-time navigational assistance (URNA): an urban bluetooth beacon for the blind , 2007, HealthNet '07.

[22]  Stephen Fickas,et al.  A comparison of four prompt modes for route finding for community travellers with severe cognitive impairments , 2007, Brain injury.