Comparing projected in-situ feedback at the manual assembly workplace with impaired workers

With projectors and depth cameras getting cheaper, assistive systems in industrial manufacturing are becoming increasingly ubiquitous. As these systems are able to continuously provide feedback using in-situ projection, they are perfectly suited for supporting impaired workers in assembling products. However, so far little research has been conducted to understand the effects of projected instructions on impaired workers. In this paper, we identify common visualizations used by assistive systems for impaired workers and introduce a simple contour visualization. Through a user study with 64 impaired participants we compare the different visualizations to a control group using no visual feedback in a real world assembly scenario, i.e. assembling a clamp. Furthermore, we introduce a simplified version of the NASA-TLX questionnaire designed for impaired participants. The results reveal that the contour visualization is significantly better in perceived mental load and perceived performance of the participants. Further, participants made fewer errors and were able to assemble the clamp faster using the contour visualization compared to a video visualization, a pictorial visualization and a control group using no visual feedback.

[1]  John Hardy,et al.  Toolkit support for interactive projected displays , 2012, MUM.

[2]  A. Cuvo,et al.  Teaching Mentally Retarded Adults to Cook , 1981 .

[3]  Pat Hanrahan,et al.  Designing effective step-by-step assembly instructions , 2003, ACM Trans. Graph..

[4]  J. Bortz,et al.  Forschungsmethoden und Evaluation für Human- und Sozialwissenschaftler , 2006 .

[5]  John R. Lutzker,et al.  Using Picture Prompts to Teach an Adult with Developmental Disabilities to Independently Complete Vocational Tasks , 1997 .

[6]  Andrew D. Wilson Using a depth camera as a touch sensor , 2010, ITS '10.

[7]  Markus Funk,et al.  Design approaches for the gamification of production environments: a study focusing on acceptance , 2015, PETRA.

[8]  G E Lancioni,et al.  Promoting Independent Task Performance by Persons with Severe Developmental Disabilities through a New Computer-Aided System , 2000, Behavior modification.

[9]  Andreas Butz,et al.  SearchLight - A Lightweight Search Function for Pervasive Environments , 2004, Pervasive.

[10]  Aart Hendriks,et al.  UN Convention on the Rights of Persons with Disabilities. , 2007, European journal of health law.

[11]  Sonja Stork,et al.  Towards Optimal Worker Assistance -- A Framework for Adaptive Selection and Presentation of Assembly Instructions , 2008 .

[12]  Angela L Sauer,et al.  Assistive technology effects on the employment outcomes for people with cognitive disabilities: A systematic review , 2010, Disability and rehabilitation. Assistive technology.

[13]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[14]  Albrecht Schmidt,et al.  Augmented manufacturing: a study with impaired persons on assistive systems using in-situ projection , 2013, PETRA '13.

[15]  Bruce H. Thomas,et al.  Applying spatial augmented reality to facilitate in-situ support for automotive spot welding inspection , 2011, VRCAI.

[16]  J. Panel Convention on the Rights of Persons with Disabilities , 2013 .

[17]  Pat Hanrahan,et al.  Identification and validation of cognitive design principles for automated generation of assembly instructions , 2004, AVI.

[18]  K. Pierce,et al.  Teaching daily living skills to children with autism in unsupervised settings through pictorial self-management. , 1994, Journal of applied behavior analysis.

[19]  J. Bortz,et al.  Forschungsmethoden und Evaluation , 1995 .

[20]  M. O'Reilly,et al.  Promoting stimulus control with textual prompts and performance feedback for persons with mild disabilities. , 1992, Journal of applied behavior analysis.

[21]  Claudio S. Pinhanez The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces , 2001, UbiComp.

[22]  Pattie Maes,et al.  LuminAR: portable robotic augmented reality interface design and prototype , 2010, UIST '10.

[23]  Stefan Kopp,et al.  An assistance system for guiding workers in central sterilization supply departments , 2013, PETRA '13.