The wouse: A wearable wince detector to stop assistive robots

Persons with severe motor impairments depend heavily upon caregivers for the performance of everyday tasks. Ongoing work is exploring the potential of giving motor-impaired users control of semi-autonomous assistive mobile manipulators to enable them to perform some self-care tasks such as scratching or shaving. Because these users are less able to escape a robot malfunction, or operate a traditional run-stop, physical human-robot interaction poses safety risks. We review approaches to safety in assistive robotics with a focus on accessible run-stops, and propose wincing as an accessible gesture for activating a run-stop device. We also present the wouse, a novel device for detecting wincing from skin movement near the eye, consisting of optical mouse components mounted near a user's temple via safety goggles. Using this device, we demonstrate a complete system to run-stop a Willow Garage PR2 robot, and perform two preliminary user studies. The first study examines discrimination of wincing from self-produced facial expressions. The results indicate the possibility for discrimination, though variability between users and inconsistent detection of skin movement remain significant challenges. The second experiment examines discrimination of wincing from external mechanical manipulations of the face during self-care tasks. The results indicate that the wouse, using a classifier trained with data from the first experiment, can be used during face-manipulation tasks. The device produced no false positives, but succeeded in correctly identifying wincing events in only two of four subjects.

[1]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[2]  Christopher J. Harper,et al.  Towards the Development of International Safety Standards for Human Robot Interaction , 2010, Int. J. Soc. Robotics.

[3]  Timo Malm,et al.  Safety of Interactive Robotics—Learning from Accidents , 2010, Int. J. Soc. Robotics.

[4]  Developing heuristics for assistive robotics , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[5]  Axel Gräser,et al.  The Rehabilitation Robots FRIEND-I & II: Daily Life Independency through Semi-Autonomous Task-Execution , 2007 .

[6]  Rolf Dieter Schraft,et al.  Robot-Dummy Crash Tests for Robot Safety Assessment , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Alessandro De Luca,et al.  Collision Detection and Safe Reaction with the DLR-III Lightweight Manipulator Arm , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Dong-Soo Kwon,et al.  Integration of a Rehabilitation Robotic System (KARES II) with Human-Friendly Man-Machine Interaction Units , 2004, Auton. Robots.

[9]  F. Gerstenbrand,et al.  Varieties of the locked-in syndrome , 1979, Journal of Neurology.

[10]  Martin Hägele,et al.  Dependable Interaction with an Intelligent Home Care Robot , 2001 .

[11]  K. Feldt,et al.  The checklist of nonverbal pain indicators (CNPI). , 2000, Pain management nursing : official journal of the American Society of Pain Management Nurses.

[12]  M Busnel,et al.  The robotized workstation "MASTER" for users with tetraplegia: description and evaluation. , 1999, Journal of rehabilitation research and development.

[13]  Paolo Dario,et al.  MOVAID: a personal robot in everyday life of disabled and elderly people , 1999 .

[14]  Kyu Sik Kwon Optimum Design for Emergency Stop Button on Robot Teach Pendants. , 1996 .

[15]  Kyu Sik Kwon Optimum Design for Emergency Stop Button on Robot Teach Pendants. , 1996, International journal of occupational safety and ergonomics : JOSE.

[16]  H.F.M. Van der Loos,et al.  VA/Stanford rehabilitation robotics research and development program: lessons learned in the application of robotics technology to the field of rehabilitation , 1995 .

[17]  S. P. Gaskill,et al.  Safety issues in modern applications of robots , 1994 .

[18]  Cucchiara,et al.  Anatomy Lesson , 1994, Annals of Internal Medicine.

[19]  R. A. Hirschfeld,et al.  Survey of robot safety in industry , 1993 .

[20]  L. Leifer,et al.  Clinical evaluation of a desktop robotic assistant. , 1989, Journal of rehabilitation research and development.

[21]  W Seamone,et al.  Early clinical evaluation of a robot arm/worktable system for spinal-cord-injured persons. , 1985, Journal of rehabilitation research and development.

[22]  Philip L. Roth,et al.  The Anatomy Lesson , 1983 .

[23]  P. Ekman,et al.  Facial Action Coding System: Manual , 1978 .

[24]  P. Ekman Universal facial expressions of emotion. , 1970 .

[25]  W. P. Chapman,et al.  VARIATIONS IN CUTANEOUS AND VISCERAL PAIN SENSITIVITY IN NORMAL SUBJECTS. , 1944, The Journal of clinical investigation.