Multimodal Interaction and Serious Game for Assistive Robotic Devices in a Simulated Environment

Sports and physical activities allow people with disabilities to have better quality of life. The proposed work aimed to develop a multimodal interaction platform of robotic devices in a simulated environment for users to train different interface options. The suggested scenarios allow a user to interact with an Intelligent Wheelchair (IW) and with an Intelligent Robotic Ramp (IRR) performing different tasks individually or with a multiplayer option. The main objective of this multimodal interaction platform is to allow users, with severe disabilities, to move around and inclusive to play the Boccia Game more independently and autonomously. A preliminary set of experiments with 27 volunteers tested the scenarios and the multimodal interface for driving the intelligent wheelchair and to maneuver the IRR. The results show excellent performance when users maneuver the IRR in which the success achieved 90%. All dimensions of CEGEQ questionnaire presented good results. Therefore the solution created is quite satisfactory for a user point of view.

[1]  Paul A. Cairns,et al.  Assessing the Core Elements of the Gaming Experience , 2010, Evaluating User Experience in Games.

[2]  Luís Paulo Reis,et al.  Patient Classification and Automatic Configuration of an Intelligent Wheelchair , 2012, ICAART.

[3]  Luís Paulo Reis,et al.  A Survey on Intelligent Wheelchair Prototypes and Simulators , 2014, WorldCIST.

[4]  Márcio Miguel Couto de Sousa.  Multimodal interface for an intelligent wheelchair , 2009 .

[5]  Luís Paulo Reis,et al.  A Methodology for Creating an Adapted Command Language for Driving an Intelligent Wheelchair , 2015, J. Intell. Robotic Syst..

[6]  Luís Paulo Reis,et al.  A Methodology for Creating Intelligent Wheelchair Users' Profiles , 2012, ICAART.

[7]  Hugo Guedelha.  Boccia - O simulador , 2017 .

[8]  Luís Paulo Reis,et al.  User modeling and command language adapted for driving an intelligent wheelchair , 2014, 2014 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[9]  Ned Kock,et al.  Publishing Information Systems Action Research for a Positivist Audience , 2007, Commun. Assoc. Inf. Syst..

[10]  Hironori Hirata,et al.  Development of intelligent wheelchair acquiring autonomous, cooperative, and collaborative behavior , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[11]  Luís Paulo Reis,et al.  Intelligent Wheelchair Driving: A Comparative Study of Cerebral Palsy Adults with Distinct Boccia Experience , 2014, WorldCIST.

[12]  Nuno Lau,et al.  Intelligent wheelchair simulator for users' training: Cerebral palsy children's case study , 2013, 2013 8th Iberian Conference on Information Systems and Technologies (CISTI).

[13]  Nuno Lau,et al.  Evaluation of Distinct Input Methods of an Intelligent Wheelchair in Simulated and Real Environments: A Performance and Usability Study , 2013, Assistive technology : the official journal of RESNA.