Design and Implementation of a Position, Speed and Orientation Fuzzy Controller Using a Motion Capture System to Operate a Wheelchair Prototype

The design and implementation of an electronic system that involves head movements to operate a prototype that can simulate future movements of a wheelchair was developed here. The controller design collects head-movements data through a MEMS sensor-based motion capture system. The research was divided into four stages: First, the instrumentation of the system using hardware and software; second, the mathematical modeling using the theory of dynamic systems; third, the automatic control of position, speed, and orientation with constant and variable speed; finally, system verification using both an electronic controller test protocol and user experience. The system involved a graphical interface for the user to interact with it by executing all the controllers in real time. Through the System Usability Scale (SUS), a score of 78 out of 100 points was obtained from the qualification of 10 users who validated the system, giving a connotation of “very good”. Users accepted the system with the recommendation to improve safety by using laser sensors instead of ultrasonic range modules to enhance obstacle detection.

[1]  Norbert Stoll,et al.  A speed compensation algorithm for a head tilts controller used for wheelchairs and rehabilitation applications , 2017, 2017 IEEE 15th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[2]  Norbert Stoll,et al.  Design and implementation of low-cost intelligent wheelchair controller for quadriplegias and paralysis patient , 2017, 2017 IEEE 15th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[3]  Yskandar Hamam,et al.  Identification of wheelchair user steering behaviour within indoor environments , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[4]  Emma Fortune,et al.  Estimation of manual wheelchair-based activities in the free-living environment using a neural network model with inertial body-worn sensors. , 2019, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[5]  Giovanni Saggio,et al.  Ambient assisted living for tetraplegic people by means of an electronic system based on a novel sensory headwear : Increased possibilities for reduced abilities , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[6]  Alfonso Gómez-Espinosa,et al.  Foot-Mounted Inertial Measurement Units-Based Device for Ankle Rehabilitation , 2018, Applied Sciences.

[7]  A. Berghold,et al.  Preventing neural tube defects in Europe: a missed opportunity. , 2005, Reproductive toxicology.

[8]  N. Hammam,et al.  Sedentary behavior and children with physical disabilities: a scoping review , 2020, Disability and rehabilitation.

[9]  Mauro Callejas-Cuervo,et al.  Joint amplitude MEMS based measurement platform for low cost and high accessibility telerehabilitation: Elbow case study. , 2017, Journal of bodywork and movement therapies.

[10]  Vicente Ferreira de Lucena,et al.  Multimodal System for Training at Distance in a Virtual or Augmented Reality Environment for Users of Electric-Powered Wheelchairs , 2016 .

[11]  Liviu Florin Manta,et al.  Wheelchair control by head motion using a noncontact method in relation to the pacient , 2019, 2019 20th International Carpathian Control Conference (ICCC).

[12]  Chian-Song Chiu,et al.  Fuzzy wall-following control of a wheelchair , 2017, 2017 Joint 17th World Congress of International Fuzzy Systems Association and 9th International Conference on Soft Computing and Intelligent Systems (IFSA-SCIS).

[13]  M. Jallouli,et al.  Wheelchair obstacle avoidance based on fuzzy controller and ultrasonic sensors , 2013, 2013 International Conference on Computer Applications Technology (ICCAT).

[14]  J. D. de Groot,et al.  Development of a wheelchair mobility skills test for children and adolescents: combining evidence with clinical expertise , 2017, BMC Pediatrics.

[15]  Seong-Whan Lee,et al.  Steady-state somatosensory evoked potentials for brain-controlled wheelchair , 2014, 2014 International Winter Workshop on Brain-Computer Interface (BCI).

[16]  Prannah Dey,et al.  Smart wheelchair integrating head gesture navigation , 2019, 2019 International Conference on Robotics,Electrical and Signal Processing Techniques (ICREST).

[17]  Youngjin Choi,et al.  EMG-based continuous control method for electric wheelchair , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Vicente Feliú Batlle,et al.  Trajectory Planning for a Stair-Climbing Mobility System Using Laser Distance Sensors , 2016, IEEE Systems Journal.

[19]  Octavian Postolache,et al.  Toward developing a smart wheelchair for user physiological stress and physical activity monitoring , 2014, 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[20]  Luis Montesano,et al.  Towards an Intelligent Wheelchair System for Users With Cerebral Palsy , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Suat Karakaya,et al.  Real time control of a wheelchair based on EMG and Kinect for the disabled people , 2015, 2015 Medical Technologies National Conference (TIPTEKNO).

[22]  Muhammad Abdul Goffar Khan,et al.  Wireless head gesture controlled wheel chair for disable persons , 2017, 2017 IEEE Region 10 Humanitarian Technology Conference (R10-HTC).

[23]  Hiroki Taniue,et al.  Development of automatic barrier detection system for wheelchair , 2015, 2015 IEEE 4th Global Conference on Consumer Electronics (GCCE).

[24]  Mohamed Jallouli,et al.  Multisensor data fusion for electrical wheelchair localization using extended Kalman Filter , 2017, 2017 18th International Conference on Sciences and Techniques of Automatic Control and Computer Engineering (STA).

[25]  Mauro Callejas Cuervo,et al.  Control Systems and Electronic Instrumentation Applied to Autonomy in Wheelchair Mobility: The State of the Art , 2020, Sensors.

[26]  Norbert Stoll,et al.  Multi-sensor robotic-wheelchair controller for handicap and quadriplegia patients using embedded technologies , 2016, 2016 9th International Conference on Human System Interactions (HSI).

[27]  Kalyani Bhole,et al.  GAIT ANALYSIS USING IMU SENSOR , 2019, 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT).

[28]  Rui Wang,et al.  A Directional Identification Method Based on Position and Posture of Head for an Omni-directional Mobile Wheelchair Robot , 2017, ICIRA.

[29]  Joav Merrick,et al.  Disability and health. , 2004, International journal of adolescent medicine and health.

[30]  Andrew A. West,et al.  Assessing wireless inertia measurement units for monitoring athletics sprint performance , 2014, IEEE SENSORS 2014 Proceedings.

[31]  Tao Lu A motion control method of intelligent wheelchair based on hand gesture recognition , 2013, 2013 IEEE 8th Conference on Industrial Electronics and Applications (ICIEA).

[32]  Huosheng Hu,et al.  EMG-based hands-free wheelchair control with EOG attention shift detection , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[33]  Zinnia Sultana,et al.  Design and implementation of a head motion-controlled semi-autonomous wheelchair for quadriplegic patients based on 3-axis accelerometer , 2019, 2019 22nd International Conference on Computer and Information Technology (ICCIT).

[34]  J. Wright,et al.  Assessing Physical Disability in Children with Spina Bifida and Scoliosis , 2000, Journal of pediatric orthopedics.

[35]  Li Zhao,et al.  Study on ultrasonic obstacle avoidance of mobile robot based on fuzzy controller , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[36]  Hairi Zamzuri,et al.  Lateral control strategy based on head movement responses for motion sickness mitigation in autonomous vehicle , 2020 .

[37]  Kosuke Sato,et al.  Extension of Projection Area using Head Orientation in Projected Virtual Hand Interface for Wheelchair Users , 2020, 2020 59th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE).

[38]  Fadel Muhammad,et al.  Development of an Web-based Wearable Gait Recognition System using Gyroscope and Accelerometer Sensors , 2020, 2020 International Seminar on Application for Technology of Information and Communication (iSemantic).

[39]  Daniel Gomes,et al.  Head-movement interface for wheelchair driving based on inertial sensors* , 2019, 2019 IEEE 6th Portuguese Meeting on Bioengineering (ENBENG).

[40]  Bing-Fei Wu,et al.  Accompanist recognition and tracking for intelligent wheelchairs , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[41]  Giulio Reina,et al.  Laser based driving assistance for smart robotic wheelchairs , 2015, 2015 IEEE 20th Conference on Emerging Technologies & Factory Automation (ETFA).

[42]  Smriti Prasad,et al.  Head-motion controlled wheelchair , 2017, 2017 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT).

[43]  Jin Zhao,et al.  An efficient real-time FPGA implementation for object detection , 2014, 2014 IEEE 12th International New Circuits and Systems Conference (NEWCAS).

[44]  Dinesh Kumar,et al.  Devices for Mobility and Manipulation for People with Reduced Abilities , 2014 .

[45]  Dan-Marius Dobrea,et al.  A New Wearable System for Head Gesture Recognition Designed to Control an Intelligent Wheelchair , 2019, 2019 E-Health and Bioengineering Conference (EHB).

[46]  W. Frontera The world report on disability. , 2012, American journal of physical medicine & rehabilitation.

[47]  Sang Min Lee,et al.  Development BCI for individuals with severely disability using EMOTIV EEG headset and robot , 2014, 2014 International Winter Workshop on Brain-Computer Interface (BCI).

[48]  Norbert Stoll,et al.  Auto calibrated head orientation controller for robotic-wheelchair using MEMS sensors and embedded technologies , 2016, 2016 IEEE Sensors Applications Symposium (SAS).

[49]  Mauro Callejas Cuervo,et al.  Capture and analysis of biomechanical signals with inertial and magnetic sensors as support in physical rehabilitation processes , 2016, 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[50]  Dwi Esti Kusumandari,et al.  Development of brain-controlled wheelchair supported by raspicam image processing based Raspberry pi , 2017, 2017 2nd International Conference on Automation, Cognitive Science, Optics, Micro Electro-­Mechanical System, and Information Technology (ICACOMIT).

[51]  André Marcato,et al.  Development of a control system for electric wheelchairs based on head movements , 2017, 2017 Intelligent Systems Conference (IntelliSys).

[52]  Heba Shaban,et al.  Smart System for Recognizing Daily Human Activities Based on Wrist IMU Sensors , 2020, 2019 International Conference on Advances in the Emerging Computing Technologies (AECT).