Development of a colon endoscope robot that adjusts its locomotion through the use of reinforcement learning

PurposeFibre optic colonoscopy is usually performed with manual introduction and advancement of the endoscope, but there is potential for a robot capable of locomoting autonomously from the rectum to the caecum. A prototype robot was designed and tested.MethodsThe robot colonic endoscope consists in a front body with clockwise helical fin and a rear body with anticlockwise one, both connected via a DC motor. Input voltage is adjusted automatically by the robot, through the use of reinforcement learning, determining speed and direction (forward or backward).ResultsExperiments were performed both in-vitro and in-vivo, showing the feasibility of the robot. The device is capable of moving in a slippery environment, and reinforcement learning algorithms such as Q-learning and SARSA can obtain better results than simply applying full tension to the robot.ConclusionsThis self-propelled robotic endoscope has potential as an alternative to current fibre optic colonoscopy examination methods, especially with the addition of new sensors under development.

[1]  Andrew W. Moore,et al.  Efficient memory-based learning for robot control , 1990 .

[2]  J. Church Endoscopy of the colon, rectum, and anus , 1995 .

[3]  Joel W. Burdick,et al.  The Development of a Robotic Endoscope , 1995, ISER.

[4]  Minoru Asada,et al.  Behavior coordination for a mobile robot using modular reinforcement learning , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[5]  A. Cuschieri,et al.  The impact of technologies on minimally invasive therapy , 1997, Surgical Endoscopy.

[6]  András Lörincz,et al.  Module Based Reinforcement Learning: An Application to a Real Robot , 1997, EWLR.

[7]  P. Swain,et al.  Wireless capsule endoscopy. , 2002, The Israel Medical Association journal : IMAJ.

[8]  D. Accoto,et al.  MEASUREMENTS OF THE FRICTIONAL PROPERTIES OF THE GASTROINTESTINAL TRACT , 2001 .

[9]  Paolo Dario,et al.  Robotic solutions and mechanisms for a semi-autonomous endoscope , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Paolo Dario,et al.  Analysis and development of locomotion devices for the gastrointestinal tract , 2002, IEEE Transactions on Biomedical Engineering.

[11]  B. Stewart,et al.  World Cancer Report , 2003 .

[12]  Pieter Abbeel,et al.  Exploration and apprenticeship learning in reinforcement learning , 2005, ICML.

[13]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[14]  Minoru Asada,et al.  Purposive Behavior Acquisition for a Real Robot by Vision-Based Reinforcement Learning , 2005, Machine Learning.

[15]  P. Colquhoun,et al.  Colorectal Cancer Screening: Do We Practice What We Preach? , 2006, Surgical innovation.

[16]  Pieter Abbeel,et al.  Using inaccurate models in reinforcement learning , 2006, ICML.

[17]  P. Johnston The Colorectal Cancer Coalition: reflections on the future. , 2006, The oncologist.

[18]  I. Kassim,et al.  Locomotion techniques for robotic colonoscopy , 2006, IEEE Engineering in Medicine and Biology Magazine.

[19]  C. Hassan,et al.  Cost-effectiveness of capsule endoscopy in screening for colorectal cancer , 2008, Endoscopy.

[20]  Paolo Dario,et al.  A New Mechanism for Mesoscale Legged Locomotion in Compliant Tubular Environments , 2009, IEEE Transactions on Robotics.

[21]  P. Boyle,et al.  World Cancer Report 2008 , 2009 .