Soft optoelectronic sensory foams with proprioception

An internally illuminated elastomeric foam detects deformations through machine learning techniques. In a step toward soft robot proprioception, and therefore better control, this paper presents an internally illuminated elastomer foam that has been trained to detect its own deformation through machine learning techniques. Optical fibers transmitted light into the foam and simultaneously received diffuse waves from internal reflection. The diffuse reflected light was interpreted by machine learning techniques to predict whether the foam was twisted clockwise, twisted counterclockwise, bent up, or bent down. Machine learning techniques were also used to predict the magnitude of the deformation type. On new data points, the model predicted the type of deformation with 100% accuracy and the magnitude of the deformation with a mean absolute error of 0.06°. This capability may impart soft robots with more complete proprioception, enabling them to be reliably controlled and responsive to external stimuli.

[1]  Ross A. Knepper,et al.  A Helping Hand: Soft Orthosis with Integrated Optical Strain Sensors and EMG Control , 2016, IEEE Robotics & Automation Magazine.

[2]  B. Martin,et al.  Age-Related Differences in Upper Limb Proprioceptive Acuity , 2007, Perceptual and motor skills.

[3]  F. Horak,et al.  Proprioception and Motor Control in Parkinson's Disease , 2009, Journal of motor behavior.

[4]  Proceedings of the 24th annual ACM symposium on User interface software and technology , 2011, UIST.

[5]  Yangsheng Xu,et al.  Robust Joint and Cartesian Control of Underactuated Manipulators , 1996 .

[6]  John,et al.  Diffusing-wave spectroscopy and multiple scattering of light in correlated random media. , 1989, Physical review. B, Condensed matter.

[7]  Daniela Rus,et al.  Dynamics and trajectory optimization for a soft spatial fluidic elastomer manipulator , 2016, Int. J. Robotics Res..

[8]  B Mazzolai,et al.  Soft-robotic arm inspired by the octopus: II. From artificial requirements to innovative technological solutions , 2012, Bioinspiration & biomimetics.

[9]  Sanlin S. Robinson,et al.  Poroelastic Foams for Simple Fabrication of Complex Soft Robots , 2015, Advanced materials.

[10]  Rebecca K. Kramer,et al.  Direct Writing of Gallium‐Indium Alloy for Stretchable Electronics , 2014 .

[11]  D. Goble,et al.  Task-dependent asymmetries in the utilization of proprioceptive feedback for goal-directed movement , 2007, Experimental Brain Research.

[12]  Huichan Zhao,et al.  Curvature control of soft orthotics via low cost solid-state optics , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Thomas J. Wallin,et al.  3D printing antagonistic systems of artificial muscle using projection stereolithography , 2015, Bioinspiration & biomimetics.

[14]  Scott M Lephart,et al.  The Sensorimotor System, Part II: The Role of Proprioception in Motor Control and Functional Joint Stability. , 2002, Journal of athletic training.

[15]  Jamie Kyujin Paik,et al.  An any-resolution pressure localization scheme using a soft capacitive sensor skin , 2018, 2018 IEEE International Conference on Soft Robotics (RoboSoft).

[16]  R. Shepherd,et al.  Scalable manufacturing of high force wearable soft actuators , 2015 .

[17]  D G Stuart,et al.  Animal solutions to problems of movement control: the role of proprioceptors. , 1988, Annual review of neuroscience.

[18]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[19]  Susumu Tachi,et al.  Position control of manipulator with passive joints using dynamic coupling , 1991, IEEE Trans. Robotics Autom..

[20]  Paolo Dario,et al.  Soft Robot Arm Inspired by the Octopus , 2012, Adv. Robotics.

[21]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[22]  T. Igarashi,et al.  Detecting shape deformation of soft objects using directional photoreflectivity measurement , 2011, UIST.

[23]  Yong-Lae Park,et al.  Design and Fabrication of Soft Artificial Skin Using Embedded Microchannels and Liquid Conductors , 2012, IEEE Sensors Journal.

[24]  W. Ferrell,et al.  Position sense at the proximal interphalangeal joint of the human index finger. , 1988, The Journal of physiology.

[25]  A. Buryanov,et al.  Proportions of Hand Segments , 2010 .

[26]  Robert J. Wood,et al.  Toward a modular soft sensor-embedded glove for human hand motion and tactile pressure measurement , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Mark R. Cutkosky,et al.  Force Sensing Robot Fingers using Embedded Fiber Bragg Grating Sensors and Shape Deposition Manufacturing , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[28]  Shoichi Iikura,et al.  Development of flexible microactuator and its applications to robotic mechanisms , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[29]  Neil B Alexander,et al.  The influence of age and physical activity on upper limb proprioceptive ability. , 2009, Journal of aging and physical activity.

[30]  Nikolaus Correll,et al.  A Robotic Skin for Collision Avoidance and Affective Touch Recognition , 2018, IEEE Robotics and Automation Letters.

[31]  S. Swinnen,et al.  Proprioceptive sensibility in the elderly: Degeneration, functional consequences and plastic-adaptive processes , 2009, Neuroscience & Biobehavioral Reviews.

[32]  Huichan Zhao,et al.  Integrated soft sensors and elastomeric actuators for tactile machines with kinesthetic sense , 2015 .

[33]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[34]  Thomas B. Sheridan,et al.  An optical tactile sensor for manipulators , 1984 .

[35]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[36]  MazzolaiBarbara,et al.  Sculpting Soft Machines , 2016 .

[37]  Peng Wang,et al.  Thin Flexible Pressure Sensor Array Based on Carbon Black/Silicone Rubber Nanocomposite , 2009, IEEE Sensors Journal.

[38]  Blake Hannaford,et al.  Measurement and modeling of McKibben pneumatic artificial muscles , 1996, IEEE Trans. Robotics Autom..

[39]  Jamie L. Branch,et al.  Robotic Tentacles with Three‐Dimensional Mobility Based on Flexible Elastomers , 2013, Advanced materials.

[40]  Yong-Lae Park,et al.  Highly stretchable optical sensors for pressure, strain, and curvature measurement , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[41]  Ross A. Knepper,et al.  A Deformable Interface for Human Touch Recognition Using Stretchable Carbon Nanotube Dielectric Elastomer Sensors and Deep Neural Networks. , 2017, Soft robotics.

[42]  Liudmila Bachinska Decorative-formative and spatial organization of representative architecture 1930s − early 1950s as a reflection of the state-ideological goal , 2018 .

[43]  Jamie Paik,et al.  An Any-Resolution Distributed Pressure Localization Scheme Using a Capacitive Soft Sensor Skin , 2018 .

[44]  YapHong Kai,et al.  High-Force Soft Printable Pneumatics for Soft Robotic Applications , 2016 .

[45]  Rebecca K. Kramer,et al.  Hyperelastic pressure sensing with a liquid-embedded elastomer , 2010 .

[46]  Sanlin S. Robinson,et al.  Highly stretchable electroluminescent skin for optical signaling and tactile sensing , 2016, Science.

[47]  Kevin J. MacKenzie,et al.  Finger length and distal finger extent patterns in humans. , 2002, American journal of physical anthropology.

[48]  Pierre Lopez,et al.  Modeling and control of McKibben artificial muscle robot actuators , 2000 .