Exploration of Self-Propelling Droplets Using a Curiosity Driven Robotic Assistant

We describe a chemical robotic assistant equipped with a curiosity algorithm (CA) that can efficiently explore the state a complex chemical system can exhibit. The CA-robot is designed to explore formulations in an open-ended way with no explicit optimization target. By applying the CA-robot to the study of self-propelling multicomponent oil-in-water droplets, we are able to observe an order of magnitude more variety of droplet behaviours than possible with a random parameter search and given the same budget. We demonstrate that the CA-robot enabled the discovery of a sudden and highly specific response of droplets to slight temperature changes. Six modes of self-propelled droplets motion were identified and classified using a time-temperature phase diagram and probed using a variety of techniques including NMR. This work illustrates how target free search can significantly increase the rate of unpredictable observations leading to new discoveries with potential applications in formulation chemistry.

[1]  Joshua W. Brown,et al.  Computational and neural mechanisms of task switching , 2006, Neurocomputing.

[2]  Pierre-Yves Oudeyer,et al.  Intrinsically Motivated Goal Exploration Processes with Automatic Curriculum Learning , 2017, J. Mach. Learn. Res..

[3]  Martin M Hanczyc,et al.  Dynamics of chemotactic droplets in salt concentration gradients. , 2014, Langmuir : the ACS journal of surfaces and colloids.

[4]  Pierre-Yves Oudeyer,et al.  Explauto: an open-source Python library to study autonomous exploration in developmental robotics , 2014, 4th International Conference on Development and Learning and on Epigenetic Robotics.

[5]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[6]  Christopher H. Bryant,et al.  Functional genomic hypothesis generation and experimentation by a robot scientist , 2004, Nature.

[7]  Stéphane Doncieux,et al.  Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study , 2012, Evolutionary Computation.

[8]  Arjan Durresi,et al.  A survey: Control plane scalability issues and approaches in Software-Defined Networking (SDN) , 2017, Comput. Networks.

[9]  R. Ivison.  The concept of competence. , 1971, Journal of rehabilitation.

[10]  A. Cangelosi,et al.  Developmental Robotics: From Babies to Robots , 2015 .

[11]  Haihu Liu,et al.  Phase-field modeling droplet dynamics with soluble surfactants , 2010, J. Comput. Phys..

[12]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[13]  A. E. Eiben,et al.  From evolutionary computation to the evolution of things , 2015, Nature.

[14]  Takashi Ikegami,et al.  Self-propelled oil droplets consuming "fuel" surfactant. , 2009, Journal of the American Chemical Society.

[15]  Pierre-Yves Oudeyer,et al.  Active learning of inverse models with intrinsically motivated goal exploration in robots , 2013, Robotics Auton. Syst..

[16]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[17]  Jürgen Schmidhuber,et al.  Formal Theory of Fun and Creativity , 2010, ECML/PKDD.

[18]  Jonathan Grizou,et al.  Artificial intelligence exploration of unstable protocells leads to predictable properties and discovery of collective behavior , 2018, Proceedings of the National Academy of Sciences.

[19]  Ken E. Whelan,et al.  The Automation of Science , 2009, Science.

[20]  B. Grzybowski,et al.  Tactic, reactive, and functional droplets outside of equilibrium. , 2016, Chemical Society reviews.

[21]  Bartosz A Grzybowski,et al.  Maze solving by chemotactic droplets. , 2010, Journal of the American Chemical Society.

[22]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[23]  Masaki Ogino,et al.  Cognitive Developmental Robotics: A Survey , 2009, IEEE Transactions on Autonomous Mental Development.

[24]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[25]  Pierre-Yves Oudeyer,et al.  Behavioral Diversity Generation in Autonomous Exploration through Reuse of Past Experience , 2016, Front. Robot. AI.

[26]  Julian Francis Miller,et al.  Evolution-in-materio: evolving computation in materials , 2014, Evolutionary Intelligence.

[27]  Pierre-Yves Oudeyer,et al.  What is Intrinsic Motivation? A Typology of Computational Approaches , 2007, Frontiers Neurorobotics.

[28]  Jochen J. Steil,et al.  Online Goal Babbling for rapid bootstrapping of inverse models in high dimensions , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[29]  D. Berlyne.  Conflict, arousal, and curiosity , 2014 .

[30]  S. Takeuchi,et al.  pH-induced motion control of self-propelled oil droplets using a hydrolyzable gemini cationic surfactant. , 2014, Langmuir : the ACS journal of surfaces and colloids.

[31]  Tom Schaul,et al.  Unifying Count-Based Exploration and Intrinsic Motivation , 2016, NIPS.

[32]  R. W. White.  Motivation reconsidered: the concept of competence. , 1959, Psychological review.

[33]  Ivison Ra.  The concept of competence. , 1971 .

[34]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[35]  Jonathan Grizou,et al.  Adaptive artificial evolution of droplet protocells in a 3D-printed fluidic chemorobotic platform with configurable environments , 2017, Nature Communications.

[36]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[37]  Jonathan Grizou,et al.  Human versus Robots in the Discovery and Crystallization of Gigantic Polyoxometalates , 2017, Angewandte Chemie.

[38]  Walter F. Stenning,et al.  AN EMPIRICAL STUDY , 2003 .

[39]  Takashi Ikegami,et al.  Fatty acid chemistry at the oil-water interface: self-propelled oil droplets. , 2007, Journal of the American Chemical Society.

[40]  Paul J. Layzell,et al.  Explorations in design space: unconventional electronics design through artificial evolution , 1999, IEEE Trans. Evol. Comput..

[41]  Gregory S. Hornby,et al.  An Evolved Antenna for Deployment on NASA's Space Technology 5 Mission , 2004 .

[42]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[43]  Juan Manuel Parrilla Gutierrez,et al.  Evolution of oil droplets in a chemorobotic platform , 2014, Nature Communications.

[44]  Yaneer Bar-Yam,et al.  Dynamics Of Complex Systems , 2019 .

[45]  J. Lehman.  EVOLUTION THROUGH THE SEARCH FOR NOVELTY , 2012 .

[46]  P. Lianos,et al.  Effect of alcohol on the properties of micellar systems. Part 1. Critical micellization concentration, micelle molecular weight and ionization degree , 1981 .

[47]  Joshua B. Tenenbaum,et al.  Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation , 2016, NIPS.

[48]  Kenichi Yoshikawa,et al.  Self-propelled motion of a droplet induced by Marangoni-driven spreading. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.