ChemOS: An orchestration software to democratize autonomous discovery

The current Edisonian approach to discovery requires up to two decades of fundamental and applied research for materials technologies to reach the market. Such a slow and capital-intensive turnaround calls for disruptive strategies to expedite innovation. Self-driving laboratories have the potential to provide the means to revolutionize experimentation by empowering automation with artificial intelligence to enable autonomous discovery. However, the lack of adequate software solutions significantly impedes the development of self-driving laboratories. In this paper, we make progress towards addressing this challenge, and we propose and develop an implementation of ChemOS; a portable, modular and versatile software package which supplies the structured layers necessary for the deployment and operation of self-driving laboratories. ChemOS facilitates the integration of automated equipment, and it enables remote control of automated laboratories. ChemOS can operate at various degrees of autonomy; from fully unsupervised experimentation to actively including inputs and feedbacks from researchers into the experimentation loop. The flexibility of ChemOS provides a broad range of functionality as demonstrated on five applications, which were executed on different automated equipment, highlighting various aspects of the software package.

[1]  Nando de Freitas,et al.  A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot , 2009, Auton. Robots.

[2]  Roberto Battiti,et al.  Learning and Intelligent Optimization , 2017, Lecture Notes in Computer Science.

[3]  James M. Dixon and Jonathan S. Lindsey,et al.  Performance of Search Algorithms in the Examination of Chemical Reaction Spaces with an Automated Chemistry Workstation , 2004 .

[4]  R. Matsuda,et al.  Simplex optimization of reaction conditions with an automated system , 1988 .

[5]  Christoph J. Brabec,et al.  Exploring the Stability of Novel Wide Bandgap Perovskites by a Robot Based High Throughput Approach , 2018 .

[6]  Vijay Kumar,et al.  The grand challenges of Science Robotics , 2018, Science Robotics.

[7]  S. Doherty,et al.  Unattended reaction monitoring using an automated microfluidic sampler and on-line liquid chromatography. , 2018, Analytica chimica acta.

[8]  Gang Han,et al.  Reproducible, high-throughput synthesis of colloidal nanocrystals for optimization in multidimensional parameter space. , 2010, Nano letters.

[9]  Alán Aspuru-Guzik,et al.  Next-Generation Experimentation with Self-Driving Laboratories , 2019, Trends in Chemistry.

[10]  Wolfgang Osten,et al.  itom: an open source metrology, automation, and data evaluation software. , 2014, Applied optics.

[11]  C. E. Berkoff,et al.  Chemical process optimization by computer — a self-directed chemical synthesis system , 1978 .

[12]  Yadunandan Dar,et al.  High‐Throughput Experimentation: A Powerful Enabling Technology for the Chemicals and Materials Industry , 2004 .

[13]  Andreas Krause,et al.  Parallelizing Exploration-Exploitation Tradeoffs with Gaussian Process Bandit Optimization , 2012, ICML.

[14]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[15]  Rahul Rao,et al.  Autonomy in materials research: a case study in carbon nanotube growth , 2016 .

[16]  R. Service The synthesis machine. , 2015, Science.

[17]  J. I The Design of Experiments , 1936, Nature.

[18]  Leroy Cronin,et al.  An autonomous organic reaction search engine for chemical reactivity , 2017, Nature Communications.

[19]  Gisbert Schneider,et al.  Automating drug discovery , 2017, Nature Reviews Drug Discovery.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[22]  Ulrich S Schubert,et al.  Combinatorial synthesis of star-shaped block copolymers: host-guest chemistry of unimolecular reversed micelles. , 2004, Journal of the American Chemical Society.

[23]  Ken E. Whelan,et al.  The Automation of Science , 2009, Science.

[24]  Eric M. Woerly,et al.  Synthesis of most polyene natural product motifs using just twelve building blocks and one coupling reaction , 2014, Nature chemistry.

[25]  Tim Chapman,et al.  A structured approach , 2003, Nature.

[26]  Michael A. Osborne,et al.  Gaussian Processes for Global Optimization , 2008 .

[27]  Cormac Simms and,et al.  Rapid Process Development and Scale-Up Using A Multiple Reactor System , 2000 .

[28]  Florian Häse,et al.  Chimera: Enabling Hierarchy Based Multi-Objective Optimization for Self-Driving Laboratories , 2018 .

[29]  Klavs F Jensen,et al.  Integrated microreactors for reaction automation: new approaches to reaction development. , 2010, Annual review of analytical chemistry.

[30]  Kasper van Wijk,et al.  PLACE , 2015, Journal of laboratory automation.

[31]  Wiebke Wagner,et al.  Steven Bird, Ewan Klein and Edward Loper: Natural Language Processing with Python, Analyzing Text with the Natural Language Toolkit , 2010, Lang. Resour. Evaluation.

[32]  A. Zeilinger,et al.  Automated Search for new Quantum Experiments. , 2015, Physical review letters.

[33]  Risto Miikkulainen,et al.  The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities , 2018, Artificial Life.

[34]  Ji-Bo Wang,et al.  The Proximal Lilly Collection: Mapping, Exploring and Exploiting Feasible Chemical Space , 2016, J. Chem. Inf. Model..

[35]  Paul R Jaschke,et al.  Wet Lab Accelerator: A Web-Based Application Democratizing Laboratory Automation for Synthetic Biology. , 2017, ACS synthetic biology.

[36]  Fabian Rudolf,et al.  Automated Planning Enables Complex Protocols on Liquid-Handling Robots. , 2018, ACS synthetic biology.

[37]  Catherine Porte,et al.  Automation and optimization by simplex methods of 6-chlorohexanol synthesis , 1996 .

[38]  H. Kori,et al.  Mice Genetically Deficient in Vasopressin V1a and V1b Receptors Are Resistant to Jet Lag , 2013, Science.

[39]  Tim Chapman Lab automation and robotics: Automation on the move , 2003, Nature.

[40]  Alán Aspuru-Guzik,et al.  The Matter Simulation (R)evolution , 2018, ACS central science.

[41]  Elting E. Morison,et al.  American Genesis: A Century of Invention and Technological Enthusiasm 1870–1970 by Thomas P. Hughes (review) , 1989, Technology and Culture.

[42]  Martin D. Burke,et al.  Synthesis of many different types of organic small molecules using one automated process , 2015, Science.

[43]  Mark J. Anderson,et al.  DOE Simplified: Practical Tools for Effective Experimentation , 2000 .

[44]  Klavs F Jensen,et al.  Feedback in Flow for Accelerated Reaction Development. , 2016, Accounts of chemical research.

[45]  Kevin Leyton-Brown,et al.  Sequential Model-Based Optimization for General Algorithm Configuration , 2011, LION.

[46]  Richard N. Zare,et al.  Optimizing Chemical Reactions with Deep Reinforcement Learning , 2017, ACS central science.

[47]  James Theiler,et al.  Accelerated search for materials with targeted properties by adaptive design , 2016, Nature Communications.

[48]  Tohru Sugawara,et al.  Past and present development of automated synthesis apparatus for pharmaceutical chemistry at Takeda Chemical Industries , 1996 .

[49]  Klavs F Jensen,et al.  A fully automated flow-based approach for accelerated peptide synthesis. , 2017, Nature chemical biology.

[50]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[51]  Guang-Zhong Yang,et al.  Powering the world’s robots—10 years of ROS , 2017, Science Robotics.

[52]  Jason E. Hein,et al.  Real-time HPLC-MS reaction progress monitoring using an automated analytical platform , 2017 .

[53]  Alán Aspuru-Guzik,et al.  ChemOS: Orchestrating autonomous experimentation , 2018, Science Robotics.

[54]  Rory A. Fisher,et al.  The Design of Experiments. , 1936 .

[55]  Jasper Snoek,et al.  Input Warping for Bayesian Optimization of Non-Stationary Functions , 2014, ICML.

[56]  Yuan Tang,et al.  TF.Learn: TensorFlow's High-level Module for Distributed Machine Learning , 2016, ArXiv.

[57]  Alexander G. Godfrey,et al.  A remote-controlled adaptive medchem lab: an innovative approach to enable drug discovery in the 21st Century. , 2013, Drug discovery today.

[58]  Jonathan S. Lindsey,et al.  A retrospective on the automation of laboratory synthetic chemistry , 1992 .

[59]  L. Andrew Corkan,et al.  Experiment manager software for an automated chemistry workstation, including a scheduler for parallel experimentation , 1992 .

[60]  P. Manju,et al.  Fast machine-learning online optimization of ultra-cold-atom experiments , 2015, Scientific Reports.

[61]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[62]  Jonathan Grizou,et al.  Human versus Robots in the Discovery and Crystallization of Gigantic Polyoxometalates , 2017, Angewandte Chemie.

[63]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[64]  S. Y. Wong,et al.  On-demand continuous-flow production of pharmaceuticals in a compact, reconfigurable system , 2016, Science.

[65]  Hideho Okamoto,et al.  Design of a robotic workstation for automated organic synthesis , 2000 .

[66]  Alán Aspuru-Guzik,et al.  Phoenics: A Bayesian Optimizer for Chemistry , 2018, ACS central science.

[67]  Richard Hoogenboom,et al.  Accelerating the living polymerization of 2-nonyl-2-oxazoline by implementing a microwave synthesizer into a high-throughput experimentation workflow. , 2005, Journal of combinatorial chemistry.

[68]  Alán Aspuru-Guzik,et al.  Accelerating the discovery of materials for clean energy in the era of smart automation , 2018, Nature Reviews Materials.

[69]  Alexei Lapkin,et al.  Automatic discovery and optimization of chemical processes , 2015 .

[70]  Leroy Cronin,et al.  Digitization of multistep organic synthesis in reactionware for on-demand pharmaceuticals , 2018, Science.

[71]  Alán Aspuru-Guzik,et al.  Materials Acceleration Platform: Accelerating Advanced Energy Materials Discovery by Integrating High-Throughput Methods and Artificial Intelligence. , 2018 .

[72]  Joseph G. Pigeon,et al.  Statistics for Experimenters: Design, Innovation and Discovery , 2006, Technometrics.

[73]  Casey Nelson Blake,et al.  American Genesis: A Century of Invention and Technological Enthusiasm, 1870–1970 by Thomas P. Hughes , 1990 .