Improving Robotic Cooking Using Batch Bayesian Optimization

With advances in the field of robotic manipulation, sensing and machine learning, robotic chefs are expected to become prevalent in our kitchens and restaurants. Robotic chefs are envisioned to replicate human skills in order to reduce the burden of the cooking process. However, the potential of robots as a means to enhance the dining experience is unrecognised. This article introduces the concept of food quality optimization and its challenges with an automated omelette cooking robotic system. The design and control of the robotic system that uses general kitchen tools is presented first. Next, we investigate new optimization strategies for improving subjective food quality rating, a problem challenging because of the qualitative nature of the objective and strongly constrained number of function evaluations possible. Our results show that through appropriate design of the optimization routine using Batch Bayesian Optimization, improvements in the subjective evaluation of food quality can be achieved reliably, with very few trials and with the ability for bulk optimization. This study paves the way towards a broader vision of personalized food for taste-and-nutrition and transferable recipes.

[1]  Darwin G. Caldwell,et al.  Robotic manipulation of food products - a review , 2003, Ind. Robot.

[2]  Weibiao Zhou,et al.  An Overview of 3D Printing Technologies for Food Fabrication , 2015, Food and Bioprocess Technology.

[3]  Da-Wen Sun,et al.  Learning techniques used in computer vision for food quality evaluation: a review , 2006 .

[4]  Fumiya Iida,et al.  Achieving Robotically Peeled Lettuce , 2018, IEEE Robotics and Automation Letters.

[5]  Alan Fern,et al.  Batch Bayesian Optimization via Simulation Matching , 2010, NIPS.

[6]  Jeffrey I Lipton,et al.  Printable food: the technology and its application in human health. , 2017, Current opinion in biotechnology.

[7]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[8]  Patricia M Sheean,et al.  An introduction to qualitative research for food and nutrition professionals. , 2009, Journal of the American Dietetic Association.

[9]  Cédric Baudrit,et al.  Modelling and analysis of complex food systems: State of the art and new trends , 2011 .

[10]  Dejan Pangercic,et al.  Robotic roommates making pancakes , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[11]  G Borg,et al.  The relation between neural and perceptual intensity: a comparative study on the neural and psychophysical response to taste stimuli , 1967, The Journal of physiology.

[12]  Eva Balsa-Canto,et al.  Improving food processing using modern optimization methods , 2003 .

[13]  Peter I. Frazier,et al.  A Tutorial on Bayesian Optimization , 2018, ArXiv.

[14]  Vincenzo Lippiello,et al.  Tracking elastic deformable objects with an RGB-D sensor for a pizza chef robot , 2017, Robotics Auton. Syst..

[15]  Stefanie Tellex,et al.  Interpreting and Executing Recipes with a Cooking Robot , 2012, ISER.

[16]  Timothy A. Haley,et al.  A survey of automation practices in the food industry , 2001 .

[17]  Da-Wen Sun,et al.  Recent developments in the applications of image processing techniques for food quality evaluation , 2004 .

[18]  Evelyne Lutton,et al.  Evolutionary Algorithms for Food Science and Technology , 2016 .

[19]  Fumiya Iida,et al.  Model-Free Design Optimization of a Hopping Robot and Its Comparison With a Human Designer , 2018, IEEE Robotics and Automation Letters.

[20]  Jennifer Barry,et al.  Bakebot: Baking Cookies with the PR2 , 2011 .

[21]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[22]  Fumiya Iida,et al.  Non-Destructive Robotic Assessment of Mango Ripeness via Multi-Point Soft Haptics , 2019, 2019 International Conference on Robotics and Automation (ICRA).