KitcheNette: Predicting and Recommending Food Ingredient Pairings using Siamese Neural Networks

As a vast number of ingredients exist in the culinary world, there are countless food ingredient pairings, but only a small number of pairings have been adopted by chefs and studied by food researchers. In this work, we propose KitcheNette which is a model that predicts food ingredient pairing scores and recommends optimal ingredient pairings. KitcheNette employs Siamese neural networks and is trained on our annotated dataset containing 300K scores of pairings generated from numerous ingredients in food recipes. As the results demonstrate, our model not only outperforms other baseline models but also can recommend complementary food pairings and discover novel ingredient pairings.

[1]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[2]  Gerlof Bouma,et al.  Normalized (pointwise) mutual information in collocation extraction , 2009 .

[3]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[4]  Wolfgang Nejdl,et al.  Proceedings of the 4th Annual ACM Web Science Conference , 2012 .

[5]  Guannan Liu,et al.  Matching Recommendations Based on Siamese Network and Metric Learning , 2018, 2018 15th International Conference on Service Systems and Service Management (ICSSSM).

[6]  Ganesh Bagler,et al.  FlavorDB: a database of flavor molecules , 2017, Nucleic Acids Res..

[7]  Antonio Torralba,et al.  Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Albert Díaz-Guilera,et al.  Food-Bridging: A New Network Construction to Unveil the Principles of Cooking , 2017, Front. ICT.

[9]  Kazjon Grace,et al.  Surprise-Triggered Reformulation of Design Goals , 2016, AAAI.

[10]  Volume 16 , 2004, Journal of Clinical Monitoring and Computing.

[11]  David C. Wilson,et al.  Combining CBR and Deep Learning to Generate Surprising Recipe Designs , 2016, ICCBR.

[12]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[13]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[14]  Albert-László Barabási,et al.  Flavor network and the principles of food pairing , 2011, Scientific reports.

[15]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[16]  Gyu Sang Choi,et al.  Automated Essay Scoring: A Siamese Bidirectional LSTM Neural Network Architecture , 2018, Symmetry.

[17]  Amaia Salvador,et al.  Learning Cross-Modal Embeddings for Cooking Recipes and Food Images , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).