Visually-aided smart kitchen environment for senior citizens suffering from dementia

In this study we proposed a design for a smart kitchen environment, which facilitated the senior citizens suffering from dementia and their caregivers. The idea of smart kitchen environment was that it was context aware and had the learning ability to adapt itself to fit senior citizens with dementia's habits and living conditions. This study developed a way to design steps and collect data elements of the coffee-making process for a cooking workflow system. Caregivers were able to instruct senior citizens suffering from dementia remotely using this cooking workflow system. A multiple cameras based visual surveillance system was designed to facilitate the observation of cooking objects and senior citizens with dementia's cooking conditions in the kitchen, audio and graphical assistance were used to deliver instructions to the senior citizens with dementia. The smart kitchen environment is concretized into a smart kitchen prototype, this prototype affirmed the feasibility of the smart kitchen environment, and also revealed the areas for further improvement.

[1]  H. Yanco,et al.  Camera Placement and Multi-Camera Fusion for Remote Robot Operation , 2006 .

[2]  Chris D. Nugent,et al.  Using duration to learn activities of daily living in a smart home environment , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[3]  E. Salmon,et al.  A grid for a precise analysis of daily activities , 2010, Neuropsychological rehabilitation.

[4]  Yasushi Nakauchi,et al.  Intelligent kitchen: cooking support by LCD and mobile robot with IC-labeled objects , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Hirokazu Kato,et al.  Work step indication with grid-pattern projection for demented senior people , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[6]  Jit Biswas,et al.  Efficient Incremental Plan Recognition Method for Cognitive Assistance , 2009, ICOST.

[7]  Roger Mohr,et al.  Optimal camera placement for accurate reconstruction , 2002, Pattern Recognit..

[8]  Patrick Olivier,et al.  Slice&Dice: Recognizing Food Preparation Activities Using Embedded Accelerometers , 2009, AmI.

[9]  Yasushi Nakauchi,et al.  Cooking procedure recognition and inference in sensor embedded kitchen , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[10]  Patrick Olivier,et al.  A Dynamic Time Warping Approach to Real-Time Activity Recognition for Food Preparation , 2010, AmI.

[11]  Anna Essén,et al.  The two facets of electronic care surveillance: an exploration of the views of older people who live with monitoring devices. , 2008, Social science & medicine.

[12]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Hiroshi Murase,et al.  Video CooKing: Towards the Synthesis of Multimedia Cooking Recipes , 2011, MMM.

[14]  Hirokazu Kato,et al.  Remote assistance using visual prompts for demented elderly in cooking , 2011, ISABEL '11.