Towards Richer Assisted Living Environments

This paper describes an ongoing research project which explores the design and use of inexpensive robotics, artificial intelligence techniques, and human–computer interaction methods, to enrich assisted living environments. Such environments provide help to the inhabitants of a home or office, assisting them to perform daily activities, helping them to socialize and interact with others, and to provide enhanced levels of security and safeness. We present the development of an inexpensive robotic solution to help people with disabilities and/or older adults to perform their daily activities. It can be used as a remote controlled surveillance system, and also as a personal assistant. It is able to recognize each inhabitant, his/her emotions, and detect abnormal situations such as falls and health problems. The whole system is designed to operate solely within a local network and special attention is given to the privacy and data protection of the users.

[1]  Holger Regenbrecht,et al.  Immersive Telepresence and Remote Collaboration using Mobile and Wearable Devices , 2019, IEEE Transactions on Visualization and Computer Graphics.

[2]  Carles Gomez,et al.  Wireless home automation networks: A survey of architectures and technologies , 2010, IEEE Communications Magazine.

[3]  A. Lakhani.  Which Melbourne Metropolitan Areas Are Vulnerable to COVID-19 Based on Age, Disability, and Access to Health Services? Using Spatial Analysis to Identify Service Gaps and Inform Delivery , 2020, Journal of Pain and Symptom Management.

[4]  Mohamed-Rafik Bouguelia,et al.  Efficient Activity Recognition in Smart Homes Using Delayed Fuzzy Temporal Windows on Binary Sensors , 2020, IEEE Journal of Biomedical and Health Informatics.

[5]  Farhat Fnaiech,et al.  A facial expression controlled wheelchair for people with disabilities , 2018, Comput. Methods Programs Biomed..

[6]  Sami Miniaoui,et al.  Introducing Innovative Item Management Process Towards Providing Smart Fridges , 2019, 2019 2nd International Conference on Communication Engineering and Technology (ICCET).

[7]  John J. Soraghan,et al.  Real-Time Embedded Intelligence System: Emotion Recognition on Raspberry Pi with Intel NCS , 2018, ICANN.

[8]  Saraju P. Mohanty,et al.  Smart Home Environment for Mild Cognitive Impairment Population: Solutions to Improve Care and Quality of Life , 2018, IEEE Consumer Electronics Magazine.

[9]  Yong Wang,et al.  A WiFi-Based Smart Home Fall Detection System Using Recurrent Neural Network , 2020, IEEE Transactions on Consumer Electronics.

[10]  Shalom Greene,et al.  IoT DEVELOPMENT FOR HEALTHY INDEPENDENT LIVING , 2017 .

[11]  Melanie Fried-Oken,et al.  New and emerging access technologies for adults with complex communication needs and severe motor impairments: State of the science , 2019, Augmentative and alternative communication.

[12]  Marielba Zacarias,et al.  Improving accessibility of mobile devices with EasyWrite , 2015, Behav. Inf. Technol..

[13]  Valentina Bianchi,et al.  A Plug and Play IoT Wi-Fi Smart Home System for Human Monitoring , 2018, Electronics.

[14]  Marielba Zacarias,et al.  Evaluating Accessible Synchronous CMC Applications , 2010, ArXiv.

[15]  Günter Edlinger,et al.  A Hybrid Brain-Computer Interface for Smart Home Control , 2011, HCI.

[16]  Jun-Hyeong Do,et al.  User-friendly interaction/interface control of intelligent home for movement-disabled people , 2003 .

[17]  James Carmichael,et al.  A speech-controlled environmental control system for people with severe dysarthria. , 2007, Medical engineering & physics.

[18]  Panos Nasiopoulos,et al.  A Non-Intrusive Deep Learning Based Fall Detection Scheme Using Video Cameras , 2020, 2020 International Conference on Information Networking (ICOIN).

[19]  Fernando G. Lobo,et al.  EasyVoice: Breaking Barriers for People with Voice Disabilities , 2008, ICCHP.

[20]  P. S. Fisher,et al.  Voice Controlled Smart House , 1993, IEEE 1993 International Conference on Consumer Electronics Digest of Technical Papers.

[21]  K. Jones,et al.  COVID‐19 and Older Adults: What We Know , 2020, Journal of the American Geriatrics Society.

[22]  Matthieu Geist,et al.  Convolutional and Recurrent Neural Networks for Activity Recognition in Smart Environment , 2015, BIRS-IMLKE.

[23]  Gustavo Rossi,et al.  User Interface Adaptation for Accessibility , 2019, Web Accessibility.

[24]  Krzysztof Z. Gajos,et al.  Ability-based design , 2018, Commun. ACM.

[25]  Rahib H. Abiyev,et al.  Head mouse control system for people with disabilities , 2019, Expert Syst. J. Knowl. Eng..

[26]  Himanshu Thapliyal,et al.  IoT-Based Fall Detection for Smart Home Environments , 2016, 2016 IEEE International Symposium on Nanoelectronic and Information Systems (iNIS).

[27]  Koki Shibasato,et al.  Gaze Region Estimation Algorithm without Calibration Using Convolutional Neural Network , 2019, ACIT.

[28]  Julio Abascal.  Ambient Intelligence for people with disabilities and elderly people , 2004 .

[29]  Amedeo Cesta,et al.  ROBIN, a Telepresence Robot to Support Older Users Monitoring and Social Inclusion: Development and Evaluation. , 2017, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[30]  Wafa Alrajhi,et al.  Smart home: toward daily use of BCI-based systems , 2017, 2017 International Conference on Informatics, Health & Technology (ICIHT).

[31]  Rohit Raj,et al.  Voice controlled cyber-physical system for smart home , 2018, ICDCN Workshops.

[32]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Jishnu U K,et al.  Voice Controlled Personal Assistant Robot for Elderly People , 2020, 2020 5th International Conference on Communication and Electronics Systems (ICCES).

[34]  Giovanni Delnevo,et al.  On enhancing accessible smart buildings using IoT , 2018, 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[35]  Sung-Bong Yang,et al.  Deep neural networks for activity recognition with multi-sensor data in a smart home , 2018, 2018 IEEE 4th World Forum on Internet of Things (WF-IoT).

[36]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  S. Intille.  The Goal : Smart People , Not Smart Homes , 2006 .

[38]  Naeem Ramzan,et al.  Remote patient monitoring: a comprehensive study , 2017, Journal of Ambient Intelligence and Humanized Computing.

[39]  Shuang-Hua Yang,et al.  A zigbee-based home automation system , 2009, IEEE Transactions on Consumer Electronics.

[40]  Fernando G. Lobo,et al.  A System for Controlling Assisted Living Environments Using Mobile Devices , 2015, ASSETS.

[41]  Momona Yamagami,et al.  Decoding Intent With Control Theory: Comparing Muscle Versus Manual Interface Performance , 2020, CHI.

[42]  Gonzalo Farias,et al.  A Neural Network Approach for Building An Obstacle Detection Model by Fusion of Proximity Sensors Data , 2018, Sensors.

[43]  Kimiyasu Kiyota,et al.  Smartphone Apps of Obstacle Detection for Visually Impaired and its Evaluation , 2019, ACIT.

[44]  Gonçalo Marques,et al.  A Mobile Computing Solution for Enhanced Living Environments and Healthcare Based on Internet of Things , 2021 .

[45]  Xinyu Zhang,et al.  "Alexa, stop spying on me!": speech privacy protection against voice assistants , 2020, SenSys.