Human-Centric Automation and Optimization for Smart Homes

A smart home needs to be human-centric, where it tries to fulfill human needs given the devices it has. Various works are developed to provide homes with reasoning and planning capability to fulfill goals, but most do not support complex sequence of plans or require significant manual effort in devising subplans. This is further aggravated by the need to optimize conflicting personal goals. A solution is to solve the planning problem represented as constraint satisfaction problem (CSP). But CSP uses hard constraints and, thus, cannot handle optimization and partial goal fulfillment efficiently. This paper aims to extend this approach to weighted CSP. Knowledge representation to help in generating planning rules is also proposed, as well as methods to improve performances. Case studies show that the system can provide intelligent and complex plans from activities generated from semantic annotations of the devices, as well as optimization to maximize personal constraints’ fulfillment. Note to Practitioners—Smart home should maximize the fulfillment of personal goals that are often conflicting. For example, it should try to fulfill as much as possible the requests made by both the mother and daughter who wants to watch TV but both having different channel preferences. That said, every person has a set of goals or constraints that they hope the smart home can fulfill. Therefore, human-centric system that automates the loosely coupled devices of the smart home to optimize the goals or constraints of individuals in the home is developed. Automated planning is done using converted services extracted from devices, where conversion is done using existing tools and concepts from Web technologies. Weighted constraint satisfaction that provides the declarative approach to cover large problem domain to realize the automated planner with optimization capability is proposed. Details to speed up planning through search space reduction are also given. Real-time case studies are run in a prototype smart home to demonstrate its applicability and intelligence, where every planning is performed under a maximum of 10 s. The vision of this paper is to be able to implement such system in a community, where devices everywhere can cooperate to ensure the well-being of the community.

[1]  Naoyuki Kubota,et al.  Weighted Constraint Satisfaction for Smart Home Automation and Optimization , 2016, Adv. Artif. Intell..

[2]  Matthias Klusch,et al.  Semantic Web Service Composition Planning with OWLS-Xplan , 2005, AAAI Fall Symposium: Agents and the Semantic Web.

[3]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[4]  Fulvio Corno,et al.  Real-time monitoring of high-level states in smart environments , 2015, J. Ambient Intell. Smart Environ..

[5]  Luca Bevilacqua,et al.  A tool for automatic generation of WS-BPEL compositions from OWL-S described services , 2011, 2011 5th International Conference on Software, Knowledge Information, Industrial Management and Applications (SKIMA) Proceedings.

[6]  Dana S. Nau,et al.  Web Service Composition with Volatile Information , 2005, SEMWEB.

[7]  James A. Hendler,et al.  HTN planning for Web Service composition using SHOP2 , 2004, J. Web Semant..

[8]  Katharina Rasch,et al.  Smart assistants for smart homes , 2013 .

[9]  Marco Aiello,et al.  Coordinating the web of services for a smart home , 2013, TWEB.

[10]  Eugenio Di Sciascio,et al.  Semantic-Based Enhancement of ISO/IEC 14543-3 EIB/KNX Standard for Building Automation , 2011, IEEE Transactions on Industrial Informatics.

[11]  Ruben Verborgh,et al.  SAMuS: Service-Oriented Architecture for Multisensor Surveillance in Smart Homes , 2014, TheScientificWorldJournal.

[12]  Paolo Traverso,et al.  Blended Planning and Acting: Preliminary Approach, Research Challenges , 2015, AAAI.

[13]  Francesco M. Donini,et al.  Semantic Matchmaking as Non-Monotonic Reasoning: A Description Logic Approach , 2007, J. Artif. Intell. Res..

[14]  Gerhard Leitner,et al.  The WISE Future of Home Technology , 2015 .

[15]  Mike P. Papazoglou,et al.  Service oriented architectures: approaches, technologies and research issues , 2007, The VLDB Journal.

[16]  Mohan Sridharan,et al.  Mixed Logical Inference and Probabilistic Planning for Robots in Unreliable Worlds , 2015, IEEE Transactions on Robotics.

[17]  Ioannis P. Vlahavas,et al.  Semantic Awareness in Automated Web Service Composition through Planning , 2010, SETN.

[18]  Athanasios V. Vasilakos,et al.  Web services composition: A decade's overview , 2014, Inf. Sci..

[19]  Javier Larrosa,et al.  On the Practical use of Variable Elimination in Constraint Optimization Problems: 'Still-life' as a Case Study , 2005, J. Artif. Intell. Res..

[20]  Fangkai Yang,et al.  Planning in Answer Set Programming while Learning Action Costs for Mobile Robots , 2014, AAAI Spring Symposia.

[21]  Mahdi Ben Alaya,et al.  OM2M: Extensible ETSI-compliant M2M Service Platform with Self-configuration Capability , 2014, ANT/SEIT.

[22]  Ruben Verborgh,et al.  Smart Configuration of Smart Environments , 2016, IEEE Transactions on Automation Science and Engineering.

[23]  Nikolaj Bjørner,et al.  Z3: An Efficient SMT Solver , 2008, TACAS.

[24]  Jürgen Jasperneite,et al.  A field level architecture for reconfigurable real-time automation systems , 2014, 2014 10th IEEE Workshop on Factory Communication Systems (WFCS 2014).

[25]  Marco Aiello,et al.  Domain-independent planning for services in uncertain and dynamic environments , 2016, Artif. Intell..

[26]  Marco Aiello,et al.  Extended Goals for Composing Services , 2009, ICAPS.

[27]  Ilche Georgievski Planning for Coordination of Devices in Energy-Smart Envronments , 2013, ICAPS 2013.

[28]  Alexander Lazovik,et al.  Dynamic Constraint Reasoning in Smart Environments , 2013, 2013 IEEE 25th International Conference on Tools with Artificial Intelligence.

[29]  Silvia Richter,et al.  The LAMA Planner: Guiding Cost-Based Anytime Planning with Landmarks , 2010, J. Artif. Intell. Res..

[30]  Jörg Hoffmann,et al.  SAP Speaks PDDL , 2010, AAAI.

[31]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[32]  Hugo Terashima-Marín,et al.  Experimental Matching of Instances to Heuristics for Constraint Satisfaction Problems , 2016, Comput. Intell. Neurosci..

[33]  Mara Nikolaidou,et al.  An Integrated Approach to Automated Semantic Web Service Composition through Planning , 2012, IEEE Transactions on Services Computing.

[34]  Naoyuki Kubota,et al.  Gestural and facial communication with smart phone based robot partner using emotional model , 2014, 2014 World Automation Congress (WAC).

[35]  Marco Aiello,et al.  HTN planning: Overview, comparison, and beyond , 2015, Artif. Intell..

[36]  Malte Helmert,et al.  Concise finite-domain representations for PDDL planning tasks , 2009, Artif. Intell..

[37]  Rina Dechter,et al.  Bucket Elimination: A Unifying Framework for Reasoning , 1999, Artif. Intell..

[38]  Noël Crespi,et al.  Semantic Context-Aware Service Composition for Building Automation System , 2014, IEEE Transactions on Industrial Informatics.

[39]  Fulvio Corno,et al.  Rule-based intelligence for domotic environments , 2010 .

[40]  Ian Horrocks,et al.  FaCT++ Description Logic Reasoner: System Description , 2006, IJCAR.

[41]  Youn Kwae Jeong,et al.  Web-of-Objects (WoO)-Based Context Aware Emergency Fire Management Systems for the Internet of Things , 2014, Sensors.

[42]  Marco Aiello,et al.  Interoperation, Composition and Simulation of Services at Home , 2010, ICSOC.

[43]  José L. Martínez Lastra,et al.  Semantics-Based Composition of Factory Automation Processes Encapsulated by Web Services , 2013, IEEE Transactions on Industrial Informatics.