im4Things: An Ontology-Based Natural Language Interface for Controlling Devices in the Internet of Things

The Internet of Things (IoT) offers opportunities for new applications and services that enable users to access and control their working and home environment from local and remote locations, aiming to perform daily life activities in an easy way. However, the IoT also introduces new challenges, some of which arise from the large range of devices currently available and the heterogeneous interfaces provided for their control. The control and management of this variety of devices and interfaces represent a new challenge for non-expert users, instead of making their life easier. Based on this understanding, in this work we present a natural language interface for the IoT, which takes advantage of Semantic Web technologies to allow non-expert users to control their home environment through an instant messaging application in an easy and intuitive way. We conducted several experiments with a group of end users aiming to evaluate the effectiveness of our approach to control home appliances by means of natural language instructions. The evaluation results proved that without the need for technicalities, the user was able to control the home appliances in an efficient way.

[1]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[2]  Shiow-Fen Hwang,et al.  A Geo-Aware Taxi Carrying Management System by Using Location Based Services and Zone Queuing Techniques on Internet of Things , 2016, Mob. Inf. Syst..

[3]  Dr. R. V. Krishnaiah,et al.  Overview and Evaluation of Bluetooth Low Energy: An Emerging Low-Power Wireless Technology , 2013 .

[4]  Dieter Fensel,et al.  Knowledge Engineering: Principles and Methods , 1998, Data Knowl. Eng..

[5]  Miguel Ángel Rodríguez-García,et al.  Feature-based opinion mining through ontologies , 2014, Expert Syst. Appl..

[6]  Ronnie W. Smith.  Natural Language Interfaces , 2006 .

[7]  Anant Vaibhav,et al.  Raspberry Pi based interactive home automation system through E-mail , 2014, 2014 International Conference on Reliability Optimization and Information Technology (ICROIT).

[8]  Peter Saint-Andre,et al.  XMPP : The Definitive Guide , 2009 .

[9]  Luis Fernando D. Haro,et al.  Low-Cost Speaker and Language Recognition Systems Running on a Raspberry Pi , 2014, IEEE Latin America Transactions.

[10]  Miguel Ángel Rodríguez-García,et al.  Open Idea: Plataforma inteligente para gestión de ideas innovadoras , 2014, Proces. del Leng. Natural.

[11]  David L. Olson,et al.  Advanced Data Mining Techniques , 2008 .

[12]  Carsten Bormann,et al.  The Constrained Application Protocol (CoAP) , 2014, RFC.

[13]  Abraham Bernstein,et al.  Evaluating the usability of natural language query languages and interfaces to Semantic Web knowledge bases , 2010, J. Web Semant..

[14]  Yiming Yang,et al.  A re-examination of text categorization methods , 1999, SIGIR '99.

[15]  Petros Maragos,et al.  Robust far-field spoken command recognition for home automation combining adaptation and multichannel processing , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Ioannis Chatzigiannakis,et al.  Developing Smart Homes Using the Internet of Things: How to demonstrate Your System , 2014, HCI.

[17]  Subhajyoti Bandyopadhyay,et al.  Cloud Computing - The Business Perspective , 2011, 2011 44th Hawaii International Conference on System Sciences.

[18]  Radek Martinek,et al.  Voice Control of Technical Functions in Smart Home with KNX Technology , 2015 .

[19]  Shiu Kumar,et al.  Ubiquitous Smart Home System Using Android Application , 2014, ArXiv.

[20]  Carles Gomez,et al.  Overview and Evaluation of Bluetooth Low Energy: An Emerging Low-Power Wireless Technology , 2012, Sensors.

[21]  R. Piyare,et al.  Bluetooth based home automation system using cell phone , 2011, 2011 IEEE 15th International Symposium on Consumer Electronics (ISCE).

[22]  James F. Allen.  Natural language understanding (2. ed.) , 1994 .

[23]  Philipp Cimiano,et al.  Towards portable natural language interfaces to knowledge bases - The case of the ORAKEL system , 2008, Data Knowl. Eng..

[24]  Ramón López-Cózar,et al.  Sistema Mayordomo: Uso de un Entorno de Inteligencia Ambiental a Través de un Sistema de Diálogo Multimodal , 2010, Proces. del Leng. Natural.

[25]  Hideki Matsuoka,et al.  Development of a control system for home appliances based on BLE technique , 2014, 2014 IEEE International Symposium on Independent Computing (ISIC).

[26]  Rafael Valencia-García,et al.  RecomMetz: A context-aware knowledge-based mobile recommender system for movie showtimes , 2015, Expert Syst. Appl..

[27]  Guo Jie,et al.  Cross-Platform Android/iOS-Based Smart Switch Control Middleware in a Digital Home , 2015 .

[28]  James F. Allen.  Natural language understanding (2nd ed.) , 1995 .

[29]  Miguel Ángel Rodríguez-García,et al.  Ontology-based annotation and retrieval of services in the cloud , 2014, Knowl. Based Syst..

[30]  Jun Zhu,et al.  Smart Home Control System Based on Internet of Things , 2015 .

[31]  Giovanni Pilato,et al.  Modular Knowledge Representation in Advisor Agents for Situation Awareness , 2011, Int. J. Semantic Comput..

[32]  Giovanni Pilato,et al.  Chatbots as Interface to Ontologies , 2014, Advances onto the Internet of Things.

[33]  George Hripcsak,et al.  Technical Brief: Agreement, the F-Measure, and Reliability in Information Retrieval , 2005, J. Am. Medical Informatics Assoc..