An intuitive interaction system for fire safety using a speech recognition technology

We propose an intuitive interaction system, which is a part of Cooperative Fire Security System using HARMS (CFS2H), to readily deal with fire in a high-rise building. The interaction system is a bridge connecting human, as an operator, to the whole system. Utilizing a natural language processing (NLP) technology using Microsoft Kinect makes the interaction system intuitive and has human-oriented operations. Human-Agent-Robot-Machine-Sensor (HARMS) provides a distributed network so that the systems are able to communicate with a high-level communication protocol. We established a scenario to verify the interaction system along with the system as a whole. The result of the verification left several technical issues and challenges.

[1]  Kohtaro Ohba,et al.  Learning affordance for semantic robots using ontology approach , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  YoungSteve,et al.  The application of hidden Markov models in speech recognition , 2007 .

[3]  Eric T. Matson,et al.  A natural language exchange model for enabling human, agent, robot and machine interaction , 2011, The 5th International Conference on Automation, Robotics and Applications.

[4]  Eric T. Matson,et al.  M2M infrastructure to integrate humans, agents and robots into collectives , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[5]  Eric T. Matson,et al.  Using indistinguishability in ubiquitous robot organizations , 2012, UbiComp.

[6]  Eric T. Matson,et al.  NL-based communication with firefighting robots , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[7]  Eric T. Matson,et al.  Design of Knowledge-Based Communication between Human and Robot Using Ontological Semantic Technology in Firefighting Domain , 2013, RiTA.

[8]  Eric T. Matson,et al.  Implementing HARMS-based indistinguishability in ubiquitous robot organizations , 2013, Robotics Auton. Syst..

[9]  Yu-Ting Li,et al.  A Cyber-Physical Management System for Delivering and Monitoring Surgical Instruments in the OR , 2013, Surgical innovation.

[10]  Eric T. Matson,et al.  Communication for Task Completion with Heterogeneous Robots , 2012, RiTA.

[11]  Mark J. F. Gales,et al.  The Application of Hidden Markov Models in Speech Recognition , 2007, Found. Trends Signal Process..

[12]  Andreas Stolcke,et al.  Finding consensus in speech recognition: word error minimization and other applications of confusion networks , 2000, Comput. Speech Lang..