Live capture of energy-related knowledge into BIM systems

Energy Management in buildings is about operating and maintaining many complex energy systems used by buildings’ occupants. The generation and collection of energy-related building information is commonly fragmented, created over the building’s lifecycle by different teams with different objectives, and stored in different systems. The development of BIM systems has helped in storing this various information. However, the knowledge utilised in maintaining energy systems has also to be captured to develop a building portfolio that is comprehensive enough to benefit buildings’ owners, occupants, and energy managers. Capturing knowledge in digital format is always a challenge when developing such systems. Therefore, this research proposes an innovative means for capturing energy-related knowledge when monitoring and maintaining building performance by the integration of Spoken Dialogue Systems (SDS) with BIM models. SDS presents a natural language interface where the expert’s utterances are understood and answered back in speech format. The advancements in Spoken Dialogue technology will be employed to enable capturing and retrieving experts/occupants’ knowledge with the system interviewing the expert concerning the problem at hand. This interface will also allow easier searching for solutions to new problems with a more comprehensive retrieval of information.

[1]  Steve J. Young,et al.  Partially observable Markov decision processes for spoken dialog systems , 2007, Comput. Speech Lang..

[2]  Kallirroi Georgila,et al.  An ISU Dialogue System Exhibiting Reinforcement Learning of Dialogue Policies: Generic Slot-Filling in the TALK In-car System , 2006, EACL.

[3]  Jae-Jun Kim,et al.  Building Ontology to Implement the BIM (Building Information Modeling) Focused on Pre-Design Stage , 2008 .

[4]  Johan Boye Dialogue Management for Automatic Troubleshooting and other Problem-solving Applications , 2007, SIGdial.

[5]  Peter Barrett,et al.  MoPMIT : a prototype system for reactive maintenance projects in The UK , 2004 .

[6]  Kurt VanLehn,et al.  A Natural Language Tutorial Dialogue System for Physics , 2006, FLAIRS Conference.

[7]  Maxine Eskénazi,et al.  LET's GO: improving spoken dialog systems for the elderly and non-natives , 2003, INTERSPEECH.

[8]  Arthur C. Graesser,et al.  AutoTutor: A simulation of a human tutor , 1999, Cognitive Systems Research.

[9]  Alexander I. Rudnicky,et al.  Task and domain specific modelling in the Carnegie Mellon communicator system , 2000, INTERSPEECH.

[10]  P. Fong,et al.  Knowledge and experience sharing in projects-based building maintenance community of practice , 2009 .

[11]  Stephanie Seneff,et al.  Dialogue Management in the Mercury Flight Reservation System , 2000 .

[12]  Marilyn A. Walker,et al.  MATCH: An Architecture for Multimodal Dialogue Systems , 2002, ACL.

[13]  Abdul Kareem Almarshad,et al.  A knowledge-based BIM system for building maintenance , 2013 .

[14]  Charles M. Eastman,et al.  An Ontological Approach to Building Information Model Exchanges in the Precast/Pre-stressed Concrete Industry , 2012 .

[15]  Ankit Shah,et al.  Sydney Opera House Facilities Management Exemplar Project , 2006 .

[16]  Roberto Pieraccini,et al.  Technical Support Dialog Systems:Issues, Problems, and Solutions , 2007, HLT-NAACL 2007.

[17]  Roberto Pieraccini,et al.  A stochastic model of human-machine interaction for learning dialog strategies , 2000, IEEE Trans. Speech Audio Process..

[18]  Weiming Shen,et al.  A Decision Support System for Integrating Corrective Maintenance, Preventive Maintenance, and Condition-Based Maintenance , 2010 .

[19]  Nan Li,et al.  Application Areas and Data Requirements for BIM-Enabled Facilities Management , 2012 .

[20]  Ming Sun,et al.  Improving the business process of reactive maintenance projects , 2002 .

[21]  Kate Carter,et al.  Sustainable BIM-based evaluation of buildings , 2013 .

[22]  Victor Zue,et al.  JUPlTER: a telephone-based conversational interface for weather information , 2000, IEEE Trans. Speech Audio Process..

[23]  Peter Poller,et al.  Natural and Intuitive Multimodal Dialogue for In-Car Applications: The SAMMIE System , 2006, ECAI.

[24]  Diane J. Litman,et al.  ITSPOKE: An Intelligent Tutoring Spoken Dialogue System , 2004, NAACL.

[25]  Stanley Peters,et al.  The WITAS multi-modal dialogue system I , 2001, INTERSPEECH.

[26]  Ömer Akin,et al.  Augmented reality-based computational fieldwork support for equipment operations and maintenance , 2011 .

[27]  Maxine Eskénazi,et al.  Let's go public! taking a spoken dialog system to the real world , 2005, INTERSPEECH.

[28]  Seth Rogers,et al.  Adaptive user interfaces for automotive environments , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[29]  Oliver Lemon,et al.  Evaluating a City Exploration Dialogue System with Integrated Question-Answering and Pedestrian Navigation , 2013, ACL.

[30]  Ramón López-Cózar,et al.  Multimodal, multilingual and adaptive dialogue system for ubiquitous interaction in an educational space , 2005 .

[31]  Johanna D. Moore,et al.  The Beetle and BeeDiff tutoring systems , 2007, SLaTE.