Self-inspection of buildings is the process of controlling the quality of construction work in order to ensure that the specifications are implemented according to the design. Under current practices, self-inspection is totally dependent on the operator’s skills, being a process that can be time-consuming and sometimes difficult to achieve. The Intuitive Self-Inspection Techniques using Augmented Reality (INSITER; for construction, refurbishment and maintenance of energy-efficient buildings made of prefabricated components) project aims to develop a software tool to support construction workers in self-inspection processes, with the overall objective of reducing major errors and extra costs. Nevertheless, one of the challenges is the lack of interoperability between the various equipment used to carry out self-inspection. Devices and current tools deployed on-site do not speak the same language, which leads to a lack of communication. Therefore, this paper presents a framework under which the equipment would be able to send information in a common format. For this purpose, the Industry Foundation Classes (IFC) de-facto standard has been established as a viable data model to represent all the information related to the building project. Along these lines, Building Information Modeling (BIM) information and IFC-compliant databases have been designed for the representation of data coming from Computer-Aided Design (CAD) modeling, laser scanning, thermography and sensor networks. Besides the IFC-data repositories, the framework is a multi-layer architecture with the goal of ensuring interoperability and promoting the stakeholders’ objectives for self-inspection during the entire construction process.