Design and Implementation of Content Validity: Instrument Development for Evaluating Functional Building Performance

The research aim is to critically evaluate the content validity of the functional building performance evaluation criteria using the Content Validity Index (CVI) and modified kappa statistic. The selection of relevant criteria for functional building performance evaluation should be managed effectively by the building management team because it is strongly related to the achievement of organizational objectives and the building occupants’ satisfaction. Studies over the past decades have shown that the criteria vary, relying on the intention of conducting the performance evaluation and the types of building. These selection criteria have a direct impact on the functional building performance and need to be done systematically. Thus, the content validity of the functional building performance evaluation criteria is a necessary step in instrument development. To achieve this research aim, the instrument has been developed based on numerous construct items that have been obtained from previous studies by various authors and established rating tools or standards. The sample of the respondents for content validation comprises of seven (7) expert panels in the area of historic building management and building performance evaluation, such as from the local municipality, related government agencies, academician and building management team. The panels reviewed and rated the instrument to ensure its relevance and the representativeness of each item. The result shows that a total of 39 items are valid and are considered to be retained, and will be further tested in the next study. The result has also shown that the Scale level – CVI/ Averaging calculation method (S-CVI/ Ave) for all items has met the criterion of 0.90. Significantly, content validity should be treated as important because it provides adequate and acceptable items of the content domain

[1]  Louis F. Sytsma,et al.  ASTM standards on environmental sampling, 2nd ed. ASTM (American Society For Testing and Materials), ASTM, west Conshohocken, PA, (1997), 1010 Pages, [ISBN No.:0‐8031‐1835‐X], U.S. List Price: $99.00 , 1999 .

[2]  Yahya Khosravi,et al.  Development and Evaluation of a New Questionnaire for Rating of Cognitive Failures at Work , 2011 .

[3]  Mohd Fadzil Mat Yasin,et al.  Harnessing knowledge management in the process of performance evaluation of facilities in Malaysia: A critical success factor , 2010 .

[4]  M. Lynn Determination and quantification of content validity. , 1986, Nursing research.

[5]  Joseph H.K. Lai,et al.  Developing a performance evaluation scheme for engineering facilities in commercial buildings: state-of-the-art review , 2017 .

[6]  A. Abbaszadeh,et al.  Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication. , 2015, Journal of caring sciences.

[7]  Sarel Lavy,et al.  Establishment of KPIs for facility performance measurement: review of literature , 2010 .

[8]  Salleh Amat,et al.  Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study. , 2015, Sultan Qaboos University medical journal.

[9]  B. Poh,et al.  Development and Validation of a Physical Activity Educational Module for Overweight and Obese Adolescents: CERGAS Programme , 2019, International journal of environmental research and public health.

[10]  Tim Sharpe Building Performance Evaluation , 2013 .

[11]  Azwani Masuwai,et al.  Evaluating the face and content validity of a Teaching and LearningGuiding Principles Instrument (TLGPI): a perspective study ofMalaysian teacher educators , 2016 .

[12]  Chin Haw Lim,et al.  Development of rating system for Sustainable building in Malaysia , 2009 .

[13]  Wolfgang F. E. Preiser,et al.  Post‐occupancy evaluation: how to make buildings work better , 1995 .

[14]  N. Ahmad,et al.  Assessing Content Validity of Enterprise Architecture Adoption Questionnaire (EAAQ) Among Content Experts , 2019, 2019 IEEE 9th Symposium on Computer Applications & Industrial Electronics (ISCAIE).

[15]  Adi Irfan Che-Ani,et al.  Building Surveying Graduates Performance from the Perspective of Building Surveyors in Malaysia , 2017, 2017 7th World Engineering Education Forum (WEEF).

[16]  Diana Kovacic Using the Content Validity Index to Determine Content Validity of an Instrument Assessing Health Care Providers’ General Knowledge of Human Trafficking , 2018 .

[17]  Syahrul Nizam Kamaruzzaman,et al.  Development of a non-domestic building refurbishment scheme for Malaysia: A Delphi approach , 2019, Energy.

[18]  C. H. Lawshe A QUANTITATIVE APPROACH TO CONTENT VALIDITY , 1975 .

[19]  Nor Atikah Hashim,et al.  Sustainable Building in Malaysia: The Development of Sustainable Building Rating System , 2012 .

[20]  Wolfgang F. E. Preiser,et al.  Intelligent office building performance evaluation , 2002 .

[21]  Norngainy Mohd Tawil,et al.  Effective Office Environment Architecture: Finding Ingenious Ideas in a Home to Stimulate the Office Environment , 2011 .

[22]  P Pieter-Jan Hoes,et al.  On occupant-centric building performance metrics , 2017 .

[23]  Richard Haigh,et al.  Disaster risk reduction and post disaster infrastructure reconstruction in Sri Lanka , 2009 .

[24]  Abbas Elmualim,et al.  Defining High Performance Buildings for Operations and Maintenance , 2010 .

[25]  Cheryl Tatano Beck,et al.  The content validity index: are you sure you know what's being reported? Critique and recommendations. , 2006, Research in nursing & health.

[26]  S. Gopikrishnan,et al.  Attributes and descriptors for building performance evaluation , 2017 .

[27]  Gail Brager,et al.  Post-occupancy evaluation: State-of-the-art analysis and state-of-the-practice review , 2018 .

[28]  J. Vischer Applying knowledge on building performance: From evidence to intelligence , 2009 .

[29]  Siti Norlizaiha Harun Heritage Building Conservation in Malaysia: Experience and Challenges , 2011 .

[30]  Muriati Mukhtar,et al.  Instrument Development for Measuring the Acceptance of UC&C: A Content Validity Study , 2019, International Journal of Advanced Computer Science and Applications.

[31]  Jacqueline C. Vischer,et al.  Towards an Environmental Psychology of Workspace: How People are Affected by Environments for Work , 2008 .

[32]  Enas Almanasreh,et al.  Evaluation of methods used for estimating content validity , 2019, Research in social & administrative pharmacy : RSAP.

[33]  Wolfgang F. E. Preiser,et al.  The habitability framework: a conceptual approach towards linking human behaviour and physical environment , 1983 .

[34]  Cheryl Tatano Beck,et al.  Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. , 2007, Research in nursing & health.

[35]  Syahrul Nizam Kamaruzzaman,et al.  A SURVEY ON THE PERFORMANCE-RISK RATING INDEX FOR BUILDING PERFORMANCE ASSESSMENT IN HIGHER EDUCATION BUILDINGS , 2015 .

[36]  Wolfgang F. E. Preiser,et al.  Assessing building performance , 2005 .

[37]  Godfried Augenbroe,et al.  Roles of building performance assessment in stakeholder dialogue in AEC , 2006 .

[38]  Dilanthi Amaratunga,et al.  Impact of integrating disaster risk reduction philosophies into infrastructure reconstruction projects in Sri Lanka , 2012 .

[39]  Alice Sabrina Ismail,et al.  Responsive Design Approach in Modern Malaysian Administrative Building , 2014 .

[40]  Soolyeon Cho,et al.  Energy efficiency and thermal comfort in historic buildings: A review , 2016 .

[41]  Joy C. MacDermid,et al.  Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis , 2017, BMC Musculoskeletal Disorders.

[42]  Mohammad A. Hassanain,et al.  On the performance evaluation of sustainable student housing facilities , 2008 .

[43]  Amr A. Oloufa,et al.  Postoccupancy Evaluation of Buildings and Development of Facility Performance Criteria , 1995 .

[44]  I. Mohammad,et al.  ESTABLISHING THE CONTENT VALIDITY INDEX OF POST OCCUPANCY EVALUATION (POE) OF GREEN BUILDING IN MALAYSIA , 2020 .

[45]  Shahrul Yani Said,et al.  Functional Assessment through Post Occupancy Review on Refurbished Historical Public Building in Kuala Lumpur , 2012 .

[46]  A. H. Nawawi,et al.  ASSESSING THE CONTENT VALIDITY OF HOSPITAL DISASTER RESILIENCE ASSESSMENT INSTRUMENT , 2016 .

[47]  Michael Clift Building quality assessment (BQA) for offices , 1996 .

[48]  N. Saad,et al.  Confirmatory factor analysis of teaching and learning guiding principles instrument among teacher educators in higher education institutions , 2017 .

[49]  Izran Sarrazin Mohammad,et al.  Content Validation of the User Attitudinal Component and Factors in Green Building , 2019 .

[50]  Per Anker Jensen,et al.  Attributes of Alignment of Real Estate and Facilities Management to Business Needs – an international comparative analysis , 2014 .

[51]  Syahrul Nizam Kamaruzzaman,et al.  Ranking the indicators of building performance and the users’ risk via Analytical Hierarchy Process (AHP): Case of Malaysia , 2016 .