How many interviews are enough? Do qualitative interviews in building energy consumption research produce reliable knowledge? JUST SOLUTIONS CAMBRIDGE WORKING PAPER 2014B Published in The Journal of Building Engineering, 2015

Research in building energy consumption often uses semi-structured interviews to produce qualitative data on consumer beliefs, attitudes, practices and skills. A survey of 54 recent papers in six prominent building and energy journals shows that the samples are typically small, but inferences are often made for interventions in the light of the findings, on the assumption that these are somehow transferable to wider populations. It is often asked ‘how many interviews are enough’ to produce reliable results. Theoretical literature on this theme has avoided a straightforward statistical critique, and justified the practice with appeals to precedent, the special nature of qualitative personal data, and a limited pool of empirical work. This paper reviews this literature and presents a statistical approach, based on binomial logic, to critiquing and supporting the practice of semi-structured interview research in the building and energy field. The approach developed offers a set of straightforward criteria which researchers can use to estimate the reliability of their findings and inferences from the qualitative data produced in semi-structured interviews.

[1]  Chris Leishman,et al.  The role of corporate reputation and employees' values in the uptake of energy efficiency in office buildings , 2011 .

[2]  M. Crouch,et al.  The logic of small samples in interview-based qualitative research , 2006 .

[3]  Wiktoria Glad,et al.  Housing renovation and energy systems: the need for social learning , 2012 .

[4]  Birgit Dagrun Risholt,et al.  Sustainability assessment of nearly zero energy renovation of dwellings based on energy, economy and home quality indicators , 2013 .

[5]  H. Herring,et al.  Improving the energy performance of UK households: Results from surveys of consumer adoption and use of low- and zero-carbon technologies , 2008 .

[6]  S. Karjalainen Consumer preferences for feedback on household electricity consumption , 2011 .

[7]  Edwin H.W. Chan,et al.  Success factors of energy performance contracting (EPC) for sustainable building energy efficiency retrofit (BEER) of hotel buildings in China , 2011 .

[8]  Lars J Nilsson,et al.  Building a business to close the efficiency gap: the Swedish ESCO Experience , 2010 .

[9]  J. Torfing Discourse Theory: Achievements, Arguments, and Challenges , 2005 .

[10]  Robert Lowe,et al.  Heat metering: socio-technical challenges in district-heated social housing , 2015 .

[11]  Chris Foulds,et al.  Investigating the performance of everyday domestic practices using building monitoring , 2013 .

[12]  S. Karatasou,et al.  Freezing the poor—Indoor environmental quality in low and very low income households during the winter period in Athens , 2014 .

[13]  Erica Löfström,et al.  How to get residents/owners in housing cooperatives to agree on sustainable renovation , 2013 .

[14]  J. Grimshaw,et al.  What is an adequate sample size? Operationalising data saturation for theory-based interview studies , 2010, Psychology & health.

[15]  Simon Guy,et al.  Low carbon heating and older adults: comfort, cosiness and glow , 2014 .

[16]  Li Shao,et al.  Promoting behaviour change through personalized energy feedback in offices , 2013 .

[17]  Toke Haunstrup Christensen,et al.  Air-to-air heat pumps in real-life use: Are potential savings achieved or are they transformed into increased comfort? , 2012 .

[18]  K. Brunner,et al.  Experiencing fuel poverty. Coping strategies of low-income households in Vienna/Austria , 2012 .

[19]  C. Preece,et al.  The rise of sustainability services for the built environment in Malaysia , 2012 .

[20]  Gavin Killip,et al.  Products, practices and processes: exploring the innovation potential for low-carbon housing refurbishment among small and medium-sized enterprises (SMEs) in the UK construction industry , 2013 .

[21]  R. Galvin German Federal policy on thermal renovation of existing homes: A policy evaluation , 2012 .

[22]  James Perkins,et al.  Relative benefits of technology and occupant behaviour in moving towards a more energy efficient, sustainable housing paradigm , 2011 .

[23]  Seppo Junnila,et al.  Housing managers key to reducing the greenhouse gas emissions of multi-family housing companies? A mixed method approach , 2012 .

[24]  D. Streiner,et al.  Health Measurement Scales: A practical guide to thier development and use , 1989 .

[25]  Sarah Broberg Viklund Energy efficiency through industrial excess heat recovery—policy impacts , 2015 .

[26]  Jez Wingfield,et al.  A socio-technical approach to post-occupancy evaluation: interactive adaptability in domestic retrofit , 2014 .

[27]  Veronika Czakó,et al.  Evolution of Hungarian residential energy efficiency support programmes: road to and operation under the Green Investment Scheme , 2012 .

[28]  Saffa Riffat,et al.  The indispensability of good operation & maintenance (O&M) manuals in the operation and maintenance of low carbon buildings , 2015 .

[29]  M. Marshall Sampling for qualitative research. , 1996, Family practice.

[30]  Wasim Saman,et al.  Near zero energy homes – What do users think? , 2014 .

[31]  Kirsten Gram-Hanssen,et al.  Residential heat comfort practices: understanding users , 2010 .

[32]  Françoise Bartiaux,et al.  A practice–theory approach to homeowners' energy retrofits in four European areas , 2014 .

[33]  Mats Bladh,et al.  Energy efficient lighting meets real home life , 2011 .

[34]  Mohamed Osmani,et al.  Feasibility of zero carbon homes in England by 2016: a house builder's perspective , 2009 .

[35]  Inge Røpke,et al.  Information and communication technologies - A new round of household electrification , 2010 .

[36]  Jan Rosenow,et al.  The politics of the German CO2-Building Rehabilitation Programme , 2013 .

[37]  M. Smithson Statistics with confidence , 2000 .

[38]  Ray Galvin,et al.  Impediments to energy-efficient ventilation of German dwellings: A case study in Aachen , 2013 .

[39]  Xiaoling Zhang,et al.  The diffusion of solar energy use in HK: What are the barriers? , 2012 .

[40]  Gillian Frances Menzies,et al.  Windows in the workplace: examining issues of environmental sustainability and occupant comfort in the selection of multi-glazed windows , 2005 .

[41]  Hannah Wittman,et al.  Post-occupancy assessment: building design, governance and household consumption , 2010 .

[42]  K. Ellegård,et al.  Anchoring energy efficiency information in households’ everyday projects: peoples’ understanding of renewable heating systems , 2015 .

[43]  Jeremy Cohen,et al.  Lifestyle and energy consumption: a comparison of four collective communities in transition , 2010 .

[44]  Val Mitchell,et al.  A persona-based approach to domestic energy retrofit , 2014 .

[45]  Mpj Mariëlle Aarts,et al.  Building automation and perceived control : a field study on motorized exterior blinds in Dutch offices , 2014 .

[46]  Ian Ridley,et al.  The side by side in use monitored performance of two passive and low carbon Welsh houses , 2014 .

[47]  Neil Allan,et al.  Low-energy dwellings: the contribution of behaviours to actual performance , 2010 .

[48]  Philip Davies,et al.  Low carbon housing refurbishment challenges and incentives: Architects perspectives , 2011 .

[49]  Fredrik Karlsson,et al.  Indoor climate in low-energy houses : an interdisciplinary investigation , 2006 .

[50]  Ian Walker,et al.  A laboratory test of the efficacy of energy display interface design , 2012 .

[51]  Mikael Togeby,et al.  A Danish case: portfolio evaluation and its impact on energy efficiency policy , 2012 .

[52]  Yolande Strengers,et al.  Comfort expectations: the impact of demand-management strategies in Australia , 2008 .

[53]  M. Hajer Coalitions, Practices, and Meaning in Environmental Politics: From Acid Rain to BSE , 2005 .

[54]  Per Anker Jensen,et al.  Sustainable renovation of residential buildings and the landlord/tenant dilemma , 2013 .

[55]  Françoise Bartiaux,et al.  Do homeowners use energy labels? A comparison between Denmark and Belgium , 2007 .

[56]  Laura Johnson,et al.  How Many Interviews Are Enough? , 2006 .

[57]  Therese Peffer,et al.  Usability of residential thermostats: Preliminary investigations , 2011 .

[58]  Philippa Howden-Chapman,et al.  The influence of electricity prepayment meter use on household energy behaviour , 2014 .

[59]  Sarah Baker,et al.  How many qualitative interviews is enough? Expert voices and early career reflections on sampling and cases in qualitative research , 2012 .

[60]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[61]  Edward Vine,et al.  An approach for evaluating the market effects of energy efficiency programs , 2010 .

[62]  Heather Cruickshank,et al.  Investigating the link between well-being and energy use; an explorative case study between passive and active domestic energy management systems , 2013 .

[63]  Bryan Marshall,et al.  Does Sample Size Matter in Qualitative Research?: A Review of Qualitative Interviews in is Research , 2013, J. Comput. Inf. Syst..

[64]  Miljana Horvat,et al.  TOOLS AND METHODS USED BY ARCHITECTS FOR SOLAR DESIGN , 2014 .

[65]  T. Crosbie,et al.  Energy-efficiency interventions in housing: learning from the inhabitants , 2010 .

[66]  A. H. Taki,et al.  Sustainable rehabilitation of the built environment in Lebanon , 2014 .

[67]  Sami Karjalainen,et al.  Should it be automatic or manual—The occupant's perspective on the design of domestic control systems , 2013 .

[68]  R. Newcombe Two-sided confidence intervals for the single proportion: comparison of seven methods. , 1998, Statistics in medicine.

[69]  A. Jovanović,et al.  Importance of building orientation in determining daylighting quality in student dorm rooms: Physical and simulated daylighting parameters’ values compared to subjective survey results , 2014 .

[70]  G. Isabelle Energy-related logics of action throughout the ages in France: historical milestones, stages of life and intergenerational transmissions , 2011 .

[71]  Ralph Horne,et al.  Low carbon, water-efficient house retrofits: an emergent niche? , 2014 .

[72]  L. Whitmarsh,et al.  Social barriers to the adoption of smart homes , 2013 .

[73]  M. Mason Sample Size and Saturation in PhD Studies Using Qualitative Interviews , 2010 .

[74]  Sirichai Thepa,et al.  Assessment of the thermal environment effects on human comfort and health for the development of novel air conditioning system in tropical regions , 2010 .

[75]  Wendy Miller,et al.  Performance evaluation of eight contemporary passive solar homes in subtropical Australia , 2012 .

[76]  C. Whitbeck,et al.  A Realist Theory of Science. , 1977 .

[77]  R. Galvin,et al.  The UK homeowner-retrofitter as an innovator in a socio-technical system , 2014 .

[78]  Neil Brown,et al.  Information, communication and entertainment appliance use—Insights from a UK household study , 2012 .

[79]  Maarten A. Hajer,et al.  The Politics of Environmental Discourse , 1997 .