The use of the Delphi method with non-parametric analysis for identifying sustainability criteria and indicators in evaluating ecotourism management: the case of Penang National Park (Malaysia)

This paper attempts to develop criteria and indicators (C&I) for measuring the sustainability of ecotourism activities in Penang National Park (PNP) in Malaysia. In carrying out this objective, a Delphi process with Content Validity Ratios—a non-parametric tool—for generating a consensus for C&I sets was adopted with 30 academic and non-academic experts in sustainable tourism, ecotourism, and forestry. After four rounds of discussion, the panel members reached a consensus on a C&I set which consists of ecological (three criteria and seven indicators), social (three criteria and eight indicators), economic (two criteria and four indicators), and institutional (one criterion and two indicators) factors for ecotourism management. A consistency reliability test was also conducted, and the Cronbach’s alpha values of criteria and indicators were reported to be acceptable. This C&I set enables the provision of a suitable approach for managing ecotourism in a sustainable manner in Penang National Park. It can serve as an instrument for the sustainability evaluation and monitoring of ecotourism management in PNP by the Department of Wildlife and Tourism Organization in Malaysia. The proposed approach and the resulting C&I could be resonated with other national parks as ecotourism destinations with similar relevant characteristics of the PNP.

[1]  Earl R. Babbie,et al.  The practice of social research , 1969 .

[2]  Murray Turoff,et al.  The Delphi Method: Techniques and Applications , 1976 .

[3]  C. H. Lawshe.  A QUANTITATIVE APPROACH TO CONTENT VALIDITY , 1975 .

[4]  David H. Gustafson,et al.  Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes , 1976 .

[5]  Erdener Kaynak,et al.  The Delphi technique in the measurement of tourism market potential: The case of Nova Scotia , 1984 .

[6]  R. Brook,et al.  Consensus methods: characteristics and guidelines for use. , 1984, American journal of public health.

[7]  Roger Ellis,et al.  Professional competence and quality assurance in the caring professions , 1988 .

[8]  Robert D. Gibbons.  A General Statistical Procedure for Ground‐Water Detection Monitoring at Waste Disposal Facilities , 1990 .

[9]  M. Strong.  The global partnership : for environment and development : a guide to Agenda 21 , 1992 .

[10]  M. Munasinghe.  Environmental issues and economic decisions in developing countries , 1993 .

[11]  B. Bramwell,et al.  Interpretation and Sustainable Tourism: The Potential and the Pitfalls , 1993 .

[12]  N Jairath,et al.  The Delphi methodology (Part one): A useful administrative approach. , 1994, Canadian journal of nursing administration.

[13]  Dulal K. Bhaumik,et al.  Statistical Methods for Groundwater Monitoring , 1994 .

[14]  D. Hunter,et al.  Qualitative Research: Consensus methods for medical and health services research , 1995 .

[15]  Z. Mieczkowski,et al.  Environmental issues of tourism and recreation , 1996 .

[16]  J. Murry,et al.  Delphi: A Versatile Methodology for Conducting Qualitative Research , 2017 .

[17]  Gilberto C. Gallopín,et al.  Environmental and sustainability indicators and the concept of situational indicators. A systems approach , 1996 .

[18]  H. Ceballos-Lascuráin,et al.  Tourism, ecotourism, and protected areas , 1996 .

[19]  James Selfe,et al.  The Delphi method: a useful tool for the allied health researcher , 1996 .

[20]  C. Gee,et al.  International Tourism: A Global Perspective , 1997 .

[21]  Peter Hardi,et al.  Assessing sustainable development : principles in practice , 1997 .

[22]  M. Stabler.  Tourism and Sustainability: Principles to Practice , 1997 .

[23]  D. Spiegelhalter,et al.  Consensus development methods, and their use in clinical guideline development. , 1998, Health technology assessment.

[24]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[25]  M. Honey,et al.  Book Review: Ecotourism and Sustainable Development: Who Owns Paradise? , 1999 .

[26]  George Wright,et al.  The Delphi technique as a forecasting tool: issues and analysis , 1999 .

[27]  Richard Butler,et al.  Sustainable tourism: A state‐of‐the‐art review , 1999 .

[28]  D. Diamantis.  The Concept of Ecotourism: Evolution and Trends , 1999 .

[29]  S. M. Moon,et al.  Research Methods in Family Therapy , 1999 .

[30]  F. Hasson,et al.  Research guidelines for the Delphi survey technique. , 2000, Journal of advanced nursing.

[31]  D. Booher,et al.  Indicators for Sustainable Communities: A Strategy Building on Complexity Theory and Distributed Intelligence , 2000 .

[32]  Graham Miller,et al.  The development of indicators for sustainable tourism: results of a Delphi survey of tourism researchers , 2001 .

[33]  Alan Brown,et al.  Criteria and Indicators for Sustainable Forest Management , 2001 .

[34]  T. Bauer.  Tourism in the Antarctic: Opportunities, Constraints, and Future Prospects , 2001 .

[35]  Stephen Morse,et al.  Breaking through the Glass Ceiling: Who really cares about sustainability indicators? , 2001 .

[36]  Roberto López-Espinosa de los Monteros.  Evaluating ecotourism in natural protected areas of La Paz Bay, Baja California Sur, México: ecotourism or nature-based tourism? , 2002 .

[37]  Poulicos Prastacos,et al.  Sustainable Development Indicators : An overview , 2002 .

[38]  Robert Loo,et al.  The Delphi method: a powerful tool for strategic management , 2002 .

[39]  W. N. Thompson,et al.  Assessing Community Support and Sustainability for Ecotourism Development , 2002 .

[40]  P. Bosch.  The European Environment Agency focuses on EU-policy in its approach to sustainable development indicators , 2002 .

[41]  V. Foucat.  Community-based ecotourism management moving towards sustainability, in Ventanilla, Oaxaca, Mexico , 2002 .

[42]  C. Powell.  The Delphi technique: myths and realities. , 2003, Journal of advanced nursing.

[43]  David R. Lee,et al.  Community Participation in Ecotourism Benefits: The Link to Conservation Practices and Perspectives , 2003 .

[44]  Yu Nu Yang,et al.  Testing the Stability of Experts' Opinions between Successive Rounds of Delphi Studies. , 2003 .

[45]  Glenn Regehr,et al.  Delphi as a method to establish consensus for diagnostic criteria. , 2003, Journal of clinical epidemiology.

[46]  R. K. Dixon,et al.  Life on the Edge: Vulnerability and Adaptation of African Ecosystems to Global Climate Change , 2003 .

[47]  H. Gudmundsson.  Making concepts matter: Sustainable mobility and indicator systems in transport policy , 2003 .

[48]  E. Rametsteiner,et al.  Forest certification--an instrument to promote sustainable forest management? , 2003, Journal of environmental management.

[49]  Suzanne D. Pawlowski,et al.  The Delphi method as a research tool: an example, design considerations and applications , 2004, Inf. Manag..

[50]  Harold Goodwin,et al.  In pursuit of ecotourism , 1996, Biodiversity & Conservation.

[51]  Roberto Espinosa de Los Monteros,et al.  Evaluating ecotourism in natural protected areas of La Paz Bay, Baja California Sur, México: ecotourism or nature-based tourism? , 2002, Biodiversity & Conservation.

[52]  Wenjun Li.  Environmental management indicators for ecotourism in China's nature reserves: A case study in Tianmushan Nature Reserve , 2004 .

[53]  A. Hezri,et al.  Sustainability indicator system and policy processes in Malaysia: a framework for utilisation and learning. , 2004, Journal of environmental management.

[54]  Graham Miller,et al.  Monitoring for a Sustainable Tourism Transition: The Challenge of Developing and Using Indicators , 2005 .

[55]  T. Manning,et al.  Indicators of sustainable development for tourism destinations. , 2005 .

[56]  Melanie Karjala,et al.  Local-level criteria and indicators: an Aboriginal perspective on sustainable forest management , 2005 .

[57]  Jo-Hui Lin,et al.  Evaluating ecotourism sustainability from the integrated perspective of resource, community and tourism , 2006 .

[58]  Stephen Dovers,et al.  Sustainability indicators, policy and governance: Issues for ecological economics , 2006 .

[59]  C. Mathers,et al.  Global prevalence of dementia: a Delphi consensus study , 2005, The Lancet.

[60]  Monique Borgerhoff Mulder,et al.  Testing Hypotheses for the Success of Different Conservation Strategies , 2006, Conservation biology : the journal of the Society for Conservation Biology.

[61]  K. Lovell,et al.  Multidisciplinary consensus of best practice for pro re nata (PRN) psychotropic medications within acute mental health settings: a Delphi study. , 2007, Journal of psychiatric and mental health nursing.

[62]  L. Lawton,et al.  Progress in tourism management Twenty years on: The state of contemporary ecotourism research , 2007 .

[63]  L. Teh,et al.  Planning for sustainable tourism in southern Pulau Banggi: an assessment of biophysical conditions and their implications for future tourism development. , 2007, Journal of environmental management.

[64]  Chia-Chien Hsu,et al.  The Delphi Technique: Making Sense of Consensus , 2007 .

[65]  John L. Innes,et al.  Indicators for demonstrating sustainable forest management in British Columbia, Canada: An international review , 2008 .

[66]  Robert D. Gibbons,et al.  Statistical Methods for Groundwater Monitoring: Second Edition , 2009 .

[67]  E. Torquebiau,et al.  Natural resource management by rural citizens in developing countries: innovations still required , 2009, Biodiversity and Conservation.

[68]  Macarena Lozano-Oyola,et al.  The assessment of sustainable tourism: Application to Spanish coastal destinations , 2010 .

[69]  R. Gifford,et al.  Defining place attachment: A tripartite organizing framework , 2010 .

[70]  Ngai Weng Chan,et al.  The potentials, threats and challenges in sustainable development of Penang National Park , 2010 .

[71]  Serenella Sala,et al.  Sustainable performance index for tourism policy development , 2010 .

[72]  G. Montibeller,et al.  Problem Structuring for Multicriteria Decision Analysis Interventions , 2010 .

[73]  Hong ChernWern,et al.  Strength-weakness-opportunities-threats analysis of Penang National Park for strategic ecotourism management. , 2010 .

[74]  Jon Barrutia,et al.  Hybrid Delphi: A methodology to facilitate contribution from experts in professional contexts , 2011 .

[75]  Jinyang Deng,et al.  Development of a point evaluation system for ecotourism destinations: a Delphi method , 2011 .

[76]  Hong Zhang,et al.  The evaluation of tourism destination competitiveness by TOPSIS & information entropy – A case in the Yangtze River Delta of China , 2011 .

[77]  M. H. Ismail,et al.  Delphi technique for generating criteria and indicators in monitoring ecotourism sustainability in Northern forests of Iran: Case study on Dohezar and Sehezar Watersheds , 2011 .

[78]  H. Vacik,et al.  Mapping indicator models: From intuitive problem structuring to quantified decision-making in sustainable forest management , 2011 .

[79]  H. Donohoe.  Defining culturally sensitive ecotourism: a Delphi consensus , 2011 .

[80]  Gordon M. Hickey,et al.  A virtual and anonymous, deliberative and analytic participation process for planning and evaluation: The Concept Mapping Policy Delphi , 2011 .

[81]  C. Hall,et al.  Policy learning and policy failure in sustainable tourism governance: from first- and second-order to third-order change? , 2011 .

[82]  Yuji Murayama,et al.  Land Use and Natural Resources Planning for Sustainable Ecotourism Using GIS in Surat Thani, Thailand , 2012 .

[83]  Brian Garrod.  Applying the Delphi method in an ecotourism context: a response to Deng et al.’s ‘Development of a point evaluation system for ecotourism destinations: a Delphi method’ , 2012 .

[84]  Jessica Coria,et al.  Ecotourism and the development of indigenous communities: the good, the bad, and the ugly. , 2012 .

[85]  Alan Grainger,et al.  Forest sustainability indicator systems as procedural policy tools in global environmental governance , 2012 .

[86]  Mónica García-Melón,et al.  A combined ANP-delphi approach to evaluate sustainable tourism , 2012 .

[87]  Heng Zhang,et al.  A structural model of residents’ intention to participate in ecotourism: The case of a wetland community , 2012 .

[88]  Sema A. Kalaian,et al.  Terminating Sequential Delphi Survey Data Collection. , 2012 .

[89]  B. Sander.  The importance of education in ecotourism ventures: lessons from Rara Avis ecolodge, Costa Rica , 2012 .

[90]  Nur Munira Azman,et al.  The Distribution of Nesting White-bellied Sea-eagle (Haliaeetus leucogaster) in Penang National Park, Malaysia: Conservation and Management Issues. , 2013, Tropical life sciences research.

[91]  Metin Dağdeviren,et al.  A group MADM method for personnel selection problem using Delphi technique based on intuitionistic fuzzy sets , 2013 .

[92]  Tiffany M. Doan.  Sustainable ecotourism in Amazonia: evaluation of six sites in southeastern Peru. , 2013 .

[93]  Guy Paré,et al.  A systematic assessment of rigor in information systems ranking-type Delphi studies , 2013, Inf. Manag..

[94]  Laura Johnson.  Critical Debates in Tourism , 2013 .

[95]  J. Sørensen,et al.  International Multispecialty Consensus on How to Evaluate Ultrasound Competence: A Delphi Consensus Survey , 2013, PloS one.

[96]  E. Bohlmeijer,et al.  Context-specific definitions of organizational concepts: Defining ‘team effectiveness’ with use of the Delphi Technique , 2013, Journal of Management & Organization.

[97]  You-Shyang Chen,et al.  Evolving MCDM Applications Using Hybrid Expert-Based ISM and DEMATEL Models: An Example of Sustainable Ecotourism , 2013, TheScientificWorldJournal.

[98]  Fatin Izzati Minhat,et al.  BENTHIC FORAMINIFERAL DISTRIBUTIONS AS BIOINDICATORS IN COASTAL WATERS OF PENANG NATIONAL PARK, MALAYSIA , 2014 .

[99]  G. Gethin,et al.  Using an e-Delphi technique in achieving consensus across disciplines for developing best practice in day surgery in Ireland , 2014 .

[100]  M. Asselin,et al.  Revisiting the Delphi Technique: Implications for Nursing Professional Development , 2014, Journal for nurses in professional development.

[101]  F. V. Pegas,et al.  Ecotourism as a conservation tool and its adoption by private protected areas in Brazil , 2014 .

[102]  R. Newcombe,et al.  Toward Minimum Standards for Certifying Patient Decision Aids , 2014, Medical decision making : an international journal of the Society for Medical Decision Making.

[103]  F. Ferreira,et al.  Current Situation of Corporate Governance Practices in Albanian Joint Stock Companies: A Delphi-based Approach , 2014 .

[104]  D. Furst,et al.  Expert consensus for performing right heart catheterisation for suspected pulmonary arterial hypertension in systemic sclerosis: a Delphi consensus study with cluster analysis , 2013, Annals of the rheumatic diseases.

[105]  B. Mohamed,et al.  Potentials, Threats and Challenges in Managing Natural Heritage in the Penang National Park , 2015 .

[106]  Liliane Pasape,et al.  Assessment of indicators of sustainable ecotourism in Tanzania , 2015 .

[107]  M. Shamsudin,et al.  Ecological conservation, ecotourism, and sustainable management: the case of Penang National Park. , 2015 .

[108]  Nuradilah Abas,et al.  Tourism Policy and Organization:Case Study of Penang National Park , 2016 .

[109]  T. Lee,et al.  Indicators of sustainable tourism: A case study from a Taiwan's wetland , 2016 .

[110]  J. Retolaza,et al.  Is the Delphi method valid for business ethics? A survey analysis , 2016 .

[111]  Pierre-Alexandre Château,et al.  Performance Indicator Framework for Evaluation of Sustainable Tourism in the Taiwan Coastal Zone , 2016 .

[112]  C. Siwar,et al.  Sustainability Measurement for Ecotourism Destination in Malaysia: A Study on Lake Kenyir, Terengganu , 2016 .

[113]  S. M. Lobo.  Ecotourism and Sustainable Development , 2016 .

[114]  K. D. Regmi,et al.  Modernisation theory, ecotourism policy, and sustainable development for poor countries of the global South: perspectives from Nepal , 2017 .

[115]  E. Ng,et al.  A self-evaluation system of quality planning for tourist attractions in Taiwan: an integrated AHP-Delphi approach from career professionals , 2017 .

[116]  Bob McKercher,et al.  Identifying core indicators of sustainable tourism: A path forward? , 2017 .

[117]  H. R. Tewari,et al.  Development of ecotourism sustainability assessment framework employing Delphi, C&I and participatory methods: A case study of KBR, West Sikkim, India , 2017 .

[118]  Siew Imm Ng,et al.  Seeking tourism sustainability – A case study of Tioman Island, Malaysia , 2017 .

[119]  Timothy J. Wood,et al.  Using consensus group methods such as Delphi and Nominal Group in medical education research* , 2017, Medical teacher.

[120]  Lanndon Ocampo,et al.  Sustainable ecotourism indicators with fuzzy Delphi method – A Philippine perspective , 2018, Ecological Indicators.

[121]  M. G. Ceddia,et al.  Contribution of international ecotourism to comprehensive economic development and convergence in the Central American and Caribbean region , 2018 .

[122]  Jian Zhou,et al.  Conservation for Sustainable Development: The Sustainability Evaluation of the Xijie Historic District, Dujiangyan City, China , 2018, Sustainability.

[123]  W. Gribb,et al.  Sustainable ecotourism management and visitor experiences: managing conflicting perspectives in Rocky Mountain National Park, USA , 2018, Journal of Ecotourism.

[124]  Aiora Zabala,et al.  Comparison of techniques for eliciting views and judgements in decision‐making , 2018 .

[125]  Bruce B. Frey,et al.  The Sage encyclopedia of educational research, measurement, and evaluation , 2018 .

[126]  J. González-Pachón,et al.  Decision-Making in Forestry: A Review of the Hybridisation of Multiple Criteria and Group Decision-Making Methods , 2019, Forests.

[127]  W. Halal,et al.  Delphi method: analysis of rounds, stakeholder and statistical indicators , 2019, Foresight.

[128]  S. Abdullah,et al.  The Perceptions of Local Communities toward Penang National Park , 2019, IOP Conference Series: Earth and Environmental Science.

[129]  H. R. Tewari,et al.  Evaluating the applicability of ESM (Ecotourism Sustainability Maximization) model to assess, monitor, and manage the ecotourism sustainability in mountain ecosystem (Mt. Kangchendzonga Base Camp Trek, India) , 2019, Environmental Monitoring and Assessment.

[130]  Sintayehu Aynalem Aseres,et al.  An exploratory study of ecotourism services quality (ESQ) in Bale Mountains National Park (BMNP), Ethiopia: using an ECOSERV model , 2020, Annals of Leisure Research.

[131]  Dušan Ristić,et al.  Tourism and sustainable development of rural settlements in protected areas - Example NP Кopaonik (Serbia) , 2019 .

[132]  George Wright,et al.  Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process , 2019, Technological Forecasting and Social Change.

[133]  Brady D. Lund,et al.  Review of the Delphi method in library and information science research , 2020, J. Documentation.

[134]  T. Thimm,et al.  A conceptual framework for indigenous ecotourism projects – a case study in Wayanad, Kerala, India , 2020 .

[135]  S. Abdullah,et al.  Recreation Resource Impacts of Pantai Kerachut Trail in Penang National Park , 2020, IOP Conference Series: Earth and Environmental Science.

[136]  Shaoai Liu,et al.  Ecotourism Research Progress: A Bibliometric Analysis During 1990–2016 , 2020, SAGE Open.

[137]  Daniel W.M. Chan,et al.  Critical risk factors for implementing building information modelling (BIM): a Delphi-based survey , 2020, International Journal of Construction Management.

[138]  Zeinab Asadpourian,et al.  SWOT-AHP-TOWS Analysis for Sustainable Ecotourism Development in the Best Area in Lorestan Province, Iran , 2020, Social Indicators Research.