Improving the question formulation in Delphi‐like surveys: Analysis of the effects of abstract language and amount of information on response behavior

[1]  Leopold Bayerlein,et al.  The influence of connotation on readability and obfuscation in Australian chairman addresses , 2011 .

[2]  Ravonne A. Green.  The Delphi Technique in Educational Research , 2014 .

[3]  Murray Turoff,et al.  Past and future emergency response information systems , 2002, CACM.

[4]  Cecile N. Gerwel Proches,et al.  An Application of Soft Systems Methodology in the Sugar Industry , 2015 .

[5]  Boris Durisin,et al.  A Study of the Performativity of the “Ambidextrous Organizations” Theory: Neither Lost in nor Lost before Translation , 2012 .

[6]  Frank Parker,et al.  Language Change and the Passive Voice , 1976 .

[7]  Kerstin Cuhls,et al.  Real-Time Delphi in practice — A comparative analysis of existing software-based tools , 2017 .

[8]  H. J. Strauss,et al.  The Delphi Technique and Its Uses In Social Science Research , 1975 .

[9]  Benoît Testé,et al.  The effects of linguistic abstraction on evaluations of the speaker in an intergroup context: Using the Linguistic Intergroup Bias makes you a good group member , 2013 .

[10]  Guidelines for Combining the Judgments of Individual Members in Decision Conferences , 1972, IEEE Engineering Management Review.

[11]  B. Martin,et al.  Special issue: emerging challenges for science, technology and innovation policy research: a reflexive overview , 2009 .

[12]  Steven J. Sherman,et al.  Social explanation: The role of timing, set, and recall on subjective likelihood estimates. , 1983 .

[13]  I. Olkin,et al.  Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement , 1999, The Lancet.

[14]  M. Calabor,et al.  The future of 'serious games' in accounting education: A Delphi study , 2019, Journal of Accounting Education.

[15]  Celeste Varum,et al.  Directions in scenario planning literature – A review of the past decades , 2010 .

[16]  M. D. de Villiers,et al.  The Delphi technique in health sciences education research , 2005, Medical teacher.

[17]  J. Schmid.  Pinning down attributions: the linguistic category model applied to wrestling reports , 1999 .

[18]  Matteo Cesari,et al.  Frailty consensus: a call to action. , 2013, Journal of the American Medical Directors Association.

[19]  E. Peel.  PREDILECTION FOR GENERALISING AND ABSTRACTING , 1975 .

[20]  G. Hilary,et al.  The Bright Side of Managerial Over-Optimism , 2014 .

[21]  N. Dalkey,et al.  An Experimental Application of the Delphi Method to the Use of Experts , 1963 .

[22]  A. Bonaccorsi,et al.  Expert biases in technology foresight. Why they are a problem and how to mitigate them , 2020 .

[23]  D. Funder,et al.  Personality as manifest in word use: correlations with self-report, acquaintance report, and behavior. , 2008, Journal of personality and social psychology.

[24]  Yaacov Trope,et al.  Time-dependent gambling: odds now, money later. , 2002, Journal of experimental psychology. General.

[25]  Jon Barrutia,et al.  Hybrid Delphi: A methodology to facilitate contribution from experts in professional contexts , 2011 .

[26]  Tzy-Yih Hsiao,et al.  Establish standards of standard costing with the application of convergent gray zone test , 2006, Eur. J. Oper. Res..

[27]  William J. Sutherland,et al.  The Delphi technique in ecology and biological conservation: applications and guidelines , 2015 .

[28]  G. Leduc,et al.  Bottom-up estimation of industrial and public R&D investment by technology in support of policy-making: the case of selected low-carbon energy technologies , 2012 .

[29]  Yaacov Trope,et al.  Creeping dispositionism: the temporal dynamics of behavior prediction. , 2003, Journal of personality and social psychology.

[30]  J. Eggers,et al.  Falling Flat , 2012 .

[31]  K. Fiedler,et al.  Language use and reification of social information: Top-down and bottom-up processing in person cognition , 1989 .

[32]  Mitsuru Ishizuka,et al.  SENTIMENT ASSESSMENT OF TEXT BY ANALYZING LINGUISTIC FEATURES AND CONTEXTUAL VALENCE ASSIGNMENT , 2008, Appl. Artif. Intell..

[33]  Jean-Charles Pomerol,et al.  Scenario development and practical decision making under uncertainty , 1999, Decis. Support Syst..

[34]  Gün R. Semin,et al.  The linguistic category model, its bases, applications and range , 1991 .

[35]  Mark A. Sherman,et al.  Adjectival Negation and the Comprehension of Multiply Negated Sentences. , 1976 .

[36]  Klaus Fiedler,et al.  A Parsimonious Theory Can Account for Complex Phenomena , 1999 .

[37]  David R. Heise,et al.  Errors in Surveys , 2010 .

[38]  Camiel J. Beukeboom,et al.  How mood turns on language. , 2006 .

[39]  J. Scott Armstrong,et al.  University of Pennsylvania Scholarlycommons Comparing Face-to-face Meetings, Nominal Groups, Delphi and Prediction Markets on an Estimation Task Comparing Face-to-face Meetings, Nominal Groups, Delphi and Prediction Markets on an Estimation Task Comparing Face-to-face Meetings, Nominal Groups, Delph , 2022 .

[40]  Gün R Semin,et al.  Linguistic signatures of regulatory focus: how abstraction fits promotion more than prevention. , 2005, Journal of personality and social psychology.

[41]  A. Kruglanski,et al.  Brief encounters ending in estrangement: motivated language use and interpersonal rapport in the question-answer paradigm. , 1997, Journal of personality and social psychology.

[42]  Ilkka A. Ronkainen,et al.  International Business and Trade in the Next Decade: Report from a Delphi Study , 1997 .

[43]  Anders Broström,et al.  Working with Distant Researchers - Distance and Content in University-Industry Interaction , 2010 .

[44]  P. Saviotti.  On the dynamics of appropriability, of tacit and of codified knowledge , 1998 .

[45]  Janet Hoek,et al.  Question Wording , 1990 .

[46]  Klaus Fiedler,et al.  Actor-Observer Bias in Close Relationships: The Role of Self-Knowledge and Self-Related Language , 1995 .

[47]  Richard E. Haney,et al.  A procedure for determining the level of abstraction of science reading material , 1991 .

[48]  R. Kemp,et al.  Evolutionary approaches for sustainable innovation policies: From niche to paradigm? , 2009 .

[49]  K. Fiedler,et al.  The Answer is in the Question: The Effect of Verb Causality on Locus of Explanation , 1995 .

[50]  F. Tödtling,et al.  One size fits all?: Towards a differentiated regional innovation policy approach , 2005 .

[51]  Kalle Lyytinen,et al.  Identifying Software Project Risks: An International Delphi Study , 2001, J. Manag. Inf. Syst..

[52]  K. Teigen,et al.  The Directionality of Verbal Probability Expressions: Effects on Decisions, Predictions, and Probabilistic Reasoning. , 1999, Organizational behavior and human decision processes.

[53]  Hilde Tobi,et al.  Quantifying the development of agreement among experts in Delphi studies , 2013 .

[54]  D. Hunter,et al.  Qualitative Research: Consensus methods for medical and health services research , 1995 .

[55]  W. Mischel,et al.  Cognitive Social Approach to Dispositional Inferences: What if the Perceiver is a Cognitive Social Theorist? , 1993 .

[56]  Richard Pibernik,et al.  Hit or Miss: What Leads Experts to Take Advice for Long-Term Judgments? , 2016, Manag. Sci..

[57]  B. Truffer,et al.  Sustainability transitions: An emerging field of research and its prospects , 2012 .

[58]  Cihan Cobanoglu,et al.  A Comparison of Mail, Fax and Web-Based Survey Methods , 2001 .

[59]  Theodore J. Gordon,et al.  RT Delphi: An efficient, “round-less” almost real time Delphi method ☆ , 2006 .

[60]  Luís Fernando Ascenção Guedes,et al.  Technology roadmapping: A methodological proposition to refine Delphi results , 2018 .

[61]  W. Bruin,et al.  The effect of question wording on consumers’ reported inflation expectations , 2012 .

[62]  Mark A. McDaniel,et al.  The influence of the level of schema abstractness upon the processing of social information , 1986 .

[63]  G. Tichy.  Over-Optimism Among Experts in Assessment and Foresight , 2002 .

[64]  Lanndon Ocampo,et al.  Sustainable ecotourism indicators with fuzzy Delphi method – A Philippine perspective , 2018, Ecological Indicators.

[65]  Peter Buxmann,et al.  An ambidextrous perspective on business intelligence and analytics support in decision processes: Insights from a multiple case study , 2015, Decis. Support Syst..

[66]  M. Roach,et al.  Increasing Web Survey Response Rates in Innovation Research: An Experimental Study of Static and Dynamic Contact Design Features , 2012 .

[67]  H. Sigall,et al.  Taking the edge off of disagreement: linguistic abstractness and self‐presentation to a heterogeneous audience , 2002 .

[68]  Murray Turoff,et al.  Delphi: A brief look backward and forward , 2011 .

[69]  Heiko A. von der Gracht,et al.  Consensus measurement in Delphi studies , 2012 .

[70]  Y. Trope,et al.  The role of feasibility and desirability considerations in near and distant future decisions: A test of temporal construal theory. , 1998 .

[71]  James C. Wetherbe,et al.  Key Issues in Information Systems Management: 1994-95 SIM Delphi Results , 1996, MIS Q..

[72]  T. Gordon,et al.  Who is an expert for foresight? A review of identification methods , 2020 .

[73]  R. Flesch,et al.  Measuring the level of abstraction. , 1950, The Journal of applied psychology.

[74]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[75]  Karin Slegers,et al.  Exploring the Potential for a Consolidated Standard for Reporting Guidelines for Qualitative Research , 2015 .

[76]  David V. Budescu,et al.  Improving Communication of Uncertainty in the Reports of the Intergovernmental Panel on Climate Change , 2009, Psychological science.

[77]  John J. Skowronski,et al.  Social judgment and social memory: The role of cue diagnosticity in negativity, positivity, and extremity biases. , 1987 .

[78]  K. Fiedler,et al.  The Backbone of Closing Speeches: The Impact of Prosecution Versus Defense Language on Judicial Attributions1 , 1998 .

[79]  P. Zimbardo,et al.  A Global Look at Time , 2014 .

[80]  Lee D. Parker,et al.  Developing the Flesch reading ease formula for the contemporary accounting communications landscape , 2013 .

[81]  Burcu Sezginsoy Seker,et al.  Comparing Different Readability Formulas on the Examples of Science-Technology and Social Science Textbooks , 2012 .

[82]  P. Gollwitzer,et al.  Implementation intentions and effective goal pursuit , 1997 .

[83]  J. Plaks,et al.  Regret for Errors of Commission and Omission in the Distant Term Versus Near Term: The Role of Level of Abstraction , 2009, Personality & social psychology bulletin.

[84]  M. Levy,et al.  Surviving Sepsis Campaign: International guidelines for management of severe sepsis and septic shock: 2008 , 2008 .

[85]  Justin Yifu Lin,et al.  Innovative R&D and optimal investment under uncertainty in high-tech industries: An implication for emerging economies , 2009 .

[86]  Patricia Wright,et al.  Some observations on how people answer questions about sentences , 1972 .

[87]  Karen M. Douglas,et al.  Effects of communication goals and expectancies on language abstraction. , 2003, Journal of personality and social psychology.

[88]  C. Haeussler.  Information-Sharing in Academia and the Industry: A Comparative Study , 2010 .

[89]  Inga-Lena Darkow,et al.  Validating an innovative real-time Delphi approach - A methodological comparison between real-time and conventional Delphi studies , 2011 .

[90]  Sadi Evren Seker.  Computerized Argument Delphi Technique , 2015, IEEE Access.

[91]  Robert M. Groves,et al.  Total Survey Error: Past, Present, and Future , 2010 .

[92]  J A DeVito,et al.  Levels of abstraction in spoken and written language. , 1967, The Journal of communication.

[93]  Rick Parente,et al.  A case study of long-term Delphi accuracy , 2011 .

[94]  C. Webb,et al.  The Delphi technique: a methodological discussion. , 1994, Journal of advanced nursing.

[95]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[96]  Klaus Weber,et al.  When the Glass is Half Full and Half Empty: CEO's Ambivalent Interpretations of Strategic Issues , 2010 .

[97]  Karen M. Douglas,et al.  Could You Mind Your Language? , 2008 .

[98]  Klaus Weber,et al.  CEO Ambivalence and Responses to Strategic Issues , 2009, Organ. Sci..

[99]  A. Tversky,et al.  The Psychology of Preferences , 1982 .

[100]  J. R. Salancik,et al.  The construction of Delphi event statements , 1971 .

[101]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[102]  P. Rondé.  Technological clusters with a knowledge-based principle: evidence from a Delphi investigation in the French case of the life sciences , 2001 .

[103]  Frederick G. Conrad,et al.  Does Conversational Interviewing Reduce Survey Measurement Error , 1997 .

[104]  Luke Georghiou,et al.  Rising to the challenges—Reflections on Future-oriented Technology Analysis , 2013 .

[105]  Glenn Regehr,et al.  Delphi as a method to establish consensus for diagnostic criteria. , 2003, Journal of clinical epidemiology.

[106]  Y. Trope.  Levels of Inference in Dispositional Judgment , 1989 .

[107]  Karen M. Douglas,et al.  Celebrating Two Decades of Linguistic Bias Research , 2008 .

[108]  Riccardo Vecchiato,et al.  Environmental uncertainty, foresight and strategic decision making: an integrated study. , 2012 .

[109]  Constance E. Helfat,et al.  Strategic Renewal of Organizations , 2009, Organ. Sci..

[110]  Yaacov Trope,et al.  Spatial Distance and Mental Construal of Social Events , 2006, Psychological science.

[111]  Jan Oliver Schwarz,et al.  The Value Contribution of Strategic Foresight: Insights from an Empirical Study on Large European Companies , 2013 .

[112]  Enver Yücesan,et al.  The impact of ERP on supply chain management: Exploratory findings from a European Delphi study , 2003, Eur. J. Oper. Res..

[113]  J. Landeta.  Current validity of the Delphi method in social sciences , 2006 .

[114]  Jindřich Krejčí.  Approaching Quality in Survey Research: Towards a Comprehensive Perspective , 2010 .

[115]  Mark A. Sherman,et al.  Bound to be easier? The negative prefix and sentence comprehension , 1973 .

[116]  Alexander Sokolov,et al.  Quantitative and qualitative approaches in Future-oriented Technology Analysis (FTA): From combination to integration? , 2013 .

[117]  Michael Smithson,et al.  Never say "not": Impact of negative wording in probability phrases on imprecise probability judgments , 2012, Int. J. Approx. Reason..

[118]  Selwyn Piramuthu,et al.  Knowledge-based scenario management - Process and support , 2010, Decis. Support Syst..

[119]  W. E. Riggs,et al.  The Delphi technique: An experimental evaluation , 1983 .

[120]  C. Dweck,et al.  A social-cognitive approach to motivation and personality , 1988 .

[121]  A. Maass,et al.  Intentional control over prejudice: when the choice of the measure matters , 1999 .

[122]  Steven P. MacGregor,et al.  Get There Early: Sensing the Future to Compete in the Present by Bob Johansen , 2009 .

[123]  Camiel J. Beukeboom,et al.  The Language of Extraversion , 2013 .

[124]  Stanley Lemeshow,et al.  Applied Logistic Regression, Second Edition , 1989 .

[125]  R. Flesch.  A new readability yardstick. , 1948, The Journal of applied psychology.

[126]  Bernhard Truffer,et al.  Prospective analysis of technological innovation systems: Identifying technological and organizational development options for biogas in Switzerland , 2009 .

[127]  G. Semin,et al.  Language use in the context of congruent and incongruent in-group behaviours , 1994 .

[128]  G. Riva,et al.  Linguistic Intergroup Bias in Political Communication , 2006, The Journal of general psychology.

[129]  Irene Hanson Frieze,et al.  Measuring Causal Attributions for Success and Failure: A Meta-Analysis of the Effects of Question-Wording Style , 1986 .

[130]  D. Chwilla,et al.  The interplay between mood and language comprehension: Evidence from P600 to semantic reversal anomalies , 2013, Neuropsychologia.

[131]  Wagner A. Kamakura,et al.  Defection Detection: Measuring and Understanding the Predictive Accuracy of Customer Churn Models , 2006 .

[132]  J. Sainte-Beuve,et al.  Foresight in a research institution: a critical review of two exercises , 2003 .

[133]  Evgeny Guglyuvatyy,et al.  Applying the Delphi Method as a Research Technique in Tax Law and Policy , 2014 .

[134]  H. Schuman.  Sample Surveys: Survey Design Issues and Strategies , 2001 .

[135]  P. Biemer.  Total Survey Error: Design, Implementation, and Evaluation , 2010 .

[136]  A. Skoogh,et al.  Maintenance in digitalised manufacturing: Delphi-based scenarios for 2030 , 2017 .

[137]  Jens Winkler,et al.  Biases in future-oriented Delphi studies: A cognitive perspective , 2016 .

[138]  Robin R. Vallacher,et al.  Levels of personal agency: Individual variation in action identification. , 1989 .

[139]  George Wright,et al.  Delphi: A reevaluation of research and theory , 1991 .

[140]  Monica R Geist,et al.  Using the Delphi method to engage stakeholders: a comparison of two studies. , 2010, Evaluation and program planning.

[141]  G. Semin,et al.  Language use in intergroup contexts: the linguistic intergroup bias. , 1989, Journal of personality and social psychology.

[142]  P. Rondé,et al.  The role of knowledge codification in the emergence of consensus under uncertainty: empirical analysis and policy implications , 2001 .

[143]  B. Watson,et al.  Patients’ Interactions with Health Providers , 2002 .

[144]  D. Wigboldus,et al.  Biased language use in stereotype maintenance: the role of encoding and goals. , 2005, Journal of Personality and Social Psychology.

[145]  K. Fiedler,et al.  The Battle of Words Between Gender Groups A Language‐Based Approach to Intergroup Processes , 1993 .

[146]  M. Coovert,et al.  Negativity effects in impression formation: The role of unit formation and schematic expectations , 1990 .

[147]  Stephen Sutton,et al.  Eliciting salient beliefs in research on the theory of planned behaviour: The effect of question wording , 2003 .

[148]  Pierre-André Mangolte,et al.  Articulation and codification of collective know-how in the steel industry: evidence from blast furnace control in France , 2003 .

[149]  George Wright,et al.  Improving the Delphi process: Lessons from social psychological research , 2011 .

[150]  K. Fiedler,et al.  The cognitive functions of linguistic categories in describing persons: Social cognition and language. , 1988 .

[151]  H. Schuman,et al.  Problems in the Use of Survey Questions to Measure Public Opinion , 1987, Science.

[152]  Laszlo Tihanyi,et al.  Information-processing demands and the multinational enterprise: a comparison of foreign and domestic earnings estimates , 2005 .

[153]  Wilfred G. Rieger,et al.  Directions in Delphi developments: Dissertations and their quality , 1986 .

[154]  David Sanders,et al.  Does Mode Matter For Modeling Political Choice? Evidence From the 2005 British Election Study , 2007, Political Analysis.

[155]  George Wright,et al.  Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process , 2019, Technological Forecasting and Social Change.

[156]  Steve Hanney,et al.  Making and implementing foresight policy to engage the academic community: health and life scientists’ involvement in, and response to, development of the UK’s technology foresight programme , 2001 .

[157]  Thomas Baumert,et al.  The determinants of regional innovation in Europe: A combined factorial and regression knowledge production function approach , 2010 .

[158]  G. Semin.  Language Puzzles , 2008 .

[159]  Johnny Wong,et al.  Barriers to the integration of BIM and sustainability practices in construction projects: A Delphi survey of international experts , 2018, Journal of Building Engineering.

[160]  Karen Gasper,et al.  Attending to the Big Picture: Mood and Global Versus Local Processing of Visual Information , 2002, Psychological science.

[161]  G. Semin,et al.  The magic spell of language: linguistic categories and their perceptual consequences. , 2007, Journal of personality and social psychology.