Fuzzy rating scales: Does internal consistency of a measurement scale benefit from coping with imprecision and individual differences in psychological rating?

Abstract Measuring psychological variables (attitudes, opinions, perceptions, feelings, etc.) there is a need for rating scales coping with both the natural imprecision and individual differences. In this respect, the so-called fuzzy rating scales have been introduced as a doubly continuous instrument allowing to capture both imprecision and individual differences. Aiming to show the advantages of using fuzzy rating scales in the setting of questionnaires, the extended Cronbach α is considered to quantify the internal consistency associated with constructs involving fuzzy rating scale-based items. This extended tool allows us to draw interesting conclusions, the main one supporting the use of fuzzy rating scales instead of standard ones (namely, Likert type, visual analogue, and even fuzzy linguistic scales). Although general theoretical conclusions could not be drawn, unequivocal majority trends can be stated from simulation-based and real-life examples.

[1]  María Asunción Lubiano,et al.  A hypothesis testing-based discussion on the sensitivity of means of fuzzy data with respect to data shape , 2017, Fuzzy Sets Syst..

[2]  María Asunción Lubiano,et al.  Hypothesis testing-based comparative analysis between rating scales for intrinsically imprecise data , 2017, Int. J. Approx. Reason..

[3]  Efendi N. Nasibov,et al.  A fuzzy ID3 induction for linguistic data sets , 2018, Int. J. Intell. Syst..

[4]  Metin Dağdeviren,et al.  Developing a fuzzy analytic hierarchy process (AHP) model for behavior-based safety management , 2008, Inf. Sci..

[5]  Zsuzsanna Eszter Tóth,et al.  Applying flexible fuzzy numbers for evaluating service features in healthcare – patients and employees in the focus , 2019, Total Quality Management & Business Excellence.

[6]  Jan Stoklasa,et al.  Fuzzy approach - a new chapter in the methodology of psychology? , 2014 .

[7]  Chimay J. Anumba,et al.  A fuzzy system for evaluating the risk of change in construction projects , 2006, Adv. Eng. Softw..

[8]  M. Fréchet Les éléments aléatoires de nature quelconque dans un espace distancié , 1948 .

[9]  Lotfi A. Zadeh,et al.  Is there a need for fuzzy logic? , 2008, NAFIPS 2008 - 2008 Annual Meeting of the North American Fuzzy Information Processing Society.

[10]  Jerry M. Mendel,et al.  A new method for calibrating the fuzzy sets used in fsQCA , 2018, Inf. Sci..

[11]  P. Kloeden,et al.  Metric spaces of fuzzy sets , 1990 .

[12]  Efendi N. Nasibov,et al.  On methods of defuzzification of parametrically represented fuzzy numbers , 2007, Automatic Control and Computer Sciences.

[13]  W. N. Arifin A Web-based Sample Size Calculator for Reliability Studies , 2018, Education in Medicine Journal.

[14]  Samuel Greiff,et al.  The world beyond rating scales : Why we should think more carefully about the response format in questionnaires , 2018 .

[15]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[16]  W. Holmes Finch,et al.  Applications of cluster analysis to the creation of perfectionism profiles: a comparison of two clustering approaches , 2014, Front. Psychol..

[17]  Lotfi A. Zadeh,et al.  Quantitative fuzzy semantics , 1971, Inf. Sci..

[18]  Enrique H. Ruspini,et al.  Numerical methods for fuzzy clustering , 1970, Inf. Sci..

[19]  Eunseong Cho Making Reliability Reliable , 2016 .

[20]  Michael Smithson,et al.  Fuzzy Sets and Fuzzy Logic in the Human Sciences , 2016, Fuzzy Logic in Its 50th Year.

[21]  Alessia Saggese,et al.  A hierarchical neuro-fuzzy architecture for human behavior analysis , 2015, Inf. Sci..

[22]  Ana Colubi,et al.  Computational Statistics and Data Analysis Fuzzy Data Treated as Functional Data: a One-way Anova Test Approach , 2022 .

[23]  Yao-Ting Sung,et al.  The Visual Analogue Scale for Rating, Ranking and Paired-Comparison (VAS-RRP): A new technique for psychological measurement , 2018, Behavior Research Methods.

[24]  Peer C. Fiss Building Better Causal Theories: A Fuzzy Set Approach to Typologies in Organization Research , 2011 .

[25]  Ulf-Dietrich Reips,et al.  Investigating measurement equivalence of visual analogue scales and Likert-type scales in Internet-based personality questionnaires , 2017, Behavior Research Methods.

[26]  Andy Wai Kan Yeung,et al.  The Historical Roots of Visual Analog Scale in Psychology as Revealed by Reference Publication Year Spectroscopy , 2019, Front. Hum. Neurosci..

[27]  Pierpaolo D'Urso,et al.  Fuzzy data analysis and classification , 2017, Adv. Data Anal. Classif..

[28]  M. Kochen APPLICATIONS OF FUZZY SETS IN PSYCHOLOGY , 1975 .

[29]  Barnabás Bede,et al.  Generalized fuzzy differentiability with LU-parametric representation , 2014, Fuzzy Sets Syst..

[30]  Kazuhisa Takemura,et al.  Ambiguous comparative judgment: Fuzzy set model and data analysis , 2007 .

[31]  Luciano Stefanini,et al.  Parametric representation of fuzzy numbers and application to fuzzy calculus , 2006, Fuzzy Sets Syst..

[32]  Faruk Şahin,et al.  Big five personality traits, entrepreneurial self-efficacy and entrepreneurial intention , 2019, International Journal of Entrepreneurial Behavior & Research.

[33]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[34]  Michel Walrave,et al.  Designing and validating the friendship quality on social network sites questionnaire , 2018, Comput. Hum. Behav..

[35]  Lotfi A. Zadeh,et al.  The concept of a linguistic variable and its application to approximate reasoning-III , 1975, Inf. Sci..

[36]  M. A. Lubiano,et al.  An Incipient Fuzzy Logic-Based Analysis of the Medical Specialty Influence on the Perception About Mental Patients , 2018 .

[37]  Zsuzsanna Eszter Tóth,et al.  Applying a fuzzy questionnaire in a peer review process , 2018, Total Quality Management & Business Excellence.

[38]  Millie Pant,et al.  A Review on Role of Fuzzy Logic in Psychology , 2015, SocProS.

[39]  Umesh Wadgave,et al.  Parametric tests for Likert scale: For and against. , 2016, Asian journal of psychiatry.

[40]  María Asunción Lubiano,et al.  The λ-mean squared dispersion associated with a fuzzy random variable , 2000, Fuzzy Sets Syst..

[41]  Neil Y. Yen,et al.  User sentiment analysis based on social network information and its application in consumer reconstruction intention , 2019, Comput. Hum. Behav..

[42]  Carlo Bertoluzza,et al.  On a new class of distances between fuzzy numbers , 1995 .

[43]  M. Puri,et al.  Fuzzy Random Variables , 1986 .

[44]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[45]  Yunus Alkis,et al.  Development and Validation of Social Anxiety Scale for Social Media Users , 2017, Comput. Hum. Behav..

[46]  T. Hesketh,et al.  Practical applications and psychometric evaluation of a computerised fuzzy graphic rating scale. , 1988 .

[47]  Burak Efe,et al.  A systematic approach for an application of personnel selection in assembly line balancing problem , 2018, Int. Trans. Oper. Res..

[48]  Ronald R. Yager,et al.  A procedure for ordering fuzzy subsets of the unit interval , 1981, Inf. Sci..

[49]  Latafat A. Gardashova,et al.  Application of Fuzzy Logic in Job Satisfaction Performance Problem , 2016 .

[50]  Stefan Van Aelst,et al.  The median of a random fuzzy number. The 1-norm distance approach , 2012, Fuzzy Sets Syst..

[51]  Chung-Hsing Yeh,et al.  Task oriented weighting in multi-criteria analysis , 1999, Eur. J. Oper. Res..

[52]  Tenko Raykov,et al.  Thanks Coefficient Alpha, We Still Need You! , 2019, Educational and psychological measurement.

[53]  Vanessa Loh,et al.  A Future-Oriented Retirement Transition Adjustment Framework , 2011 .

[54]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[55]  Ulf-Dietrich Reips,et al.  Erratum to: Investigating measurement equivalence of visual analogue scales and Likert-type scales in Internet-based personality questionnaires , 2017, Behavior Research Methods.

[56]  Design aspects of rating scales in questionnaires , 2018 .

[57]  María Asunción Lubiano,et al.  Case Study-Based Sensitivity Analysis of Scale Estimates w.r.t. the Shape of Fuzzy Data , 2018, SMPS.

[58]  Beryl Hesketh,et al.  Work Adjustment Theory: An empirical test using a fuzzy rating scale☆ , 1992 .

[59]  Allison S. Gabriel,et al.  Fuzzy Profiles , 2018 .

[60]  María Asunción Lubiano,et al.  Descriptive analysis of responses to items in questionnaires. Why not using a fuzzy rating scale? , 2016, Inf. Sci..

[61]  M. Jeon,et al.  General mixture item response models with different item response structures: Exposition with an application to Likert scales , 2018, Behavior Research Methods.

[62]  L. Zadeh A COMPUTATIONAL APPROACH TO FUZZY QUANTIFIERS IN NATURAL LANGUAGES , 1983 .

[63]  Jose M. Alonso,et al.  Modeling Human Perceptions in e-Commerce Applications: A Case Study on Business-to-Consumers Websites in the Textile and Fashion Sector , 2019 .

[64]  Ralf Körner,et al.  On the variance of fuzzy random variables , 1997, Fuzzy Sets Syst..

[65]  Mark Robinson,et al.  Using multi-item psychometric scales for research and practice in human resource management , 2018 .

[66]  David P. Pancho,et al.  Descriptive and Comparative Analysis of Human Perceptions expressed through Fuzzy Rating Scale-based Questionnaires , 2016, Int. J. Comput. Intell. Syst..

[67]  Francisco Herrera,et al.  A Fuzzy Linguistic Methodology to Deal With Unbalanced Linguistic Term Sets , 2008, IEEE Transactions on Fuzzy Systems.

[68]  M. Frazier,et al.  The path(s) to employee trust in direct supervisor in nascent and established relationships: A fuzzy set analysis , 2016 .

[69]  Robert Pryor,et al.  An Application of a Computerized Fuzzy Graphic Rating Scale to the Psychological Measurement of Individual Differences , 1988, Int. J. Man Mach. Stud..

[70]  K. Jin,et al.  MIMIC approach to assessing differential item functioning with control of extreme response style , 2019, Behavior research methods.

[71]  Ana Colubi,et al.  Nonparametric criteria for supervised classification of fuzzy data , 2011, Int. J. Approx. Reason..

[72]  Daniel M. McNeish,et al.  Psychological Methods Thanks Coefficient Alpha , We ’ ll Take It From Here , 2022 .

[73]  Douglas G. Bonett,et al.  Cronbach's alpha reliability: Interval estimation, hypothesis testing, and sample size planning , 2015 .

[74]  María Angeles Gil,et al.  Fuzzy Rating Scale-Based Questionnaires and Their Statistical Analysis , 2015, IEEE Transactions on Fuzzy Systems.

[75]  Inci Albayrak,et al.  A new fuzzy decision making approach for personnel selection problem , 2018, Intell. Decis. Technol..

[76]  María Asunción Lubiano,et al.  Hypothesis testing for means in connection with fuzzy rating scale-based data: algorithms and applications , 2016, Eur. J. Oper. Res..

[77]  S. Javali,et al.  Effect Of Varying Sample Size In Estimation Of Reliability Coefficients Of Internal Consistency , 2011 .

[78]  M. Warrens,et al.  An empirical analysis of alleged misunderstandings of coefficient alpha , 2018, International Journal of Social Research Methodology.

[79]  Eric Benoit,et al.  Expression of uncertainty in fuzzy scales based measurements , 2013 .

[80]  Tim Hesketh,et al.  Computerized fuzzy ratings: The concept of a fuzzy class , 1994 .

[81]  María Asunción Lubiano,et al.  Analyzing data from a fuzzy rating scale-based questionnaire. A case study. , 2015, Psicothema.

[82]  Halil Yurdugül,et al.  MINIMUM SAMPLE SIZE FOR CRONBACH'S COEFFICIENT ALPHA: A MONTE-CARLO STUDY CRONBACH ALFA KATSAYISI İÇİN MİNİMUM ÖRNEKLEM GENİŞLİĞİ: MONTE-CARLO ÇALIŞMASI , 2008 .

[83]  L. Thurstone Theory of attitude measurement. , 1929 .

[84]  Alaa Houri,et al.  Are school psychologists' special education eligibility decisions reliable and unbiased?: A multi-study experimental investigation. , 2019, Journal of school psychology.

[85]  Seonghoon Kim,et al.  Cronbach’s Coefficient Alpha , 2015 .

[86]  Terry D. Clark,et al.  Fuzzy Set Theory , 2008 .

[87]  Victor I. Chang,et al.  A fuzzy computational model of emotion for cloud based sentiment analysis , 2017, Inf. Sci..

[88]  Ulf-Dietrich Reips,et al.  Why Semantic Differentials in Web-Based Research Should Be Made from Visual Analogue Scales and Not from 5-Point Scales , 2012 .