The Ordinal Controversy and the Fuzzy Inference System Through an Application and Simulation to Teaching Activity Evaluation

The handling of ordinal variables presents many difficulties in both the measurements phase and the statistical data analysis. Many efforts have been made to overcome them. An alternative approach to traditional methods used to process ordinal data has been developed over the last two decades. It is based on a fuzzy inference system and is presented, here, applied to the student evaluations of teaching data collected via Internet in Modena, during the academic year 2009/10, by a questionnaire containing items with a four-point Likert scale. The scores emerging from the proposed fuzzy inference system proved to be approximately comparable to scores obtained through the practical, but questionable, procedure based on the average of the item value labels. The fuzzification using a number of membership functions smaller than the number of modalities of input variables yielded outputs that were closer to the average of the item value labels. The Center-of-Area defuzzification method showed good performances and lower dispersion around the mean of the value labels.

[1]  Raymond E. Bernberg,et al.  Socio-Psychological Factors in Industrial Morale: I. The Prediction of Specific Indicators , 1952 .

[2]  L. Thurstone A law of comparative judgment. , 1994 .

[3]  Przemyslaw Grzegorzewski Trapezoidal approximations of fuzzy numbers preserving the expected interval - Algorithms and properties , 2008, Fuzzy Sets Syst..

[4]  D. Dubois,et al.  Fundamentals of fuzzy sets , 2000 .

[5]  Gisella Facchinetti,et al.  Ordinal scales and fuzzy set systems to measure agreement: An application to the evaluation of teaching activity , 2005 .

[6]  C. Osgood The nature and measurement of meaning. , 1952, Psychological bulletin.

[7]  Przemyslaw Grzegorzewski,et al.  Trapezoidal approximations of fuzzy numbers , 2003, Fuzzy Sets Syst..

[8]  A. Agresti Categorical data analysis , 1993 .

[9]  Michael Smithson,et al.  Fuzzy set theory and the social sciences: the scope for applications , 1988 .

[10]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[11]  Leo P. Crespi Public Opinion Toward Conscientious Objectors: II. Measurement of National Approval-Disapproval , 1945 .

[12]  H. Weisberg,et al.  Dimensions of Candidate Evaluation , 1970, American Political Science Review.

[13]  P. Abrami,et al.  Students' Evaluations of University Teaching: Research Findings, Methodological Issues, and Directions for Future Research , 1987 .

[14]  T. Amemiya QUALITATIVE RESPONSE MODELS: A SURVEY , 1981 .

[15]  Gerald Albaum,et al.  Is a Central Tendency Error Inherent in the Use of Semantic Differential Scales in Different Cultures? , 2003 .

[16]  S. Presser,et al.  Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording, and Context , 1996 .

[17]  Davide Ferrari,et al.  Web‐based versus paper‐based data collection for the evaluation of teaching activity: empirical evidence from a case study , 2011 .

[18]  Nikola Kasabov,et al.  Foundations Of Neural Networks, Fuzzy Systems, And Knowledge Engineering [Books in Brief] , 1996, IEEE Transactions on Neural Networks.

[19]  Irving Crespi,et al.  Use of a Scaling Technique in Surveys , 1961 .

[20]  F. Thomas Juster,et al.  Prediction and consumer buying intentions. , 1960 .

[21]  Leonard R. Sussman,et al.  Nominal, Ordinal, Interval, and Ratio Typologies are Misleading , 1993 .

[22]  Etienne E. Kerre,et al.  Defuzzification: criteria and classification , 1999, Fuzzy Sets Syst..

[23]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[24]  Przemyslaw Grzegorzewski,et al.  Trapezoidal approximations of fuzzy numbers - revisited , 2007, Fuzzy Sets Syst..

[25]  S. Labovitz,et al.  Introduction to social research , 1971 .

[26]  S S Stevens,et al.  On the Theory of Scales of Measurement. , 1946, Science.

[27]  Frederic M. Lord,et al.  On the Statistical Treatment of Football Numbers. , 1953 .

[28]  L. Thurstone Attitudes Can Be Measured , 1928, American Journal of Sociology.

[29]  Chi-Tsuen Yeh Weighted trapezoidal and triangular approximations of fuzzy numbers , 2009, Fuzzy Sets Syst..

[30]  J. Hofmans,et al.  Combining quality and quantity. A psychometric evaluation of the self-anchoring scale , 2009 .

[31]  F. Thomas Juster,et al.  Consumer Buying Intentions and Purchase Probability: An Experiment in Survey Design , 1966 .

[32]  Constantin von Altrock,et al.  Fuzzy Logic and NeuroFuzzy Applications in Business and Finance , 1996 .

[33]  Anirban DasGupta,et al.  Fundamentals of Probability: A First Course , 2010 .

[34]  Leo P. Crespi Public Opinion toward Conscientious Objectors: III. Intensity of Social Rejection in Stereotype and Attitude , 1945 .

[35]  Michael Smithson,et al.  Fuzzy Set Analysis for Behavioral and Social Sciences , 1986 .

[36]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[37]  Jarl K. Kampen,et al.  The Ordinal Controversy Revisited , 2000 .

[38]  L. Thurstone The method of paired comparisons for social values , 1927 .