Evaluation of E-Learning Web Sites Using Fuzzy Axiomatic Design Based Approach

High quality web site has been generally recognized as a critical enabler to conduct online business. Numerous studies exist in the literature to measure the business performance in relation to web site quality. In this paper, an axiomatic design based approach for fuzzy group decision making is adopted to evaluate the quality of e-learning web sites. Another multi-criteria decision making technique, namely fuzzy TOPSIS, is applied in order to validate the outcome. The methodology proposed in this paper has the advantage of incorporating requirements and enabling reductions in the problem size, as compared to fuzzy TOPSIS. A case study focusing on Turkish e-learning websites is presented, and based on the empirical findings, managerial implications and recommendations for future research are offered.

[1]  Elsabé Cloete,et al.  Electronic education system model , 2001, Comput. Educ..

[2]  C. Kahraman,et al.  Fuzzy multi-attribute selection among transportation companies using axiomatic design and analytic h , 2005 .

[3]  Richard T. Vidgen,et al.  Data triangulation and web quality metrics: A case study in e-government , 2006, Inf. Manag..

[4]  Ching-Hsue Cheng,et al.  Selecting IS personnel use fuzzy GDSS based on metric distance method , 2005, Eur. J. Oper. Res..

[5]  Maggie McPherson,et al.  Critical issues for e-learning delivery: what may seem obvious is not always put into practice , 2008, J. Comput. Assist. Learn..

[6]  Da Ruan,et al.  Evaluating e‐learning web site quality in a fuzzy environment , 2007, Int. J. Intell. Syst..

[7]  Chung-Hsing Yeh,et al.  Modeling subjective evaluation for fuzzy group multicriteria decision making , 2009, Eur. J. Oper. Res..

[8]  C. Kahraman,et al.  Multi-attribute comparison of advanced manufacturing systems using fuzzy vs. crisp axiomatic design approach , 2005 .

[9]  Tien-Fu Liang,et al.  Application of fuzzy multi-objective linear programming to aggregate production planning , 2004, Comput. Ind. Eng..

[10]  Chen-Tung Chen,et al.  Extensions of the TOPSIS for group decision-making under fuzzy environment , 2000, Fuzzy Sets Syst..

[11]  Francisco Herrera,et al.  Multiperson decision-making based on multiplicative preference relations , 2001, Eur. J. Oper. Res..

[12]  Stefanos D. Kollias,et al.  An intelligent e-learning system based on learner profiling and learning resources adaptation , 2008, Comput. Educ..

[13]  Marin D. Guenov,et al.  Application of axiomatic design and design structure matrix to the decomposition of engineering systems , 2005 .

[14]  Ying-Ming Wang,et al.  Optimal aggregation of fuzzy preference relations with an application to broadband internet service selection , 2008, Eur. J. Oper. Res..

[15]  Gwo-Jen Hwang,et al.  A group-decision approach for evaluating educational web sites , 2004, Comput. Educ..

[16]  Mehmet Mutlu Yenisey Axiomatic Design Approach for E-Commercial Web Sites , 2007, HCI.

[17]  Elaine Toms,et al.  Measuring user perceptions of Web site reputation , 2004, Inf. Process. Manag..

[18]  Francisco Javier Miranda González,et al.  Quantitative evaluation of commercial web sites: : an empirical study of Spanish firms , 2004, Int. J. Inf. Manag..

[19]  Cengiz Kahraman,et al.  Fuzzy axiomatic design-based performance evaluation model for docking facilities in shipbuilding industry: The case of Turkish shipyards , 2009, Expert Syst. Appl..

[20]  Soyoung Kim,et al.  Dimensional hierarchy of retail website quality , 2004, Inf. Manag..

[21]  Jos van Iwaarden,et al.  Perceptions about the quality of web sites: a survey amongst students at Northeastern University and Erasmus University , 2004, Inf. Manag..

[22]  Cengiz Kahraman,et al.  Fuzzy Multi-Attribute Decision Making Using an Information Axiom-Based Approach , 2008 .

[23]  Hungyune Chao,et al.  Assessing the Quality of Academic Libraries on the Web: The Development and Testing of Criteria. , 2002 .

[24]  Shyi-Ming Chen,et al.  Aggregating Fuzzy Opinions in the Group Decision-making Environment , 1998, Cybern. Syst..

[25]  Jie Lu,et al.  Team Situation Awareness using Web-Based Fuzzy Group Decision Support Systems , 2008 .

[26]  G. Tonkay,et al.  Application of modified fuzzy ahp method to analyze bolting sequence of structural joints , 1995 .

[27]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[28]  Chung-Hsing Yeh,et al.  Inter-company comparison using modified TOPSIS with objective weights , 2000, Comput. Oper. Res..

[29]  Thomas L. Saaty,et al.  Decision Making, Scaling, and Number Crunching , 1989 .

[30]  N. Mahdavi-Amiri,et al.  A Heuristic Methodology for Multi-Criteria Evaluation of Web-Based E-Learning Systems Based on User Satisfaction , 2008 .

[31]  Soroush Saghafian,et al.  Multi-criteria Group Decision Making Using A Modified Fuzzy TOPSIS Procedure , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[32]  Nicolae-George Dragulanescu,et al.  Website Quality Evaluations: Criteria and Tools , 2002 .

[33]  Cengiz Kahraman,et al.  Application of axiomatic design and TOPSIS methodologies under fuzzy environment for proposing competitive strategies on Turkish container ports in maritime transportation network , 2009, Expert Syst. Appl..

[34]  Osman Kulak,et al.  A methodology for the design of office cells using axiomatic design principles , 2008 .

[35]  Nam P. Suh Designing-in of quality through axiomatic design , 1995 .

[36]  Ingoo Han,et al.  The impact of Web quality and playfulness on user acceptance of online retailing , 2007, Inf. Manag..

[37]  Abo Sinna,et al.  EXTENSIONS OF TOPSIS FOR MULTIOBJECTIVE LARGE-SCALE NONLINEAR PROGRAMMING PROBLEMS , 2005 .

[38]  David S. Cochran,et al.  A decomposition approach for manufacturing system design , 2001 .

[39]  José L. Gascó,et al.  E-government success: some principles from a Spanish case study , 2007, Ind. Manag. Data Syst..

[40]  M. Helander,et al.  Axiomatc design in ergonomics and an extension of the information axiom , 2002 .

[41]  Cengiz Kahraman,et al.  An integrated fuzzy QFD model proposal on routing of shipping investment decisions in crude oil tanker market , 2009, Expert Syst. Appl..

[42]  D. Ruan,et al.  A Linguistic-Valued Weighted Aggregation Operator to Multiple Attribute Group Decision Making with Quantitative and Qualitative Information , 2008, Int. J. Comput. Intell. Syst..

[43]  Emel Aktas,et al.  An Evaluation Methodology for Ergonomic Design of Electronic Consumer Products Based on Fuzzy Axiomatic Design , 2008, J. Multiple Valued Log. Soft Comput..

[44]  Nam P. Suh,et al.  principles in design , 1990 .

[45]  Menno D. T. de Jong,et al.  Evaluating municipal websites: A methodological comparison of three think-aloud variants , 2009, Gov. Inf. Q..

[46]  T. Chu,et al.  Improved extensions of the TOPSIS for group decisionmaking under fuzzy environment , 2002 .

[47]  David S. Cochran,et al.  Manufacturing System Design , 1998 .

[48]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[49]  Prashant C. Palvia,et al.  Developing and validating an instrument for measuring user-perceived web quality , 2002, Inf. Manag..

[50]  Emre Cevikcan,et al.  Fuzzy VIKOR and Fuzzy Axiomatic Design Versus to Fuzzy Topsis: An Application of Candidate Assessment , 2009, J. Multiple Valued Log. Soft Comput..

[51]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[52]  Sung-Wan Kim,et al.  Validation of an evaluation model for learning management systems , 2008, J. Comput. Assist. Learn..

[53]  Yi-Shun Wang,et al.  Assessment of learner satisfaction with asynchronous electronic learning systems , 2003, Inf. Manag..

[54]  Sang-Gook Kim,et al.  Design of Software System Based on Axiomatic Design , 1991 .

[55]  Sheng-Hshiung Tsaur,et al.  The evaluation of airline service quality by fuzzy MCDM. , 2002 .

[56]  Richard T. Vidgen,et al.  Measuring Web site quality improvements: a case study of the forum on strategic management knowledge exchange , 2003, Ind. Manag. Data Syst..

[57]  S. Birgi Martin,et al.  AXIOMATIC DESIGN FOR THE DEVELOPMENT OF ENTERPRISE LEVEL E-COMMERCE STRATEGIES , 2002 .

[58]  Harold W. Webb,et al.  SiteQual: an integrated measure of Web site quality , 2004, J. Enterp. Inf. Manag..

[59]  Mahmoud A. Abo-Sinna,et al.  Extensions of TOPSIS for multi-objective large-scale nonlinear programming problems , 2005, Appl. Math. Comput..

[60]  Hsu-Shih Shih,et al.  Incremental analysis for MCDM with an application to group TOPSIS , 2008, Eur. J. Oper. Res..

[61]  Rian van der Merwe,et al.  A framework and methodology for evaluating e-commerce Web sites , 2003, Internet Res..

[62]  Ta-Chung Chu,et al.  Facility Location Selection Using Fuzzy TOPSIS Under Group Decisions , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[63]  Helmut Schneider,et al.  Web site design benchmarking within industry groups , 2003, Internet Res..

[64]  Cengiz Kahraman,et al.  A new multi-attribute decision making method: Hierarchical fuzzy axiomatic design , 2009, Expert Syst. Appl..

[65]  Osman Kulak,et al.  A decision support system for fuzzy multi-attribute selection of material handling equipments , 2005, Expert Syst. Appl..

[66]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[67]  Ping Ge,et al.  Applying axiomatic design theory to the evaluation and optimization of large-scale engineering systems , 2006 .

[68]  Alastair G. Smith,et al.  Applying evaluation criteria to New Zealand government websites , 2001, Int. J. Inf. Manag..

[69]  Da Ruan,et al.  A fuzzy preference‐ranking model for a quality evaluation of hospital web sites , 2006, Int. J. Intell. Syst..

[70]  Evangelos Grigoroudis,et al.  The assessment of user-perceived web quality: Application of a satisfaction benchmarking approach , 2008, Eur. J. Oper. Res..

[71]  Nam P. Suh,et al.  Design and operation of large systems , 1995 .

[72]  W. Poon,et al.  A study of Web‐based learning (WBL) environment in Malaysia , 2004 .

[73]  Nam P. Suh Design of Systems , 1997 .

[74]  Metin Celik A hybrid design methodology for structuring an Integrated Environmental Management System (IEMS) for shipping business. , 2009, Journal of environmental management.

[75]  Miyoung Jeong,et al.  Conceptualizing Web site quality and its consequences in the lodging industry , 2003 .

[76]  Barrie Dale,et al.  Key quality factors in Web site design and use: an examination , 2002 .

[77]  Zhongsheng Hua,et al.  A note on group decision-making based on concepts of ideal and anti-ideal points in a fuzzy environment , 2007, Math. Comput. Model..