Evaluation of E-Learning Web Sites Using Fuzzy Axiomatic Design Based Approach

High quality web site has been generally recognized as a critical enabler to conduct online business. Numerous studies exist in the literature to measure the business performance in relation to web site quality. In this paper, an axiomatic design based approach for fuzzy group decision making is adopted to evaluate the quality of e-learning web sites. Another multi-criteria decision making technique, namely fuzzy TOPSIS, is applied in order to validate the outcome. The methodology proposed in this paper has the advantage of incorporating requirements and enabling reductions in the problem size, as compared to fuzzy TOPSIS. A case study focusing on Turkish elearning websites is presented, and based on the empirical findings, managerial implications and recommendations for future research are offered.

[1]  Ching-Hsue Cheng,et al.  Selecting IS personnel use fuzzy GDSS based on metric distance method , 2005, Eur. J. Oper. Res..

[2]  M. Bohanec,et al.  The Analytic Hierarchy Process , 2004 .

[3]  Metin Celik.  A hybrid design methodology for structuring an Integrated Environmental Management System (IEMS) for shipping business. , 2009, Journal of environmental management.

[4]  Chung-Hsing Yeh,et al.  Modeling subjective evaluation for fuzzy group multicriteria decision making , 2009, Eur. J. Oper. Res..

[5]  Jie Lu,et al.  Team Situation Awareness using Web-Based Fuzzy Group Decision Support Systems , 2008, Int. J. Comput. Intell. Syst..

[6]  Mehmet Mutlu Yenisey.  Axiomatic Design Approach for E-Commercial Web Sites , 2007, HCI.

[7]  Miyoung Jeong,et al.  Conceptualizing Web site quality and its consequences in the lodging industry , 2003 .

[8]  S. Birgi Martin,et al.  AXIOMATIC DESIGN FOR THE DEVELOPMENT OF ENTERPRISE LEVEL E-COMMERCE STRATEGIES , 2002 .

[9]  C. Kahraman,et al.  Multi-attribute comparison of advanced manufacturing systems using fuzzy vs. crisp axiomatic design approach , 2005 .

[10]  Cengiz Kahraman,et al.  Fuzzy Multi-Attribute Decision Making Using an Information Axiom-Based Approach , 2008 .

[11]  Jun Liu,et al.  A Linguistic-Valued Weighted Aggregation Operator to Multiple Attribute Group Decision Making with Quantitative and Qualitative Information , 2008, Int. J. Comput. Intell. Syst..

[12]  G. Tonkay,et al.  Application of modified fuzzy ahp method to analyze bolting sequence of structural joints , 1995 .

[13]  Hsu-Shih Shih,et al.  Incremental analysis for MCDM with an application to group TOPSIS , 2008, Eur. J. Oper. Res..

[14]  Soroush Saghafian,et al.  Multi-criteria Group Decision Making Using A Modified Fuzzy TOPSIS Procedure , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[15]  Richard T. Vidgen,et al.  Measuring Web site quality improvements: a case study of the forum on strategic management knowledge exchange , 2003, Ind. Manag. Data Syst..

[16]  Thomas L. Saaty,et al.  Decision Making, Scaling, and Number Crunching , 1989 .

[17]  Ying-Ming Wang,et al.  Optimal aggregation of fuzzy preference relations with an application to broadband internet service selection , 2008, Eur. J. Oper. Res..

[18]  Shyi-Ming Chen,et al.  Aggregating Fuzzy Opinions in the Group Decision-making Environment , 1998, Cybern. Syst..

[19]  Menno D. T. de Jong,et al.  Evaluating municipal websites: A methodological comparison of three think-aloud variants , 2009, Gov. Inf. Q..

[20]  Stefanos D. Kollias,et al.  An intelligent e-learning system based on learner profiling and learning resources adaptation , 2008, Comput. Educ..

[21]  Maggie McPherson,et al.  Critical issues for e-learning delivery: what may seem obvious is not always put into practice , 2008, J. Comput. Assist. Learn..

[22]  Richard T. Vidgen,et al.  Data triangulation and web quality metrics: A case study in e-government , 2006, Inf. Manag..

[23]  Ta-Chung Chu,et al.  Facility Location Selection Using Fuzzy TOPSIS Under Group Decisions , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[24]  Steve Caplin,et al.  Principles Of Design , 2011 .

[25]  Tien-Fu Liang,et al.  Application of fuzzy multi-objective linear programming to aggregate production planning , 2004, Comput. Ind. Eng..

[26]  Abo Sinna,et al.  EXTENSIONS OF TOPSIS FOR MULTIOBJECTIVE LARGE-SCALE NONLINEAR PROGRAMMING PROBLEMS , 2005 .

[27]  Cengiz Kahraman,et al.  An integrated fuzzy QFD model proposal on routing of shipping investment decisions in crude oil tanker market , 2009, Expert Syst. Appl..

[28]  Francisco Herrera,et al.  Multiperson decision-making based on multiplicative preference relations , 2001, Eur. J. Oper. Res..

[29]  N. Mahdavi-Amiri,et al.  A Heuristic Methodology for Multi-Criteria Evaluation of Web-Based E-Learning Systems Based on User Satisfaction , 2008 .

[30]  Nam P. Suh.  Design of Systems , 2007 .

[31]  Prashant C. Palvia,et al.  Developing and validating an instrument for measuring user-perceived web quality , 2002, Inf. Manag..

[32]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[33]  Chung-Hsing Yeh,et al.  Inter-company comparison using modified TOPSIS with objective weights , 2000, Comput. Oper. Res..

[34]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[35]  Nam P. Suh.  Design of Systems , 1997 .

[36]  Helmut Schneider,et al.  Web site design benchmarking within industry groups , 2003, Internet Res..

[37]  Ping Ge,et al.  Applying axiomatic design theory to the evaluation and optimization of large-scale engineering systems , 2006 .

[38]  David S. Cochran,et al.  Manufacturing System Design , 1998 .

[39]  Nicolae-George Dragulanescu,et al.  Website Quality Evaluations: Criteria and Tools , 2002 .

[40]  Da Ruan,et al.  Evaluating e‐learning web site quality in a fuzzy environment , 2007, Int. J. Intell. Syst..

[41]  Jie Lu,et al.  Team Situation Awareness using Web-Based Fuzzy Group Decision Support Systems , 2008 .

[42]  Sang-Gook Kim,et al.  Design of software systems based on axiomatic design , 1991 .

[43]  R. Wilsnack.  Information Control , 1980 .

[44]  L. A. ZADEH,et al.  The concept of a linguistic variable and its application to approximate reasoning - I , 1975, Inf. Sci..

[45]  Elaine Toms,et al.  Measuring user perceptions of Web site reputation , 2004, Inf. Process. Manag..

[46]  Da Ruan,et al.  A fuzzy preference‐ranking model for a quality evaluation of hospital web sites , 2006, Int. J. Intell. Syst..

[47]  Francisco Javier Miranda González,et al.  Quantitative evaluation of commercial web sites: : an empirical study of Spanish firms , 2004, Int. J. Inf. Manag..

[48]  Sheng-Hshiung Tsaur,et al.  The evaluation of airline service quality by fuzzy MCDM. , 2002 .

[49]  Yi-Shun Wang,et al.  Assessment of learner satisfaction with asynchronous electronic learning systems , 2003, Inf. Manag..

[50]  Marin D. Guenov,et al.  Application of axiomatic design and design structure matrix to the decomposition of engineering systems , 2005, Syst. Eng..

[51]  Cengiz Kahraman,et al.  A new multi-attribute decision making method: Hierarchical fuzzy axiomatic design , 2009, Expert Syst. Appl..

[52]  Barrie Dale,et al.  Key quality factors in Web site design and use: an examination , 2002 .

[53]  M. Ivimey.  Annual report , 1958, IRE Transactions on Engineering Writing and Speech.

[54]  Osman Kulak,et al.  A methodology for the design of office cells using axiomatic design principles , 2008 .

[55]  José L. Gascó,et al.  E-government success: some principles from a Spanish case study , 2007, Ind. Manag. Data Syst..

[56]  Jos van Iwaarden,et al.  Perceptions about the quality of web sites: a survey amongst students at Northeastern University and Erasmus University , 2004, Inf. Manag..

[57]  Elsabé Cloete,et al.  Electronic education system model , 2001, Comput. Educ..

[58]  Cengiz Kahraman,et al.  Application of axiomatic design and TOPSIS methodologies under fuzzy environment for proposing competitive strategies on Turkish container ports in maritime transportation network , 2009, Expert Syst. Appl..

[59]  Emel Aktas,et al.  An Evaluation Methodology for Ergonomic Design of Electronic Consumer Products Based on Fuzzy Axiomatic Design , 2008, J. Multiple Valued Log. Soft Comput..

[60]  Hungyune Chao,et al.  Assessing the Quality of Academic Libraries on the Web: The Development and Testing of Criteria. , 2002 .

[61]  David S. Cochran,et al.  A decomposition approach for manufacturing system design , 2001 .

[62]  W. Poon,et al.  A study of Web‐based learning (WBL) environment in Malaysia , 2004 .

[63]  Gülçin Büyüközkan,et al.  Evaluation of E-Learning Web Sites Using Fuzzy Axiomatic Design Based Approach , 2010 .

[64]  Sung-Wan Kim,et al.  Validation of an evaluation model for learning management systems , 2008, J. Comput. Assist. Learn..

[65]  Gwo-Hshiung Tzeng,et al.  Group decision-making based on concepts of ideal and anti-ideal points in a fuzzy environment , 2007, Math. Comput. Model..

[66]  Harold W. Webb,et al.  SiteQual: an integrated measure of Web site quality , 2004, J. Enterp. Inf. Manag..

[67]  M. Helander,et al.  Axiomatc design in ergonomics and an extension of the information axiom , 2002 .

[68]  ChenChen-Tung.  Extensions of the TOPSIS for group decision-making under fuzzy environment , 2000 .

[69]  Emre Cevikcan,et al.  Fuzzy VIKOR and Fuzzy Axiomatic Design Versus to Fuzzy Topsis: An Application of Candidate Assessment , 2009, J. Multiple Valued Log. Soft Comput..

[70]  Soyoung Kim,et al.  Dimensional hierarchy of retail website quality , 2004, Inf. Manag..

[71]  Chen-Tung Chen,et al.  Extensions of the TOPSIS for group decision-making under fuzzy environment , 2000, Fuzzy Sets Syst..

[72]  Cengiz Kahraman,et al.  Fuzzy axiomatic design-based performance evaluation model for docking facilities in shipbuilding industry: The case of Turkish shipyards , 2009, Expert Syst. Appl..

[73]  Rian van der Merwe,et al.  A framework and methodology for evaluating e-commerce Web sites , 2003, Internet Res..

[74]  Nam P. Suh,et al.  Design and operation of large systems , 1995 .

[75]  Nam P. Suh,et al.  Axiomatic Design: Advances and Applications , 2001 .

[76]  Osman Kulak,et al.  A decision support system for fuzzy multi-attribute selection of material handling equipments , 2005, Expert Syst. Appl..

[77]  Gwo-Jen Hwang,et al.  A group-decision approach for evaluating educational web sites , 2004, Comput. Educ..

[78]  N. Suh.  Designing-in of Quality Through Axiomatic Design , 2004 .

[79]  Ingoo Han,et al.  The impact of Web quality and playfulness on user acceptance of online retailing , 2007, Inf. Manag..

[80]  Alastair G. Smith,et al.  Applying evaluation criteria to New Zealand government websites , 2001, Int. J. Inf. Manag..

[81]  Evangelos Grigoroudis,et al.  The assessment of user-perceived web quality: Application of a satisfaction benchmarking approach , 2008, Eur. J. Oper. Res..