An intuitionistic fuzzy data-driven product ranking model using sentiment analysis and multi-criteria decision-making

Abstract With the advent of web 2.0 websites, the impact of customers on each other's purchasing decisions has increased, and this has changed the decision-making procedure, attitude, and consumer purchase behavior. Along with increasing the volume of customers' reviews on sites, the need for a method that can be used to rank alternative products considering a set of product features and the customer comments related to these features on websites is essential. Many attempts have been made aimed at product ranking through online customer reviews (OCRs), which have their own shortcomings. These limitations occur during different stages, including focusing only on specified features on online shopping sites or extracting features based on term frequency. Other limitations are not paying attention to low repetition, but to only important features (in identifying features), not paying attention to neutral expressions including hesitations or uncertainty in consumers’ purchase decisions (in identifying the sentiment orientations of each review), using expert-based approaches to determine the weight of features (in determining the weight of features), and ranking merely based on the star rating and ignoring the valuable information in OCRs or not considering the robustness of decision-making and most effective features (in ranking alternatives). Accordingly, this study aims to narrow these gaps by proposing an integrated framework that combines sentiment analysis (SA) and multi-criteria decision-making (MCDM) techniques based on intuitionistic fuzzy sets (IFS). In the following, the developed hybrid model has been used in a real-world case to rank five mobile phone products using the OCRs on the Amazon site to illustrate the availability and utility of the proposed methodology. Sensitivity analysis has been performed to determine the most robust method and most effective features.

[1]  E. Triantaphyllou,et al.  A Sensitivity Analysis Approach for Some Deterministic Multi-Criteria Decision-Making Methods* , 1997 .

[2]  A. Choudhary,et al.  Mining millions of reviews: a technique to rank products based on importance of reviews , 2011, ICEC '11.

[3]  Ying Luo,et al.  Integration of correlations with standard deviations for determining attribute weights in multiple attribute decision making , 2010, Math. Comput. Model..

[4]  Janusz Kacprzyk,et al.  Entropy for intuitionistic fuzzy sets , 2001, Fuzzy Sets Syst..

[5]  Orhan Feyzioglu,et al.  Evaluation of hospital web services using intuitionistic fuzzy AHP and intuitionistic fuzzy VIKOR , 2016, 2016 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM).

[6]  Chuan Zhang,et al.  Customized ranking for products through online reviews: a method incorporating prospect theory with an improved VIKOR , 2020, Applied Intelligence.

[7]  Conrad S. Tucker,et al.  Quantifying Product Favorability and Extracting Notable Product Features Using Large Scale Social Media Data , 2015, J. Comput. Inf. Sci. Eng..

[8]  Sasan Barak,et al.  Outsourcing modelling using a novel interval-valued fuzzy quantitative strategic planning matrix (QSPM) and multiple criteria decision-making (MCDMs) , 2020, International Journal of Production Economics.

[9]  Yang Liu,et al.  Supporting consumer’s purchase decision: a method for ranking products based on online multi-attribute product ratings , 2017, Soft Computing.

[10]  T. Daim,et al.  Measuring emotional reactions of university students towards a Student Information System (SIS): A Turkish university case , 2020 .

[11]  Yufei Yuan,et al.  Managing business-to-business relationships throughout the e-commerce procurement life cycle , 2000, Internet Res..

[12]  Jianqiang Wang,et al.  A Fuzzy Decision Support Model With Sentiment Analysis for Items Comparison in e-Commerce: The Case Study of http://PConline.com , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Yixin Zhang,et al.  A Decision-Making Model Under Probabilistic Linguistic Circumstances with Unknown Criteria Weights for Online Customer Reviews , 2020, International Journal of Fuzzy Systems.

[14]  Habib Ullah Khan,et al.  CAPRA: a comprehensive approach to product ranking using customer reviews , 2015, Computing.

[15]  Stephen J. Carson,et al.  The Effects of Positive and Negative Online Customer Reviews: Do Brand Strength and Category Maturity Matter? , 2013 .

[16]  Japinder Singh,et al.  Feature-based opinion mining and ranking , 2012, J. Comput. Syst. Sci..

[17]  Zeshui Xu,et al.  Intuitionistic Fuzzy Information Aggregation , 2012 .

[18]  Francisco Herrera,et al.  An overview of MULTIMOORA for multi-criteria decision-making: Theory, developments, applications, and challenges , 2019, Inf. Fusion.

[19]  Richard Bellman,et al.  Decision-making in fuzzy environment , 2012 .

[20]  Yang Liu,et al.  Processes and methods of information fusion for ranking products based on online reviews: An overview , 2020, Inf. Fusion.

[21]  Jiangjiang Wang,et al.  Review on multi-criteria decision analysis aid in sustainable energy decision-making , 2009 .

[22]  Mário S. Alvim,et al.  Exploiting semantic relationships for unsupervised expansion of sentiment lexicons , 2020, Inf. Syst..

[23]  Peide Liu,et al.  Probabilistic linguistic TODIM method for selecting products through online product reviews , 2019, Inf. Sci..

[24]  Tugrul U. Daim,et al.  Technology Adoption in Emerging Regions: Case of the Smartphone in Saudi Arabia , 2020 .

[25]  Zeshui Xu,et al.  Prioritized intuitionistic fuzzy aggregation operators , 2013, Inf. Fusion.

[26]  Linghui Tang Mine your Customers or Mine your Business: The Moderating Role of Culture in Online Word-of-Mouth Reviews , 2017 .

[27]  Kumar Ravi,et al.  Ranking of branded products using aspect-oriented sentiment analysis and ensembled multiple criteria decision-making , 2017 .

[28]  Bing Liu,et al.  Mining Opinion Features in Customer Reviews , 2004, AAAI.

[29]  Sebnem Yilmaz Balaman,et al.  Improved decisions for marketing, supply and purchasing: Mining big data through an integration of sentiment analysis and intuitionistic fuzzy multi criteria assessment , 2019, Comput. Ind. Eng..

[30]  Yung-Ming Li,et al.  Deriving market intelligence from microblogs , 2013, Decis. Support Syst..

[31]  Yu-N Cheah,et al.  Aspect extraction in sentiment analysis: comparative analysis and survey , 2016, Artificial Intelligence Review.

[32]  Edmundas Kazimieras Zavadskas,et al.  An improved fuzzy MULTIMOORA approach for multi-criteria decision making based on objective weighting method (CCSD) and its application to technological forecasting method selection , 2019, Eng. Appl. Artif. Intell..

[33]  Gaurav Kumar,et al.  An Integration of Sentiment Analysis and MCDM Approach for Smartphone Recommendation , 2020, Int. J. Inf. Technol. Decis. Mak..

[34]  Bing Liu,et al.  Opinion observer: analyzing and comparing opinions on the Web , 2005, WWW '05.

[35]  Gang Kou,et al.  Visualizing market structure through online product reviews: Integrate topic modeling, TOPSIS, and multi-dimensional scaling approaches , 2015, Electron. Commer. Res. Appl..

[36]  Xiangling Fu,et al.  A decision‐making algorithm for online shopping using deep‐learning–based opinion pairs mining and q‐rung orthopair fuzzy interaction Heronian mean operators , 2020, Int. J. Intell. Syst..

[37]  Yongtae Park,et al.  Review-based measurement of customer satisfaction in mobile service: Sentiment analysis and VIKOR approach , 2014, Expert Syst. Appl..

[38]  Hwee Tou Ng,et al.  An Unsupervised Neural Attention Model for Aspect Extraction , 2017, ACL.

[39]  Jacob Goldenberg,et al.  Mine Your Own Business: Market-Structure Surveillance Through Text Mining , 2012, Mark. Sci..

[40]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[41]  Yang Liu,et al.  A Method for Ranking Products Through Online Reviews Based on Sentiment Classification and Interval-Valued Intuitionistic Fuzzy TOPSIS , 2017, Int. J. Inf. Technol. Decis. Mak..

[42]  Ang Liu,et al.  Application of data analytics for product design: Sentiment analysis of online product reviews , 2018, CIRP Journal of Manufacturing Science and Technology.

[43]  Hector Garcia-Molina,et al.  Crawling the web: discovery and maintenance of large-scale web data , 2001 .

[44]  T. Daim,et al.  Critical Factors Related to Student Success Technology , 2020 .

[45]  Olawale Popoola,et al.  Selection of waste-to-energy technology for distributed generation using IDOCRIW-Weighted TOPSIS method: A case study of the City of Johannesburg, South Africa , 2021 .

[46]  E. Zavadskas,et al.  Project management by multimoora as an instrument for transition economies , 2010 .

[47]  Dong Zhang,et al.  An extended TODIM method to rank products with online reviews under intuitionistic fuzzy environment , 2020, J. Oper. Res. Soc..

[48]  Klaus-Dieter Thoben,et al.  Machine learning in manufacturing: advantages, challenges, and applications , 2016 .

[49]  T. Daim,et al.  Factors Influencing Student Information Technology Adoption , 2021, IEEE Transactions on Engineering Management.

[50]  Yung-Ming Li,et al.  A diffusion mechanism for social advertising over microblogs , 2012, Decis. Support Syst..

[51]  Maurizio Morisio,et al.  A systematic literature review of multicriteria recommender systems , 2020, Artificial Intelligence Review.

[52]  Zeshui Xu,et al.  Intuitionistic Fuzzy Aggregation Operators , 2007, IEEE Transactions on Fuzzy Systems.

[53]  Panagiotis G. Ipeirotis,et al.  Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics , 2010, IEEE Transactions on Knowledge and Data Engineering.

[54]  Yuchen Li,et al.  A Decision Method for Online Purchases Considering Dynamic Information Preference Based on Sentiment Orientation Classification and Discrete DIFWA Operators , 2019, IEEE Access.

[55]  Walter Daelemans,et al.  Media coverage in times of political crisis: A text mining approach , 2012, Expert Syst. Appl..

[56]  Mark Crovella,et al.  Selecting a characteristic set of reviews , 2012, KDD.

[57]  Chao Chen,et al.  Intuitionistic fuzzy MULTIMOORA approach for multi-criteria assessment of the energy storage technologies , 2019, Appl. Soft Comput..

[58]  N. Malys,et al.  Comparative analysis of MCDM methods for the assessment of sustainable housing affordability , 2016 .

[59]  Arunodaya Raj Mishra,et al.  Developing a new framework for conceptualizing the emerging sustainable community-based tourism using an extended interval-valued Pythagorean fuzzy SWARA-MULTIMOORA , 2021 .

[60]  Ping Ji,et al.  Understanding customer needs through quantitative analysis of Kano's model , 2010 .

[61]  S. F. Bernritter,et al.  Too good to be true: the role of online reviews’ features in probability to buy , 2017 .

[62]  Zeshui Xu,et al.  Some geometric aggregation operators based on intuitionistic fuzzy sets , 2006, Int. J. Gen. Syst..

[63]  Yang Liu,et al.  Ranking products through online reviews: A method based on sentiment analysis technique and intuitionistic fuzzy set theory , 2017, Inf. Fusion.

[64]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[65]  Xiaohong Chen,et al.  New doctors ranking system based on VIKOR method , 2018, Int. Trans. Oper. Res..

[66]  Xiangji Huang,et al.  Mining Online Reviews for Predicting Sales Performance: A Case Study in the Movie Domain , 2012, IEEE Transactions on Knowledge and Data Engineering.

[67]  Guangfei Yang,et al.  Integrating rich and heterogeneous information to design a ranking system for multiple products , 2016, Decis. Support Syst..

[68]  Tien-Ping Tan,et al.  Comparative analysis of MCDM methods for product aspect ranking: TOPSIS and VIKOR , 2017, 2017 8th International Conference on Information and Communication Systems (ICICS).

[69]  Raymond Y. K. Lau,et al.  Product aspect extraction supervised with online domain knowledge , 2014, Knowl. Based Syst..

[70]  Gaurav Kumar,et al.  A multi-criteria decision making approach for recommending a product using sentiment analysis , 2018, 2018 12th International Conference on Research Challenges in Information Science (RCIS).

[71]  H. B. Marri,et al.  E-commerce and its impact on operations management , 2002 .

[72]  Ting-Yu Chen,et al.  Objective weights with intuitionistic fuzzy entropy measures and computational experiment analysis , 2011, Appl. Soft Comput..

[73]  Jianqiang Wang,et al.  A Linguistic Intuitionistic Cloud Decision Support Model with Sentiment Analysis for Product Selection in E-commerce , 2019, Int. J. Fuzzy Syst..

[74]  Maria Virvou,et al.  The effect of preprocessing techniques on Twitter sentiment analysis , 2016, 2016 7th International Conference on Information, Intelligence, Systems & Applications (IISA).

[75]  Edmundas Kazimieras Zavadskas,et al.  Multimoora Optimization Used to Decide on a Bank Loan to Buy Property , 2011 .

[76]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[77]  Valentinas Podvezko,et al.  Integrated Determination of Objective Criteria Weights in MCDM , 2016, Int. J. Inf. Technol. Decis. Mak..

[78]  Peide Liu,et al.  HOTEL SELECTION UTILIZING ONLINE REVIEWS: A NOVEL DECISION SUPPORT MODEL BASED ON SENTIMENT ANALYSIS AND DL-VIKOR METHOD , 2019, Technological and Economic Development of Economy.

[79]  Himanshu Sharma,et al.  Ranking hotels using aspect ratings based sentiment classification and interval-valued neutrosophic TOPSIS , 2019, International Journal of System Assurance Engineering and Management.

[80]  Krassimir T. Atanassov,et al.  Intuitionistic fuzzy sets , 1986 .

[81]  Francisco Herrera,et al.  A Historical Account of Types of Fuzzy Sets and Their Relationships , 2016, IEEE Transactions on Fuzzy Systems.

[82]  Le Wang,et al.  The differences in hotel selection among various types of travellers: A comparative analysis with a useful bounded rationality behavioural decision support model , 2020 .

[83]  Hua Xu,et al.  Weakness Finder: Find product weakness from Chinese reviews by using aspects based sentiment analysis , 2012, Expert Syst. Appl..

[84]  Ariyur Mahadevan Abirami,et al.  Sentiment analysis model to emphasize the impact of online reviews in healthcare industry , 2017, Online Inf. Rev..

[85]  Soo-Min Kim,et al.  Determining the Sentiment of Opinions , 2004, COLING.

[86]  Tugrul U. Daim,et al.  The impact of open-border organization culture and employees' knowledge, attitudes, and rewards with regards to open innovation: an empirical study , 2020, J. Knowl. Manag..

[87]  N. Kumaresh,et al.  A Comprehensive Study on Lexicon Based Approaches for Sentiment Analysis , 2019, Asian Journal of Computer Science and Technology.

[88]  Shyi-Ming Chen,et al.  Handling multicriteria fuzzy decision-making problems based on vague set theory , 1994 .

[89]  Mohammad Ebrahim Banihabib,et al.  Comparison of Different Multi Criteria Decision-Making Models in Prioritizing Flood Management Alternatives , 2015, Water Resources Management.

[90]  V. Uma,et al.  Aspect-based approach to measure performance of financial services using voice of customer , 2019, J. King Saud Univ. Comput. Inf. Sci..

[91]  Yi Peng,et al.  A Fuzzy PROMETHEE Approach for Mining Customer Reviews in Chinese , 2014, Arabian Journal for Science and Engineering.

[92]  Diyar Akay,et al.  A multi-criteria intuitionistic fuzzy group decision making for supplier selection with TOPSIS method , 2009, Expert Syst. Appl..

[93]  Dong Zhang,et al.  Ranking products with IF-based sentiment word framework and TODIM method , 2019, Kybernetes.

[94]  Zeshui Xu,et al.  Approaches to multiple attribute group decision making based on intuitionistic fuzzy power aggregation operators , 2011, Knowl. Based Syst..