Discrepancy detection between actual user reviews and numeric ratings of Google App store using deep learning

Abstract Nowadays online reviews play a significant role in influencing the decision of consumers. Consumers show their experience and information about product quality in their reviews. Product Reviews from Amazon to Restaurant Reviews from Yelp are facing problems with fake reviews and fake numeric ratings. Online reviews typically consist of qualitative (text format) and quantitative (rating) formats. In the case of Google Play store fake numeric ratings can play a big role in the success of apps. People tend to believe that a high-star rating may be significantly attached with a good review. However, user star level rating information does not usually match with text format of review. Despite many efforts to resolve this issue, Apple App Store and Google Play Store are still facing this problem. This study proposes a novel Google App numeric reviews & ratings contradiction prediction framework using Deep Learning approaches. The framework consists of two phases. In the first phase, the polarity of reviews are predicted using sentiment analysis tool to build ground truth. In the second phase, star ratings are predicted from text format of reviews after training deep learning models on ground truth obtained in the first phase. Experimental results demonstrate that based on actual user reviews the proposed framework significantly predicts unbiased star rating of app.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Iryna Gurevych,et al.  Beyond the stars: exploiting free-text user reviews to improve the accuracy of movie recommendations , 2009, TSA@CIKM.

[3]  Harald C. Gall,et al.  Analyzing reviews and code of mobile apps for better release planning , 2017, 2017 IEEE 24th International Conference on Software Analysis, Evolution and Reengineering (SANER).

[4]  Muneera Bano,et al.  A systematic review on the relationship between user involvement and system success , 2015, Inf. Softw. Technol..

[5]  Gyu Sang Choi,et al.  Aggression detection through deep neural model on Twitter , 2021, Future Gener. Comput. Syst..

[6]  Gyu Sang Choi,et al.  A Novel Stacked CNN for Malarial Parasite Detection in Thin Blood Smear Images , 2020, IEEE Access.

[7]  Yanchun Zhang,et al.  Helpfulness Prediction for Online Reviews with Explicit Content-Rating Interaction , 2019, WISE.

[8]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[9]  Yongquan Lu,et al.  sDeepFM: Multi-Scale Stacking Feature Interactions for Click-Through Rate Prediction , 2020, Electronics.

[10]  Wentao Mao,et al.  Robust Detection of Bearing Early Fault Based on Deep Transfer Learning , 2020, Electronics.

[11]  Sushma Jain,et al.  Sentiment analysis of customer product reviews using machine learning , 2017, 2017 International Conference on Intelligent Computing and Control (I2C2).

[12]  Sandro Fioretti,et al.  Recognition of Gait Phases with a Single Knee Electrogoniometer: A Deep Learning Approach , 2020, Electronics.

[13]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[14]  Philip S. Yu,et al.  A holistic lexicon-based approach to opinion mining , 2008, WSDM '08.

[15]  Asif Ekbal,et al.  How Intense Are You? Predicting Intensities of Emotions and Sentiments using Stacked Ensemble [Application Notes] , 2020, IEEE Comput. Intell. Mag..

[16]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[17]  Zinedine Rebiai,et al.  SCIA at SemEval-2019 Task 3: Sentiment Analysis in Textual Conversations Using Deep Learning , 2019, *SEMEVAL.

[18]  Rishi Chandy,et al.  Identifying spam in the iOS app store , 2012, WebQuality '12.

[19]  Hang Li,et al.  Deep learning for natural language processing: advantages and challenges , 2018 .

[20]  Erik Cambria,et al.  ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis , 2021, Future Gener. Comput. Syst..

[21]  Dietmar Pfahl,et al.  Simple App Review Classification with Only Lexical Features , 2018 .

[22]  Xiang-Chun Liu,et al.  Information filtering based on eliminating redundant diffusion and compensating balance , 2019, International Journal of Modern Physics B.

[23]  Xiaolong Wang,et al.  Active deep learning method for semi-supervised sentiment classification , 2013, Neurocomputing.

[24]  Amjed Tahir,et al.  On Satisfying the Android OS Community: User Feedback Still Central to Developers' Portfolios , 2015, 2015 24th Australasian Software Engineering Conference.

[25]  Jin Wang,et al.  Post Text Processing of Chinese Speech Recognition Based on Bidirectional LSTM Networks and CRF , 2019, Electronics.

[26]  Eric Gilbert,et al.  VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text , 2014, ICWSM.

[27]  Md. Saeed Siddik,et al.  Predicting an Effective Android Application Release Based on User Reviews and Ratings , 2019, 2019 7th International Conference on Smart Computing & Communications (ICSCC).

[28]  Noah A. Smith,et al.  Transition-Based Dependency Parsing with Stack Long Short-Term Memory , 2015, ACL.

[29]  Walid Maalej,et al.  User feedback in the appstore: An empirical study , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).