Gender Prediction Through Synthetic Resampling of User Profiles Using SeqGANs

Generative Adversarial Networks (GANs) have enabled researchers to achieve groundbreaking results on generating synthetic images. While GANs have been heavily used for generating synthetic image data, there is limited work on using GANs for synthetically resampling the minority class, particularly for text data. In this paper, we utilize Sequential Generative Adversarial Networks (SeqGAN) for creating synthetic user profiles from text data. The text data consists of articles that the users have read that are representative of the minority class. Our goal is to improve the predictive power of supervised learning algorithms for the gender prediction problem, using articles consumed by the user from a large health-based website as our data source. Our study shows that by creating synthetic user profiles for the minority class with SeqGANs and passing in the resampled training data to an XGBoost classifier, we achieve a gain of 2% in AUROC, as well as a 3% gain in both F1-Score and AUPR for gender prediction when compared to SMOTE. This is promising for the use of GANs in the application of text resampling.

[1]  Xinran Y. Lehto,et al.  Gender differences in online travel information search: Implications for marketing communications on the internet , 2007 .

[2]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[3]  Ruchika Malhotra,et al.  Techniques for text classification: Literature review and current trends , 2015, Webology.

[4]  Hua Li,et al.  Demographic prediction based on user's browsing behavior , 2007, WWW '07.

[5]  Enhong Chen,et al.  Exploiting probabilistic topic models to improve text categorization under class imbalance , 2011, Inf. Process. Manag..

[6]  Tu Minh Phuong,et al.  Gender Prediction Using Browsing History , 2013, KSE.

[7]  Gustavo E. A. P. A. Batista,et al.  A study of the behavior of several methods for balancing machine learning training data , 2004, SKDD.

[8]  Kazuyuki Murase,et al.  ProWSyn: Proximity Weighted Synthetic Oversampling Technique for Imbalanced Data Set Learning , 2013, PAKDD.

[9]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[10]  Ee-Peng Lim,et al.  On strategies for imbalanced text classification using SVM: A comparative study , 2009, Decis. Support Syst..

[11]  Tanmoy Chakraborty,et al.  Phishing URL Detection with Oversampling based on Text Generative Adversarial Networks , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[12]  Eric Medvet,et al.  Your Paper has been Accepted, Rejected, or Whatever: Automatic Generation of Scientific Paper Reviews , 2016, CD-ARES.

[13]  Sally J. McMillan,et al.  Online Marketing Communications , 2009 .

[14]  Anna Rumshisky,et al.  GhostWriter: Using an LSTM for Automatic Rap Lyric Generation , 2015, EMNLP.

[15]  Fajri Koto,et al.  SMOTE-Out, SMOTE-Cosine, and Selected-SMOTE: An enhancement strategy to handle imbalance in data level , 2014, 2014 International Conference on Advanced Computer Science and Information System.

[16]  Seong-Il Yang,et al.  Oversampling for Imbalanced Data Classification Using Adversarial Network , 2018, 2018 International Conference on Information and Communication Technology Convergence (ICTC).

[17]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[18]  George Karypis,et al.  Content-Based Methods for Predicting Web-Site Demographic Attributes , 2010, 2010 IEEE International Conference on Data Mining.

[19]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[20]  Nitesh V. Chawla,et al.  Characterizing online health and wellness information consumption: A study , 2019, Inf. Fusion.

[21]  Akshi Kumar,et al.  Characterizing relatedness of web and requirements engineering , 2015, Webology.

[22]  Francisco Herrera,et al.  SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary , 2018, J. Artif. Intell. Res..