MOPSO-Based CNN for Keyword Selection on Google Ads

Google Ads is an advertising agency that provides ads to advertisers. Advertisers match the user’s search terms and push ads by selecting keywords related to their ad content. Keywords can determine the type of users an advertiser pushes, the effectiveness of the ad promotion, and the sales of the ad product. Automatically selecting keywords that are satisfactory to advertisers from a large number of keywords provided by Google Ads is the main task of this paper. But there is not too much time for the model to judge whether keywords are selected, choosing correct keywords in the shortest time is another task of this paper. Therefore, a structure of the model that can get some useful keywords for advertisers is designed and an improved multi-objective particle swarm optimization algorithm is proposed to achieve this multi-objective task. These are also the main contributions of this paper. To accomplish this multi-objective task, many technical issues need to be overcome, such as the mixed language problem, the imbalance problem, the problem of extracting features from corpora and so on. This paper proposes a corpus selection method to solve the mixed problem of Chinese and English in keywords, word embedding method to solve the representation of keywords, re-sampling to solve data imbalance problem, improved convolutional neural network (CNN) to solve classification problem, and a multi-objective particle swarm optimization algorithm (MOPSO) to achieve neural structure search of CNN so that the effect of the classification is improved and the training time is reduced. The keyword selection problem is solved with the combination of evolutionary computing, deep learning, machine learning, and text processing techniques. Experimental results show that the proposed algorithm greatly improved the accuracy of keyword selection and shortened the time of selecting keywords. Therefore, this algorithm has a good application value.

[1]  Bartosz Krawczyk,et al.  Learning from imbalanced data: open challenges and future directions , 2016, Progress in Artificial Intelligence.

[2]  Grzegorz Szymanski,et al.  Model of the Effectiveness of Google Adwords Advertising Activities , 2018, 2018 IEEE 13th International Scientific and Technical Conference on Computer Sciences and Information Technologies (CSIT).

[3]  Lamiaa Mostafa.  Webpage Keyword Extraction Using Term Frequency , 2013 .

[4]  Hadi Veisi,et al.  Sentiment analysis based on improved pre-trained word embeddings , 2019, Expert Syst. Appl..

[5]  Shi,et al.  Method of Feature Reduction in Short Text Classification Based on Feature Clustering , 2019, Applied Sciences.

[6]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[7]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[8]  Shijie Lu,et al.  Investigating the Spillover Effect of Keyword Market Entry in Sponsored Search Advertising , 2017, Mark. Sci..

[9]  Chen Wang,et al.  A neural model for type classification of entities for text , 2019, Knowl. Based Syst..

[10]  Mengjie Zhang,et al.  A Particle Swarm Optimization-Based Flexible Convolutional Autoencoder for Image Classification , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Hongfei Lin,et al.  Bidirectional long short-term memory with CRF for detecting biomedical event trigger in FastText semantic space , 2018, BMC Bioinformatics.

[12]  Kenneth E. Barner,et al.  Inductive conformal predictor for convolutional neural networks: Applications to active learning for image classification , 2019, Pattern Recognit..

[13]  Ibrahim Riza Hallac,et al.  Evaluating deep learning models for sentiment classification , 2018, Concurr. Comput. Pract. Exp..

[14]  Qiang Zhang,et al.  Improving Medical Short Text Classification with Semantic Expansion Using Word-Cluster Embedding , 2018, ICISA.

[15]  Yuming Zhou,et al.  A novel ensemble method for classifying imbalanced data , 2015, Pattern Recognit..

[16]  Hui Han,et al.  Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning , 2005, ICIC.

[17]  Selen Bozkurt,et al.  Comparison of orthogonal NLP methods for clinical phenotyping and assessment of bone scan utilization among prostate cancer patients , 2019, Journal of Biomedical Informatics.

[18]  Swapnil Prakash Kapse,et al.  An Improved Multi-Objective Particle Swarm Optimization Based on Utopia Point Guided Search , 2018, Int. J. Appl. Metaheuristic Comput..

[19]  Xin Yao,et al.  MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning , 2014 .

[20]  Yijing Li,et al.  Imbalanced text sentiment classification using universal and domain-specific knowledge , 2018, Knowl. Based Syst..

[21]  Hua Xu,et al.  Chinese sentiment classification using a neural network tool — Word2vec , 2014, 2014 International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI).

[22]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[23]  Peng Jiang,et al.  An Imbalance Modified Deep Neural Network With Dynamical Incremental Learning for Chemical Fault Diagnosis , 2019, IEEE Transactions on Industrial Electronics.

[24]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[25]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[26]  A. Zink,et al.  Medical needs and major complaints related to pruritus in Germany: a 4‐year retrospective analysis using Google AdWords Keyword Planner , 2018, Journal of the European Academy of Dermatology and Venereology : JEADV.

[27]  Harald Sack,et al.  Knowledge-Based Short Text Categorization Using Entity and Category Embedding , 2019, GI-Jahrestagung.

[28]  Guang Li,et al.  A Knee Point Driven Particle Swarm Optimization Algorithm for Sparse Reconstruction , 2017, SEAL.

[29]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[30]  D. Gardner,et al.  Website Analytics of a Google Ads Campaign for a Men’s Mental Health Website: Comparative Analysis , 2018, JMIR mental health.

[31]  Junwei Zhou,et al.  Arabic Sentiment Classification Using Convolutional Neural Network and Differential Evolution Algorithm , 2019, Comput. Intell. Neurosci..

[32]  Richard C. Chapman,et al.  Application of Particle Swarm to Multiobjective Optimization , 1999 .

[33]  Anselmo Cardoso de Paiva,et al.  Convolutional neural network-based PSO for lung nodule false positive reduction on CT images , 2018, Comput. Methods Programs Biomed..

[34]  Peng Wang,et al.  Semantic expansion using word embedding clustering and convolutional neural network for improving short text classification , 2016, Neurocomputing.

[35]  J. Resneck,et al.  Online Advertising for Cancer Prevention: Google Ads and Tanning Beds. , 2016, JAMA dermatology.

[36]  M. Zweig,et al.  Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. , 1993, Clinical chemistry.

[37]  Yi Yang,et al.  Overcoming Language Variation in Sentiment Analysis with Social Attention , 2015, TACL.

[38]  Li Zhang,et al.  Evolving Image Classification Architectures With Enhanced Particle Swarm Optimisation , 2018, IEEE Access.

[39]  Beatriz de la Iglesia,et al.  Attention-Based Recurrent Neural Networks (RNNs) for Short Text Classification: An Application in Public Health Monitoring , 2019, IWANN.