A Comparative Study of Machine Learning Methods for Automatic Classification of Academic and Vocational Guidance Questions

Academic and vocational guidance is a particularly important issue today, as it strongly determines the chances of successful integration into the labor market, which has become increasingly difficult. Families have understood this because they are interested, often with concern, in the orientation of their child. In this context, it is very important to consider the interests, trades, skills, and personality of each student to make the right decision and build a strong career path. This paper deals with the problematic of educational and vocational guidance by providing a comparative study of the results of four machine-learning algorithms. The algorithms we used are for the automatic classification of school orientation questions and four categories based on John L. Holland's Theory of RIASEC typology. The results of this study show that neural networks work better than the other three algorithms in terms of the automatic classification of these questions. In this sense, our model allows us to automatically generate questions in this domain. This model can serve practitioners and researchers in E-Orientation for further research because the algorithms give us good results.

[1]  G. D. Bruin,et al.  The Structural Validity of Holland's R-I-A-S-E-C Model of Vocational Personality Types for Young Black South African Men and Women , 2002 .

[2]  El Habib Benlahmar,et al.  Automatic Classification of Academic and Vocational Guidance Questions using Multiclass Neural Network , 2019, International Journal of Advanced Computer Science and Applications.

[3]  Riadh Jeljali,et al.  A Comparison Between Moodle, Facebook, and Paper-based Assessment Tools: Students' Perception of Preference and Effect on Performance , 2018, Int. J. Emerg. Technol. Learn..

[4]  Meng Yang,et al.  A New Method of Improving BERT for Text Classification , 2019, IScIDE.

[5]  Mark Lee,et al.  High Accuracy Rule-based Question Classification using Question Syntax and Semantics , 2016, COLING.

[6]  Ellen M. Voorhees,et al.  Building a question answering test collection , 2000, SIGIR '00.

[7]  Kamalanath Samarakoon,et al.  Support of Mobile Phones in a Private Network for Science Teaching , 2016, Int. J. Interact. Mob. Technol..

[8]  Arnold R. Spokane,et al.  Holland's Theory of Vocational Personalities in Work Environments. , 2005 .

[9]  J. L. Holland,et al.  Making vocational choices : a theory of vocational personalities and work environments , 1984 .

[10]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[11]  Phil Blunsom,et al.  A Convolutional Neural Network for Modelling Sentences , 2014, ACL.

[12]  Siddharth Patwardhan,et al.  Question analysis: How Watson reads a clue , 2012, IBM J. Res. Dev..

[13]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[14]  Feng Zhu,et al.  A novel CNN-based method for Question Classification in Intelligent Question Answering , 2018, ACAI.

[15]  Dina Guglielmi,et al.  Les intérêts professionnels selon le modèle hexagonal de Holland. Structures et différences de genre , 2004 .

[16]  Dan Roth,et al.  Learning Question Classifiers , 2002, COLING.

[17]  El Habib Benlahmar,et al.  Using Deep Learning Word Embeddings for Citations Similarity in Academic Papers , 2018, BDCA.

[18]  Margaret M. Nauta The development, evolution, and status of Holland's theory of vocational personalities: Reflections and future directions for counseling psychology. , 2010, Journal of counseling psychology.

[19]  El Habib Benlahmar,et al.  Survey of Plagiarism Detection Approaches and Big data Techniques related to Plagiarism Candidate Retrieval , 2017, BDCA.

[20]  Wan Fatimah Wan Ahmad,et al.  A review in feature extraction approach in question classification using Support Vector Machine , 2014, 2014 IEEE International Conference on Control System, Computing and Engineering (ICCSCE 2014).

[21]  Waqar Mahmood,et al.  Multi-label biomedical question classification for lexical answer type prediction , 2019, J. Biomed. Informatics.

[22]  Giuseppe De Pietro,et al.  Extracting Compact Sets of Features for Question Classification in Cognitive Systems: A Comparative Study , 2015, 2015 10th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC).

[23]  Patanjali Kashyap Machine Learning Algorithms and Their Relationship with Modern Technologies , 2017 .

[24]  Andreea Godea,et al.  Annotating Educational Questions for Student Response Analysis , 2018, LREC.

[25]  AzureML Team,et al.  AzureML: Anatomy of a machine learning service , 2016, PAPIs.

[26]  Halil Kilicoglu,et al.  Automatically Classifying Question Types for Consumer Health Questions , 2014, AMIA.

[27]  Astalini Astalini,et al.  Effectivenes of Using E-Module and E-Assessment , 2019, Int. J. Interact. Mob. Technol..

[28]  Lei Huang,et al.  Novel architecture for long short-term memory used in question classification , 2018, Neurocomputing.

[29]  Luísa Coheur,et al.  From symbolic to sub-symbolic information in question classification , 2011, Artificial Intelligence Review.

[30]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..