More General Evaluation of a Client-Centered Counseling Agent

A lot of people in Japan suffer from bad conditions of their mental health with an increasing tendency, in particular jobseekers and elderly persons. The classical way to solve their problem is to consult a counselor, who treats these people in a way to become aware of the core of their problem and to solve it. However, the number of well qualified counselors is limited. For this purpose, we developed a VCA (Virtual Counseling Agent) as a further evolution of a formerly developed CRECA (Context Respectful Counseling Agent). CRECA had a text interface. To much more imitate a human counselor, VCA has an image avatar and a voice conversation using the Google Cloud audio API. Further, VCA is made independent of counseling content fields. Thus, it is more generalized than CRECA or ELIZA in order for every people to easily use everywhere in every situation. Here, VCA, CRECA, and ELIZA are comparatively evaluated by questionnaire after the use of 10 college students having career problems as well as elderly persons struggling with modern IT. As a result, VCA significantly exceeded the average value of ELIZA along with the significant difference at the level of 5%. Moreover, average of the evaluation value is not worse than CRECA. Compared to CRECA, VCA does not limit the content and field of consultation. Especially, elderly persons struggling with modern IT could not use CRECA that have only text interface. It can be used generally at any time in everyday natural conversation. It can easily be used by elderly people and the digital divided due to voice conversion.

[1]  Alistair Kennedy,et al.  Getting Emotional about News Summarization , 2012, Canadian Conference on AI.

[2]  Matteo Turilli,et al.  Turing’s Imitation Game: Still an Impossible Challenge for All Machines and Some Judges––An Evaluation of the 2008 Loebner Contest , 2008, Minds and Machines.

[3]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[4]  Hans van der Heijden,et al.  User Acceptance of Hedonic Information Systems , 2004, MIS Q..

[5]  M. Friedman.  The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[6]  Avelino J. Gonzalez,et al.  Towards a Context-Based Dialog Management Layer for Expert Systems , 2009, 2009 International Conference on Information, Process, and Knowledge Management.

[7]  Ernesto Damiani,et al.  Context respectful counseling agent integrated with robot nodding for dialog promotion , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[8]  Joseph Weizenbaum,et al.  and Machine , 1977 .

[9]  Sangdo Han,et al.  Counseling Dialog System with 5W1H Extraction , 2013, SIGDIAL Conference.

[10]  Erkki Sutinen,et al.  The effectiveness of automatic text summarization in mobile learning contexts , 2013, Comput. Educ..

[11]  M. Friedman.  A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[12]  Yoshitaka Sakurai,et al.  Using contexts to supervise a collaborative process , 2010, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[13]  Gurpreet Singh Lehal,et al.  A Survey of Text Summarization Extractive Techniques , 2010 .

[14]  Setsuo Tsuruta,et al.  Context-based counselor agent for software development ecosystem , 2013, Computing.

[15]  Christine J. Yeh,et al.  Evaluation of a Web-Based Peer Discussion Group for Counselor Trainees , 2012 .

[16]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[17]  Michael J. Lambert,et al.  The empirical case for the common factors in therapy: Quantitative findings. , 1999 .

[18]  C. Rogers,et al.  The necessary and sufficient conditions of therapeutic personality change. , 1957, Journal of consulting psychology.

[19]  Milton Friedman,et al.  A Correction: The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1939 .

[20]  C. Talley,et al.  Career counseling. , 1984, American journal of hospital pharmacy.