Study of Coordination Between Patients with Schizophrenia and Socially Assistive Robot During Physical Activity

The goal of this study was to analyze the interpersonal coordination of patients suffering from schizophrenia (SZ) using a humanoid robot NAO. NAO was controlled by a neurally-inspired model that enables motions synchronization between robot and human. Using a robot has the advantage in that it can be modified and controlled without being influenced by the human with whom they are interacting. More specifically, we were interested in non-intentional interpersonal coordination which has been found in previous studies to be preserved for SZ. We performed an experiment in which we asked patients and control participants to jointly perform fitness movements with the robot which was programmed to either synchronize with the human (a bidirectional condition) or move at a fixed frequency with them (a unidirectional condition). We showed that non-intentional interpersonal coordination was preserved for SZ during Human/Robot interaction (as for human/human interaction). Also, the best synchronization, stability and the best performance in term of speed were obtained with the bidirectional condition. Our results showed that, in this specific context of an interaction at preferential frequency of subject, there were only a few differences between SZ and controls in terms of interpersonal synchronization skills. Nevertheless, we observed more variability for SZ which could partly be explained by the weaker intrapersonal coordination that they exhibited.

[1]  Hanafiah Yussof,et al.  Humanoid robot NAO interacting with autistic children of moderately impaired intelligence to augment communication skills , 2012 .

[2]  Emilia I. Barakova,et al.  Long‐term LEGO therapy with humanoid robot for children with ASD , 2015, Expert Syst. J. Knowl. Eng..

[3]  Hans-Jürgen Möller,et al.  Kinematical analysis of motor function in schizophrenic patients: a possibility to separate negative symptoms from extrapyramidal dysfunction induced by neuroleptics? , 2004, Pharmacopsychiatry.

[4]  Aymar de Rugy,et al.  A Neuro-Mechanical Model for Interpersonal Coordination , 2006, Biological Cybernetics.

[5]  Philippe Gaussier,et al.  Paladyn Journal of Behavioral Robotics a Synchrony-based Perspective for Partner Selection and Attentional Mechanism in Human-robot Interaction , 2022 .

[6]  R. Schmidt,et al.  Evaluating the Dynamics of Unintended Interpersonal Coordination , 1997 .

[7]  T. McCormack,et al.  Duration judgements in patients with schizophrenia , 2003, Psychological Medicine.

[8]  Deana B. Davalos,et al.  Effects of interval duration on temporal processing in schizophrenia , 2003, Brain and Cognition.

[9]  Nilanjan Sarkar,et al.  Robot-Mediated Imitation Skill Training for Children With Autism , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data: A Model Comparison Perspective , 1990 .

[11]  R L Morrison,et al.  Social functioning of schizophrenic patients: clinical and research issues. , 1987, Schizophrenia bulletin.

[12]  Mary Lavelle,et al.  Nonverbal Behavior During Face-to-face Social Interaction in Schizophrenia: A Review , 2014, The Journal of nervous and mental disease.

[13]  Attention for movement production: Abnormal profiles in schizophrenia , 2006, Schizophrenia Research.

[14]  John-John Cabibihan,et al.  Using robot animation to promote gestural skills in children with autism spectrum disorders , 2016, J. Comput. Assist. Learn..

[15]  R. Schmidt,et al.  Impairments of Social Motor Coordination in Schizophrenia , 2012, PloS one.

[16]  Laura M. Tully,et al.  Social impairment in schizophrenia: new approaches for treating a persistent problem , 2015, Current opinion in psychiatry.

[17]  D. Braff,et al.  Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the "right stuff"? , 2000, Schizophrenia bulletin.

[18]  M. Ciolacu Facial Expressions and Non Verbal Comunication , 2014 .

[19]  Leah R Dickens,et al.  Meta-Analyses of the Intra- and Interpersonal Outcomes of Interpersonal Coordination , 2016 .

[20]  B. Bardy,et al.  Using mimicry of body movements by a virtual agent to increase synchronization behavior and rapport in individuals with schizophrenia , 2018, Scientific Reports.

[21]  Mary Lavelle,et al.  Is Nonverbal Communication Disrupted in Interactions Involving Patients With Schizophrenia? , 2012, Schizophrenia bulletin.

[22]  R. Schmidt,et al.  Nonverbal expressive behaviour in schizophrenia and social phobia , 2013, Psychiatry Research.

[23]  E. Walker,et al.  Longitudinal progression of movement abnormalities in relation to psychotic symptoms in adolescents at high risk of schizophrenia. , 2008, Archives of general psychiatry.

[24]  Michael T. Turvey,et al.  Frequency detuning of the phase entrainment dynamics of visually coupled rhythmic movements , 1995, Biological Cybernetics.

[25]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[26]  Michael F. Green,et al.  Social cognition in schizophrenia , 2015, Nature Reviews Neuroscience.

[27]  A. Billard,et al.  Influence of facial feedback during a cooperative human-robot task in schizophrenia , 2017, Scientific Reports.

[28]  K. Berry,et al.  Social networks and symptomatic and functional outcomes in schizophrenia: a systematic review and meta-analysis , 2018, Social Psychiatry and Psychiatric Epidemiology.

[29]  R. Schmidt,et al.  Social Motor Coordination in Unaffected Relatives of Schizophrenia Patients: A Potential Intermediate Phenotype , 2013, Front. Behav. Neurosci..

[30]  J. Issartel,et al.  Unintended interpersonal co-ordination: “can we march to the beat of our own drum?” , 2007, Neuroscience Letters.

[31]  Nava Levit-Binnun,et al.  Transcranial Magnetic Stimulation at M1 disrupts cognitive networks in schizophrenia , 2007, Schizophrenia Research.

[32]  Arnaud Revel,et al.  Emergence of structured interactions: From a theoretical model to pragmatic robotics , 2009, Neural Networks.

[33]  M. Argyle,et al.  The Communication of Inferior and Superior Attitudes by Verbal and Non‐verbal Signals* , 1970 .

[34]  Christos Nikolopoulos,et al.  Accessible Robots for Improving Social Skills of Individuals with Autism , 2016, J. Artif. Intell. Soft Comput. Res..