Understanding how adherence goals promote adherence behaviours: a repeated measure observational study with HIV seropositive patients

BackgroundThe extent to which patients follow treatments as prescribed is pivotal to treatment success. An exceptionally high level (> 95%) of HIV medication adherence is required to suppress viral replication and protect the immune system and a similarly high level (> 80%) of adherence has also been suggested in order to benefit from prescribed exercise programmes. However, in clinical practice, adherence to both often falls below the desirable level. This project aims to investigate a wide range of psychological and personality factors that may lead to adherence/non-adherence to medical treatment and exercise programmes.MethodsHIV positive patients who are referred to the physiotherapist-led 10-week exercise programme as part of the standard care are continuously recruited. Data on social cognitive variables (attitude, intention, subjective norms, self-efficacy, and outcome beliefs) about the goal and specific behaviours, selected personality factors, perceived quality of life, physical activity, self-reported adherence and physical assessment are collected at baseline, at the end of the exercise programme and again 3 months later. The project incorporates objective measures of both exercise (attendance log and improvement in physical measures such as improved fitness level, weight loss, improved circumferential anthropometric measures) and medication adherence (verified by non-invasive hair analysis).DiscussionThe novelty of this project comes from two key aspects, complemented with objective information on exercise and medication adherence. The project assesses beliefs about both the underlying goal such as following prescribed treatment; and about the specific behaviours such as undertaking the exercise or taking the medication, using both implicit and explicit assessments of patients’ beliefs and attitudes. We predict that i) the way people think about the underlying goal of their treatments explains medication and exercise behaviours over and above the effects of the behaviour-specific thinking and ii) the relationship between adherence to exercise and to medical treatment is stronger among those with more favourable views about the goal. Results from this study should identify the key contributing factors to inform subsequent adherence research and afford a more streamlined assessment matrix. The project also aims to inform patient care practices.UK Clinical Research Network registration numberUKCRN 7842.

[1]  P. Sheeran,et al.  Expanding the affective and normative components of the theory of planned behavior: A meta-analysis of anticipated affect and moral norms , 2009 .

[2]  S. Horn,et al.  Adherence to Chest Physiotherapy in Adults with Cystic Fibrosis , 2006, Journal of health psychology.

[3]  M. Millar Predicting Dental Flossing Behavior: The Role of Implicit and Explicit Responses and Beliefs , 2011 .

[4]  Howard Leventhal,et al.  The self-regulation of health and illness behaviour. , 2003 .

[5]  G. Lucas Antiretroviral adherence, drug resistance, viral fitness and HIV disease progression: a tangled web is woven. , 2005, The Journal of antimicrobial chemotherapy.

[6]  William A. Cunningham,et al.  Executive Function: Mechanisms Underlying Emotion Regulation. , 2007 .

[7]  M. Conner,et al.  Efficacy of the Theory of Planned Behaviour: a meta-analytic review. , 2001, The British journal of social psychology.

[8]  Bertram Gawronski,et al.  Handbook of implicit social cognition : measurement, theory,and applications , 2010 .

[9]  Blair T. Johnson,et al.  Efficacy of Antiretroviral Therapy Adherence Interventions: A Research Synthesis of Trials, 1996 to 2004 , 2006, Journal of acquired immune deficiency syndromes.

[10]  S. Kalichman Co-occurrence of treatment nonadherence and continued HIV transmission risk behaviors: implications for positive prevention interventions. , 2008, Psychosomatic medicine.

[11]  Anthony G. Greenwald,et al.  Is the Implicit Association Test a Valid and Valuable Measure of Implicit Consumer Social Cognition , 2004 .

[12]  M. Perugini,et al.  Relations Between Implicit and Explicit Measures of Attitudes and Measures of Behavior: Evidence of Moderation by Individual Difference Variables , 2007, Personality & social psychology bulletin.

[13]  E.,et al.  Self-Discrepancy : A Theory Relating Self and Affect , 2022 .

[14]  M. Conner,et al.  Anticipated regret as an additional predictor in the theory of planned behaviour: a meta-analysis. , 2008, The British journal of social psychology.

[15]  J. Mahoney,et al.  Medication Adherence in Elderly Patients Receiving Home Health Services following Hospital Discharge , 2001, The Annals of pharmacotherapy.

[16]  Carla J. Groom,et al.  The self-regulation of automatic associations and behavioral impulses. , 2008, Psychological review.

[17]  R. McCrae,et al.  Toward a Geography of Personality Traits , 2004 .

[18]  Christopher J Armitage,et al.  Augmenting the theory of planned behaviour with the prototype/willingness model: predictive validity of actor versus abstainer prototypes for adolescents' health-protective and health-risk intentions. , 2006, British journal of health psychology.

[19]  M. Perugini,et al.  Prediction of behavior , 2010 .

[20]  P. Pintrich,et al.  Handbook of self-regulation , 2000 .

[21]  David Trafimow,et al.  Predicting behaviour from perceived behavioural control: tests of the accuracy assumption of the theory of planned behaviour. , 2003, The British journal of social psychology.

[22]  D. Cella,et al.  Psychometric validation of the revised Functional Assessment of Human Immunodeficiency Virus Infection (FAHI) quality of life instrument , 1997, Quality of Life Research.

[23]  P. Sheeran,et al.  Moderation of cognition-intention and cognition-behaviour relations: a meta-analysis of properties of variables from the theory of planned behaviour. , 2004, The British journal of social psychology.

[24]  Charles S. Carver,et al.  Impulse and Constraint: Perspectives From Personality Psychology, Convergence With Theory in Other Areas, and Potential for Integration , 2005, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[25]  C. Camp,et al.  A Fluctuating Pattern of Over- and Under-Adherence for HAART: A Case Study from a Videophone Intervention Project , 2011, Clinical gerontologist.

[26]  M. Conner,et al.  Social cognition models and health behaviour: A structured review , 2000 .

[27]  M. Banaji,et al.  PREDICTIVE VALIDITY OF THE IAT 1 RUNNING HEAD : PREDICTIVE VALIDITY OF THE IAT Understanding and Using the Implicit Association Test : III . Meta-analysis of Predictive Validity , 2006 .

[28]  John A. Bargh,et al.  Losing Consciousness: Automatic Influences on Consumer Judgment, Behavior, and Motivation , 2002 .

[29]  K. Courneya Efficacy, effectiveness, and behavior change trials in exercise research , 2010, The international journal of behavioral nutrition and physical activity.

[30]  Reinout W Wiers,et al.  Implicit cognition and addiction: a tool for explaining paradoxical behavior. , 2010, Annual review of clinical psychology.

[31]  P. Herzberg,et al.  Typological and dimensional approach at comparing the Giessen Test (GT) with the NEO-Five-Factor-Inventory (NEO-FFI) , 2008, Psycho-social medicine.

[32]  K. Phillips,et al.  Moderate intensity exercise training reverses functional aerobic impairment in HIV-infected individuals , 2008, AIDS care.

[33]  Brian A. Nosek,et al.  Implicit social cognition: from measures to mechanisms , 2011, Trends in Cognitive Sciences.

[34]  A. Greenwald,et al.  The Brief Implicit Association Test. , 2009, Experimental psychology.

[35]  Antonio Terracciano,et al.  Personality Plasticity After Age 30 , 2006, Personality & social psychology bulletin.

[36]  Alexander J. Rothman,et al.  Reflective and Automatic Processes in the Initiation and Maintenance of Dietary Change , 2009, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[37]  S. Maes,et al.  Psychological interventions for rheumatoid arthritis: Examining the role of self‐regulation with a systematic review and meta‐analysis of randomized controlled trials , 2010, Arthritis care & research.

[38]  G. Godin,et al.  Efficacy of interventions in improving adherence to antiretroviral therapy , 2005, International journal of STD & AIDS.

[39]  R. Greenblatt,et al.  Sensitive analysis of anti-HIV drugs, efavirenz, lopinavir and ritonavir, in human hair by liquid chromatography coupled with tandem mass spectrometry. , 2008, Rapid communications in mass spectrometry : RCM.

[40]  Antonio Terracciano,et al.  Hierarchical linear modeling analyses of the NEO-PI-R scales in the Baltimore Longitudinal Study of Aging. , 2005, Psychology and aging.

[41]  D. Roter,et al.  Patient adherence to HIV medication regimens: a review of published and abstract reports. , 2002, Patient education and counseling.

[42]  R. Petersen,et al.  Detecting dementia with the mini-mental state examination in highly educated individuals. , 2008, Archives of neurology.

[43]  Jan De Houwer,et al.  How to Define and Examine the Implicitness of Implicit Measures. , 2007 .

[44]  E. Deci,et al.  Autonomous regulation and long-term medication adherence in adult outpatients. , 1998, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[45]  M. Manning,et al.  The effects of subjective norms on behaviour in the theory of planned behaviour: a meta-analysis. , 2009, The British journal of social psychology.

[46]  Mardge H. Cohen,et al.  Protease inhibitor levels in hair strongly predict virologic response to treatment , 2009, AIDS.

[47]  P. Diem,et al.  Monotoring adherence to prescribed medication in type 2 diabetic patients treated with sulfonylureas. , 2002, Swiss medical weekly.

[48]  F. Lampe,et al.  Adherence to antiretroviral treatment in patients with HIV in the UK: a study of complexity , 2008, AIDS care.

[49]  Walter Mischel,et al.  From good intentions to willpower. , 1996 .

[50]  M. Conner,et al.  Prospective prediction of health-related behaviours with the Theory of Planned Behaviour: a meta-analysis , 2011 .

[51]  W. Hofmann,et al.  A Meta-Analysis on the Correlation Between the Implicit Association Test and Explicit Self-Report Measures , 2005, Personality & social psychology bulletin.

[52]  L. R. Goldberg,et al.  THE STRUCTURE OF CONSCIENTIOUSNESS: AN EMPIRICAL INVESTIGATION BASED ON SEVEN MAJOR PERSONALITY QUESTIONNAIRES , 2005 .

[53]  A. Petróczi,et al.  HIV Patient Characteristics that Affect Adherence to Exercise Programmes: An Observational Study , 2010, The open AIDS journal.

[54]  A. Greenwald,et al.  Measuring individual differences in implicit cognition: the implicit association test. , 1998, Journal of personality and social psychology.

[55]  Matthew E Falagas,et al.  Socioeconomic status (SES) as a determinant of adherence to treatment in HIV infected patients: a systematic review of the literature , 2008, Retrovirology.

[56]  M. Stirratt,et al.  HIV Treatment Adherence Research and Intervention , 2007 .

[57]  Brian A. Nosek,et al.  Understanding and using the implicit association test: I. An improved scoring algorithm. , 2003, Journal of personality and social psychology.

[58]  Pantel Vokonas,et al.  Healthy psychological functioning and incident coronary heart disease: the importance of self-regulation. , 2011, Archives of general psychiatry.

[59]  G. Peytavin,et al.  Indinavir concentrations in hair from patients receiving highly active antiretroviral therapy , 1998, The Lancet.

[60]  Brian A. Nosek,et al.  A unified theory of implicit attitudes, stereotypes, self-esteem, and self-concept. , 2002, Psychological review.

[61]  A. Feingold,et al.  Gender differences in personality: a meta-analysis. , 1994, Psychological bulletin.

[62]  Anthony G. Greenwald,et al.  Predictive Validity of the Implicit Association Test in Studies of Brands, Consumer Attitudes, and Behavior , 2004 .

[63]  Rocco Lagioia,et al.  Short-term change in distance walked in 6 min is an indicator of outcome in patients with chronic heart failure in clinical practice. , 2006, Journal of the American College of Cardiology.

[64]  Kathleen C. Gerbasi,et al.  Short, homogeneous versions of the Marlow‐Crowne Social Desirability Scale , 1972 .

[65]  Brian A. Nosek,et al.  Policy Implications of Implicit Social Cognition , 2012 .

[66]  David C. McClelland,et al.  How Do Self-Attributed and Implicit Motives Differ?. , 1989 .

[67]  W. Saal,et al.  The applicability of the Theory of Planned Behaviour in predicting adherence to ART among a South African sample , 2012, Journal of health psychology.

[68]  G. Guyatt,et al.  The 6-minute walk: a new measure of exercise capacity in patients with chronic heart failure. , 1985, Canadian Medical Association journal.

[69]  Michael A. Olson,et al.  Implicit and Explicit Measures of Attitudes: The Perspective of the MODE Model , 2009 .

[70]  D. Jansen,et al.  The Development of and First Experiences with a Behavioural Self-regulation Intervention for Endstage Renal Disease Patients and Their Partners , 2011 .

[71]  Silje Sommer Hukkelberg,et al.  The Role of Self‐identity in the Theory of Planned Behavior: A Meta‐Analysis , 2010 .

[72]  C. Cherry,et al.  A six-month, supervised, aerobic and resistance exercise program improves self-efficacy in people with human immunodeficiency virus: a randomised controlled trial. , 2006, The Australian journal of physiotherapy.

[73]  P. Sheeran,et al.  Descriptive norms as an additional predictor in the theory of planned behaviour: A meta-analysis , 2003 .

[74]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[75]  D. Nau,et al.  The relationship of disease severity, health beliefs and medication adherence among HIV patients , 2000, AIDS care.

[76]  Deniz S. Ones,et al.  GROUP DIFFERENCES IN PERSONALITY: META‐ANALYSES COMPARING FIVE U.S. RACIAL GROUPS , 2008 .

[77]  K. Vohs,et al.  The Strength Model of Self-Control , 2007, Encyclopedia of Behavioral Medicine.

[78]  W. Peetermans,et al.  Prevalence and correlates of nonadherence to antiretroviral therapy in a population of HIV patients using Medication Event Monitoring System. , 2004, AIDS patient care and STDs.

[79]  M. Conner,et al.  The Theory of Planned Behaviour , 2004 .

[80]  Brian A. Nosek,et al.  A unified theory of implicit attitudes, stereotypes, self-esteem, and self-concept. , 2002 .

[81]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[82]  S. Kalichman,et al.  HIV treatment adherence in women living with HIV/AIDS: research based on the Information-Motivation-Behavioral Skills model of health behavior. , 2001, The Journal of the Association of Nurses in AIDS Care : JANAC.

[83]  Sara A. Pyle,et al.  Health and Quality of Life Outcomes , 2006 .

[84]  A. V. van Dyk Differences Between Patients Who Do and Do Not Adhere to Antiretroviral Therapy , 2011, The Journal of the Association of Nurses in AIDS Care : JANAC.

[85]  I. Ajzen The theory of planned behavior , 1991 .

[86]  M. Rijken,et al.  The Development of and First Experiences with a Behavioural Self-regulation Intervention for End-stage Renal Disease Patients and Their Partners , 2011, Journal of health psychology.

[87]  S. Epstein,et al.  Individual differences in intuitive-experiential and analytical-rational thinking styles. , 1996, Journal of personality and social psychology.

[88]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[89]  R. R. Abidin Psychological Assessment Resources , 1995 .

[90]  R. Glazier,et al.  Effects of progressive resistive exercise in adults living with HIV/AIDS: systematic review and meta-analysis of randomized trials , 2008, AIDS care.

[91]  B. N. Buswell,et al.  Gender differences in self-esteem: a meta-analysis. , 1999, Psychological bulletin.

[92]  Ross D Crosby,et al.  Defining clinically meaningful change in health-related quality of life. , 2003, Journal of clinical epidemiology.

[93]  Michelangelo Vianello,et al.  Implicit conscientiousness predicts academic performance , 2010 .

[94]  R. Horne Treatment perceptions and self-regulation , 2012 .

[95]  J. Steiner,et al.  Health and Quality of Life Outcomes , 2006 .

[96]  J. Weinman,et al.  The self-regulation of health and illness behaviour , 2003 .

[97]  Ross J. Harris,et al.  Life expectancy of individuals on combination antiretroviral therapy in high-income countries: a collaborative analysis of 14 cohort studies , 2008, The Lancet.

[98]  R. Glazier,et al.  Effectiveness of aerobic exercise in adults living with HIV/AIDS: systematic review. , 2004, Medicine and science in sports and exercise.

[99]  Noreen M Clark,et al.  Management of chronic disease by patients. , 2003, Annual review of public health.

[100]  I. Ajzen Perceived behavioral control, self-efficacy, locus of control, and the theory of planned behavior. , 2002 .

[101]  Nicholas F Taylor,et al.  Therapeutic exercise in physiotherapy practice is beneficial: a summary of systematic reviews 2002-2005. , 2007, The Australian journal of physiotherapy.

[102]  N. Miller,et al.  Adherence to exercise training in heart failure: a review , 2008, Heart Failure Reviews.

[103]  P. Furness The Human Tissue Act , 2006, BMJ : British Medical Journal.

[104]  S. Cole,et al.  Racial Disparities in HIV Virologic Failure: Do Missed Visits Matter? , 2009, Journal of Acquired Immune Deficiency Syndromes.

[105]  M. Banaji,et al.  Implicit social cognition: attitudes, self-esteem, and stereotypes. , 1995, Psychological review.

[106]  G. Maio,et al.  “How much do you like your name?” An implicit measure of global self-esteem , 2008 .

[107]  Stephen N. Goggin,et al.  An assessment of the fakeability of self-report and implicit personality measures , 2009 .

[108]  C. Chiorri,et al.  Prediction of adherence to antiretroviral therapy: can patients’ gender play some role? An Italian pilot study , 2008, AIDS care.

[109]  Jonathan Evans Dual-processing accounts of reasoning, judgment, and social cognition. , 2008, Annual review of psychology.

[110]  P. Sheeran Intention—Behavior Relations: A Conceptual and Empirical Review , 2002 .

[111]  Vas Taras,et al.  Examining the impact of Culture's consequences: a three-decade, multilevel, meta-analytic review of Hofstede's cultural value dimensions. , 2010, The Journal of applied psychology.

[112]  Russell H. Fazio,et al.  Attitudes and cognitive consistency: The role of associative and propositional processes , 2008 .

[113]  Mahzarin R. Banaji,et al.  Measuring the Suicidal Mind , 2010, Psychological science.

[114]  Marco Perugini,et al.  Predicting and understanding behavioral volitions: the interplay between goals and behaviors , 2000 .

[115]  P. Costa,et al.  Gender differences in personality traits across cultures: robust and surprising findings. , 2001, Journal of personality and social psychology.

[116]  Gail Ironson,et al.  Social support, positive states of mind, and HIV treatment adherence in men and women living with HIV/AIDS. , 2004, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[117]  C. Cadarso-Suárez,et al.  Assessing relationships between health-related quality of life and adherence to antiretroviral therapy , 2004, Quality of Life Research.

[118]  F. Cicuttini,et al.  Physical activity uptake in patients with HIV: who does how much? , 2008, International journal of STD & AIDS.

[119]  C. Carver,et al.  Control theory: a useful conceptual framework for personality-social, clinical, and health psychology. , 1982, Psychological bulletin.

[120]  R. McCrae,et al.  Self‐Regulation and the Five‐Factor Model of Personality Traits , 2010 .

[121]  R. Hoyle,et al.  Personality processes and problem behavior. , 2000, Journal of personality.

[122]  P. Sheeran,et al.  Augmenting the Theory of Planned Behavior: Roles for Anticipated Regret and Descriptive Norms , 1999 .

[123]  K. Hergenrather,et al.  Applying the theory of planned behavior to explore HAART adherence among HIV-positive immigrant Latinos: elicitation interview results. , 2011, Patient education and counseling.

[124]  E. Clingerman Physical Activity, Social Support, and Health-Related Quality of Life Among Persons With HIV Disease , 2004, Journal of community health nursing.

[125]  Tanya M. Swart,et al.  A review of health behaviour theories: how useful are these for developing interventions to promote long-term medication adherence for TB and HIV/AIDS? , 2007, BMC public health.

[126]  J. Bartholomew,et al.  The Benefits of Exercise Training for Quality of Life in HIV/AIDS in the Post-HAART Era , 2004, Sports medicine.

[127]  James J. Gross,et al.  Handbook of emotion regulation , 2007 .

[128]  B. Roberts,et al.  Personality Trait Change in Adulthood , 2008, Current directions in psychological science.

[129]  F. Cicuttini,et al.  The Effects of Exercise Training on Metabolic and Morphological Outcomes for People Living With HIV: A Systematic Review of Randomised Controlled Trials , 2010, HIV clinical trials.

[130]  Lucy Yardley,et al.  Understanding adherence to physiotherapy: Findings from an experimental simulation and an observational clinical study , 2010, Psychology & health.

[131]  Bertram Gawronski,et al.  Are “implicit” attitudes unconscious? , 2006, Consciousness and Cognition.

[132]  M. Becker,et al.  The Health Belief Model: A Decade Later , 1984, Health education quarterly.

[133]  K. Buchacz,et al.  Factors associated with non-adherence to antiretroviral therapy in the SUN study , 2011, AIDS care.

[134]  J. Houwer,et al.  The Dominance of Associative Theorizing in Implicit Attitude Research: Propositional and Behavioral Alternatives , 2011 .

[135]  Donald H. Saklofske,et al.  Chapter 6 – Personality, Self-Regulation, and Adaptation: A Cognitive-Social Framework , 2000 .

[136]  T. Nepusz,et al.  Incongruence in Doping Related Attitudes, Beliefs and Opinions in the Context of Discordant Behavioural Data: In Which Measure Do We Trust? , 2011, PloS one.

[137]  Jerry L. Grenard,et al.  Deliberative and spontaneous cognitive processes associated with HIV risk behavior , 2013, Journal of Behavioral Medicine.

[138]  A. Robin,et al.  Adherence in glaucoma: objective measurements of once-daily and adjunctive medication use. , 2007, American journal of ophthalmology.

[139]  M. Banaji,et al.  Prediction of suicide ideation and attempts among adolescents using a brief performance-based test. , 2007, Journal of consulting and clinical psychology.

[140]  R. McCrae,et al.  Personality profiles of cultures: aggregate personality traits. , 2005, Journal of personality and social psychology.

[141]  M. Perugini,et al.  The role of desires and anticipated emotions in goal-directed behaviours: broadening and deepening the theory of planned behaviour. , 2001, The British journal of social psychology.

[142]  E. Pronin How We See Ourselves and How We See Others , 2008, Science.

[143]  R. Greenblatt,et al.  Microanalysis of the antiretroviral nevirapine in human hair from HIV-infected patients by liquid chromatography-tandem mass spectrometry , 2011, Analytical and bioanalytical chemistry.

[144]  C. Leport,et al.  Hair versus plasma concentrations as indicator of indinavir exposure in HIV-1-infected patients treated with indinavir/ritonavir combination , 2007, AIDS.

[145]  G. Kok,et al.  Self-regulatory processes mediate the intention-behavior relation for adherence and exercise behaviors. , 2012, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[146]  A. Wu,et al.  Effectiveness of a home-based exercise intervention for HIV-infected adults: a randomized trial. , 2002, The Journal of the Association of Nurses in AIDS Care : JANAC.

[147]  Clare Wilkinson,et al.  Effectiveness of exercise-referral schemes to promote physical activity in adults: systematic review. , 2007, The British journal of general practice : the journal of the Royal College of General Practitioners.

[148]  R. Baumeister,et al.  Self-regulation and personality: how interventions increase regulatory success, and how depletion moderates the effects of traits on behavior. , 2006, Journal of personality.

[149]  D. Warburton,et al.  Characteristics of Physical Activity Guidelines and their Effect on Adherence , 2009, Sports medicine.

[150]  P. Addison Human Tissue Act. , 1968, British medical journal.

[151]  P. Gollwitzer,et al.  Implementation intentions and goal achievement: A meta-analysis of effects and processes , 2006 .

[152]  W. von Hippel,et al.  Implicit Prejudice Toward Injecting Drug Users Predicts Intentions to Change Jobs Among Drug and Alcohol Nurses , 2008, Psychological science.

[153]  Scott R. Smith,et al.  Factors Influencing Medication Adherence Beliefs and Self-Efficacy in Persons Naive to Antiretroviral Therapy: A Multicenter, Cross-Sectional Study , 2004, AIDS and Behavior.

[154]  Brian A. Nosek,et al.  Understanding and Using the Brief Implicit Association Test: Recommended Scoring Procedures , 2014, PloS one.

[155]  B. Roberts,et al.  Patterns of mean-level change in personality traits across the life course: a meta-analysis of longitudinal studies. , 2006, Psychological bulletin.

[156]  Charles Abraham,et al.  Conscientiousness and the Theory of Planned Behavior: Toward a more Complete Model of the Antecedents of Intentions and Behavior , 2001 .