UvA-DARE ( Digital Academic Repository ) Memory detection 2 . 0 : The first web-based memory detection test

There is accumulating evidence that reaction times (RTs) can be used to detect recognition of critical (e.g., crime) information. A limitation of this research base is its reliance upon small samples (average n = 24), and indications of publication bias. To advance RT-based memory detection, we report upon the development of the first web-based memory detection test. Participants in this research (Study1: n = 255; Study2: n = 262) tried to hide 2 high salient (birthday, country of origin) and 2 low salient (favourite colour, favourite animal) autobiographical details. RTs allowed to detect concealed autobiographical information, and this, as predicted, more successfully so than error rates, and for high salient than for low salient items. While much remains to be learned, memory detection 2.0 seems to offer an interesting new platform to efficiently and validly conduct RT-based memory detection research.

[1]  Bruno Verschuere,et al.  What's on Your Mind? Recent Advances in Memory Detection Using the Concealed Information Test , 2014 .

[2]  M. Lee,et al.  Statistical Evidence in Experimental Psychology , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[3]  C. Spearman.  CORRELATION CALCULATED FROM FAULTY DATA , 1910 .

[4]  Ewout H. Meijer,et al.  Detecting Concealed Information from Groups Using a Dynamic Questioning Approach: Simultaneous Skin Conductance Measurement and Immediate Feedback , 2013, Front. Psychology.

[5]  Eran Dayan,et al.  Estimating the validity of the guilty knowledge test from simulated experiments: the external validity of mock crime studies. , 2003, Journal of experimental psychology. Applied.

[6]  M. Birnbaum.  Human research and data collection via the internet. , 2004, Annual review of psychology.

[7]  D. Lykken.  The GSR in the detection of guilt. , 1959 .

[8]  Todd M. Gureckis,et al.  CUNY Academic , 2016 .

[9]  Bruno Verschuere,et al.  Antisociality, underarousal and the validity of the Concealed Information Polygraph Test , 2007, Biological Psychology.

[10]  Xavier Robin,et al.  pROC: an open-source package for R and S+ to analyze and compare ROC curves , 2011, BMC Bioinformatics.

[11]  Niklas Ravaja,et al.  Salience of Guilty Knowledge Test items affects accuracy in realistic mock crimes. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[12]  J. Wicherts,et al.  Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results , 2011, PloS one.

[13]  Travis L. Seymour,et al.  Combining Blink, Pupil, and Response Time Measures in a Concealed Knowledge Test , 2013, Front. Psychology.

[14]  George Visu-Petra,et al.  Detecting Concealed Information from a Mock Crime Scenario by Using Psychophysiological and Rt-Based Measures , 2011 .

[15]  Bruno Verschuere,et al.  RT-BASED MEMORY DETECTION: ITEM SALIENCY EFFECTS IN THE SINGLE-PROBE AND THE MULTIPLE-PROBE PROTOCOL , 2015 .

[16]  Matthias Gamer,et al.  Does the Guilty Actions Test allow for differentiating guilty participants from informed innocents? A re-examination. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[17]  Bruno Verschuere,et al.  Detecting concealed information with reaction times: Validity and comparison with the polygraph , 2010 .

[18]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[19]  D. Fowles,et al.  The skin conductance orienting response to semantic stimuli: significance can be independent of arousal. , 2007, Psychophysiology.

[20]  Neil Stewart,et al.  Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript Web experiments , 2014, Behavior research methods.

[21]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[22]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[23]  Jess R. Kerlin,et al.  Successful detection of verbal and visual concealed knowledge using an RT‐based paradigm , 2008 .

[24]  George Visu-Petra,et al.  Reaction Time‐based Detection of Concealed Information in Relation to Individual Differences in Executive Functioning , 2012 .

[25]  Jesse Chandler,et al.  Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers , 2013, Behavior Research Methods.

[26]  Jacob Cohen,et al.  THINGS I HAVE LEARNED (SO FAR) , 1990 .

[27]  W. Brown.  SOME EXPERIMENTAL RESULTS IN THE CORRELATION OF MENTAL ABILITIES1 , 1910 .

[28]  Aldert Vrij,et al.  Eliciting cues to deception and truth: What matters are the questions asked , 2012 .

[29]  Travis L. Seymour,et al.  Time and Encoding Effects in the Concealed Knowledge Test , 2009, Applied psychophysiology and biofeedback.

[30]  Reinout W. Wiers,et al.  Measuring implicit alcohol associations via the Internet: Validation of Web-based implicit association tests , 2008, Behavior research methods.

[31]  David G. Rand,et al.  The promise of Mechanical Turk: how online labor markets can help theorists run behavioral experiments. , 2012, Journal of theoretical biology.

[32]  G. Ritchie.  1 2 3 4 5 6 7 8 , 2000 .

[33]  Bruno Verschuere,et al.  Practical guidelines for developing a CIT , 2011 .

[34]  Jacob M. Marszalek,et al.  Sample Size in Psychological Research over the Past 30 Years , 2011, Perceptual and motor skills.

[35]  Gershon Ben-Shakhar,et al.  The validity of psychophysiological detection of information with the Guilty Knowledge Test: a meta-analytic review. , 2003, The Journal of applied psychology.

[36]  J. Wicherts,et al.  The Rules of the Game Called Psychological Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[37]  S. Gosling,et al.  Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. , 2004, The American psychologist.

[38]  Bruno Verschuere,et al.  Detecting deception through reaction times , 2015 .

[39]  Daniël Lakens,et al.  Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs , 2013, Front. Psychol..

[40]  Bruno Verschuere,et al.  Reaction time measures in deception research: comparing the effects of irrelevant and relevant stimulus-response compatibility. , 2013, Acta psychologica.

[41]  Michael D. Buhrmester,et al.  Amazon's Mechanical Turk , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[42]  Brian A. Nosek,et al.  An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[43]  Ewout H. Meijer,et al.  Memory detection with the Concealed Information Test: a meta analysis of skin conductance, respiration, heart rate, and P300 data. , 2014, Psychophysiology.

[44]  Mihai Varga,et al.  When Interference Helps: Increasing Executive Load to Facilitate Deception Detection in the Concealed Information Test , 2013, Front. Psychol..

[45]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[46]  David E. Stout.  Things I have learned (thus far)…reflections of an accounting academic , 2016 .

[47]  Israel Lieblich,et al.  Validity of the guilty knowledge technique in a prisoner's sample. , 1976 .

[48]  C M Seifert,et al.  Using response time measures to assess "guilty knowledge". , 2000, The Journal of applied psychology.

[49]  Angela Evans,et al.  An interfering dot-probe task facilitates the detection of mock crime memory in a reaction time (RT)-based concealed information test. , 2013, Acta psychologica.

[50]  Bruno Verschuere,et al.  Memory detection: theory and application of the concealed information test , 2011 .

[51]  K. Nakayama,et al.  Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experiments , 2012, Psychonomic Bulletin & Review.

[52]  Bruno Verschuere,et al.  Predicting the sensitivity of the Reaction Time-based Concealed Information Test , 2013 .