Neuroinformatics Software Applications Supporting Electronic Data Capture, Management, and Sharing for the Neuroimaging Community

Accelerating insight into the relation between brain and behavior entails conducting small and large-scale research endeavors that lead to reproducible results. Consensus is emerging between funding agencies, publishers, and the research community that data sharing is a fundamental requirement to ensure all such endeavors foster data reuse and fuel reproducible discoveries. Funding agency and publisher mandates to share data are bolstered by a growing number of data sharing efforts that demonstrate how information technologies can enable meaningful data reuse. Neuroinformatics evaluates scientific needs and develops solutions to facilitate the use of data across the cognitive and neurosciences. For example, electronic data capture and management tools designed to facilitate human neurocognitive research can decrease the setup time of studies, improve quality control, and streamline the process of harmonizing, curating, and sharing data across data repositories. In this article we outline the advantages and disadvantages of adopting software applications that support these features by reviewing the tools available and then presenting two contrasting neuroimaging study scenarios in the context of conducting a cross-sectional and a multisite longitudinal study.

[1]  S. Y. Nussbeck,et al.  Changing requirements and resulting needs for IT-infrastructure for longitudinal research in the neurosciences , 2016, Neuroscience Research.

[2]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[3]  F. Collins,et al.  Policy: NIH plans to enhance reproducibility , 2014, Nature.

[4]  Michael L. Hines,et al.  Neuroinformatics Original Research Article Neuron and Python , 2022 .

[5]  Carol M Hamilton,et al.  PhenX: a toolkit for interdisciplinary genetics research , 2010, Current opinion in lipidology.

[6]  Steen Moeller,et al.  The Human Connectome Project: A data acquisition perspective , 2012, NeuroImage.

[7]  Bruce R. Rosen,et al.  Enabling collaborative research using the Biomedical Informatics Research Network (BIRN) , 2011, J. Am. Medical Informatics Assoc..

[8]  M P Young,et al.  Brain structure-function relationships: advances from neuroinformatics. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[9]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[10]  Frazier Jean,et al.  CANDIShare: A Resource for Pediatric Neuroimaging Data , 2010 .

[11]  Thomas E. Nichols,et al.  The ENIGMA Consortium: large-scale collaborative analyses of neuroimaging and genetic data , 2014, Brain Imaging and Behavior.

[12]  L. Johnston,et al.  Monitoring the Future: National Survey of High School Seniors 1991 , 1998 .

[13]  David B. Keator,et al.  XCEDE: An Extensible Schema for Biomedical Data , 2011, Neuroinformatics.

[14]  Richie Poulton,et al.  Persistent cannabis users show neuropsychological decline from childhood to midlife , 2012, Proceedings of the National Academy of Sciences.

[15]  Arthur W. Toga,et al.  Effi cient , distributed and interactive neuroimaging data analysis using the LONI Pipeline , 2009 .

[16]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[17]  Perry L. Miller,et al.  The Human Brain Project: neuroinformatics tools for integrating, searching and modeling multidisciplinary neuroscience data , 1998, Trends in Neurosciences.

[18]  David N Kennedy,et al.  Data sharing and publishing in the field of neuroimaging , 2012, GigaScience.

[19]  Hans-Peter Meinzer,et al.  DICOM structured reporting: Part 2. Problems and challenges in implementation for PACS workstations. , 2004, Radiographics : a review publication of the Radiological Society of North America, Inc.

[20]  Lawrence Hunter,et al.  AMIA Board white paper: definition of biomedical informatics and specification of core competencies for graduate education in the discipline , 2012, J. Am. Medical Informatics Assoc..

[21]  Daniel S. Margulies,et al.  NeuroVault.org: A repository for sharing unthresholded statistical maps, parcellations, and atlases of the human brain , 2016, NeuroImage.

[22]  Jean-Baptiste Poline,et al.  Improving functional magnetic resonance imaging reproducibility , 2015, GigaScience.

[23]  Jessica A. Turner,et al.  COINS: An Innovative Informatics and Neuroimaging Tool Suite Built for Large Heterogeneous Datasets , 2011, Front. Neuroinform..

[24]  Nicholas R Cozzarelli,et al.  UPSIDE: Uniform principle for sharing integral data and materials expeditiously. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Daniel P. Kennedy,et al.  The Autism Brain Imaging Data Exchange: Towards Large-Scale Evaluation of the Intrinsic Brain Architecture in Autism , 2013, Molecular Psychiatry.

[26]  P. Fox,et al.  Mapping context and content: the BrainMap model , 2002, Nature Reviews Neuroscience.

[27]  R. Kane,et al.  Computerized assessment in neuropsychology: A review of tests and test batteries , 1992, Neuropsychology Review.

[28]  James F. Brinkley,et al.  A partnership approach for Electronic Data Capture in small-scale clinical trials , 2011, J. Biomed. Informatics.

[29]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[30]  Gordon M Shepherd,et al.  Supporting Databases for Neuroscience Research , 2002, Journal of Neuroscience.

[31]  Christopher G. Chute,et al.  Synergies and Distinctions Between Computational Disciplines in Biomedical Research: Perspective From the Clinical and Translational Science Award Programs , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[32]  Sten Grillner,et al.  Global Neuroinformatics: The International Neuroinformatics Coordinating Facility , 2007, The Journal of Neuroscience.

[33]  Robert A. Greenes,et al.  Imaging Systems in Radiology , 2014 .

[34]  Torsten Rohlfing,et al.  N-CANDA data integration: anatomy of an asynchronous infrastructure for multi-site, multi-instrument longitudinal data capture , 2013, J. Am. Medical Informatics Assoc..

[35]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[36]  Thomas E. Nichols,et al.  Image-based vs. Coordinate-based Meta-analysis , 2009, NeuroImage.

[37]  Daniel S. Marcus,et al.  The extensible neuroimaging archive toolkit , 2007, Neuroinformatics.

[38]  David B. Keator,et al.  Derived Data Storage and Exchange Workflow for Large-Scale Neuroimaging Analyses on the BIRN Grid , 2009, Front. Neuroinform..

[39]  Arthur W. Toga,et al.  Is it time to re-prioritize neuroimaging databases and digital repositories? , 2009, NeuroImage.

[40]  David A. Clunie,et al.  DICOM Structured Reporting , 2000 .

[41]  R. Gur,et al.  A cognitive neuroscience-based computerized battery for efficient measurement of individual differences: Standardization and initial construct validation , 2010, Journal of Neuroscience Methods.

[42]  David B. Keator,et al.  Towards structured sharing of raw and derived neuroimaging data across existing resources , 2012, NeuroImage.

[43]  Angela R. Laird,et al.  BrainMap , 2007, Neuroinformatics.

[44]  Krzysztof J. Gorgolewski,et al.  Making big data open: data sharing in neuroimaging , 2014, Nature Neuroscience.

[45]  Winston A Hide,et al.  Big data: The future of biocuration , 2008, Nature.

[46]  Marco Eichelberg,et al.  DICOM Structured Reporting - a prototype implementation , 2001, CARS.

[47]  Hans-Michael Müller,et al.  The Neuroscience Information Framework: A Data and Knowledge Environment for Neuroscience , 2008, Neuroinformatics.

[48]  Adam R Ferguson,et al.  Big data from small data: data-sharing in the 'long tail' of neuroscience , 2014, Nature Neuroscience.

[49]  J. Morris,et al.  The Uniform Data Set (UDS): Clinical and Cognitive Variables and Descriptive Data From Alzheimer Disease Centers , 2006, Alzheimer disease and associated disorders.

[50]  Z. Khachaturian Alzheimer's & Dementia: The Journal of the Alzheimer's Association , 2008, Alzheimer's & Dementia.

[51]  Russell A. Poldrack,et al.  Large-scale automated synthesis of human functional neuroimaging data , 2011, Nature Methods.

[52]  Stephen D. Larson,et al.  NeuroLex.org: an online framework for neuroscience knowledge , 2013, Front. Neuroinform..

[53]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[54]  Timothy O. Laumann,et al.  Informatics and Data Mining Tools and Strategies for the Human Connectome Project , 2011, Front. Neuroinform..

[55]  Stephen H. Koslow,et al.  Neuroinformatics: Opportunities across Disciplinary and National Borders , 1996, NeuroImage.

[56]  Joseph J. Paton,et al.  Big behavioral data: psychology, ethology and the foundations of neuroscience , 2014, Nature Neuroscience.

[57]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[58]  Thomas Martin Deserno,et al.  DICOM for Clinical Research: PACS-Integrated Electronic Data Capture in Multi-Center Trials , 2015, Journal of Digital Imaging.

[59]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[60]  F. Collins,et al.  Sharing and reporting the results of clinical trials. , 2015, JAMA.

[61]  J. Ioannidis Why Most Published Research Findings Are False , 2005, PLoS medicine.

[62]  Vijay K. Venkatraman,et al.  Multimodal imaging of the self-regulating developing brain , 2012, Proceedings of the National Academy of Sciences.

[63]  Nicole Tourigny,et al.  Bio2RDF: Towards a mashup to build bioinformatics knowledge systems , 2008, J. Biomed. Informatics.

[64]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[65]  Patrick O'Malley,et al.  Monitoring the Future national survey results on drug use, 1975-2018: Overview, key findings on adolescent drug use , 2015 .

[66]  Arthur W. Toga,et al.  Human neuroimaging as a “Big Data” science , 2013, Brain Imaging and Behavior.

[67]  J. Ioannidis Why Most Published Research Findings Are False , 2005 .

[68]  T. Insel,et al.  Wesleyan University From the SelectedWorks of Charles A . Sanislow , Ph . D . 2010 Research Domain Criteria ( RDoC ) : Toward a New Classification Framework for Research on Mental Disorders , 2018 .

[69]  Daniel S. Marcus,et al.  Obscuring Surface Anatomy in Volumetric Imaging Data , 2012, Neuroinformatics.

[70]  Bharat B. Biswal,et al.  Making data sharing work: The FCP/INDI experience , 2013, NeuroImage.

[71]  Brian A. Nosek,et al.  Power failure: why small sample size undermines the reliability of neuroscience , 2013, Nature Reviews Neuroscience.

[72]  Aniket Kittur,et al.  The Cognitive Atlas: Toward a Knowledge Foundation for Cognitive Neuroscience , 2011, Front. Neuroinform..

[73]  J. Ioannidis,et al.  Potential Reporting Bias in fMRI Studies of the Brain , 2013, PloS one.

[74]  Arthur W. Toga,et al.  The informatics core of the Alzheimer's Disease Neuroimaging Initiative , 2010, Alzheimer's & Dementia.

[75]  Alan C. Evans,et al.  LORIS: a web-based data management system for multi-center studies , 2012, Front. Neuroinform..

[76]  C Rosse,et al.  Imaging and the Human Brain Project: A Review , 2002, Methods of Information in Medicine.

[77]  Satrajit S. Ghosh,et al.  Data sharing in neuroimaging research , 2012, Front. Neuroinform..

[78]  P. Harris,et al.  Research electronic data capture (REDCap) - A metadata-driven methodology and workflow process for providing translational research informatics support , 2009, J. Biomed. Informatics.

[79]  Christian Windischberger,et al.  Toward discovery science of human brain function , 2010, Proceedings of the National Academy of Sciences.

[80]  Shahram Ghandeharizadeh,et al.  Letter from the Special Issue Editor , 1994, IEEE Data Eng. Bull..

[81]  S Day,et al.  Double data entry: what value, what price? , 1998, Controlled clinical trials.

[82]  Matthew J. McAuliffe,et al.  Sharing Heterogeneous Data: The National Database for Autism Research , 2012, Neuroinformatics.

[83]  Angela R Laird,et al.  Brainmap taxonomy of experimental design: Description and evaluation , 2005, Human brain mapping.

[84]  C. Lord,et al.  Autism Diagnostic Observation Schedule , 2016 .

[85]  Torsten Rohlfing,et al.  The National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA): A Multisite Study of Adolescent Development and Substance Use. , 2015, Journal of studies on alcohol and drugs.

[86]  David N. Kennedy,et al.  The Three NITRCs: A Guide to Neuroimaging Neuroinformatics Resources , 2015, Neuroinformatics.

[87]  David C. Glahn,et al.  Neuroinformatics Database (NiDB) – A Modular, Portable Database for the Storage, Analysis, and Sharing of Neuroimaging Data , 2013, Neuroinformatics.

[88]  Vincenzo Bonifati,et al.  Assessment of neurological and behavioural function: the NIH Toolbox , 2010 .

[89]  Jessica A. Turner,et al.  Neuroanatomical domain of the foundational model of anatomy ontology , 2014, J. Biomed. Semant..

[90]  John P A Ioannidis,et al.  Excess significance bias in the literature on brain volume abnormalities. , 2011, Archives of general psychiatry.

[91]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[92]  Oluwasanmi Koyejo,et al.  Toward open sharing of task-based fMRI data: the OpenfMRI project , 2013, Front. Neuroinform..

[93]  Angela R. Laird,et al.  ALE meta-analysis of action observation and imitation in the human brain , 2010, NeuroImage.

[94]  Joylee Wu,et al.  The National Alzheimer's Coordinating Center (NACC) Database: The Uniform Data Set , 2007, Alzheimer disease and associated disorders.