Handling Metadata in a Neurophysiology Laboratory

To date, non-reproducibility of neurophysiological research is a matter of intense discussion in the scientific community. A crucial component to enhance reproducibility is to comprehensively collect and store metadata, that is, all information about the experiment, the data, and the applied preprocessing steps on the data, such that they can be accessed and shared in a consistent and simple manner. However, the complexity of experiments, the highly specialized analysis workflows and a lack of knowledge on how to make use of supporting software tools often overburden researchers to perform such a detailed documentation. For this reason, the collected metadata are often incomplete, incomprehensible for outsiders or ambiguous. Based on our research experience in dealing with diverse datasets, we here provide conceptual and technical guidance to overcome the challenges associated with the collection, organization, and storage of metadata in a neurophysiology laboratory. Through the concrete example of managing the metadata of a complex experiment that yields multi-channel recordings from monkeys performing a behavioral motor task, we practically demonstrate the implementation of these approaches and solutions with the intention that they may be generalized to other projects. Moreover, we detail five use cases that demonstrate the resulting benefits of constructing a well-organized metadata collection when processing or analyzing the recorded data, in particular when these are shared between laboratories in a modern scientific collaboration. Finally, we suggest an adaptable workflow to accumulate, structure and store metadata from different sources using, by way of example, the odML metadata framework.

[1]  W. Geisler Visual perception and the statistical properties of natural scenes. , 2008, Annual review of psychology.

[2]  Eran Stark,et al.  Large-scale, high-density (up to 512 channels) recording of local circuits in behaving animals. , 2014, Journal of neurophysiology.

[3]  Nigel W. Hardy,et al.  Promoting coherent minimum reporting guidelines for biological and biomedical investigations: the MIBBI project , 2008, Nature Biotechnology.

[4]  Paolo Manghi,et al.  Data journals: A survey , 2014, J. Assoc. Inf. Sci. Technol..

[5]  Wachtler Thomas,et al.  Mobile metadata: bringing Neuroinformatics tools to the bench , 2014 .

[6]  Hiroaki Kitano,et al.  The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models , 2003, Bioinform..

[7]  S. Morrison,et al.  Time to do something about reproducibility , 2014, eLife.

[8]  Jan Grewe,et al.  A Bottom-up Approach to Data Annotation in Neurophysiology , 2011, Front. Neuroinform..

[9]  J. Lisman The Challenge of Understanding the Brain: Where We Stand in 2015 , 2015, Neuron.

[10]  N. Perlin,et al.  Introduction to Metadata , 2006, 2006 IEEE International Professional Communication Conference.

[11]  Peter Bächtold,et al.  Bottom-Up Approach , 2013 .

[12]  W. Singer,et al.  Synchronization of neuronal responses in primary visual cortex of monkeys viewing natural images. , 2008, Journal of neurophysiology.

[13]  Irene Kuhn,et al.  Sorting out the FACS: a devil in the details. , 2014, Cell reports.

[14]  Sonja Grün,et al.  Designing Workflows for the Reproducible Analysis of Electrophysiological Data , 2015, BrainComp.

[15]  S. Goodman,et al.  Reproducible Research: Moving toward Research the Public Can Really Trust , 2007, Annals of Internal Medicine.

[16]  Pierre Yger,et al.  Neo: an object model for handling electrophysiology data in multiple formats , 2014, Front. Neuroinform..

[17]  Christof Koch,et al.  Neurodata Without Borders: Creating a Common Data Format for Neurophysiology , 2015, Neuron.

[18]  Bernd Pulverer,et al.  Reproducibility blues , 2015, The EMBO journal.

[19]  CM Lewis,et al.  Recording of brain activity across spatial scales , 2015, Current Opinion in Neurobiology.

[20]  Sonja Grün,et al.  Local field potentials in primate motor cortex encode grasp kinetic parameters , 2015, NeuroImage.

[21]  Benda Jan,et al.  File format and library for neuroscience data and metadata , 2014 .

[22]  K. Deisseroth,et al.  Engineering Approaches to Illuminating Brain Structure and Dynamics , 2013, Neuron.

[23]  A. Riehle,et al.  Mapping the spatio-temporal structure of motor cortical LFP and spiking activities during reach-to-grasp movements , 2013, Front. Neural Circuits.

[24]  R. Peng Reproducible Research in Computational Science , 2011, Science.

[25]  Michael L. Hines,et al.  NeuroML: A Language for Describing Data Driven Models of Neurons and Networks with a High Degree of Biological Detail , 2010, PLoS Comput. Biol..

[26]  Douglas J. Bakkum,et al.  Revealing neuronal function through microelectrode array recordings , 2015, Front. Neurosci..

[27]  Jayashree Kalpathy-Cramer,et al.  Web based tools for visualizing imaging data and development of XNATView, a zero footprint image viewer , 2014, Front. Neuroinform..

[28]  Alexei Verkhratsky,et al.  From Galvani to patch clamp: the development of electrophysiology , 2006, Pflügers Archiv.

[29]  Sidarta Ribeiro,et al.  Multielectrode recordings: the next steps , 2002, Current Opinion in Neurobiology.

[30]  M. Tomasello,et al.  Methodological Challenges in the Study of Primate Cognition , 2011, Science.

[31]  Chung-Chuan Lo,et al.  Polarity-specific high-level information propagation in neural networks , 2014, Front. Neuroinform..

[32]  Andrew P. Davison,et al.  Sumatra: A Toolkit for Reproducible Research , 2018, Implementing Reproducible Research.

[33]  Pierre Yger,et al.  PyNN: A Common Interface for Neuronal Network Simulators , 2008, Front. Neuroinform..

[34]  Mario Niepel,et al.  Adaptive informatics for multi-factorial and high content biological data , 2011, Nature Methods.

[35]  M. Murayama,et al.  The fiber-optic imaging and manipulation of neural activity during animal behavior , 2016, Neuroscience Research.

[36]  Miles A. Whittington,et al.  Minimum Information about a Neuroscience Investigation (MINI): Electrophysiology , 2008 .

[37]  Bruce Graham,et al.  Creating, documenting and sharing network models , 2012, Network.

[38]  Mikhail A. Lebedev,et al.  Chronic, Wireless Recordings of Large Scale Brain Activity in Freely Moving Rhesus Monkeys , 2014, Nature Methods.

[39]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.

[40]  Michael J. Black,et al.  Decoding Complete Reach and Grasp Actions from Local Primary Motor Cortex Populations , 2010, The Journal of Neuroscience.