Automatic channel selection in neural microprobes: A combinatorial multi-armed bandit approach

State-of-the-art neural microprobes contain hundreds of electrodes within a single shaft. Due to hardware and wiring restrictions, it is usually only possible to measure a small subset of the available electrodes simultaneously. The selection of the best channels is typically performed offline either manually or automatically. However, having a fixed selection for long-term observation does not allow the system to react to changes in the neural activity, and may therefore lead to the loss of important information. In this paper, we formulate the process of autonomously selecting the best subset of electrodes as a combinatorial multi-armed bandit problem with non-stationary rewards, thus allowing the probe to adapt its selection policies online. In order to minimize exploratory actions of the probe, we furthermore take advantage of the existing dependencies between neighboring channels. Our approach is an adaptation of the discounted upper confidence bounds (D-UCB) algorithm, and identifies the electrodes providing the largest amount of non-redundant information. To the best of our knowledge, this is the first online approach for the problem of electrode selection. In extensive experiments, we demonstrate that our solution is not only able to converge towards an average optimal selection policy, but it is also able to react to changes in the neural activity or to damages of the recording electrodes.

[1]  E. S. Page.  CONTINUOUS INSPECTION SCHEMES , 1954 .

[2]  Peter Auer,et al.  The Nonstochastic Multiarmed Bandit Problem , 2002, SIAM J. Comput..

[3]  G. Buzsáki.  Large-scale recording of neuronal ensembles , 2004, Nature Neuroscience.

[4]  Dirk Thierens,et al.  An Adaptive Pursuit Strategy for Allocating Operator Probabilities , 2005, BNAIC.

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  Michèle Sebag,et al.  Multi-armed Bandit, Dynamic Environments and Meta-Bandits , 2006 .

[7]  Joel W. Burdick,et al.  A control algorithm for autonomous optimization of extracellular recordings , 2006, IEEE Transactions on Biomedical Engineering.

[8]  Patrick Merken,et al.  The NeuroProbes project: A concept for electronic depth control , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Patrick Ruther,et al.  Control and data acquisition software for high-density CMOS-based microprobe arrays implementing electronic depth control , 2010, Biomedizinische Technik. Biomedical engineering.

[10]  Maria Alessandra Umiltà,et al.  Toward Automated Electrode Selection in the Electronic Depth Control Strategy for Multi-unit Recordings , 2010, ICONIP.

[11]  O. Paul,et al.  CMOS-Based High-Density Silicon Microprobe Arrays for Electronic Depth Control in Intracortical Neural Recording , 2011, Journal of Microelectromechanical Systems.

[12]  Eric Moulines,et al.  On Upper-Confidence Bound Policies for Switching Bandit Problems , 2011, ALT.

[13]  I. Ulbert,et al.  CMOS-Based High-Density Silicon Microprobe Arrays for Electronic Depth Control in Intracortical Neural Recording–Characterization and Application , 2012, Journal of Microelectromechanical Systems.

[14]  Marc M. Van Hulle,et al.  Enhancing the Yield of High-Density electrode Arrays through Automated electrode Selection , 2012, Int. J. Neural Syst..

[15]  Wei Chen,et al.  Combinatorial multi-armed bandit: general framework, results and applications , 2013, ICML 2013.

[16]  Wolfram Burgard,et al.  Automatic channel selection and neural signal estimation across channels of neural probes , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  T. Galchev,et al.  CMOS-based neural probe with enhanced electronic depth control , 2015, 2015 Transducers - 2015 18th International Conference on Solid-State Sensors, Actuators and Microsystems (TRANSDUCERS).