Robust registration of calcium images by learned contrast synthesis

Multi-modal image registration is a challenging task that is vital to fuse complementary signals for subsequent analyses. Despite much research into cost functions addressing this challenge, there exist cases in which these are ineffective. In this work, we show that (1) this is true for the registration of in-vivo Drosophila brain volumes visualizing genetically encoded calcium indicators to an nc82 atlas and (2) that machine learning based contrast synthesis can yield improvements. More specifically, the number of subjects for which the registration outright failed was greatly reduced (from 40% to 15%) by using a synthesized image.

[1]  Vincent Lepetit,et al.  Supervised Feature Learning for Curvilinear Structure Segmentation , 2013, MICCAI.

[2]  Gregory S.X.E. Jefferis,et al.  NBLAST: Rapid, Sensitive Comparison of Neuronal Structure and Construction of Neuron Family Databases , 2016, Neuron.

[3]  Tobias Pietzsch,et al.  BigDataViewer: visualization and processing for large image data sets , 2015, Nature Methods.

[4]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[5]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[6]  Snehashis Roy,et al.  Magnetic Resonance Image Example-Based Contrast Synthesis , 2013, IEEE Transactions on Medical Imaging.

[7]  Snehashis Roy,et al.  Magnetic resonance image synthesis through patch regression , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[8]  A. Wong,et al.  Two-Photon Calcium Imaging Reveals an Odor-Evoked Map of Activity in the Fly Brain , 2003, Cell.

[9]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[10]  Jan Kybic,et al.  Automatic simultaneous segmentation and fast registration of histological images , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[11]  Aaron Carass,et al.  Using image synthesis for multi-channel registration of different image modalities , 2015, Medical Imaging.

[12]  Nassir Navab,et al.  Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention , 2008, Medical Image Anal..

[13]  Nikos Paragios,et al.  Image transport regression using mixture of experts and discrete Markov Random Fields , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.