Accurate Junction Detection and Characterization in Natural Images

Accurate junction detection and characterization are of primary importance for several aspects of scene analysis, including depth recovery and motion analysis. In this work, we introduce a generic junction analysis scheme. The first asset of the proposed procedure is an automatic criterion for the detection of junctions, permitting to deal with textured parts in which no detection is expected. Second, the method yields a characterization of L-, Y- and X- junctions, including a precise computation of their type, localization and scale. Contrary to classical approaches, scale characterization does not rely on the linear scale-space. First, an a contrario approach is used to compute the meaningfulness of a junction. This approach relies on a statistical modeling of suitably normalized gray level gradients. Then, exclusion principles between junctions permit their precise characterization. We give implementation details for this procedure and evaluate its efficiency through various experiments.

[1]  Erik M. Jorgensen,et al.  A post-docking role for active zone protein Rim , 2001, Nature Neuroscience.

[2]  Thomas C. Südhof,et al.  Multiple Roles for the Active Zone Protein RIM1α in Late Stages of Neurotransmitter Release , 2004, Neuron.

[3]  Yasuhiro Sunaga,et al.  cAMP-GEFII is a direct target of cAMP in regulated exocytosis , 2000, Nature Cell Biology.

[4]  T. Südhof,et al.  Mammalian Homologues of Caenorhabditis elegans unc-13 Gene Define Novel Family of C2-domain Proteins (*) , 1995, The Journal of Biological Chemistry.

[5]  M. Torres,et al.  Non‐additive potentiation of glutamate release by phorbol esters and metabotropic mGlu7 receptor in cerebrocortical nerve terminals , 2011, Journal of neurochemistry.

[6]  T. Poggio,et al.  BOOK REVIEW David Marr’s Vision: floreat computational neuroscience VISION: A COMPUTATIONAL INVESTIGATION INTO THE HUMAN REPRESENTATION AND PROCESSING OF VISUAL INFORMATION , 2009 .

[7]  Nils Brose,et al.  Molecular Dynamics of a Presynaptic Active Zone Protein Studied in Munc13-1–Enhanced Yellow Fluorescent Protein Knock-In Mutant Mice , 2006, The Journal of Neuroscience.

[8]  Jean-Michel Morel,et al.  From Gestalt Theory to Image Analysis: A Probabilistic Approach , 2007 .

[9]  Yongtian Wang,et al.  An Empirical Study of Object Category Recognition: Sequential Testing with Generalized Samples , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[10]  Thomas C. Südhof,et al.  Munc13-1 is essential for fusion competence of glutamatergic synaptic vesicles , 1999, Nature.

[11]  Roland T. Chin,et al.  On the Detection of Dominant Points on Digital Curves , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Laxmi Parida,et al.  Junctions: Detection, Classification, and Reconstruction , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Yasuhiro Sunaga,et al.  The cAMP Sensor Epac2 Is a Direct Target of Antidiabetic Sulfonylurea Drugs , 2009, Science.

[14]  Nils Brose,et al.  Move over protein kinase C, you've got company: alternative cellular effectors of diacylglycerol and phorbol esters , 2002, Journal of Cell Science.

[15]  A M Graybiel,et al.  A family of cAMP-binding proteins that directly activate Rap1. , 1998, Science.

[16]  M. Gazzaniga The new cognitive neurosciences, 2nd ed. , 2000 .

[17]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[18]  Song-Chun Zhu,et al.  Primal sketch: Integrating structure and texture , 2007, Comput. Vis. Image Underst..

[19]  Nils Brose,et al.  Differential Control of Vesicle Priming and Short-Term Plasticity by Munc13 Isoforms , 2002, Neuron.

[20]  R. Petralia,et al.  EPAC null mutation impairs learning and social interactions via aberrant regulation of miR-124 and Zif268 translation , 2012, Molecular Neurodegeneration.

[21]  Thomas C. Südhof,et al.  The synaptic vesicle cycle: a cascade of protein–protein interactions , 1995, Nature.

[22]  Robert W. Burgess,et al.  Rab3 Dynamically Controls Protein Composition at Active Zones , 2009, Neuron.

[23]  Lionel Moisan,et al.  A Probabilistic Criterion to Detect Rigid Point Matches Between Two Images and Estimate the Fundamental Matrix , 2004, International Journal of Computer Vision.

[24]  K. Hsu,et al.  Presynaptic Mechanism Underlying cAMP-Induced Synaptic Potentiation in Medial Prefrontal Cortex Pyramidal Neurons , 2006, Molecular Pharmacology.

[25]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Rüdiger von der Heydt,et al.  Detection of General Edges and Keypoints , 1992, ECCV.

[27]  J. Hell,et al.  Phosphorylation of presynaptic and postsynaptic calcium channels by cAMP‐dependent protein kinase in hippocampal neurons. , 1995, The EMBO journal.

[28]  Hans P. Moravec Towards Automatic Visual Obstacle Avoidance , 1977, IJCAI.

[29]  Lionel Moisan,et al.  Meaningful Alignments , 2000, International Journal of Computer Vision.

[30]  Bin Luo,et al.  Resolution- Independent Characteristic Scale Dedicated to Satellite Images , 2007, IEEE Transactions on Image Processing.

[31]  Marsha Jo Hannah,et al.  Computer matching of areas in stereo images. , 1974 .

[32]  E. Adelson Lightness Perception and Lightness Illusions , 1999 .

[33]  Roland T. Chin,et al.  Scale-Based Detection of Corners of Planar Curves , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Yann Gousseau,et al.  An A Contrario Decision Method for Shape Element Recognition , 2006, International Journal of Computer Vision.

[35]  J. Sánchez-Prieto,et al.  cAMP-dependent Facilitation of Glutamate Release by β-Adrenergic Receptors in Cerebrocortical Nerve Terminals* , 1996, The Journal of Biological Chemistry.

[36]  Adolfo Guzmán-Arenas,et al.  Decomposition of a visual scene into three-dimensional bodies , 1968, AFIPS Fall Joint Computing Conference.

[37]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[38]  Virginia M. Pickel,et al.  Cytoplasmic loop of β-adrenergic receptors: synaptic and intracellular localization and relation to catecholaminergic neurons in the nuclei of the solitary tracts , 1989, Brain Research.

[39]  Thomas C. Südhof,et al.  Rim is a putative Rab3 effector in regulating synaptic-vesicle fusion , 1997, Nature.

[40]  Thomas C. Südhof,et al.  RIM1α forms a protein scaffold for regulating neurotransmitter release at the active zone , 2002, Nature.

[41]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[42]  J. Pin,et al.  D-myo-inositol 1-phosphate as a surrogate of D-myo-inositol 1,4,5-tris phosphate to monitor G protein-coupled receptor activation. , 2006, Analytical biochemistry.

[43]  T. Südhof,et al.  RAB3 and synaptotagmin: the yin and yang of synaptic membrane fusion. , 1998, Annual review of neuroscience.

[44]  Thomas C. Südhof,et al.  β Phorbol Ester- and Diacylglycerol-Induced Augmentation of Transmitter Release Is Mediated by Munc13s and Not by PKCs , 2002, Cell.

[45]  Adolfo Guzman,et al.  Decomposition of a visual scene into three-dimensional bodies , 1968 .

[46]  Eric D. Sinzinger,et al.  A model-based approach to junction detection using radial energy , 2008, Pattern Recognit..

[47]  Peter Kovesi,et al.  Phase Congruency Detects Corners and Edges , 2003, DICTA.

[48]  Azriel Rosenfeld,et al.  Angle Detection on Digital Curves , 1973, IEEE Transactions on Computers.

[49]  Josep Rizo,et al.  Intramolecular occlusion of the diacylglycerol-binding site in the C1 domain of munc13-1. , 2005, Biochemistry.

[50]  B. Law,et al.  Identification of Soluble Protein Phosphatases That Dephosphorylate Voltage-sensitive Sodium Channels in Rat Brain (*) , 1995, The Journal of Biological Chemistry.

[51]  Rachid Deriche,et al.  Recovering and characterizing image features using an efficient model based approach , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Wolfgang Förstner,et al.  Polymorphic grouping for image segmentation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[53]  Josh H. McDermott,et al.  Psychophysics with junctions in real images. , 2010, Perception.

[54]  N Rubin,et al.  The Role of Junctions in Surface Completion and Contour Matching , 2001, Perception.

[55]  Michael Lindenbaum,et al.  Boundary ownership by lifting to 2.1D , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[56]  Robert Bergevin,et al.  Detection and characterization of junctions in a 2D image , 2004, Comput. Vis. Image Underst..

[57]  R. Shigemoto,et al.  Co-expression of Metabotropic Glutamate Receptor 7 and N-type Ca2+ Channels in Single Cerebrocortical Nerve Terminals of Adult Rats* , 2003, Journal of Biological Chemistry.

[58]  Julien Rabin,et al.  A Statistical Approach to the Matching of Local Features , 2009, SIAM J. Imaging Sci..

[59]  Luis Álvarez,et al.  Affine Morphological Multiscale Analysis of Corners and Multiple Junctions , 1997, International Journal of Computer Vision.

[60]  P W Gean,et al.  Isoproterenol potentiates synaptic transmission primarily by enhancing presynaptic calcium influx via P- and/or Q-type calcium channels in the rat amygdala , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[61]  Wolfgang Förstner,et al.  A Framework for Low Level Feature Extraction , 1994, ECCV.

[62]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[63]  Y. Nishizuka,et al.  Taxonomy and function of C1 protein kinase C homology domains , 1997, Protein science : a publication of the Protein Society.

[64]  Carlo Tomasi,et al.  Edge, Junction, and Corner Detection Using Color Distributions , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[65]  Guojun Lu,et al.  An Improved Curvature Scale-Space Corner Detector and a Robust Corner Matching Approach for Transformed Image Identification , 2008, IEEE Transactions on Image Processing.

[66]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[67]  T. Sudhof,et al.  Phosphorylation of rabphilin-3A by Ca2+/calmodulin- and cAMP-dependent protein kinases in vitro , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[68]  E. Neher,et al.  Application of an Epac Activator Enhances Neurotransmitter Release at Excitatory Central Synapses , 2008, The Journal of Neuroscience.

[69]  Thomas C. Südhof,et al.  RIM1α is required for presynaptic long-term potentiation , 2002, Nature.

[70]  Gui-Song Xia,et al.  Compositional Boosting for Computing Hierarchical Image Structures , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[71]  Inmaculada Herrero,et al.  Glutamate exocytosis evoked by 4-aminopyridine is inhibited by free fatty acids released from rat cerebrocortical synaptosomes , 1991, Neuroscience Letters.

[72]  Rachid Deriche,et al.  A computational approach for corner and vertex detection , 1993, International Journal of Computer Vision.

[73]  R Lujan,et al.  Perisynaptic Location of Metabotropic Glutamate Receptors mGluR1 and mGluR5 on Dendrites and Dendritic Spines in the Rat Hippocampus , 1996, The European journal of neuroscience.

[74]  T. Südhof,et al.  Genomic definition of RIM proteins: evolutionary amplification of a family of synaptic regulatory proteins. , 2003, Genomics.

[75]  Robert S. Zucker,et al.  cAMP Acts on Exchange Protein Activated by cAMP/cAMP-Regulated Guanine Nucleotide Exchange Protein to Regulate Transmitter Release at the Crayfish Neuromuscular Junction , 2005, The Journal of Neuroscience.

[76]  Luc Van Gool,et al.  Efficient Non-Maximum Suppression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[77]  Kendal Broadie,et al.  Drosophila Unc-13 is essential for synaptic transmission , 1999, Nature Neuroscience.

[78]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[79]  D. Linden,et al.  Adapter protein 14-3-3 is required for a presynaptic form of LTP in the cerebellum , 2004, Nature Neuroscience.

[80]  Davi Geiger,et al.  Segmentation by grouping junctions , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[81]  R. Nicoll,et al.  Mediation of hippocampal mossy fiber long-term potentiation by cyclic AMP. , 1994, Science.

[82]  Mariella Dimiccoli,et al.  Exploiting T-junctions for depth segregation in single images , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[83]  Francisco Ciruela,et al.  The Metabotropic Glutamate Receptor mGlu7 Activates Phospholipase C, Translocates Munc-13-1 Protein, and Potentiates Glutamate Release at Cerebrocortical Nerve Terminals* , 2010, The Journal of Biological Chemistry.

[84]  Hans Wallach Über visuell wahrgenommene Bewegungsrichtung , 1935 .

[85]  Helmut L. Haas,et al.  Histamine and noradrenaline decrease calcium-activated potassium conductance in hippocampal pyramidal cells , 1983, Nature.

[86]  Wolfgang Förstner,et al.  Detecting interpretable and accurate scale-invariant keypoints , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[87]  R. Bolles,et al.  Recognizing and Locating Partially Visible Objects: The Local-Feature-Focus Method , 1982 .

[88]  Ze-Jun Feng,et al.  Pre- and postsynaptic beta-adrenergic activation enhances excitatory synaptic transmission in layer V/VI pyramidal neurons of the medial prefrontal cortex of rats. , 2008, Cerebral cortex.

[89]  Gang Liu,et al.  A perception-inspired building index for automatic built-up area detection in high-resolution satellite images , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[90]  Thomas C. Südhof,et al.  Phosphorylation of RIM1α by PKA Triggers Presynaptic Long-Term Potentiation at Cerebellar Parallel Fiber Synapses , 2003, Cell.

[91]  Azriel Rosenfeld,et al.  Non-maximum suppression of gradient magnitudes makes them easier to threshold , 1982, Pattern Recognit. Lett..

[92]  F. H. Lopes da Silva,et al.  Rab3a is involved in transport of synaptic vesicles to the active zone in mouse brain nerve terminals. , 2001, Molecular biology of the cell.

[93]  Jean-Michel Morel,et al.  From Gestalt Theory to Image Analysis , 2008 .

[94]  G. Kanizsa,et al.  Organization in Vision: Essays on Gestalt Perception , 1979 .

[95]  Farzin Mokhtarian,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[96]  M. Torres,et al.  Co‐activation of PKA and PKC in cerebrocortical nerve terminals synergistically facilitates glutamate release , 2003, Journal of neurochemistry.

[97]  Mark Hedley,et al.  Fast corner detection , 1998, Image Vis. Comput..

[98]  Uri Ashery,et al.  Phosphorylation of Snapin by PKA modulates its interaction with the SNARE complex , 2001, Nature Cell Biology.

[99]  Alberto Darszon,et al.  Epac Activates the Small G Proteins Rap1 and Rab3A to Achieve Exocytosis* , 2009, The Journal of Biological Chemistry.

[100]  E Neher,et al.  Preferential potentiation of fast-releasing synaptic vesicles by cAMP at the calyx of Held. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[101]  Jitendra Malik,et al.  Using contours to detect and localize junctions in natural images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[102]  B. S. Manjunath,et al.  An axiomatic approach to corner detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[103]  Thomas C. Südhof,et al.  RIM Proteins Activate Vesicle Priming by Reversing Autoinhibitory Homodimerization of Munc13 , 2011, Neuron.

[104]  A. Teschemacher,et al.  Potentiation of Exocytosis by Phospholipase C-Coupled G-Protein-Coupled Receptors Requires the Priming Protein Munc13-1 , 2007, The Journal of Neuroscience.

[105]  Tomoyuki Takahashi,et al.  Presynaptic Mechanism Underlying cAMP-Dependent Synaptic Potentiation , 2004, The Journal of Neuroscience.

[106]  David J. Beymer,et al.  Finding junctions using the image gradient , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[107]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[108]  R. Nicoll,et al.  Noradrenaline blocks accommodation of pyramidal cell discharge in the hippocampus , 1982, Nature.

[109]  Alan V. Smrcka,et al.  Phospholipase C-ε links Epac2 activation to the potentiation of glucose-stimulated insulin secretion from mouse islets of Langerhans , 2011, Islets.

[110]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[111]  Nils Brose,et al.  Phorbol Esters Modulate Spontaneous and Ca2+-Evoked Transmitter Release via Acting on Both Munc13 and Protein Kinase C , 2008, The Journal of Neuroscience.

[112]  Refractor Vision , 2000, The Lancet.

[113]  J. Bos,et al.  Epac proteins: multi-purpose cAMP targets. , 2006, Trends in biochemical sciences.

[114]  Jitendra Malik,et al.  Figure/Ground Assignment in Natural Images , 2006, ECCV.

[115]  S. Rossie,et al.  Identification of the sites of selective phosphorylation and dephosphorylation of the rat brain Na+ channel alpha subunit by cAMP-dependent protein kinase and phosphoprotein phosphatases. , 1993, The Journal of biological chemistry.

[116]  Christian Griesinger,et al.  Modular architecture of Munc13/calmodulin complexes: dual regulation by Ca2+ and possible function in short‐term synaptic plasticity , 2010, The EMBO journal.

[117]  F. Deschenes,et al.  Detection of lines, line junctions and line terminations , 2004 .

[118]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[119]  T. Shibasaki,et al.  Critical Role of cAMP-GEFII·Rim2 Complex in Incretin-potentiated Insulin Secretion* , 2001, The Journal of Biological Chemistry.

[120]  Thomas C. Südhof,et al.  The role of Rab3A in neurotransmitter release , 1994, Nature.

[121]  Han Wang,et al.  Real-time corner detection algorithm for motion estimation , 1995, Image Vis. Comput..

[122]  Robert C. Bolles,et al.  Locating Partially Visible Objects: The Local Feature Focus Method , 1980, AAAI.

[123]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[124]  K. Jakobs,et al.  A new phospholipase-C–calcium signalling pathway mediated by cyclic AMP and a Rap GTPase , 2001, Nature Cell Biology.

[125]  W. Freeman Steerable filters and local analysis of image structure , 1992 .

[126]  Hans P. Morevec Towards automatic visual obstacle avoidance , 1977, IJCAI 1977.

[127]  Tony Lindeberg,et al.  Segmentation and Classification of Edges Using Minimum Description Length Approximation and Complementary Junction Cues , 1996, Comput. Vis. Image Underst..

[128]  C F Stevens,et al.  Increased transmitter release at excitatory synapses produced by direct activation of adenylate cyclase in rat hippocampal slices , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[129]  Tony Lindeberg,et al.  Junction detection with automatic selection of detection scales and localization scales , 1994, Proceedings of 1st International Conference on Image Processing.

[130]  Thomas C. Südhof,et al.  RIM Proteins Tether Ca2+ Channels to Presynaptic Active Zones via a Direct PDZ-Domain Interaction , 2011, Cell.

[131]  Frédéric Cao,et al.  Good continuations in digital image level lines , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[132]  Carmen W. Dessauer,et al.  Physiological Roles for G Protein-Regulated Adenylyl Cyclase Isoforms: Insights from Knockout and Overexpression Studies , 2008, Neurosignals.

[133]  Marino Zerial,et al.  Rab proteins as membrane organizers , 2001, Nature Reviews Molecular Cell Biology.

[134]  Miguel Cazorla,et al.  Two Bayesian methods for junction classification , 2003, IEEE Trans. Image Process..

[135]  S. M. Steve SUSAN - a new approach to low level image processing , 1997 .

[136]  Jae-Hoon Bae,et al.  Glucagon-like peptide-1 enhances glucokinase activity in pancreatic β-cells through the association of Epac2 with Rim2 and Rab3A. , 2012, Endocrinology.

[137]  S. Thompson,et al.  Presynaptic enhancement of inhibitory synaptic transmission by protein kinases A and C in the rat hippocampus in vitro , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[138]  Karl Rohr,et al.  Recognizing corners by fitting parametric models , 1992, International Journal of Computer Vision.

[139]  Wolfgang Förstner,et al.  Coding Images with Local Features , 2010, International Journal of Computer Vision.

[140]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[141]  Jean-Michel Morel,et al.  Junction detection and filtering: a morphological approach , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[142]  Laxmi Parida,et al.  Visual organization for figure/ground separation , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[143]  Nils Brose,et al.  Munc13-1 Is a Presynaptic Phorbol Ester Receptor that Enhances Neurotransmitter Release , 1998, Neuron.

[144]  Pietro Perona Steerable-scalable kernels for edge detection and junction analysis , 1992, Image Vis. Comput..

[145]  Miguel Cazorla,et al.  Junction detection and grouping with probabilistic edge models and Bayesian A , 2002, Pattern Recognit..

[146]  R. Shigemoto,et al.  The Inhibition of Glutamate Release by Metabotropic Glutamate Receptor 7 Affects Both [Ca2+] c and cAMP , 2002, The Journal of Biological Chemistry.

[147]  Julie Delon,et al.  An accurate and contrast invariant junction detector , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).