Frame Synchronization of High-Speed Vision Sensors with Temporally Modulated Illumination in Highly Dynamic Scenes

Abstract — The authors propose an original camera synchronization technique to generate temporally-aligned vision frames during image acquisition, based on phase-locked loop (PLL), and is applicable to low-cost wireless vision sensor networks. No dedicated receivers are required so that the algorithm is applicable to vision sensors with only data storage for image or image-feature sequences. A Manchester Encoding inspired illumination modulation method can carry sequential information owing to serial communication, as well as satisfactory robustness to disturbances, such as mobile targets, fluctuating illumination amplitude, and moving cameras, etc., approved by experiments that a 1,000-Hz vision sensor is locked to 500-Hz modulated LED illumination with only 24- μ s jitters.

[1]  Geert Leus,et al.  Digital Receiver Design for Transmitted Reference Ultra-Wideband Systems , 2009, EURASIP J. Wirel. Commun. Netw..

[2]  Koichi Hashimoto,et al.  A Signal Normalization Technique for Illumination-Based Synchronization of 1,000-fps Real-Time Vision Sensors in Dynamic Scenes , 2010, Sensors.

[3]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[4]  Pansoo Kim,et al.  Robust Frame Synchronization for Low Signal-to-Noise Ratio Channels Using Energy-Corrected Differential Correlation , 2009, EURASIP J. Wirel. Commun. Netw..

[5]  Lior Wolf,et al.  Correspondence-free Synchronization and Reconstruction in a Non-rigid Scene , 2004 .

[6]  Moe Z. Win,et al.  Frame Synchronization for Variable-Length Packets , 2008, IEEE Journal on Selected Areas in Communications.

[7]  George A. Triantafyllidis,et al.  Synchronous Image Acquisition based on Network Synchronization , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[8]  Koichi Hashimoto,et al.  Illumination-Based Synchronization of High-Speed Vision Sensors , 2010, Sensors.

[9]  Koichi Hashimoto,et al.  Frame indexing of the illumination-based synchronized high-speed vision sensors , 2010, 2010 IEEE/SICE International Symposium on System Integration.

[10]  M. Ishikawa,et al.  A high-speed vision system with in-pixel programmable ADCs and PEs for real-time visual sensing , 2004, The 8th IEEE International Workshop on Advanced Motion Control, 2004. AMC '04..

[11]  Lajos Hanzo,et al.  Orthogonal frequency division multiplex synchronisation techniques for wireless local area networks , 1996, Proceedings of PIMRC '96 - 7th International Symposium on Personal, Indoor, and Mobile Communications.

[12]  Song Guo,et al.  A Flexible and Efficient Key Distribution Scheme for Renewable Wireless Sensor Networks , 2009, EURASIP J. Wirel. Commun. Netw..

[13]  Lihua Li,et al.  DFT-Based Channel Estimation with Symmetric Extension for OFDMA Systems , 2009, EURASIP J. Wirel. Commun. Netw..

[14]  Masatoshi Ishikawa,et al.  A Pixel-Parallel Algorithm for Detecting and Tracking Fast-Moving Modulated Light Signals , 2005, J. Robotics Mechatronics.

[15]  John M. Cioffi,et al.  Spatio-temporal coding for wireless communication , 1998, IEEE Trans. Commun..

[16]  Timos K. Sellis,et al.  Spatio-temporal composition and indexing for large multimedia applications , 1998, Multimedia Systems.

[17]  Tan F. Wong,et al.  Timing acquisition in ultra-wideband communication systems , 2005, IEEE Transactions on Vehicular Technology.