A Signal Normalization Technique for Illumination-Based Synchronization of 1,000-fps Real-Time Vision Sensors in Dynamic Scenes

To acquire images of dynamic scenes from multiple points of view simultaneously, the acquisition time of vision sensors should be synchronized. In this paper, an illumination-based synchronization derived from the phase-locked loop (PLL) mechanism based on the signal normalization method is proposed and evaluated. To eliminate the system dependency due to the amplitude fluctuation of the reference illumination, which may be caused by the moving objects or relative positional distance change between the light source and the observed objects, the fluctuant amplitude of the reference signal is normalized framely by the estimated maximum amplitude between the reference signal and its quadrature counterpart to generate a stable synchronization in highly dynamic scenes. Both simulated results and real world experimental results demonstrated successful synchronization result that 1,000-Hz frame rate vision sensors can be successfully synchronized to a LED illumination or its reflected light with satisfactory stability and only 28-μs jitters.

[1]  Roland E. Best Phase-locked loops : design, simulation, and applications , 2003 .

[2]  Masatoshi Ishikawa,et al.  An Image-Moment Sensor with Variable-Length Pipeline Structure , 2007, IEICE Trans. Electron..

[3]  Gyula Simon,et al.  The flooding time synchronization protocol , 2004, SenSys '04.

[4]  Fikret Sivrikaya,et al.  Time synchronization in sensor networks: a survey , 2004, IEEE Network.

[5]  Hironobu Fujiyoshi,et al.  Fast 3D position measurement with two unsynchronized cameras , 2003, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694).

[6]  Masao Nakagawa,et al.  Performance evaluation of visible-light wireless communication system using white LED lightings , 2004, Proceedings. ISCC 2004. Ninth International Symposium on Computers And Communications (IEEE Cat. No.04TH8769).

[7]  Piyush Rai,et al.  A Cost-effective Multiple Camera Vision System using FireWire Cameras and Software Synchronization , 2004 .

[8]  M. Ishikawa,et al.  A QVGA-Size Pixel-Parallel Image Processor for 1,000-fps Vision , 2009, IEEE Micro.

[9]  S. Ando,et al.  Correlation image sensor: two-dimensional matched detection of amplitude-modulated light , 2003 .

[10]  Koichi Hashimoto,et al.  Performance Evaluation of Illumination-based Synchronization of High-Speed Vision Sensors in Dynamic Scenes , 2010 .

[11]  Koichi Hashimoto,et al.  Illumination-Based Synchronization of High-Speed Vision Sensors , 2010, Sensors.

[12]  Saurabh Ganeriwal,et al.  Timing-sync protocol for sensor networks , 2003, SenSys '03.

[13]  George A. Triantafyllidis,et al.  Synchronous Image Acquisition based on Network Synchronization , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[14]  Masao Nakagawa,et al.  Indoor Visible Light Data Transmission System Utilizing White LED Lights , 2003 .

[15]  Koichi Hashimoto,et al.  An Advanced Algorithm for Illumination-Based Synchronization of High-Speed Vision Sensors in Dynamic Scenes , 2010, ICIRA.

[16]  Keiichiro Kagawa,et al.  An image sensor with an in-pixel demodulation function for detecting the intensity of a modulated light signal , 2003 .

[17]  Deborah Estrin,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Fine-grained Network Time Synchronization Using Reference Broadcasts , 2022 .

[18]  M. Ishikawa,et al.  A high-speed vision system with in-pixel programmable ADCs and PEs for real-time visual sensing , 2004, The 8th IEEE International Workshop on Advanced Motion Control, 2004. AMC '04..

[19]  M. L. Meade,et al.  Advances in lock-in amplifiers , 1982 .