Synchronized High-Speed Vision Sensor Network for Expansion of Field of View †

We propose a 500-frames-per-second high-speed vision (HSV) sensor network that acquires frames at a timing that is precisely synchronized across the network. Multiple vision sensor nodes, individually comprising a camera and a PC, are connected via Ethernet for data transmission and for clock synchronization. A network of synchronized HSV sensors provides a significantly expanded field-of-view compared with that of each individual HSV sensor. In the proposed system, the shutter of each camera is controlled based on the clock of the PC locally provided inside the node, and the shutters are globally synchronized using the Precision Time Protocol (PTP) over the network. A theoretical analysis and experiment results indicate that the shutter trigger skew among the nodes is a few tens of microseconds at most, which is significantly smaller than the frame interval of 1000-fps-class high-speed cameras. Experimental results obtained with the proposed system comprising four nodes demonstrated the ability to capture the propagation of a small displacement along a large-scale structure.

[1]  Derek Bradley,et al.  Synchronization and rolling shutter compensation for consumer video camera arrays , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[2]  Ryad Benosman,et al.  Event-Driven Stereo Visual Tracking Algorithm to Solve Object Occlusion , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[3]  M. Branicky,et al.  Design Considerations for Software Only Implementations of the IEEE 1588 Precision Time Protocol , 2005 .

[4]  Masatoshi Ishikawa,et al.  High-speed gaze controller for millisecond-order pan/tilt camera , 2011, 2011 IEEE International Conference on Robotics and Automation.

[5]  Maria Q. Feng,et al.  A Vision-Based Sensor for Noncontact Structural Displacement Measurement , 2015, Sensors.

[6]  Masatoshi Ishikawa,et al.  A networked high-speed vision system for vehicle tracking , 2014, 2014 IEEE Sensors Applications Symposium (SAS).

[7]  Masatoshi Ishikawa,et al.  Frame synchronization for networked high-speed vision systems , 2014, IEEE SENSORS 2014 Proceedings.

[8]  Masatoshi Ishikawa,et al.  High-speed 3D sensing with three-view geometry using a segmented pattern , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Koichi Hashimoto,et al.  Two-dimensional tracking of a motile micro-organism allowing high-resolution observation with various imaging techniques , 2005 .

[10]  Masatoshi Ishikawa,et al.  A High-Speed and Compact Vision System Suitable for Wearable Man-machine Interfaces , 2007, MVA.

[11]  Eugenio Culurciello,et al.  Activity-driven, event-based vision sensors , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[12]  Koichi Hashimoto,et al.  Illumination-based real-time contactless synchronization of high-speed vision sensors , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[13]  Akio Namiki,et al.  1-ms sensory-motor fusion system , 2000 .

[14]  George A. Triantafyllidis,et al.  Synchronous Image Acquisition based on Network Synchronization , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[15]  Masatoshi Ishikawa,et al.  Development of Motion-Blur-Compensated High-Speed Moving Visual Inspection Vehicle for Tunnels , 2016 .

[16]  Eugene Serabyn,et al.  A Mach-Zender digital holographic microscope with sub-micrometer resolution for imaging and tracking of marine micro-organisms. , 2014, The Review of scientific instruments.

[17]  Géza Schay Introduction to probability with statistical applications , 2007 .

[18]  Masatoshi Ishikawa,et al.  Target tracking behind occlusions using a networked high-speed vision system , 2014, IEEE SENSORS 2014 Proceedings.