Soft Synchronization: Synchronization for Network-Connected Machine Vision Systems

Many computer vision applications require synchronization between image acquisition and external trigger events. Hardware and software triggering are widely used but have several limitations. Soft synchronization is investigated, which operates by time tagging both trigger events and images in a video stream and selecting the image corresponding to each trigger event. A stochastic model is developed for soft synchronization; and, based on the model, the uncertainty interval and confidence for correct image selection are determined, and an efficient calibration method is derived. Soft synchronization is experimentally demonstrated on a Linux image processing computer with a camera connected by the IEEE-1394 serial bus. To minimize timing variability, time tags are associated with images and events in the corresponding interrupt service routines within the operating system of the image processing computer. The model-based analysis applied to the experimental hardware shows that image/event synchronization within inter-frame interval can be achieved with 99% confidence. Experiments confirm this result.

[1]  Kang Lee,et al.  IEEE 1588 standard for a precision clock synchronization protocol for networked measurement and control systems , 2002, 2nd ISA/IEEE Sensors for Industry Conference,.

[2]  Tor Skeie,et al.  Timeliness of real-time IP communication in switched industrial Ethernet networks , 2006, IEEE Transactions on Industrial Informatics.

[3]  Nasser Kehtarnavaz,et al.  Proceedings of SPIE - The International Society for Optical Engineering , 1991 .

[4]  Kang B. Lee,et al.  Standard for a Precision Clock Synchronization Protocol for Networked Measurement and Control Systems , 2004 .

[5]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[6]  M. Whitehorn,et al.  Stereo vision in LHD automation , 2001, Conference Record of the 2001 IEEE Industry Applications Conference. 36th IAS Annual Meeting (Cat. No.01CH37248).

[7]  R. L. Horst,et al.  Vision system for high-resolution dimensional measurements and on-line SPC: web process application , 1992 .

[8]  Dawn M. Tilbury,et al.  PLC Communication using PROFINET: Experimental Results and Analysis , 2006, 2006 IEEE Conference on Emerging Technologies and Factory Automation.

[9]  Andrey V. Savkin,et al.  Robust Video/Ultrasonic Fusion-Based Estimation for Automotive Applications , 2007, IEEE Transactions on Vehicular Technology.

[10]  A. Iqbal,et al.  Evaluation of real-time delays for networked telerobotics , 2005, INDIN '05. 2005 3rd IEEE International Conference on Industrial Informatics, 2005..

[11]  Werner von Seelen,et al.  Image processing and behavior planning for intelligent vehicles , 2003, IEEE Trans. Ind. Electron..

[12]  Javier Silvestre-Blanes,et al.  Multimedia applications in industrial networks: integration of image processing in Profibus , 2003, IEEE Trans. Ind. Electron..

[13]  L. Atchison.  Firewire: standard computer industry interconnect for test & measurement , 1999 .

[14]  Ieee Standards Board.  IEEE Standard for a High Performance Serial Bus-Amendment 1 , 2000 .

[15]  Bernardo Wagner,et al.  RTnet - a flexible hard real-time networking framework , 2005, 2005 IEEE Conference on Emerging Technologies and Factory Automation.

[16]  A. Flammini,et al.  Experimental evaluation of PROFINET performance , 2004, IEEE International Workshop on Factory Communication Systems, 2004. Proceedings..

[17]  Jürgen Jasperneite,et al.  PROFINET: an integration platform for heterogeneous industrial communication systems , 2005, 2005 IEEE Conference on Emerging Technologies and Factory Automation.

[18]  Onur Toker,et al.  A 3-D vision-based man-machine interface for hand-controlled telerobot , 2005, IEEE Transactions on Industrial Electronics.

[19]  J. Samitier,et al.  Practical evaluation of messages latencies in CAN , 2003, EFTA 2003. 2003 IEEE Conference on Emerging Technologies and Factory Automation. Proceedings (Cat. No.03TH8696).

[20]  R. Santamaria.  IEEE-1394: a standard for the next millenium , 1999, Gateway to the New Millennium. 18th Digital Avionics Systems Conference. Proceedings (Cat. No.99CH37033).

[21]  P. Dallemagne,et al.  An application layer for using Firewire in industrial applications , 2000, 2000 IEEE International Workshop on Factory Communication Systems. Proceedings (Cat. No.00TH8531).

[22]  Uwe Schelinski,et al.  IEEE 1394 "FireWire" system design for industrial and factory automation applications , 2001, ETFA 2001. 8th International Conference on Emerging Technologies and Factory Automation. Proceedings (Cat. No.01TH8597).

[23]  I. J. Wickelgren.  The facts about FireWire [serial communication bus] , 1997 .