Color tracking for multiple robot control using a system-on-programmable-chip

Abstract A new trend in construction is the emerging technologies to accommodate personal indoor robots moving among occupants and assisting them. In many circumstances, the coordination of multiple robots is required for task execution, whereby it is important to cooperatively control robots to navigate in a desired formation. For this, real-time information of each robot's location can be made available via the use of computer vision technologies. This paper presents the development of a digital camera surveillance system that can track color tags of moving robots in an indoor environment. The system, which comprises image demosaicking, color detection, relative distance estimation and moving object tracking, is designed for controlling a number of miniature robots, utilizing the system-on-programmable-chip technology. Here, essential issues of real-time computation and low power consumption are simultaneously resolved with register-transfer level and gate circuits. Experimental results are provided for verification. An emphasis is given to construction applications.

[1]  Mun-Kyu Lee,et al.  User Authentication Based on Distance Estimation Using Ultrasonic Sensors , 2008, 2008 International Conference on Computational Intelligence and Security.

[2]  Behrokh Khoshnevis,et al.  Automated construction by contour craftingrelated robotics and information technologies , 2004 .

[3]  Dong Hun Shin,et al.  Open-loop Velocity Control of Concrete Floor Finishing Robots , 2003, J. Intell. Robotic Syst..

[4]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[5]  Jong-Hoon Youn,et al.  Performance Tests for Wireless Real-Time Localization Systems to Improve Mobile Robot Navigation in Various Indoor Environments , 2008 .

[6]  Bernd Jähne,et al.  A theoretical and experimental investigation of the systematic errors and statistical uncertainties of Time-Of-Flight-cameras , 2008, Int. J. Intell. Syst. Technol. Appl..

[7]  Dimitrios Hatzinakos,et al.  Color image zooming on the Bayer pattern , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Vijay Kumar,et al.  A Framework and Architecture for Multi-Robot Coordination , 2000, ISER.

[9]  R. D'Andrea,et al.  Future challenges of coordinating hundreds of autonomous vehicles in distribution facilities , 2008, 2008 IEEE International Conference on Technologies for Practical Robot Applications.

[10]  Carlos Balaguer.  Towards Robotic Smart Home , 2007 .

[11]  Florent de Dinechin,et al.  Floating-Point Trigonometric Functions for FPGAs , 2007, 2007 International Conference on Field Programmable Logic and Applications.

[12]  Stergios I. Roumeliotis,et al.  3D relative pose estimation from distance-only measurements , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  A. Stubbs,et al.  Multivehicle systems control over networks: a hovercraft testbed for networked and decentralized control , 2006, IEEE Control Systems.

[14]  Sangwook Lee,et al.  Automated recognition of surface defects using digital color image processing , 2006 .

[15]  Tieniu Tan,et al.  A real-time object detecting and tracking system for outdoor night surveillance , 2008, Pattern Recognit..

[16]  Ronie Navon,et al.  Monitoring labor inputs: automated-data-collection model and enabling technologies , 2003 .

[17]  Roger V. Bostelman,et al.  Adapting a teleoperated device for autonomous control using three-dimensional positioning sensors: experiences with the NIST RoboCrane ☆ , 2004 .

[18]  Zachary Dodds,et al.  Evaluating the Roomba: A low-cost, ubiquitous platform for robotics research and education , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[19]  Carlos Balaguer,et al.  A mechatronics security system for the construction site , 2003 .

[20]  Quang Phuc Ha,et al.  FPGA-Based Relative Distance Estimation for Indoor Robot Control Using Monocular Digital Camera , 2010, J. Adv. Comput. Intell. Intell. Informatics.

[21]  Jong-Won Seo,et al.  PROTOTYPING AND AUTOMATING A CONCRETE SURFACE GRINDING MACHINE FOR IMPROVING INFRASTRUCTURE CONDITIONS , 2006 .

[22]  Touradj Ebrahimi,et al.  Shadow identification and classification using invariant color models , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[23]  Weisi Lin,et al.  Demosaicing with improved edge direction detection , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[24]  Weizhong Zhang,et al.  An Autonomous Mobile Robotics Testbed: Construction, Validation, and Experiments , 2010, IEEE Transactions on Control Systems Technology.

[25]  Patricio A. Vela,et al.  Personnel tracking on construction sites using video cameras , 2009, Adv. Eng. Informatics.

[26]  William A. Sethares,et al.  Distance Estimation Using Bidirectional Communications Without Synchronous Clocking , 2007, IEEE Transactions on Signal Processing.

[27]  Chimay J. Anumba,et al.  Ubiquitous location tracking for context-specific information delivery on construction sites , 2008 .

[28]  Shiqing Ren,et al.  Separating Reflection Components of Smooth Metallic Surface Using Special Random Sampling Method , 2008, 2008 3rd International Conference on Innovative Computing Information and Control.

[29]  Luh-Maan Chang,et al.  Automated bridge coating defect recognition using adaptive ellipse approach , 2009 .

[30]  Tomohiro Yoshida,et al.  Application of RFID technology to prevention of collision accident with heavy equipment , 2010 .

[31]  Tinku Acharya,et al.  Image Processing: Principles and Applications , 2005, J. Electronic Imaging.

[32]  David Arditi,et al.  USING COLORS TO DETECT STRUCTURAL COMPONENTS IN DIGITAL PICTURES , 2002 .

[33]  J. Mashford,et al.  A morphological approach to pipe image interpretation based on segmentation by support vector machine , 2010 .

[34]  Paul M. Goodrum,et al.  Assessing the impact of materials tracking technologies on construction craft productivity , 2009 .

[35]  Carlos Balaguer,et al.  Robotics and Automation in Construction , 2008 .

[36]  Q. P. Ha,et al.  Chip-Based Design for Real-Time Moving Object Detection Using a Digital Camera Module , 2009, 2009 2nd International Congress on Image and Signal Processing.

[37]  Mark S. Nixon,et al.  Feature Extraction and Image Processing , 2002 .