Dual-band stereo vision based on heterogeneous sensor networks

This paper presents an approach of dual-band imagery based on heterogeneous sensor network which consists of infrared and optical sensors, and our approach of imaging reconstructs the three-dimensional shapes of the objects in some special environments such as smog, darkness, glare and so forth. Two dichroic mirrors are used for the construction of the binocular stereo vision system which consists of two optical (visible) and two infrared cameras. We make use of the complementarity between infrared and visible images to form two fused images as the source images of the stereo vision system. A stereo matching algorithm based on dual-band images is proposed as well. We use the gray, gradient direction and gradient magnitude of the pixels taken from the two bands of images to compute the disparity value of each pixel. Experiments show that the stereo matching algorithm is robust and not sensitive to the environmental variations. As a result, the dual-band stereo vision system has a good support for the target recognitions and measurements in different environments, such as all-weather traffic monitoring, searching and rescuing in fires, and so forth. We present an approach of dual-band imagery based on heterogeneous sensor network.A stereo vision system based on visible and infrared dual-band is designed.Our approach can reconstruct the three-dimensional shapes in special environments.A stereo matching algorithm based on dual-band images is proposed.

[1]  T. Farr,et al.  Geologic interpretation from composited radar and Landsat imagery , 1979 .

[2]  Qilian Liang,et al.  Sensor placement and lifetime of wireless sensor networks: theory and performance analysis , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[3]  Lu Fang,et al.  Stereo Matching with Optimal Local Adaptive Radiometric Compensation , 2015, IEEE Signal Processing Letters.

[4]  Wen-Hsiang Tsai,et al.  Optimal Design and Placement of Omni-Cameras in Binocular Vision Systems for Accurate 3-D Data Measurement , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  V. Grayson CuQlock-Knopp,et al.  Navigation through fog using stereoscopic active imaging , 2000, Defense, Security, and Sensing.

[6]  Saad M. Darwish,et al.  Multi-level fuzzy contourlet-based image fusion for medical applications , 2013, IET Image Process..

[7]  Qilian Liang,et al.  Radar Sensor Wireless Channel Modeling in Foliage Environment: UWB Versus Narrowband , 2011, IEEE Sensors Journal.

[8]  Peng Zhao,et al.  Precise perimeter measurement for 3D object with a binocular stereo vision measurement system , 2010 .

[9]  E. Micheli-Tzanakou,et al.  Medical imaging fusion applications: An overview , 2001, Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat.No.01CH37256).

[10]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Qilian Liang,et al.  Throughput and Energy-Efficiency-Aware Protocol for Ultrawideband Communication in Wireless Sensor Networks: A Cross-Layer Approach , 2008, IEEE Transactions on Mobile Computing.

[12]  Xin Wang,et al.  On the Throughput Capacity and Performance Analysis of Hybrid Wireless Networks over Fading Channels , 2013, IEEE Transactions on Wireless Communications.

[13]  Joseph W. Starr,et al.  A comparison of IR stereo vision and LIDAR for use in fire environments , 2012, 2012 IEEE Sensors.

[14]  Emmanuel G. Collins,et al.  Efficient Path-Based Stereo Matching With Subpixel Accuracy , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Yiming Pi,et al.  TDoA for Passive Localization: Underwater versus Terrestrial Environment , 2013, IEEE Transactions on Parallel and Distributed Systems.

[16]  Qilian Liang,et al.  Automatic target recognition using waveform diversity in radar sensor networks , 2008, Pattern Recognit. Lett..

[17]  Xiuzhen Cheng,et al.  Opportunistic Sensing in Wireless Sensor Networks: Theory and Application , 2014, IEEE Trans. Computers.

[18]  Qilian Liang,et al.  Fault-tolerant and energy efficient cross-layer design for wireless sensor networks , 2007, Int. J. Sens. Networks.

[19]  Q. Liang,et al.  Situation Understanding Based on Heterogeneous Sensor Networks and Human-Inspired Favor Weak Fuzzy Logic System , 2011, 2009 IEEE International Conference on Communications.

[20]  Hai Jin,et al.  Color Image Segmentation Based on Mean Shift and Normalized Cuts , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).