Fast Motion Object Detection Algorithm Using Complementary Depth Image on an RGB-D Camera

Stereo vision has become a popular topic in recent years, especially in-depth images from stereo vision. Depth information can be extracted either from a dual camera or RGB-D camera. In image processing, the realization of object detection is only based on the color information or depth images separately; however, both have advantages and disadvantages. Therefore, many researchers have combined them together to achieve better results. A new fast motion object-detection algorithm is presented based on the complementary depth images and color information, which is able to detect motion objects without background noise. The experiment results show that the proposed fast object detection algorithm can achieve 84.4% of the segmentation accuracy rate on average with a 45 FPS computation speed on an embedded platform.

[1]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[2]  Hong Liu,et al.  Depth Motion Detection—A Novel RS-Trigger Temporal Logic based Method , 2014, IEEE Signal Processing Letters.

[3]  Jenq-Neng Hwang,et al.  Tracking Live Fish From Low-Contrast and Low-Frame-Rate Stereo Videos , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Antonios Gasteratos,et al.  Efficient hierarchical matching algorithm for processing uncalibrated stereo vision images and its hardware architecture , 2011 .

[5]  Massimo Bertozzi,et al.  Vehicle detection by means of stereo vision-based obstacles features extraction and monocular pattern analysis , 2006, IEEE Transactions on Image Processing.

[6]  Yong Pei,et al.  Multilevel Depth and Image Fusion for Human Activity Detection , 2013, IEEE Transactions on Cybernetics.

[7]  Igor Tishchenko,et al.  The concept of video surveillance system based on the principles of stereo vision , 2016, 2016 18th Conference of Open Innovations Association and Seminar on Information Security and Protection of Information Technology (FRUCT-ISPIT).

[8]  Mohan M. Trivedi,et al.  On Color-, Infrared-, and Multimodal-Stereo Approaches to Pedestrian Detection , 2007, IEEE Transactions on Intelligent Transportation Systems.

[9]  Young Hoon Joo,et al.  Fast and robust algorithm of tracking multiple moving objects for intelligent video surveillance systems , 2011, IEEE Transactions on Consumer Electronics.

[10]  Bernhard Rinner,et al.  Design of a heterogeneous, energy-aware, stereo-vision based sensing platform for traffic surveillance , 2011, 2011 Proceedings of the Ninth International Workshop on Intelligent Solutions in Embedded Systems.

[11]  Siu-Yeung Cho,et al.  Window-based approach for fast stereo correspondence , 2013, IET Comput. Vis..

[12]  Dongxiao Li,et al.  Full-Image Guided Filtering for Fast Stereo Matching , 2013, IEEE Signal Processing Letters.

[13]  Peter H. N. de With,et al.  Employing a RGB-D sensor for real-time tracking of humans across multiple re-entries in a smart environment , 2012, IEEE Transactions on Consumer Electronics.

[14]  Lynne E. Parker,et al.  Real-Time Multiple Human Perception With Color-Depth Cameras on a Mobile Robot , 2013, IEEE Transactions on Cybernetics.

[15]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[16]  Yajun Fang,et al.  Depth-based target segmentation for intelligent vehicles: fusion of radar and binocular stereo , 2002, IEEE Trans. Intell. Transp. Syst..