Sensor Tag Detection, Tracking and Recognition for AR Application

Augmented reality (AR) applications are widely used in our world today. It may look at the first glance that AR is primarily used in entertainment and learning applications, but in fact, now big companies and corporations try to integrate AR technologies into their industrial processes. It reduces the number of unnecessary communication and increases the net profit of the company. Most companies use AR devices for frontend tasks and a server side for backend. This approach allows reducing the performance requirements for an AR device by implementing time-consuming operations on the powerful server. However, some operations should be implemented directly on the AR device and we have to implement them rationally in terms of performance. Also we have to make interaction between the AR device and a server more effectively. The most important and frequently used operations in AR applications are related to computer vision: image processing, objects detection, tracking and recognition. Therefore, it is important to compare the performance of these operations on AR devices and suggest those that will be implemented on the server side and on the AR device. This paper focuses on deciding these tasks for an AR client-side application for the Siemens company. This application provides a more effective way for monitoring the equipment at remote facilities. Different approaches for sensor tag detection and tracking on a real time video are considered and evaluated. The way for communication between the AR device and the server side is suggested

[1]  David S. Doermann,et al.  Text Detection and Recognition in Imagery: A Survey , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Andrew Y. Ng,et al.  Text Detection and Character Recognition in Scene Images with Unsupervised Feature Learning , 2011, 2011 International Conference on Document Analysis and Recognition.

[3]  Noman Islam,et al.  A Survey on Optical Character Recognition System , 2017, ArXiv.

[4]  Vikram Mutneja,et al.  Methods of Image Edge Detection: A Review , 2015 .

[5]  Alok Aggarwal,et al.  Automatic text recognition in natural scene and its translation into user defined language , 2014, 2014 International Conference on Parallel, Distributed and Grid Computing.

[6]  Ishpreet Singh,et al.  Comparison between Edge Detection Techniques , 2016 .

[7]  Ardeshir Goshtasby,et al.  On the Canny edge detector , 2001, Pattern Recognit..

[8]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[9]  M. Student,et al.  Sobel Edge Detection Algorithm , 2013 .

[10]  Horst Bischof,et al.  Efficient Maximally Stable Extremal Region (MSER) Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Ching-Tang Hsieh,et al.  Multiple license plate detection for complex background , 2005, 19th International Conference on Advanced Information Networking and Applications (AINA'05) Volume 1 (AINA papers).

[12]  Hamid Hassanpour,et al.  A neural network-based approach for recognizing multi-font printed English characters , 2015 .

[13]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[14]  Jiri Matas,et al.  Forward-Backward Error: Automatic Detection of Tracking Failures , 2010, 2010 20th International Conference on Pattern Recognition.

[15]  Simon Josefsson,et al.  The Base16, Base32, and Base64 Data Encodings , 2003, RFC.

[16]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Thomas M. Breuel Character recognition by adaptive statistical similarity , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[18]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[19]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Junichi Nakamura,et al.  Image Sensors and Signal Processing for Digital Still Cameras , 2005 .

[22]  Edward R. Dougherty,et al.  An introduction to morphological image processing , 1992 .

[23]  Michael Werman,et al.  Real-time object tracking from a moving video camera: a software approach on a PC , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[24]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[26]  Pierre Fite-Georgel,et al.  Is there a reality in Industrial Augmented Reality? , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[27]  Silvio Savarese,et al.  Learning to Track at 100 FPS with Deep Regression Networks , 2016, ECCV.

[28]  Sander Soo,et al.  Object detection using Haar-cascade Classifier , 2014 .

[29]  Dieter Schmalstieg,et al.  Towards Massively Multi-user Augmented Reality on Handheld Devices , 2005, Pervasive.

[30]  David S. Doermann,et al.  Automatic text detection and tracking in digital video , 2000, IEEE Trans. Image Process..

[31]  Xiangyu Wang,et al.  Research trends and opportunities of augmented reality applications in architecture, engineering, and construction , 2013 .