Using machine learning and computer vision to estimate the angular velocity of wind turbines in smart grids remotely

Abstract Today, power generation from clean and renewable resources such as wind and solar is of great salience. Smart grid technology efficiently responds to the increasing demand for electric power. Intelligent monitoring, control, and maintenance of wind energy facilities are indispensable to increase the performance and efficiency of smart grids (SGs). Integration of state-of-the-art machine learning algorithms and vision sensor networks approaches pave the way toward enhancing the wind farms’ performance. The generating power in a wind turbine farm is the most critical parameter that should be measured accurately. Produced power is highly related to weather patterns, and a new farm in a near area is also likely to have similar energy generation. Therefore, accurate and perpetual prediction models of the existing wind farms can be led to develop new stations with lower costs. The paper aims to estimate the angular velocity of turbine blades using vision sensors and signal processing. The high wind in the wind farm can cause the camera to vibrate in successive frames, and the noise in the input images can also strengthen the problem. Thanks to couples of solid computer vision algorithms, including FAST (Features from Accelerated Segment Test), SIFT (Scale-Invariant Feature Transform), SURF (Speeded Up Robust Features), BF (Brute-Force), FLANN (Fast Library for Approximate Nearest Neighbors), AE (Autoencoder), and SVM (support vector machines), this paper accurately localizes the Hub and track the presence of the Blade in consecutive frames of a video stream. The simulation results show that determining the hub location and the blade presence in sequential frames results in an accurate estimation of wind turbine angular velocity with 95.36% accuracy.

[1]  Jianmin Dong,et al.  Mobile User Indoor-Outdoor Detection through Physical Daily Activities , 2019, Sensors.

[2]  Arthur A. Goshtasby,et al.  An Autoencoder-Based Image Descriptor for Image Matching and Retrieval , 2016 .

[3]  Osama A. Mohammed,et al.  A Survey on Smart Grid Cyber-Physical System Testbeds , 2017, IEEE Communications Surveys & Tutorials.

[4]  Hussein T. Mouftah,et al.  Wireless Sensor Networks for Cost-Efficient Residential Energy Management in the Smart Grid , 2011, IEEE Transactions on Smart Grid.

[5]  Christopher Durugbo,et al.  Performance assessment of wind turbine gearboxes using in-service data: Current approaches and future trends , 2015 .

[6]  Marina Gashinova,et al.  Road Edge Recognition Using the Stripe Hough Transform From Millimeter-Wave Radar Images , 2015, IEEE Transactions on Intelligent Transportation Systems.

[7]  R. K. Agrawal,et al.  An Introductory Study on Time Series Modeling and Forecasting , 2013, ArXiv.

[8]  Jian Zhao,et al.  Recognition of Windmills in Remote Sensing Image By SVM and Morphological Attribute Filters , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[9]  Wei Wang,et al.  Generalized Autoencoder: A Neural Network Framework for Dimensionality Reduction , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Martin Reisslein,et al.  Integrating Renewable Energy Resources into the Smart Grid: Recent Developments in Information and Communication Technologies , 2018, IEEE Transactions on Industrial Informatics.

[11]  Javad Mohammadi,et al.  Novel Approach for Baseline Detection and Text Line Segmentation , 2012 .

[12]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[13]  Mayorkinos Papaelias,et al.  Wind turbine reliability analysis , 2013 .

[14]  Vehbi C. Gungor,et al.  Online and Remote Motor Energy Monitoring and Fault Diagnostics Using Wireless Sensor Networks , 2009, IEEE Transactions on Industrial Electronics.

[15]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[16]  Gerhard P. Hancke,et al.  Industrial Wireless Sensor Networks: Challenges, Design Principles, and Technical Approaches , 2009, IEEE Transactions on Industrial Electronics.

[17]  Rudra Prakash Maheshwari,et al.  Wavelet-based Fault Classification Scheme for a Transmission Line Using a Support Vector Machine , 2008 .

[18]  Mahdi Bahaghighat,et al.  PSNR Enhancement in Image Streaming over Cognitive Radio Sensor Networks , 2017 .

[19]  David G. Lowe,et al.  Scalable Nearest Neighbor Algorithms for High Dimensional Data , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Naeim Karimimehr,et al.  Fingerprint image enhancement using Gabor wavelet transform , 2010, 2010 18th Iranian Conference on Electrical Engineering.

[21]  Robert C. Green,et al.  Intrusion Detection System in A Multi-Layer Network Architecture of Smart Grids by Yichi , 2015 .

[22]  Thomas Quatieri,et al.  Discrete-Time Speech Signal Processing: Principles and Practice , 2001 .

[23]  Banshidhar Majhi,et al.  Brain MR image classification using two-dimensional discrete wavelet transform and AdaBoost with random forests , 2016, Neurocomputing.

[24]  Sevki Demirbas,et al.  Critical aspects of wind energy systems in smart grid applications , 2015 .

[25]  Ashfaqur Rahman,et al.  Wind power prediction in new stations based on knowledge of existing Stations: A cluster based multi source domain adaptation approach , 2018, Knowl. Based Syst..

[26]  Gerhard P. Hancke,et al.  Opportunities and Challenges of Wireless Sensor Networks in Smart Grid , 2010, IEEE Transactions on Industrial Electronics.

[27]  Hongxun Yao,et al.  Auto-encoder based dimensionality reduction , 2016, Neurocomputing.

[28]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[29]  Shuhui Li,et al.  Using neural networks to estimate wind turbine power generation , 2001 .

[30]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[31]  Jiajun Wen,et al.  A general moving detection method using dual-target nonparametric background model , 2019, Knowl. Based Syst..

[32]  Rudra Prakash Maheshwari,et al.  Fault classification technique for series compensated transmission line using support vector machine , 2010 .

[33]  Marcel Bonar Kristanda,et al.  Performance analysis of conventional moving average methods in forex forecasting , 2017, 2017 International Conference on Smart Cities, Automation & Intelligent Computing Systems (ICON-SONICS).

[34]  Ganapati Panda,et al.  Distance relaying for transmission line using support vector machine and radial basis function neural network , 2007 .

[35]  Saravanakumar Rajendran,et al.  A review of estimation of effective wind speed based control of wind turbines , 2015 .

[36]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[37]  Haimonti Dutta,et al.  Machine Learning for the New York City Power Grid , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  N. S. Marimuthu,et al.  Intelligent approaches using support vector machine and extreme learning machine for transmission line protection , 2010, Neurocomputing.

[39]  Mahdi Bahaghighat,et al.  A Machine Learning-Based Approach for Counting Blister Cards Within Drug Packages , 2019, IEEE Access.

[40]  Mahdi Bahaghighat,et al.  Wind turbine tower detection using feature descriptors and deep learning , 2020, Facta universitatis - series: Electronics and Energetics.

[41]  Fouad Slaoui-Hasnaoui,et al.  Wind Turbine Condition Monitoring: State-of-the-Art Review, New Trends, and Future Challenges , 2014 .

[42]  Ilker Mert,et al.  Estimating the energy production of the wind turbine using artificial neural network , 2015, Neural Computing and Applications.

[43]  Frank C. Lambert,et al.  A survey on communication networks for electric system automation , 2006, Comput. Networks.

[44]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Cansin Yaman Evrenosoglu,et al.  A Fault Classification and Localization Method for Three-Terminal Circuits Using Machine Learning , 2013, IEEE Transactions on Power Delivery.

[46]  Enrico Zio,et al.  Reliability assessment of generic geared wind turbines by GTST-MLD model and Monte Carlo simulation , 2015 .

[47]  Warren B. Powell,et al.  Adaptive Stochastic Control for the Smart Grid , 2011, Proceedings of the IEEE.

[48]  Mehdi Keshavarz Bahaghighat,et al.  Fingerprint image enhancement using GWT and DMF , 2010, 2010 2nd International Conference on Signal Processing Systems.

[49]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[50]  Fausto Pedro García Márquez,et al.  Linear and nonlinear features and machine learning for wind turbine blade ice detection and diagnosis , 2019, Renewable Energy.

[51]  Mahdi Bahaghighat,et al.  Image Transmission over Cognitive Radio Networks for Smart Grid Applications , 2019, Applied Sciences.

[52]  Mengyan Nie,et al.  Review of condition monitoring and fault diagnosis technologies for wind turbine gearbox , 2013 .

[53]  Hao-Tian Zhang,et al.  Monitoring system for smart grid , 2012, 2012 International Conference on Machine Learning and Cybernetics.

[54]  H. T. Mouftah,et al.  Wireless multimedia sensor and actor networks for the next generation power grid , 2011, Ad Hoc Networks.

[55]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[56]  Thierry Chateau,et al.  Joint hierarchical learning for efficient multi-class object detection , 2014, IEEE Winter Conference on Applications of Computer Vision.

[57]  Mahdi Bahaghighat,et al.  VISION INSPECTION AND MONITORING OF WIND TURBINE FARMS IN EMERGING SMART GRIDS , 2018 .

[58]  Vladimir Vapnik,et al.  Support-vector networks , 2004, Machine Learning.

[59]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[60]  Minping Jia,et al.  Intelligent fault diagnosis of rotating machinery using improved multiscale dispersion entropy and mRMR feature selection , 2019, Knowl. Based Syst..

[61]  Fangxing Li,et al.  A Smart Home Test Bed for Undergraduate Education to Bridge the Curriculum Gap From Traditional Power Systems to Modernized Smart Grids , 2015, IEEE Transactions on Education.

[62]  Yi Yang,et al.  A Survey on Technologies for Implementing Sensor Networks for Power Delivery Systems , 2007, 2007 IEEE Power Engineering Society General Meeting.

[63]  Mahdi Bahaghighat,et al.  Designing quality control system based on vision inspection in pharmaceutical product lines , 2018, 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET).

[64]  Nei Kato,et al.  An early warning system against malicious activities for smart grid communications , 2011, IEEE Network.

[65]  Ian F. Akyildiz,et al.  A survey on wireless sensor networks for smart grid , 2015, Comput. Commun..

[66]  Gordana Ivosev,et al.  Dimensionality reduction and visualization in principal component analysis. , 2008, Analytical chemistry.

[67]  Chao Liu,et al.  A novel adversarial learning framework in deep convolutional neural network for intelligent diagnosis of mechanical faults , 2019, Knowl. Based Syst..

[68]  Mahdi Bahaghighat,et al.  A new descriptor for UAV images mapping by applying discrete local radon , 2018, 2018 8th Conference of AI & Robotics and 10th RoboCup Iranopen International Symposium (IRANOPEN).

[69]  G. Panda,et al.  Fault Classification and Section Identification of an Advanced Series-Compensated Transmission Line Using Support Vector Machine , 2007, IEEE Transactions on Power Delivery.

[70]  Goran Nenadic,et al.  Machine learning methods for wind turbine condition monitoring: A review , 2019, Renewable Energy.

[71]  Mahdi Bahaghighat,et al.  Vision Inspection of Bottle Caps in Drink Factories Using Convolutional Neural Networks , 2019, 2019 IEEE 15th International Conference on Intelligent Computer Communication and Processing (ICCP).