Reinforcement Learning Concepts Ministering Smart City Applications Using IoT

In deep learning, artificial intelligence does influence numerous sides of smart cities. Deep learning is an auspicious approach for extracting the exact information from raw sensor data from IoT devices deployed in complex environments. In that, self-learning machines tremor humanity in cities in the areas such as safety, transportation, healthiness, governance, and atmosphere. Smart city IoT structures are aimed at providing germ-free water, steady power, harmless gas, and streamlined and cost-effective open lighting. As smart urban communities free up assets by acutely running on dependable distribution, they can guarantee in various administrations to change of location deserving of life. Water and energy models are vital to each city, and smarter administration of them is the development for smart city using IoT. The main aim of deep learning is to resolve “natural” glitches which have been categorized by high dimension and no rubrics. With deep learning, computers can captivate from knowledge but similarly can understand the world in terms of a hierarchy of concepts, where each concept is well-defined in terms of simpler concepts. The hierarchy of thoughts is built “bottom up” without predefined rules. More specifically, a form of deep learning called reinforcement learning (RL) is based on a system of rewards. RL is a form of unsupervised learning, and an RL agent fascinates by an acquiescent incentive or reinforcement from its environment, without any form of supervision other than its own decision-making strategy. In machine learning, the atmosphere is characteristically expressed as a Markov decision process (MDP) as numerous reinforcement learning algorithms for this background use dynamic indoctrination methods. The key variance among the traditional procedures and reinforcement learning algorithms is that the conclusion does not require consciousness around the MDP, and they mark great MDPs where meticulous approaches become unfeasible. Reinforcement learning differs from standard supervised learning in that correct input/output pairs are never presented, nor suboptimal actions explicitly corrected. Additional, there is an emphasis on online presentation, which includes discovering an equilibrium amid examination (of uncharted territory) and manipulation (of current knowledge). A smart city needs technical competence in transportation, communique, security procedures, and planning infrastructure. In order to make cost-effective, qualitative, and self-sustainable infrastructure construction in smart city, there is a need to incorporate IoT devices and solutions in the architecture plan. This chapter studies and infers machines learning from data and observations, self-learning for robots, learning culture, humanity, emotions and ethics, (self)-learning affect services and our lives in future cities, and risks to humanity and cities. Moreover, in urban development, ICT and IOT are important building blocks in creating a smart infrastructure for managing ever-increasing city population.

[1]  Giuseppe Anastasi,et al.  IoT Applications in Smart Cities: A Perspective Into Social and Ethical Issues , 2018, 2018 IEEE International Conference on Smart Computing (SMARTCOMP).

[2]  Dishari Sarker,et al.  Cognitive IoT incorporating intelligence in building smart environment , 2017 .

[3]  Nashwa Abdelbaki,et al.  A Survey on Smart Cities' IoT , 2017, AISI.

[4]  Mohsen Guizani,et al.  Semisupervised Deep Reinforcement Learning in Support of IoT and Smart City Services , 2018, IEEE Internet of Things Journal.

[5]  Kostas Kolomvatsos,et al.  Reinforcement Learning for Predictive Analytics in Smart Cities , 2017, Informatics.

[6]  Mehregan Mahdavi,et al.  Machine Learning Applications: The Past and Current Research Trend in Diverse Industries , 2019, Inventions.

[7]  Sherali Zeadally,et al.  IoT technologies for smart cities , 2018, IET Networks.

[8]  Andrea Acquaviva,et al.  IoT platform for Smart Cities: Requirements and implementation case studies , 2016, 2016 IEEE 2nd International Forum on Research and Technologies for Society and Industry Leveraging a better tomorrow (RTSI).

[9]  Huajun Chen,et al.  Semantic Framework of Internet of Things for Smart Cities: Case Studies , 2016, Sensors.

[10]  Eugenio Di Sciascio,et al.  Machine learning in the Internet of Things: A semantic-enhanced approach , 2018, Semantic Web.

[11]  P. Bagavathi Sivakumar,et al.  Design of IoT Systems and Analytics in the Context of Smart City Initiatives in India , 2016 .

[12]  Sherali Zeadally,et al.  Internet of Things (IoT) Technologies for Smart Cities , 2017 .

[13]  Amit P. Sheth,et al.  Machine learning for Internet of Things data analysis: A survey , 2017, Digit. Commun. Networks.

[14]  Norbert A. Streitz,et al.  Grand challenges for ambient intelligence and implications for design contexts and smart societies , 2019, J. Ambient Intell. Smart Environ..

[15]  Paulo F. Pires,et al.  Classifying Smart IoT Devices for Running Machine Learning Algorithms , 2018 .

[16]  Ala I. Al-Fuqaha,et al.  Enabling Cognitive Smart Cities Using Big Data and Machine Learning: Approaches and Challenges , 2018, IEEE Communications Magazine.

[17]  Mirko Perkusich,et al.  A Smart Trust Management Method to Detect On-Off Attacks in the Internet of Things , 2018, Secur. Commun. Networks.

[18]  Joberto S. B. Martins Towards Smart City Innovation Under the Perspective of Software-Defined Networking, Artificial Intelligence and Big Data , 2018, ArXiv.

[19]  Himadri Nath Saha,et al.  IoT solutions for smart cities , 2017, 2017 8th Annual Industrial Automation and Electromechanical Engineering Conference (IEMECON).

[20]  Angel P. del Pobil,et al.  The Role of Internet of Things (IoT) in Smart Cities: Technology Roadmap-oriented Approaches , 2018 .