Placement of Access Points for Indoor Positioning based on DDPG

With the development of the Internet of Things, location-based services are becoming ubiquitous. Rapid and accurate deployment of access points (AP) in indoor environments is an effective way to improve the positioning accuracy. In this paper, a method is proposed for optimal deployment of indoor positioning access points based on Deep Deterministic Policy Gradient Algorithms (DDPG). With this method, the APs, in their initial states, are randomly placed in the target area under the premise of ensuring full network coverage. Each AP is regarded as an agent, and the optimal objective of AP deployment is defined as achieving the maximum Euclidean distance of the reference signal. The priority experience replay mechanism is introduced in this process, which guides the behavior by performing a series of actions and interacting with the environment to obtain the maximum reward for the agent. Simulation experiments are carried out to evaluate the performance of the proposed method. The results show that the proposed deployment method can converge quickly. Compared with the random deployment method and the maximization-minimization method, the proposed deployment method can effectively improve the positioning accuracy.

[1]  Brian W. Kernighan,et al.  WISE design of indoor wireless systems: practical computation and optimization , 1995 .

[2]  Nachol Chaiyaratana,et al.  Wireless LAN access point placement using a multi-objective genetic algorithm , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[3]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[4]  Mohsen Guizani,et al.  Internet of Things Architecture: Recent Advances, Taxonomy, Requirements, and Open Challenges , 2017, IEEE Wireless Communications.

[5]  J. Ugon,et al.  A new algorithm for the placement of WLAN access points based on nonsmooth optimization technique , 2005, The 7th International Conference on Advanced Communication Technology, 2005, ICACT 2005..

[6]  Lin Ma,et al.  Rapid deployment of APs in WLAN indoor positioning system , 2011, 2011 6th International ICST Conference on Communications and Networking in China (CHINACOM).

[7]  Kun Yang,et al.  A Map-Assisted WiFi AP Placement Algorithm Enabling Mobile Device’s Indoor Positioning , 2017, IEEE Systems Journal.

[8]  Haibin Zhang,et al.  Secure Real-Time Monitoring and Management of Smart Distribution Grid Using Shared Cellular Networks , 2017, IEEE Wireless Communications.

[9]  Limin Xiao,et al.  Optimization of AP placement in indoor fingerprint positioning , 2013, 2013 International Conference on ICT Convergence (ICTC).

[10]  Mohamed T. Faheem Saidahmed,et al.  Optimal placement of access points for indoor positioning using a genetic algorithm , 2017, 2017 12th International Conference on Computer Engineering and Systems (ICCES).

[11]  Alexandre Caminada,et al.  The Impact of AP Placement in WLAN-Based Indoor Positioning System , 2009, 2009 Eighth International Conference on Networks.

[12]  Guoqing Wang,et al.  Design of Intelligent Bus Positioning Based on Internet of Things for Smart Campus , 2018, IEEE Access.

[13]  Xiang Ling,et al.  Joint access point placement and channel assignment for 802.11 wireless LANs , 2006, IEEE Transactions on Wireless Communications.

[14]  Laurence T. Yang,et al.  Placement of Access Points for Indoor Wireless Coverage and Fingerprint-Based Localization , 2013, 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing.

[15]  Guy Lever,et al.  Deterministic Policy Gradient Algorithms , 2014, ICML.

[16]  Chunlin Chen,et al.  A novel DDPG method with prioritized experience replay , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[17]  Simo Ali-Löytty,et al.  A comparative survey of WLAN location fingerprinting methods , 2009, 2009 6th Workshop on Positioning, Navigation and Communication.

[18]  Wai-Choong Wong,et al.  Access point placement for fingerprint-based localization , 2010, 2010 IEEE International Conference on Communication Systems.

[19]  Liqaa Nawaf,et al.  Internet Transit Access Point placement and bandwidth allocation in Wireless Mesh Networks , 2017, 2017 IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC).

[20]  Shih-Hau Fang,et al.  A Novel Access Point Placement Approach for WLAN-Based Location Systems , 2010, 2010 IEEE Wireless Communication and Networking Conference.

[21]  Iana Siomina,et al.  Integrated Access Point Placement and Channel Assignment for Wireless LANs in an Indoor Office Environment , 2007, 2007 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[22]  Julien Ugon,et al.  Optimal placement of access point in WLAN based on a new algorithm , 2005, International Conference on Mobile Business (ICMB'05).

[23]  Anthony Ephremides,et al.  Spectral efficiency and optimal base placement for indoor wireless networks , 1996, IEEE J. Sel. Areas Commun..