The Anatomy of An Intent Based Search and Crawler Engine for the Web of Things

Web of Things (WoT) is becoming increasingly interesting for researchers and professionals over the past few years. It provides numerous opportunities by disseminating the data that is generated by physical things and fills the gap between the physical and the virtual world. Despite its importance, WoT search has not been studied enough in the past. Given the dynamic challenge of the WoT, collecting data from WoT resources is not well developed. Furthermore, the effectiveness of WoT search can be significantly improved if the users' intention of the search is also considered. This can be facilitated by knowing the existing status of the WoT in real-world. In this chapter, we address multiple challenges in this area. Firstly, we depict the analytical structure of the future WoT which facilitate crawling, indexing and searching the data from physical things. Secondly, we show how we can identify WoT and extract the data from it. Thirdly, we use our crawler to crawl and analyse WoT data on the Internet. Furthermore, we provide a showcase in the analysis of the flights delay data. Finally, we provide a discussion on future research in this area.

[1]  Bo Sheng,et al.  Microsearch: When Search Engines Meet Small Devices , 2009, Pervasive.

[2]  Qun Li,et al.  Snoogle: A Search Engine for Pervasive Environments , 2010, IEEE Transactions on Parallel and Distributed Systems.

[3]  Dave Raggett,et al.  The Web of Things: Challenges and Opportunities , 2015, Computer.

[4]  Yang Dongdong,et al.  The prediction of flight delays based the analysis of Random flight points , 2015, 2015 34th Chinese Control Conference (CCC).

[5]  Wolfgang Kellerer,et al.  A real-time search engine for the Web of Things , 2010, IOT.

[6]  Yujie Liu,et al.  Estimation of Arrival Flight Delay and Delay Propagation in a Busy Hub-Airport , 2008, 2008 Fourth International Conference on Natural Computation.

[7]  Damon Horowitz,et al.  The anatomy of a large-scale social search engine , 2010, WWW '10.

[8]  Quan Z. Sheng,et al.  SIEF: Efficiently Answering Distance Queries for Failure Prone Graphs , 2015, EDBT.

[9]  Emre Velipasaoglu,et al.  Intent-based diversification of web search results: metrics and algorithms , 2011, Information Retrieval.

[10]  Arkady B. Zaslavsky,et al.  Context-Aware Sensor Search, Selection and Ranking Model for Internet of Things Middleware , 2013, 2013 IEEE 14th International Conference on Mobile Data Management.

[11]  Adam Jatowt,et al.  Intent-Based Categorization of Search Results Using Questions from Web Q&A Corpus , 2009, WISE.

[12]  Wolfgang Jank,et al.  Estimating Flight Departure Delay Distributions - A Statistical Approach With Long-Term Trend and Short-Term Pattern , 2008 .

[13]  Leilani Battle,et al.  Building the Internet of Things Using RFID: The RFID Ecosystem Experience , 2009, IEEE Internet Computing.

[14]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[15]  Vikram Srinivasan,et al.  MAX: human-centric search of the physical world , 2005, SenSys '05.

[16]  Antonio F. Gómez-Skarmeta,et al.  An Analysis of M2M Platforms: Challenges and Opportunities for the Internet of Things , 2012, 2012 Sixth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[17]  Hamsa Balakrishnan,et al.  Characterization and prediction of air traffic delays , 2014 .

[18]  Xu Han,et al.  An efficient index for massive IOT data in cloud environment , 2012, CIKM '12.

[19]  Lina Yao,et al.  Context-aware Point-of-Interest Recommendation Using Tensor Factorization with Social Regularization , 2015, SIGIR.

[20]  Amanda Spink,et al.  Determining the user intent of web search engine queries , 2007, WWW '07.

[21]  Bill N. Schilit,et al.  Enabling the Internet of Things , 2015, Computer.

[22]  Hongming Cai,et al.  An IoT-Oriented Data Storage Framework in Cloud Computing Platform , 2014, IEEE Transactions on Industrial Informatics.

[23]  Alexander Kröller,et al.  RDF provisioning for the Internet of Things , 2012, 2012 3rd IEEE International Conference on the Internet of Things.

[24]  Raymond K. Wong,et al.  A New Meta-heuristic Approach for Efficient Search in the Internet of Things , 2015, 2015 IEEE International Conference on Services Computing.

[25]  Jaydip Sen,et al.  Internet of Things - Applications and Challenges in Technology and Standardization , 2011 .

[26]  Jaeho Kim,et al.  M2M Service Platforms: Survey, Issues, and Enabling Technologies , 2014, IEEE Communications Surveys & Tutorials.

[27]  Benoit Christophe,et al.  Searching the 'Web of Things' , 2011, 2011 IEEE Fifth International Conference on Semantic Computing.

[28]  Athanasios V. Vasilakos,et al.  When things matter: A survey on data-centric internet of things , 2016, J. Netw. Comput. Appl..

[29]  Lina Yao,et al.  ECS: A Framework for Diversified and Relevant Search in the Internet of Things , 2015, WISE.

[30]  Daqiang Zhang,et al.  Searching in Internet of Things: Vision and Challenges , 2011, 2011 IEEE Ninth International Symposium on Parallel and Distributed Processing with Applications.

[31]  Gerd Kortuem,et al.  Smart objects as building blocks for the Internet of things , 2010, IEEE Internet Computing.

[32]  Anurag Agarwal,et al.  The Internet of Things—A survey of topics and trends , 2015, Inf. Syst. Frontiers.

[33]  Song Ma,et al.  Flight Delay and Delay Propagation Analysis Based on Bayesian Network , 2008, 2008 International Symposium on Knowledge Acquisition and Modeling.

[34]  Antonio Pintus,et al.  Paraimpu: a platform for a social web of things , 2012, WWW.

[35]  Luigi Atzori,et al.  Friendship Selection in the Social Internet of Things: Challenges and Possible Strategies , 2015, IEEE Internet of Things Journal.

[36]  Lina Yao,et al.  Correlation discovery in web of things , 2013, WWW '13 Companion.

[37]  Wu He,et al.  Internet of Things in Industries: A Survey , 2014, IEEE Transactions on Industrial Informatics.

[38]  Xi Geng.  Analysis and Countermeasures to Flight Delay Based on Statistical Data , 2013, 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics.

[39]  Michael Blackstock,et al.  IoT mashups with the WoTKit , 2012, 2012 3rd IEEE International Conference on the Internet of Things.

[40]  Torsten Braun,et al.  Service descriptions and linked data for integrating WSNs into enterprise IT , 2012, 2012 Third International Workshop on Software Engineering for Sensor Network Applications (SESENA).

[41]  Lirong Zheng,et al.  Ecosystem analysis in the design of open platform-based in-home healthcare terminals towards the internet-of-things , 2013, 2013 15th International Conference on Advanced Communications Technology (ICACT).

[42]  Hai Yu,et al.  A Statistical Analysis on the Periodicity of Flight Delay Rate of the Airports in the US , 2014 .

[43]  Fan Yang,et al.  Initial Flight Delay Modeling and Estimating Based on an Improved Bayesian Network Structure Learning Algorithm , 2009, 2009 Fifth International Conference on Natural Computation.

[44]  Xiaogang Wang,et al.  IntentSearch: Capturing User Intention for One-Click Internet Image Search , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Alex Singleton,et al.  Web mapping 2.0: The neogeography of the GeoWeb , 2008 .

[46]  Geng Wu,et al.  M2M: From mobile to embedded internet , 2011, IEEE Communications Magazine.

[47]  Lina Yao,et al.  Things of Interest Recommendation by Leveraging Heterogeneous Relations in the Internet of Things , 2016, ACM Trans. Internet Techn..