Quality of Information in Mobile Crowdsensing

Smartphones have become the most pervasive devices in people’s lives and are clearly transforming the way we live and perceive technology. Today’s smartphones benefit from almost ubiquitous Internet connectivity and come equipped with a plethora of inexpensive yet powerful embedded sensors, such as an accelerometer, a gyroscope, a microphone, and a camera. This unique combination has enabled revolutionary applications based on the mobile crowdsensing paradigm, such as real-time road traffic monitoring, air and noise pollution, crime control, and wildlife monitoring, just to name a few. Differently from prior sensing paradigms, humans are now the primary actors of the sensing process, since they become fundamental in retrieving reliable and up-to-date information about the event being monitored. As humans may behave unreliably or maliciously, assessing and guaranteeing Quality of Information (QoI) becomes more important than ever. In this article, we provide a new framework for defining and enforcing the QoI in mobile crowdsensing and analyze in depth the current state of the art on the topic. We also outline novel research challenges, along with possible directions of future work.

[1]  Zhongcheng Li,et al.  A Truthful Incentive Mechanism for Online Recruitment in Mobile Crowd Sensing System , 2017, Sensors.

[2]  Kamal Kant Bharadwaj,et al.  Fuzzy computational models for trust and reputation systems , 2009, Electron. Commer. Res. Appl..

[3]  Shlomo Zilberstein,et al.  Models of Bounded Rationality , 1995 .

[4]  Zhu Wang,et al.  Mobile Crowd Sensing and Computing , 2015, ACM Comput. Surv..

[5]  Guihai Chen,et al.  Privacy and Quality Preserving Multimedia Data Aggregation for Participatory Sensing Systems , 2015, IEEE Transactions on Mobile Computing.

[6]  Chao Huang,et al.  Spatial-Temporal Aware Truth Finding in Big Data Social Sensing Applications , 2015, 2015 IEEE Trustcom/BigDataSE/ISPA.

[7]  Wen Hu,et al.  Ear-Phone: A context-aware noise mapping using smart phones , 2013, Pervasive Mob. Comput..

[8]  Reza Curtmola,et al.  Collaborative Bluetooth-based location authentication on smart phones , 2015, Pervasive Mob. Comput..

[9]  Sajal K. Das,et al.  RescuePal: A smartphone-based system to discover people in emergency scenarios , 2016, 2016 IEEE 17th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM).

[10]  Mani B. Srivastava,et al.  Truth Discovery in Crowdsourced Detection of Spatial Events , 2014, IEEE Transactions on Knowledge and Data Engineering.

[11]  Bo Zhao,et al.  A Survey on Truth Discovery , 2015, SKDD.

[12]  Alexander Schill,et al.  GaML - A Modeling Language for Gamification , 2013, 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing.

[13]  S. A. Ehikioya A characterization of information quality using fuzzy logic , 1999, 18th International Conference of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.99TH8397).

[14]  Bechir Hamdaoui,et al.  A Survey on Energy-Efficient Routing Techniques with QoS Assurances for Wireless Multimedia Sensor Networks , 2012, IEEE Communications Surveys & Tutorials.

[15]  H. Simon Models of Bounded Rationality: Empirically Grounded Economic Reason , 1997 .

[16]  Pradeep K. Atrey,et al.  Modeling and assessing quality of information in multisensor multimedia monitoring systems , 2011, TOMCCAP.

[17]  Shiguang Wang,et al.  Towards Cyber-Physical Systems in Social Spaces: The Data Reliability Challenge , 2014, 2014 IEEE Real-Time Systems Symposium.

[18]  Sergey Brin,et al.  Reprint of: The anatomy of a large-scale hypertextual web search engine , 2012, Comput. Networks.

[19]  Mini Mathew,et al.  Quality of Information and Energy Efficiency Optimization for Sensor Networks via Adaptive Sensing and Transmitting , 2014, IEEE Sensors Journal.

[20]  Bo Zhao,et al.  A Bayesian Approach to Discovering Truth from Conflicting Sources for Data Integration , 2012, Proc. VLDB Endow..

[21]  Wen Hu,et al.  On the need for a reputation system in mobile phone based sensing , 2014, Ad Hoc Networks.

[22]  Richard H. R. Harper,et al.  Trust, Computing, and Society: Trust, Computing, and Society: Introduction , 2014 .

[23]  Reza Olfati-Saber,et al.  Distributed Kalman filtering for sensor networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[24]  Dong Wang,et al.  Social Sensing: A maximum likelihood estimation approach , 2015 .

[25]  Sajal K. Das,et al.  A trust-based framework for data forwarding in opportunistic networks , 2013, Ad Hoc Networks.

[26]  Georgios B. Giannakis,et al.  Sensor-Centric Data Reduction for Estimation With WSNs via Censoring and Quantization , 2012, IEEE Transactions on Signal Processing.

[27]  José M. Molina López,et al.  Trust Management Through Fuzzy Reputation , 2003, International Journal of Cooperative Information Systems.

[28]  Yuping Zhao,et al.  A Novel Fast Anti-Collision Algorithm for RFID Systems , 2007, 2007 International Conference on Wireless Communications, Networking and Mobile Computing.

[29]  Tilo Strutz,et al.  Data Fitting and Uncertainty: A practical introduction to weighted least squares and beyond , 2010 .

[30]  L. Mui,et al.  A computational model of trust and reputation , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[31]  Jiannong Cao,et al.  Improving Data Quality with an Accumulated Reputation Model in Participatory Sensing Systems , 2014, Sensors.

[32]  R. Peterson,et al.  A Meta-analysis of Online Trust Relationships in E-commerce , 2017 .

[33]  Wen Hu,et al.  Are you contributing trustworthy data?: the case for a reputation system in participatory sensing , 2010, MSWIM '10.

[34]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[35]  Mani B. Srivastava,et al.  Aggregating Crowdsourced Quantitative Claims: Additive and Multiplicative Models , 2016, IEEE Transactions on Knowledge and Data Engineering.

[36]  Sajal K. Das,et al.  Incentive Mechanisms for Participatory Sensing , 2015, ACM Trans. Sens. Networks.

[37]  Syngjoo Choi,et al.  Social learning in networks: a Quantal Response Equilibrium analysis of experimental data , 2012 .

[38]  Serge Abiteboul,et al.  Corroborating information from disagreeing views , 2010, WSDM '10.

[39]  F. Rombouts,et al.  Modeling of the Bacterial Growth Curve , 1990, Applied and environmental microbiology.

[40]  R. McKelvey,et al.  Quantal Response Equilibria for Extensive Form Games , 1998 .

[41]  K. R. Remesh Babu,et al.  A mobile crowd sensing based task assignment in Internet of Things , 2016, 2016 International Conference on Emerging Technological Trends (ICETT).

[42]  Morris Sloman,et al.  Trust Management Tools for Internet Applications , 2003, iTrust.

[43]  Larry P. English Information Quality Applied: Best Practices for Improving Business Information, Processes and Systems , 2009 .

[44]  Sushil Jajodia,et al.  Secure Data Aggregation in Wireless Sensor Networks: Filtering out the Attacker's Impact , 2014, IEEE Transactions on Information Forensics and Security.

[45]  Francesco Restuccia Mechanisms for improving information quality in smartphone crowdsensing systems , 2016 .

[46]  Sajal K. Das,et al.  An integrated cloud-based framework for mobile phone sensing , 2012, MCC '12.

[47]  Andrew Raij,et al.  A Survey of Incentive Techniques for Mobile Crowd Sensing , 2015, IEEE Internet of Things Journal.

[48]  Gang Wang,et al.  Poster: Defending against Sybil Devices in Crowdsourced Mapping Services , 2016, MobiSys '16 Companion.

[49]  Masamichi Shimosaka,et al.  Steered crowdsensing: incentive design towards quality-oriented place-centric crowdsensing , 2014, UbiComp.

[50]  Wazir Zada Khan,et al.  Mobile Phone Sensing Systems: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[51]  Audun J sang,et al.  An Algebra for Assessing Trust in Certi cation Chains , 1998 .

[52]  Prasant Mohapatra,et al.  STAMP: Enabling Privacy-Preserving Location Proofs for Mobile Users , 2016, IEEE/ACM Transactions on Networking.

[53]  Eric S. Crawley,et al.  A Framework for QoS-based Routing in the Internet , 1998, RFC.

[54]  Prasant Mohapatra,et al.  Collusion-resilient quality of information evaluation based on information provenance , 2011, 2011 8th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[55]  Edward Cutrell,et al.  Deterring Cheating in Online Environments , 2015, TCHI.

[56]  Han Zou,et al.  Exploiting cyclic features of walking for pedestrian dead reckoning with unconstrained smartphones , 2016, UbiComp.

[57]  Dan Roth,et al.  Knowing What to Believe (when you already know something) , 2010, COLING.

[58]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[59]  H. Simon,et al.  Models Of Man : Social And Rational , 1957 .

[60]  Heng Ji,et al.  FaitCrowd: Fine Grained Truth Discovery for Crowdsourced Data Aggregation , 2015, KDD.

[61]  Dong Wang,et al.  Hardness-Aware Truth Discovery in Social Sensing Applications , 2016, 2016 International Conference on Distributed Computing in Sensor Systems (DCOSS).

[62]  Sajal K. Das,et al.  Performance analysis of a hierarchical discovery protocol for WSNs with Mobile Elements , 2012, 2012 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM).

[63]  Mo Li,et al.  How Long to Wait? Predicting Bus Arrival Time With Mobile Phone Based Participatory Sensing , 2012, IEEE Transactions on Mobile Computing.

[64]  Xue Liu,et al.  Generalized Decision Aggregation in Distributed Sensing Systems , 2014, 2014 IEEE Real-Time Systems Symposium.

[65]  Erik Blasch,et al.  Towards unbiased evaluation of uncertainty reasoning: The URREF ontology , 2012, 2012 15th International Conference on Information Fusion.

[66]  Sajal K. Das,et al.  Analysis and Optimization of a Protocol for Mobile Element Discovery in Sensor Networks , 2014, IEEE Transactions on Mobile Computing.

[67]  Lu Su,et al.  Tackling the Redundancy and Sparsity in Crowd Sensing Applications , 2016, SenSys.

[68]  Lance Kaplan,et al.  On truth discovery in social sensing: A maximum likelihood estimation approach , 2012, 2012 ACM/IEEE 11th International Conference on Information Processing in Sensor Networks (IPSN).

[69]  Anirban Mondal,et al.  CityZen: A Cost-Effective City Management System with Incentive-Driven Resident Engagement , 2014, 2014 IEEE 15th International Conference on Mobile Data Management.

[70]  Salil S. Kanhere,et al.  A Trust Framework for Social Participatory Sensing Systems , 2012, MobiQuitous.

[71]  Rino Falcone,et al.  Trust Theory: A Socio-Cognitive and Computational Model , 2010 .

[72]  Kin K. Leung,et al.  A Survey of Incentive Mechanisms for Participatory Sensing , 2015, IEEE Communications Surveys & Tutorials.

[73]  Daqing Zhang,et al.  CrowdRecruiter: selecting participants for piggyback crowdsensing under probabilistic coverage constraint , 2014, UbiComp.

[74]  Andrew Campbell,et al.  The Rise of People-Centric Sensing , 2008, IEEE Internet Computing.

[75]  Gang Wang,et al.  "Will Check-in for Badges": Understanding Bias and Misbehavior on Location-Based Social Networks , 2021, ICWSM.

[76]  Pramod K. Varshney,et al.  Sparsity-Promoting Extended Kalman Filtering for Target Tracking in Wireless Sensor Networks , 2012, IEEE Signal Processing Letters.

[77]  Luca Foschini,et al.  Quantifying User Reputation Scores, Data Trustworthiness, and User Incentives in Mobile Crowd-Sensing , 2017, IEEE Access.

[78]  F. Caccioli,et al.  Optimal growth trajectories with finite carrying capacity. , 2015, Physical review. E.

[79]  S. V. Kasmir Raja,et al.  QoS routing in wireless sensor networks—a survey , 2012, CSUR.

[80]  Simon Jackman,et al.  Bayesian Analysis for the Social Sciences , 2009 .

[81]  Roberto López-Valcarce,et al.  A Diffusion-Based EM Algorithm for Distributed Estimation in Unreliable Sensor Networks , 2013, IEEE Signal Processing Letters.

[82]  Shaohan Hu,et al.  On Source Dependency Models for Reliable Social Sensing: Algorithms and Fundamental Error Bounds , 2016, 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS).

[83]  Klara Nahrstedt,et al.  CENTURION: Incentivizing multi-requester mobile crowd sensing , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[84]  Yu Hen Hu,et al.  Maximum likelihood multiple-source localization using acoustic energy measurements with wireless sensor networks , 2005, IEEE Trans. Signal Process..

[85]  Yang Wang,et al.  TaskMe: multi-task allocation in mobile crowd sensing , 2016, UbiComp.

[86]  Jin-Hee Cho,et al.  Hierarchical Trust Management for Wireless Sensor Networks and its Applications to Trust-Based Routing and Intrusion Detection , 2012, IEEE Transactions on Network and Service Management.

[87]  Charu C. Aggarwal,et al.  On Bayesian interpretation of fact-finding in information networks , 2011, 14th International Conference on Information Fusion.

[88]  Alexander Boden,et al.  Help beacons: design and evaluation of an ad-hoc lightweight s.o.s. system for smartphones , 2014, CHI.

[89]  Romit Roy Choudhury,et al.  MoVi: mobile phone based video highlights via collaborative sensing , 2010, MobiSys '10.

[90]  Deborah Estrin,et al.  Image browsing, processing, and clustering for participatory sensing: lessons from a DietSense prototype , 2007, EmNets '07.

[91]  Venkataramana Badarla,et al.  Consensus-Aware Sociopsychological Trust Model for Wireless Sensor Networks , 2016, ACM Trans. Sens. Networks.

[92]  Ohad Shamir,et al.  Good learners for evil teachers , 2009, ICML '09.

[93]  Jiangtao Wang,et al.  PSAllocator: Multi-Task Allocation for Participatory Sensing with Sensing Capability Constraints , 2017, CSCW.

[94]  Ming Xu,et al.  FIDC: A framework for improving data credibility in mobile crowdsensing , 2017, Comput. Networks.

[95]  Salil S. Kanhere,et al.  A Trust-Based Recruitment Framework for Multi-hop Social Participatory Sensing , 2013, 2013 IEEE International Conference on Distributed Computing in Sensor Systems.

[96]  Cecilia Mascolo,et al.  EmotionSense: a mobile phones based adaptive platform for experimental social psychology research , 2010, UbiComp.

[97]  Stephen Marsh,et al.  Formalising Trust as a Computational Concept , 1994 .

[98]  Sajal K. Das,et al.  Optimizing the Lifetime of Sensor Networks with Uncontrollable Mobile Sinks and QoS Constraints , 2016, TOSN.

[99]  Cesare Stefanelli,et al.  Exploring value-of-information-based approaches to support effective communications in tactical networks , 2015, IEEE Communications Magazine.

[100]  Sajal K. Das,et al.  Lifetime optimization with QoS of sensor networks with uncontrollable mobile sinks , 2015, 2015 IEEE 16th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM).

[101]  Brian Mac Namee,et al.  Dynamic estimation of worker reliability in crowdsourcing for regression tasks: Making it work , 2014, Expert Syst. Appl..

[102]  Xingquan Zhu,et al.  Active learning with uncertain labeling knowledge , 2014, Pattern Recognit. Lett..

[103]  Audun Jøsang,et al.  An Algebra for Assessing Trust in Certification Chains , 1999, NDSS.

[104]  Hwee Pink Tan,et al.  SEW-ing a Simple Endorsement Web to incentivize trustworthy participatory sensing , 2014, 2014 Eleventh Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[105]  Randy Showstack Crowdsourcing for the National Map , 2012 .

[106]  Hengchang Liu,et al.  Experiences with GreenGPS—Fuel-Efficient Navigation Using Participatory Sensing , 2016, IEEE Transactions on Mobile Computing.

[107]  Junping Du,et al.  LDTS: A Lightweight and Dependable Trust System for Clustered Wireless Sensor Networks , 2013, IEEE Transactions on Information Forensics and Security.

[108]  Etienne E. Kerre,et al.  Defuzzification: criteria and classification , 1999, Fuzzy Sets Syst..

[109]  Audun Jøsang,et al.  Interpreting Belief Functions as Dirichlet Distributions , 2007, ECSQARU.

[110]  Suvadip Batabyal,et al.  Mobility Models, Traces and Impact of Mobility on Opportunistic Routing Algorithms: A Survey , 2015, IEEE Communications Surveys & Tutorials.

[111]  R. McKelvey,et al.  Quantal Response Equilibria for Normal Form Games , 1995 .

[112]  Thomas F. La Porta,et al.  Quality of information-aware mobile applications , 2014, Pervasive Mob. Comput..

[113]  Tommaso Melodia,et al.  U-Wear: Software-Defined Ultrasonic Networking for Wearable Devices , 2015, MobiSys.

[114]  Deborah Estrin,et al.  Recruitment Framework for Participatory Sensing Data Collections , 2010, Pervasive.

[115]  Mani B. Srivastava,et al.  On the quality and value of information in sensor networks , 2013, TOSN.

[116]  Leonidas J. Guibas,et al.  Mobiscopes for Human Spaces , 2007, IEEE Pervasive Computing.

[117]  Ellie D'Hondt,et al.  Participatory noise mapping works! An evaluation of participatory sensing as an alternative to standard techniques for environmental monitoring , 2013, Pervasive Mob. Comput..

[118]  Chao Huang,et al.  Topic-Aware Social Sensing with Arbitrary Source Dependency Graphs , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[119]  Ciprian Dobre,et al.  Trust and reputation management for opportunistic dissemination , 2017, Pervasive Mob. Comput..

[120]  Colin Camerer Behavioural studies of strategic thinking in games , 2003, Trends in Cognitive Sciences.

[121]  Jiangtao Wang,et al.  Fine-Grained Multitask Allocation for Participatory Sensing With a Shared Budget , 2016, IEEE Internet of Things Journal.

[122]  Athanasios V. Vasilakos,et al.  ReTrust: Attack-Resistant and Lightweight Trust Management for Medical Sensor Networks , 2012, IEEE Transactions on Information Technology in Biomedicine.

[123]  Dan Roth,et al.  Generalized fact-finding , 2011, WWW.

[124]  Tiago Oliveira,et al.  Modelling and testing consumer trust dimensions in e-commerce , 2017, Comput. Hum. Behav..

[125]  Klara Nahrstedt,et al.  INCEPTION: incentivizing privacy-preserving data aggregation for mobile crowd sensing systems , 2016, MobiHoc.

[126]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[127]  Tao Qin,et al.  Computing Quantal Response Equilibrium for Sponsored Search Auctions , 2015, AAMAS.

[128]  Tao Li,et al.  A survey on expert finding techniques , 2017, Journal of Intelligent Information Systems.

[129]  Emiliano Miluzzo,et al.  People-centric urban sensing , 2006, WICON '06.

[130]  Cecilia Mascolo,et al.  Mining users' significant driving routes with low-power sensors , 2014, SenSys.

[131]  Hengchang Liu,et al.  Exploitation of Physical Constraints for Reliable Social Sensing , 2013, 2013 IEEE 34th Real-Time Systems Symposium.

[132]  Sajal K. Das,et al.  ZoneTrust: Fast Zone-Based Node Compromise Detection and Revocation in Wireless Sensor Networks Using Sequential Hypothesis Testing , 2012, IEEE Transactions on Dependable and Secure Computing.

[133]  Yutaka Arakawa,et al.  Gamification-based incentive mechanism for participatory sensing , 2014, 2014 IEEE International Conference on Pervasive Computing and Communication Workshops (PERCOM WORKSHOPS).

[134]  Pengfei Zhang,et al.  A Trust-based Mixture of Gaussian Processes Model for Robust Participatory Sensing , 2017, AAMAS.

[135]  Lionel Brunie,et al.  Trust management and reputation systems in mobile participatory sensing applications: A survey , 2015, Comput. Networks.

[136]  Kevin S. Chan,et al.  Quality of information approach to improving source selection in tactical networks , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[137]  Koteswararao Kondepu,et al.  A hybrid and flexible discovery algorithm for wireless sensor networks with mobile elements , 2012, 2012 IEEE Symposium on Computers and Communications (ISCC).

[138]  Alessandro Bozzon,et al.  Choosing the right crowd: expert finding in social networks , 2013, EDBT '13.

[139]  Philip S. Yu,et al.  Truth Discovery with Multiple Conflicting Information Providers on the Web , 2007, IEEE Transactions on Knowledge and Data Engineering.

[140]  Shirlee-ann Knight,et al.  User perceptions of information quality in world wide web information retrieval behaviour , 2007 .

[141]  Sajal K. Das,et al.  FIDES: A trust-based framework for secure user incentivization in participatory sensing , 2014, Proceeding of IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks 2014.

[142]  Wei Cheng,et al.  ARTSense: Anonymous reputation and trust in participatory sensing , 2013, 2013 Proceedings IEEE INFOCOM.

[143]  Charu C. Aggarwal,et al.  Mining collective intelligence in diverse groups , 2013, WWW.

[144]  Jordi Sabater-Mir,et al.  On representation and aggregation of social evaluations in computational trust and reputation models , 2007, Int. J. Approx. Reason..

[145]  M. Verleysen,et al.  Classification in the Presence of Label Noise: A Survey , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[146]  Shen Li,et al.  Scalable social sensing of interdependent phenomena , 2015, IPSN.

[147]  Teck-Hua Ho,et al.  Sophisticated Experience-Weighted Attraction Learning and Strategic Teaching in Repeated Games , 2002, J. Econ. Theory.

[148]  Dong Wang,et al.  Social Sensing: Building Reliable Systems on Unreliable Data , 2015 .

[149]  Xuemin Shen,et al.  SACRM: Social Aware Crowdsourcing with Reputation Management in mobile sensing , 2014, Comput. Commun..

[150]  Audun Jøsang,et al.  AIS Electronic Library (AISeL) , 2017 .

[151]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[152]  Charu C. Aggarwal,et al.  Using humans as sensors: An estimation-theoretic perspective , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[153]  Romit Roy Choudhury,et al.  Micro-Blog: sharing and querying content through mobile phones and social participation , 2008, MobiSys '08.

[154]  Mohamed F. Younis,et al.  Topology management techniques for tolerating node failures in wireless sensor networks: A survey , 2014, Comput. Networks.

[155]  International Foundation for Autonomous Agents and MultiAgent Systems ( IFAAMAS ) , 2007 .

[156]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[157]  Alec Wolman,et al.  I am a sensor, and I approve this message , 2010, HotMobile '10.

[158]  Weiguo Fan,et al.  ExpertRank: A topic-aware expert finding algorithm for online knowledge communities , 2013, Decis. Support Syst..

[159]  Shaojie Tang,et al.  Quality-Aware Sensing Coverage in Budget-Constrained Mobile Crowdsensing Networks , 2016, IEEE Transactions on Vehicular Technology.

[160]  Andreas Krause,et al.  Toward Community Sensing , 2008, 2008 International Conference on Information Processing in Sensor Networks (ipsn 2008).

[161]  Mohsen Guizani,et al.  An Efficient Distributed Trust Model for Wireless Sensor Networks , 2015, IEEE Transactions on Parallel and Distributed Systems.

[162]  Thomas B. L. Kirkwood,et al.  Deciphering death: a commentary on Gompertz (1825) ‘On the nature of the function expressive of the law of human mortality, and on a new mode of determining the value of life contingencies’ , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[163]  Minyue Fu,et al.  Target Tracking in Wireless Sensor Networks Based on the Combination of KF and MLE Using Distance Measurements , 2012, IEEE Transactions on Mobile Computing.

[164]  Peter Filzmoser,et al.  Identification of Multivariate Outliers: A Performance Study , 2016 .

[165]  Victoria J. Hodge,et al.  A Survey of Outlier Detection Methodologies , 2004, Artificial Intelligence Review.

[166]  Qi Han,et al.  Toward real-time and cooperative mobile visual sensing and sharing , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[167]  Mani B. Srivastava,et al.  Reputation-based framework for high integrity sensor networks , 2004, SASN '04.

[168]  Panagiotis G. Ipeirotis,et al.  Get another label? improving data quality and data mining using multiple, noisy labelers , 2008, KDD.

[169]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[170]  Fan Ye,et al.  Mobile crowdsensing: current state and future challenges , 2011, IEEE Communications Magazine.

[171]  Charu C. Aggarwal,et al.  Recursive Ground Truth Estimator for Social Data Streams , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[172]  Alejandro P. Buchmann,et al.  Managing Expectations: Runtime Negotiation of Information Quality Requirements in Event-Based Systems , 2014, ICSOC.

[173]  Wei Cheng,et al.  Enabling Reputation and Trust in Privacy-Preserving Mobile Sensing , 2014, IEEE Transactions on Mobile Computing.

[174]  M. Hansen,et al.  Participatory Sensing , 2019, Internet of Things.

[175]  Sarvapali D. Ramchurn,et al.  DEVISING A TRUST MODEL FOR MULTI-AGENT INTERACTIONS USING CONFIDENCE AND REPUTATION , 2004, Appl. Artif. Intell..

[176]  Salil S. Kanhere,et al.  Trust-based privacy-aware participant selection in social participatory sensing , 2015, J. Inf. Secur. Appl..

[177]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[178]  Stefan Dietze,et al.  Human Beyond the Machine: Challenges and Opportunities of Microtask Crowdsourcing , 2015, IEEE Intelligent Systems.

[179]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[180]  Guangjie Han,et al.  A Trust Cloud Model for Underwater Wireless Sensor Networks , 2017, IEEE Communications Magazine.

[181]  Chenglin Miao,et al.  Cloud-Enabled Privacy-Preserving Truth Discovery in Crowd Sensing Systems , 2015, SenSys.

[182]  Sajal K. Das,et al.  Accurate and Efficient Modeling of 802.15.4 Unslotted CSMA/CA through Event Chains Computation , 2016, IEEE Transactions on Mobile Computing.

[183]  Salil S. Kanhere,et al.  A Reputation Framework for Social Participatory Sensing Systems , 2014, Mob. Networks Appl..

[184]  Taylor Cassidy,et al.  The Wisdom of Minority: Unsupervised Slot Filling Validation based on Multi-dimensional Truth-Finding , 2014, COLING.

[185]  Joseph R. Long,et al.  The Definition of a Trust , 1922 .

[186]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[187]  Jing Gao,et al.  Truth Discovery on Crowd Sensing of Correlated Entities , 2015, SenSys.

[188]  Chen-Khong Tham,et al.  Quality of Contributed Service and Market Equilibrium for Participatory Sensing , 2013, IEEE Transactions on Mobile Computing.

[189]  Tilo Strutz,et al.  Data Fitting and Uncertainty , 2011 .

[190]  Siegfried Gottwald,et al.  Fuzzy Sets and Fuzzy Logic , 1993 .

[191]  Azzedine Boukerche,et al.  Towards a novel trust-based opportunistic routing protocol for wireless networks , 2016, Wirel. Networks.

[192]  Sajal K. Das,et al.  A Trust-Based Framework for Fault-Tolerant Data Aggregation in Wireless Multimedia Sensor Networks , 2012, IEEE Transactions on Dependable and Secure Computing.

[193]  Xin Wang,et al.  Secure Routing Based on Social Similarity in Opportunistic Networks , 2016, IEEE Transactions on Wireless Communications.

[194]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[195]  John S. Baras,et al.  STAR: Semiring Trust Inference for Trust-Aware Social Recommenders , 2016, RecSys.

[196]  Nicholas R. Jennings,et al.  Coordinating Measurements for Air Pollution Monitoring in Participatory Sensing Settings , 2015, AAMAS.

[197]  Yun Liu,et al.  Modeling and predicting opinion formation with trust propagation in online social networks , 2017, Commun. Nonlinear Sci. Numer. Simul..

[198]  Stefan Dietze,et al.  Understanding Malicious Behavior in Crowdsourcing Platforms: The Case of Online Surveys , 2015, CHI.