An uncertainty measure and fusion rule for conflict evidences of big data via Dempster–Shafer theory

ABSTRACT We are living in a world surrounded by big data which can be often created by social networks, online and offline transactions, medical records and sensors. An appropriate treatment of big data can effect in enlightening, sharp and pertinent decision-making in numerous fields, like field of medical and healthcare, field of business, field of management and government. However, plenty of threats initiated by the characteristic of big data leads to the studying of big data. On the other hand, uncertainty measure of big data is a major task. Dempster–Shafer theory of evidence is an important tool of uncertainty modelling. In this paper, an effort has been made to propose an approach to measure uncertainty that involved in big data and a fusion rule of conflict evidences of big data. Finally, numerical examples are illustrated under these settings and results are compared with existing approaches.

[1]  S. Dhivya,et al.  Cloud Based Fuzzy Healthcare System , 2015 .

[2]  Pan Su,et al.  A hierarchical fuzzy cluster ensemble approach and its application to big data clustering , 2015, J. Intell. Fuzzy Syst..

[3]  Didier Dubois,et al.  Default Reasoning and Possibility Theory , 1988, Artif. Intell..

[4]  Hong Yan,et al.  Mining of protein-protein interfacial residues from massive protein sequential and spatial data , 2015, Fuzzy Sets Syst..

[5]  Jason H. Li,et al.  Tactical big data analytics: challenges, use cases, and solutions , 2014, PERV.

[6]  Jie Chen,et al.  An Efficient Combination Method of Conflict Evidences , 2015 .

[7]  R. Yager.  On the dempster-shafer framework and new combination rules , 1987, Inf. Sci..

[8]  George A. Papakostas,et al.  Learning Distributions of Image Features by Interactive Fuzzy Lattice Reasoning in Pattern Recognition Applications , 2015, IEEE Computational Intelligence Magazine.

[9]  Han De,et al.  Weighted evidence combination based on distance of evidence and uncertainty measure , 2011 .

[10]  Chongzhao Han,et al.  A modified evidence combination approach based on ambiguity measure , 2008, 2008 11th International Conference on Information Fusion.

[11]  Thanuka Wickramarathne.  Evidence updating for stream-processing in big-data: Robust conditioning in soft and hard data fusion environments , 2017, 2017 20th International Conference on Information Fusion (Fusion).

[12]  G. Klir,et al.  MEASURING TOTAL UNCERTAINTY IN DEMPSTER-SHAFER THEORY: A NOVEL APPROACH , 1994 .

[13]  Hsien-Tsung Chang,et al.  IoT Big-Data Centred Knowledge Granule Analytic and Cluster Framework for BI Applications: A Case Base Analysis , 2015, PloS one.

[14]  Nik Bessis,et al.  Big data‐based extraction of fuzzy partition rules for heart arrhythmia detection: a semi‐automated approach , 2016, Concurr. Comput. Pract. Exp..

[15]  P. Limbourg,et al.  Fault tree analysis in an early design stage using the Dempster-Shafer theory of evidence , 2007 .

[16]  Shi Wen-kang,et al.  Combining belief functions based on distance of evidence , 2004 .

[17]  Nadia Nedjah,et al.  Soft computing in big data intelligent transportation systems , 2016, Appl. Soft Comput..

[18]  Catherine K. Murphy.  Combining belief functions when evidence conflicts , 2000, Decis. Support Syst..

[19]  D. Dubois,et al.  A NOTE ON MEASURES OF SPECIFICITY FOR FUZZY SETS , 1985 .

[20]  An Liu,et al.  A Modified D-S Decision-Making Algorithm for Multi-sensor Target Identification , 2010, ICSI.

[21]  Yan Li,et al.  A Weighted Evidence Combination Method Based on Improved Conflict Measure Factor , 2015 .

[22]  Zhenhua Wang,et al.  Analysis of user behaviors by mining large network data sets , 2014, Future Gener. Comput. Syst..

[23]  Araceli Sanchis,et al.  Web news mining in an evolving framework , 2016, Inf. Fusion.

[24]  Mimmo Parente,et al.  Time Aware Knowledge Extraction for microblog summarization on Twitter , 2015, Inf. Fusion.

[25]  Frans Voorbraak,et al.  On the Justification of Dempster's Rule of Combination , 1988, Artif. Intell..

[26]  Mika Sato-Ilic,et al.  Multidimensional Joint Scale and Cluster Analysis , 2015, Complex Adaptive Systems.

[27]  Simon C. K. Shiu,et al.  Interval extreme learning machine for big data based on uncertainty reduction , 2015, J. Intell. Fuzzy Syst..

[28]  Ye Xiu.  A New Combination Rules of Evidence Theory , 2000 .

[29]  Yang,et al.  Combination Rule Based on Proportional Redistribution of Generalized Conflict for Evidence Theory , 2014 .

[30]  Simone A. Ludwig.  MapReduce-based fuzzy c-means clustering algorithm: implementation and scalability , 2015, Int. J. Mach. Learn. Cybern..

[31]  María José del Jesús,et al.  A View on Fuzzy Systems for Big Data: Progress and Opportunities , 2016, Int. J. Comput. Intell. Syst..

[32]  Benjamin W. Wah,et al.  Significance and Challenges of Big Data Research , 2015, Big Data Res..

[33]  Srinivasan Subramaniam,et al.  Distilling Big Data: Refining Quality Information in the Era of Yottabytes , 2015, TheScientificWorldJournal.

[34]  Claire D'Este,et al.  Development of an intelligent environmental knowledge system for sustainable agricultural decision support , 2014, Environ. Model. Softw..

[35]  José M. Cecilia,et al.  Parallel implementation of fuzzy minimals clustering algorithm , 2016, Expert Syst. Appl..

[36]  Yongchuan Tang,et al.  Conflicting evidence combination based on uncertainty measure and distance of evidence , 2016, SpringerPlus.

[37]  Witold Pedrycz,et al.  An overview on the roles of fuzzy set techniques in big data processing: Trends, challenges and opportunities , 2017, Knowl. Based Syst..

[38]  Chin-Teng Lin,et al.  A new data-driven neural fuzzy system with collaborative fuzzy clustering mechanism , 2015, Neurocomputing.

[39]  Jean Dezert,et al.  On the behavior of Dempster's rule of combination and the foundations of Dempster-Shafer Theory , 2011, 2012 6th IEEE International Conference Intelligent Systems.

[40]  Huapu Lu,et al.  Big Data-Driven Based Real-Time Traffic Flow State Identification and Prediction , 2015 .

[41]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[42]  Jean Dezert,et al.  On the validity of Dempster-Shafer Theory , 2012, 2012 15th International Conference on Information Fusion.

[43]  Hamid Mcheick,et al.  The evident use of evidence theory in big data analytics using cloud computing , 2014, 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE).

[44]  Aboul Ella Hassanien,et al.  Dimensionality reduction of medical big data using neural-fuzzy classifier , 2014, Soft Computing.

[45]  Alexander Lepskiy.  Estimation of Conflict and Decreasing of Ignorance in Dempster-Shafer Theory , 2013, ITQM.

[46]  Henri Prade,et al.  Representation and combination of uncertainty with belief functions and possibility measures , 1988, Comput. Intell..

[47]  Bin Li,et al.  A New DS Combination Method for Dealing with Conflict Evidence Effectively , 2013 .

[48]  Marimuthu Palaniswami,et al.  Fuzzy c-Means Algorithms for Very Large Data , 2012, IEEE Transactions on Fuzzy Systems.

[49]  Fuyuan Xiao,et al.  Conflict management based on belief function entropy in sensor fusion , 2016, SpringerPlus.

[50]  Dong Chen,et al.  Novel Algorithm for Identifying and Fusing Conflicting Data in Wireless Sensor Networks , 2014, Sensors.

[51]  Qi Liu,et al.  Combining belief functions based on distance of evidence , 2004, Decis. Support Syst..

[52]  Kehua Guo,et al.  TMR: Towards an efficient semantic-based heterogeneous transportation media big data retrieval , 2016, Neurocomputing.

[53]  Sankar K. Pal,et al.  FGSN: Fuzzy Granular Social Networks - Model and applications , 2015, Inf. Sci..

[54]  Yuying Wang,et al.  Type-2 fuzzy event parallel computing system: Overcoming computer int index limitation in big data , 2016, Appl. Soft Comput..

[55]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[56]  Tharam S. Dillon,et al.  Cloud Computing: Issues and Challenges , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[57]  YI Xiao,et al.  An Improved Dempster-Shafer Algorithm for Resolving the Conflicting Evidences , 2006 .

[58]  C. L. Philip Chen,et al.  Data-intensive applications, challenges, techniques and technologies: A survey on Big Data , 2014, Inf. Sci..

[59]  Ji-yao An,et al.  Combination of Evidence with Different Weighting Factors: A Novel Probabilistic-Based Dissimilarity Measure Approach , 2015, J. Sensors.