Expertise and confidence explain how social influence evolves along intellective tasks

Discovering the antecedents of individuals' influence in collaborative environments is an important, practical, and challenging problem. In this paper, we study interpersonal influence in small groups of individuals who collectively execute a sequence of intellective tasks. We observe that along an issue sequence with feedback, individuals with higher expertise and social confidence are accorded higher interpersonal influence. We also observe that low-performing individuals tend to underestimate their high-performing teammate's expertise. Based on these observations, we introduce three hypotheses and present empirical and theoretical support for their validity. We report empirical evidence on longstanding theories of transactive memory systems, social comparison, and confidence heuristics on the origins of social influence. We propose a cognitive dynamical model inspired by these theories to describe the process by which individuals adjust interpersonal influences over time. We demonstrate the model's accuracy in predicting individuals' influence and provide analytical results on its asymptotic behavior for the case with identically performing individuals. Lastly, we propose a novel approach using deep neural networks on a pre-trained text embedding model for predicting the influence of individuals. Using message contents, message times, and individual correctness collected during tasks, we are able to accurately predict individuals' self-reported influence over time. Extensive experiments verify the accuracy of the proposed models compared to baselines such as structural balance and reflected appraisal model. While the neural networks model is the most accurate, the dynamical model is the most interpretable for influence prediction.

[1]  Robert D. Kleinberg,et al.  Continuous-time model of structural balance , 2010, Proceedings of the National Academy of Sciences.

[2]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[3]  Nan Hua,et al.  Universal Sentence Encoder , 2018, ArXiv.

[4]  Roberto Tempo,et al.  A Tutorial on Modeling and Analysis of Dynamic Social Networks. Part II , 2018, Annu. Rev. Control..

[5]  F. Heider Attitudes and cognitive organization. , 1946, The Journal of psychology.

[6]  Dwight D. Frink,et al.  How Individual Performance Affects Variability of Peer Evaluations in Classroom Teams , 2014 .

[7]  Nazrul I. Shaikh,et al.  A particle-learning-based approach to estimate the influence matrix of online social networks , 2018, Comput. Stat. Data Anal..

[8]  Kyle Lewis,et al.  Knowledge and Performance in Knowledge-Worker Teams: A Longitudinal Study of Transactive Memory Systems , 2004, Manag. Sci..

[9]  R. Moreland,et al.  Group Versus Individual Training and Group Performance: The Mediating Role of Transactive Memory , 1995 .

[10]  Francesco Bullo,et al.  Dynamic models of appraisal networks explaining collective learning , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[11]  Chiara Ravazzi,et al.  Learning Influence Structure in Sparse Social Networks , 2018, IEEE Transactions on Control of Network Systems.

[12]  C. Altafini,et al.  Computing global structural balance in large-scale signed social networks , 2011, Proceedings of the National Academy of Sciences.

[13]  T. Beehr,et al.  Peer Appraisals: Differentiation of Individual Performance on Group Tasks , 2001 .

[14]  Francesco Bullo,et al.  Opinion Dynamics and the Evolution of Social Power in Influence Networks , 2015, SIAM Rev..

[15]  Steven Thomas Smith,et al.  Influence Estimation on Social Media Networks Using Causal Inference , 2018, 2018 IEEE Statistical Signal Processing Workshop (SSP).

[16]  Noah E. Friedkin,et al.  Social influence and opinions , 1990 .

[17]  J. Shepperd,et al.  Individual Contributions to a Collective Effort , 1989 .

[18]  Le Song,et al.  Influence Estimation and Maximization in Continuous-Time Diffusion Networks , 2016, ACM Trans. Inf. Syst..

[19]  John R. Austin Transactive memory in organizational groups: the effects of content, consensus, specialization, and accuracy on group performance. , 2003, The Journal of applied psychology.

[20]  Daniel Dajun Zeng,et al.  Social balance in signed networks , 2014, Information Systems Frontiers.

[21]  Francesco Bullo,et al.  Positive contagion and the macrostructures of generalized balance , 2019, Network Science.

[22]  Stephen P. Boyd,et al.  CVXPY: A Python-Embedded Modeling Language for Convex Optimization , 2016, J. Mach. Learn. Res..

[23]  Eric R. Stone,et al.  Intuitive evaluation of likelihood judgment producers: evidence for a confidence heuristic , 2004 .

[24]  P. Bonacich Power and Centrality: A Family of Measures , 1987, American Journal of Sociology.

[25]  Wei Chen,et al.  Efficient influence maximization in social networks , 2009, KDD.

[26]  Robert L. Goldstone,et al.  Social Learning Strategies in Networked Groups , 2013, Cogn. Sci..

[27]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[29]  R. Hertwig Tapping into the Wisdom of the Crowd—with Confidence , 2012, Science.

[30]  Aravind Srinivasan,et al.  Local balancing influences global structure in social networks , 2011, Proceedings of the National Academy of Sciences.

[31]  Fabián Riquelme,et al.  Measuring user influence on Twitter: A survey , 2015, Inf. Process. Manag..

[32]  Eric Gilbert,et al.  VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text , 2014, ICWSM.

[33]  Abdullah Almaatouq,et al.  Adaptive social networks promote the wisdom of crowds , 2020, Proceedings of the National Academy of Sciences.

[34]  Mahdi Jalili,et al.  Inference of Hidden Social Power Through Opinion Formation in Complex Networks , 2017, IEEE Transactions on Network Science and Engineering.

[35]  P. R. Laughlin,et al.  Demonstrability and social combination processes on mathematical intellective tasks. , 1986 .

[36]  Gonzalo G. de Polavieja,et al.  Improving Collective Estimations Using Resistance to Social Influence , 2015, PLoS Comput. Biol..

[37]  Michael Szell,et al.  Multirelational organization of large-scale social networks in an online world , 2010, Proceedings of the National Academy of Sciences.

[38]  Omer Levy,et al.  RoBERTa: A Robustly Optimized BERT Pretraining Approach , 2019, ArXiv.

[39]  J. Shepperd Productivity loss in performance groups: A motivation analysis. , 1993 .

[40]  Kyle Lewis Measuring transactive memory systems in the field: scale development and validation. , 2003, The Journal of applied psychology.

[41]  K. Kułakowski,et al.  The Heider balance - a continuous approach , 2005, physics/0501073.

[42]  Young Ji Kim,et al.  Dynamics of collective performance in collaboration networks , 2018, PloS one.

[43]  Le Song,et al.  Scalable Influence Estimation in Continuous-Time Diffusion Networks , 2013, NIPS.

[44]  H. London,et al.  THE JURY METHOD: HOW THE PERSUADER PERSUADES , 1970 .

[45]  Jure Leskovec,et al.  The dynamics of viral marketing , 2005, EC '06.

[46]  Noah E. Friedkin,et al.  A Formal Theory of Reflected Appraisals in the Evolution of Power , 2011 .

[47]  Ching-Yung Lin,et al.  Personalized recommendation driven by information flow , 2006, SIGIR.

[48]  S. Ye Measuring message propagation and social influence on Twitter , 2013 .

[49]  D. Sperber,et al.  "Two heads are better" stands to reason. , 2012, Science.

[50]  Ping-Kuo Chen,et al.  Exploring the antecedents and consequences of the transactive memory system: an empirical analysis , 2017, J. Knowl. Manag..

[51]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[52]  D. Goodin The cambridge dictionary of statistics , 1999 .

[53]  C. Granger Testing for causality: a personal viewpoint , 1980 .

[54]  Duncan J. Watts,et al.  Everyone's an influencer: quantifying influence on twitter , 2011, WSDM '11.

[55]  J. Henrich,et al.  The cultural niche: Why social learning is essential for human adaptation , 2011, Proceedings of the National Academy of Sciences.

[56]  J. R. French,et al.  The bases of social power. , 1959 .

[57]  知秀 柴田 5分で分かる!? 有名論文ナナメ読み:Jacob Devlin et al. : BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding , 2020 .

[58]  Shyhtsun Felix Wu,et al.  Measuring message propagation and social influence on Twitter.com , 2010, Int. J. Commun. Networks Distributed Syst..

[59]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[60]  Hans van Vliet,et al.  The effect of governance on global software development: An empirical research in transactive memory systems , 2014, Inf. Softw. Technol..

[61]  M. Degroot Reaching a Consensus , 1974 .

[62]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[63]  W. J. Granger,et al.  Essays in Econometrics Collected Papers of Clive , 2001 .

[64]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[65]  R. Cardy,et al.  Self-monitoring and performance appraisal: rating outcomes in project teams , 2000 .

[66]  Qianni Deng,et al.  How Your Friends Influence You: Quantifying Pairwise Influences on Twitter , 2012, 2012 International Conference on Cloud and Service Computing.

[67]  Nazrul I. Shaikh,et al.  Influence Estimation and Opinion-Tracking Over Online Social Networks , 2018 .

[68]  Francesco Bonchi,et al.  The Meme Ranking Problem: Maximizing Microblogging Virality , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[69]  Francesco Bullo,et al.  The Coevolution of Appraisal and Influence Networks Leads to Structural Balance , 2016, IEEE Transactions on Network Science and Engineering.

[70]  Jonathan P. Thomas,et al.  The confidence heuristic: A game-theoretic analysis , 1995 .

[71]  Kian-Lee Tan,et al.  Real-time Targeted Influence Maximization for Online Advertisements , 2015, Proc. VLDB Endow..

[72]  Kamesh Munagala,et al.  Modeling opinion dynamics in social networks , 2014, WSDM.

[73]  Francesco Bullo,et al.  Structural balance emerges and explains performance in risky decision-making , 2019, Nature Communications.

[74]  R. W. Haas,et al.  Using Peer Evaluations to Assess Individual Performances in Group Class Projects , 1996 .

[75]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[76]  Wei Chen,et al.  Scalable influence maximization for prevalent viral marketing in large-scale social networks , 2010, KDD.

[77]  Qi He,et al.  TwitterRank: finding topic-sensitive influential twitterers , 2010, WSDM '10.

[78]  Damon Centola,et al.  Network dynamics of social influence in the wisdom of crowds , 2017, Proceedings of the National Academy of Sciences.

[79]  Andreas Krause,et al.  Cost-effective outbreak detection in networks , 2007, KDD '07.

[80]  A. Colman,et al.  The Persuasive Power of Knowledge: Testing the Confidence Heuristic , 2018, Journal of experimental psychology. General.

[81]  Mahdi Jalili,et al.  Influence maximization of informed agents in social networks , 2015, Appl. Math. Comput..

[82]  Inga Carboni,et al.  The impact of awareness and accessibility on expertise retrieval: A multilevel network perspective , 2010, J. Assoc. Inf. Sci. Technol..

[83]  Claudio Altafini,et al.  Consensus Problems on Networks With Antagonistic Interactions , 2013, IEEE Transactions on Automatic Control.

[84]  Shelley E. Taylor,et al.  Theory and Research Concerning Social Comparisons of Personal Attributes , 2001 .

[85]  Kyle Lewis,et al.  Transactive Memory Systems, Learning, and Learning Transfer , 2005, Organ. Sci..

[86]  Francesco Bullo,et al.  How truth wins in opinion dynamics along issue sequences , 2017, Proceedings of the National Academy of Sciences.

[87]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.