Effective norm emergence in cell systems under limited communication

BackgroundThe cooperation of cells in biological systems is similar to that of agents in cooperative multi-agent systems. Research findings in multi-agent systems literature can provide valuable inspirations to biological research. The well-coordinated states in cell systems can be viewed as desirable social norms in cooperative multi-agent systems. One important research question is how a norm can rapidly emerge with limited communication resources.ResultsIn this work, we propose a learning approach which can trade off the agents’ performance of coordinating on a consistent norm and the communication cost involved. During the learning process, the agents can dynamically adjust their coordination set according to their own observations and pick out the most crucial agents to coordinate with. In this way, our method significantly reduces the coordination dependence among agents.ConclusionThe experiment results show that our method can efficiently facilitate the social norm emergence among agents, and also scale well to large-scale populations.

[1]  Nikos A. Vlassis,et al.  Collaborative Multiagent Reinforcement Learning by Payoff Propagation , 2006, J. Mach. Learn. Res..

[2]  Agostino Poggi,et al.  Multiagent Systems , 2006, Intelligenza Artificiale.

[3]  Ho-fung Leung,et al.  The dynamics of reinforcement social learning in networked cooperative multiagent systems , 2017, Eng. Appl. Artif. Intell..

[4]  Nicholas S. Flann,et al.  Biocellion: accelerating computer simulation of multicellular biological system models , 2014, Bioinform..

[5]  Jun Sun,et al.  Heuristic Collective Learning for Efficient and Robust Emergence of Social Norms , 2015, AAMAS.

[6]  Sandip Sen,et al.  Accelerating Norm Emergence Through Hierarchical Heuristic Learning , 2016, ECAI.

[7]  Jiajie Peng,et al.  Identifying consistent disease subnetworks using DNet. , 2017, Methods.

[8]  Yadong Wang,et al.  DisSetSim: an online system for calculating similarity between disease sets , 2016, Journal of Biomedical Semantics.

[9]  Shuhui Liu,et al.  Improving the measurement of semantic similarity by combining gene ontology and co-functional network: a random walk based approach , 2018, BMC Systems Biology.

[10]  Sandip Sen,et al.  Emergence of conventions through social learning , 2013, Autonomous Agents and Multi-Agent Systems.

[11]  Wanying Xu,et al.  OAHG: an integrated resource for annotating human genes with multi-level ontologies , 2016, Scientific Reports.

[12]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[13]  Meikang Qiu,et al.  Online optimization for scheduling preemptable tasks on IaaS cloud systems , 2012, J. Parallel Distributed Comput..

[14]  Gerhard Weiss,et al.  Multiagent Systems , 1999 .

[15]  Ho-fung Leung,et al.  Multiagent Reinforcement Social Learning toward Coordination in Cooperative Multiagent Systems , 2015, TAAS.

[16]  Y. Gong,et al.  Association study between vitamin D receptor gene polymorphisms and asthma in the chinese han population: a case-control study , 2009, BMC Medical Genetics.

[17]  Yadong Wang,et al.  Identifying term relations cross different gene ontology categories , 2017, BMC Bioinformatics.

[18]  Hongfang Liu,et al.  Detecting concept mentions in biomedical text using hidden Markov model: multiple concept types at once or one at a time? , 2014, J. Biomed. Semant..

[19]  Jun Sun,et al.  Efficient and Robust Emergence of Norms through Heuristic Collective Learning , 2017, ACM Trans. Auton. Adapt. Syst..

[20]  Liang Cheng,et al.  Measuring disease similarity and predicting disease-related ncRNAs by a novel method , 2017, BMC Medical Genomics.

[21]  Sandip Sen,et al.  Emergence of Norms through Social Learning , 2007, IJCAI.

[22]  Yue Jiang,et al.  DisSim: an online system for exploring significant similar diseases and exhibiting potential therapeutic drugs , 2016, Scientific Reports.

[23]  Yadong Wang,et al.  A novel method to measure the semantic similarity of HPO terms , 2017, Int. J. Data Min. Bioinform..

[24]  Michail G. Lagoudakis,et al.  Coordinated Reinforcement Learning , 2002, ICML.

[25]  Jianye Hao,et al.  Hierarchical Learning for Emergence of Social Norms in Networked Multiagent Systems , 2015, Australasian Conference on Artificial Intelligence.