Design of a web-based application of the coupled multi-agent system model and environmental model for watershed management analysis using Hadoop

Watersheds are modeled as coupled human and natural systems (CHNSs) by coupling a multi-agent system (MAS) model and an environmental model. The computational intensity and model accessibility of the coupled models are addressed in this paper. Multithreaded programming is used to improve the computational efficiency. As a result, the total running time of the coupled models is reduced by 80%, from one hour for a sequential run to twelve minutes with an eight-core desktop machine, running the model in parallel. To make the coupled models publicly accessible, a web-based application of the coupled models is implemented in the Hadoop-based cloud computing environment, which allows users to access and execute the model simultaneously without an increase in latency. This study presents a case of cyberinfrastructure design for complex watershed management problems, especially to parallelize computational models and provide model accessibility with user scalability. Combine multithreaded programming with Hadoop-based cloud computing.Reduce the runtime of the coupled models by 80% for the case study.Enable the scalable execution of the coupled models via the network.

[1]  David A. Bennett,et al.  Parallel agent-based modeling of spatial opinion diffusion accelerated using graphics processing units , 2011 .

[2]  A. Palazzo,et al.  Farm-Level Impacts of Alternative Spatial Water Management Policies for the Protection of Instream Flows , 2009 .

[3]  Eric Bonabeau,et al.  Agent-based modeling: Methods and techniques for simulating human systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Joshua M. Epstein.  Agent-based computational models and generative social science , 1999 .

[5]  Timothy G. Mattson,et al.  Patterns for parallel programming , 2004 .

[6]  Kurt Keutzer,et al.  A design pattern language for engineering (parallel) software: merging the PLPP and OPL projects , 2010, ParaPLoP '10.

[7]  George H. Hargreaves,et al.  Reference Crop Evapotranspiration from Temperature , 1985 .

[8]  Jon Parker,et al.  A Distributed Platform for Global-Scale Agent-Based Models of Disease Transmission , 2011, TOMC.

[9]  Elinor Ostrom,et al.  Complexity of Coupled Human and Natural Systems , 2007, Science.

[10]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[11]  M. Janssen,et al.  Multi-Agent Systems for the Simulation of Land-Use and Land-Cover Change: A Review , 2003 .

[12]  Li An,et al.  Modeling human decisions in coupled human and natural systems: Review of agent-based models , 2012 .

[13]  Sanjiva Weerawarana,et al.  Unraveling the Web services web: an introduction to SOAP, WSDL, and UDDI , 2002, IEEE Internet Computing.

[14]  Charles M. Macal,et al.  Managing Business Complexity: Discovering Strategic Solutions with Agent-Based Modeling and Simulation , 2007 .

[15]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[16]  Yong Liu,et al.  Cloud computing for integrated stochastic groundwater uncertainty analysis , 2013, Int. J. Digit. Earth.

[17]  James W. Haefner,et al.  Parallel Computers and Individual-based Models: An Overview , 1992 .

[18]  Laura Díaz,et al.  Service-oriented applications for environmental models: Reusable geospatial services , 2010, Environ. Model. Softw..

[19]  Shaowen Wang,et al.  Agent-based modeling within a cyberinfrastructure environment: a service-oriented computing approach , 2011, Int. J. Geogr. Inf. Sci..

[20]  David A. Bennett,et al.  Modelling adaptive, spatially aware, and mobile agents: Elk migration in Yellowstone , 2006, Int. J. Geogr. Inf. Sci..

[21]  Michael Monticino,et al.  Coupled human and natural systems: A multi-agent-based approach , 2007, Environ. Model. Softw..

[22]  J. Stephen Lansing,et al.  Anti-chaos, common property, and the emergence of cooperation , 2000 .

[23]  Howard W Reeves,et al.  Linking MODFLOW with an Agent‐Based Land‐Use Model to Support Decision Making , 2010, Ground water.

[24]  Anthony M. Castronova,et al.  Modeling water resource systems using a service-oriented computing paradigm , 2011, Environ. Model. Softw..

[25]  Daniel G. Brown,et al.  Evaluating the effects of land‐use development policies on ex‐urban forest cover: An integrated agent‐based GIS approach , 2009, Int. J. Geogr. Inf. Sci..

[26]  J. Eheart,et al.  An agent‐based model of farmer decision‐making and water quality impacts at the watershed scale under markets for carbon allowances and a second‐generation biofuel crop , 2011 .

[27]  Keith W. Hipel,et al.  The Future of Systems, Man, and Cybernetics: Application Domains and Research Methods , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Claudia Pahl-Wostl,et al.  Information, public empowerment, and the management of urban watersheds , 2005, Environ. Model. Softw..

[29]  Petraq J. Papajorgji,et al.  An architecture for developing service-oriented and component-based environmental models , 2004 .

[30]  Anthony M. Castronova,et al.  Models as web services using the Open Geospatial Consortium (OGC) Web Processing Service (WPS) standard , 2013, Environ. Model. Softw..

[31]  Christophe Le Page,et al.  Agent based simulation of a small catchment water management in northern Thailand: Description of the CATCHSCAPE model , 2003 .

[32]  Jack Dongarra,et al.  MPI: The Complete Reference , 1996 .

[33]  G. Nigel Gilbert,et al.  Simulation for the social scientist , 1999 .

[34]  Robert G. Reynolds,et al.  Unraveling ancient mysteries: reimagining the past using evolutionary computation in a complex gaming environment , 2005, IEEE Transactions on Evolutionary Computation.

[35]  Arun Krishnan,et al.  Parallel Computing Platform for the Agent-Based Modeling of Multicellular Biological Systems , 2004, PDCAT.

[36]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[37]  Munindar P. Singh,et al.  Service-Oriented Computing: Key Concepts and Principles , 2005, IEEE Internet Comput..

[38]  S. Running,et al.  A continuous satellite‐derived global record of land surface evapotranspiration from 1983 to 2006 , 2010 .

[39]  Willem A. Schreuder,et al.  Using a Cloud to Replenish Parched Groundwater Modeling Efforts , 2010, Ground water.

[40]  Robert J. Vanderbei,et al.  Robust Optimization of Large-Scale Systems , 1995, Oper. Res..

[41]  Ashton M. Shortridge,et al.  Exploring Complexity in a Human–Environment System: An Agent-Based Spatial Model for Multidisciplinary and Multiscale Integration , 2005 .

[42]  Chris Barrow,et al.  River Basin Development Planning and Management: A Critical Review , 1998 .

[43]  David A. Bennett,et al.  Parallel agent-based simulation of individual-level spatial interactions within a multicore computing environment , 2013, Int. J. Geogr. Inf. Sci..

[44]  François Bousquet,et al.  SINUSE: a multi-agent model to negotiate water demand management on a free access water table , 2003, Environ. Model. Softw..

[45]  David Holmes,et al.  Java Concurrency in Practice , 2006 .

[46]  Timothy G. Mattson,et al.  Reengineering for Parallelism: an entry point into PLPP for legacy applications , 2007, Concurr. Comput. Pract. Exp..

[47]  S. Goetz,et al.  Satellite based analysis of northern ET trends and associated changes in the regional water balance from 1983 to 2005 , 2008 .

[48]  Herbert Dawid,et al.  EURACE: A massively parallel agent-based model of the European economy , 2008, Appl. Math. Comput..

[49]  L. Joseph,et al.  Bayesian Statistics: An Introduction , 1989 .

[50]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[51]  Z. Samani,et al.  Reference crop evapotranspiration from ambient air temperature , 1985 .

[52]  Danny C. C. Poo,et al.  Java Database Connectivity , 2008 .