Supporting decision making process with "ideal" software agents - What do business executives want?

According to Simon's (1977) decision making theory, intelligence is the first and most important phase in the decision making process. With the escalation of information resources available to business executives, it is becoming imperative to explore the potential and challenges of using agent-based systems to support the intelligence phase of decision-making. This research examines UK executives' perceptions of using agent-based support systems and the criteria for design and development of their ''ideal'' intelligent software agents. The study adopted an inductive approach using focus groups to generate a preliminary set of design criteria of ''ideal'' agents. It then followed a deductive approach using semi-structured interviews to validate and enhance the criteria. This qualitative research has generated unique insights into executives' perceptions of the design and use of agent-based support systems. The systematic content analysis of qualitative data led to the proposal and validation of design criteria at three levels. The findings revealed the most desirable criteria for agent based support systems from the end users' point view. The design criteria can be used not only to guide intelligent agent system design but also system evaluation.

[1]  Neal G. Shaw,et al.  A comprehensive agent-based architecture for intelligent information retrieval in a distributed heterogeneous environment , 2002, Decis. Support Syst..

[2]  Miles MacLeod,et al.  Usability measurement in context , 1994, Behav. Inf. Technol..

[3]  Lipika Dey,et al.  A rough-fuzzy document grading system for customized text information retrieval , 2005, Inf. Process. Manag..

[4]  Theophilus B. A. Addo,et al.  Diffusion of executive information systems in organizations and the shift to Web technologies , 2000, Ind. Manag. Data Syst..

[5]  Efraim Turban,et al.  Decision support systems and intelligent systems , 1997 .

[6]  Robert S. Taylor,et al.  Value-Added Processes in Information Systems , 1987 .

[7]  Shirley Gregor,et al.  User participation in decision support systems development: Influencing system outcomes , 2004, Eur. J. Inf. Syst..

[8]  Anne Morris,et al.  The problem of information overload in business organisations: a review of the literature , 2000, Int. J. Inf. Manag..

[9]  Rob Kling,et al.  What Is Social Informatics and Why Does It Matter? , 2007, D Lib Mag..

[10]  Hyacinth S. Nwana,et al.  Software agents: an overview , 1996, The Knowledge Engineering Review.

[11]  Doug Riecken,et al.  Introduction: personalized views of personalization , 2000, CACM.

[12]  Philip Powell,et al.  Reflections on information systems practice, education and research: 10 years of the Information Systems Journal , 2001, Inf. Syst. J..

[13]  Anil Kumar,et al.  Key data management issues in a global executive information system , 2001, Ind. Manag. Data Syst..

[14]  Shijia Gao,et al.  Conceptual modeling and development of an intelligent agent-assisted decision support system for anti-money laundering , 2009, Expert Syst. Appl..

[15]  Izak Benbasat,et al.  Empirical Research in Information Systems: The Practice of Relevance , 1999, MIS Q..

[16]  Hyacinth S. Nwana,et al.  2 Multi-Agent Systems : Promises and Reality , 1999 .

[17]  Dominique L. Scapin,et al.  Ergonomic criteria for evaluating the ergonomic quality of interactive systems , 1997, Behav. Inf. Technol..

[18]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[19]  José L. Roldán,et al.  Managing Executive Information Systems for Strategic Intelligence in South Africa and Spain , 2010 .

[20]  Chun Wei Choo,et al.  How Senior Managers Acquire and Use Information in Environmental Scanning , 1994, Inf. Process. Manag..

[21]  BeathCynthia Mathis,et al.  The information technology interaction model , 1995 .

[22]  Jos van Hillegersberg,et al.  Enterprise resource planning: ERP adoption by European midsize companies , 2000, CACM.

[23]  Jane Fulton Suri,et al.  Experience prototyping , 2000, DIS '00.

[24]  N. Bevan,et al.  Quality in use: incorporating human factors into the software engineering lifecycle , 1997, Proceedings of IEEE International Symposium on Software Engineering Standards.

[25]  Hugh J. Watson,et al.  Determinates of EIS acceptance , 1995, Inf. Manag..

[26]  Shuhua Liu,et al.  Strategic scanning and interpretation revisiting: foundations for a software agent support system ‐ Part 2: scanning the business environment with software agents , 1998 .

[27]  Herbert A. Simon,et al.  The new science of management decision , 1960 .

[28]  V. Lakshmi Narasimhan,et al.  A new classification scheme for software agents , 2005, Third International Conference on Information Technology and Applications (ICITA'05).

[29]  Gerard Salton,et al.  Improving retrieval performance by relevance feedback , 1997, J. Am. Soc. Inf. Sci..

[30]  Henry C. W. Lau,et al.  Design and development of agent-based procurement system to enhance business intelligence , 2009, Expert Syst. Appl..

[31]  Marcela D. Rodríguez,et al.  Context-Aware Mobile Communication in Hospitals , 2003, Computer.

[32]  Enid Mumford,et al.  The story of socio‐technical design: reflections on its successes, failures and potential , 2006, Inf. Syst. J..

[33]  Graham Pervan,et al.  A critical analysis of decision support systems research , 2005, J. Inf. Technol..

[34]  E. V. Krishnamurthy,et al.  Contextual information management using contract: based workflow , 2005, CF '05.

[35]  Murray Sinclair,et al.  User-centred design does make a difference. The case of decision support systems in crop production , 2001, Behav. Inf. Technol..

[36]  Btjbsell L. Ackoft,et al.  MANAGEMENT MISINFORMATION SYSTEMS* , 2007 .

[37]  Gareth J. F. Jones,et al.  Context-aware Retrieval: Exploring a New Environment for Information Retrieval and Information Filtering , 2001, Personal and Ubiquitous Computing.

[38]  Liisa von Hellens,et al.  Qualitative Research in Information Systems , 2007, Australas. J. Inf. Syst..

[39]  Janice M. Morse,et al.  "Perfectly Healthy, but Dead": The Myth of Inter-Rater Reliability , 1997 .

[40]  Eija Kaasinen,et al.  Usability Challenges in Agent Based Services , 1999, IS&N.

[41]  Christopher C. Yang,et al.  Intelligent infomediary for web financial information , 2004, Decis. Support Syst..

[42]  N. Roberts,et al.  Value-added processes in information systems , 1986 .

[43]  J. W. Jones,et al.  THE STRUCTURE OF EXECUTIVE INFORMATION SYSTEMS: AN EXPLORATORY ANALYSIS , 1986 .

[44]  Ahmed Karmouch,et al.  ACAI: agent-based context-aware infrastructure for spontaneous applications , 2005, J. Netw. Comput. Appl..

[45]  Peretz Shoval,et al.  Experimentation with an information filtering system that combines cognitive and sociological filtering integrated with user stereotypes , 1999, Decis. Support Syst..

[46]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[47]  David D. Lewis,et al.  A comparison of two learning algorithms for text categorization , 1994 .

[48]  Paula Nicolson,et al.  Quality of life, distress and self-esteem: a focus group study of people with chronic bronchitis. , 2003, British journal of health psychology.

[49]  B. K. Blaylock,et al.  COGNITIVE STYLE AND THE USEFULNESS OF INFORMATION , 1984 .

[50]  Jérôme Gensel,et al.  Context-aware filtering for collaborative web systems: adapting the awareness information to the user's context , 2005, SAC '05.

[51]  Alberto RibesAbstract,et al.  Multi agent systems , 2019, Proceedings of the 2005 International Conference on Active Media Technology, 2005. (AMT 2005)..

[52]  Athula Ginige,et al.  Improving information retrieval effectiveness by assigning context to documents , 2004, ISICT.

[53]  Cynthia Mathis Beath,et al.  The Information Technology Interaction Model: A Foundation for the MBA Core Course , 1995, MIS Q..

[54]  Nicholas R. Jennings,et al.  A Roadmap of Agent Research and Development , 2004, Autonomous Agents and Multi-Agent Systems.

[55]  Javed Mostafa,et al.  An experiment in building profiles in information filtering: the role of context of user relevance feedback , 2002, Inf. Process. Manag..

[56]  Juhani Iivari,et al.  The user – the great unknown of systems development: reasons, forms, challenges, experiences and intellectual contributions of user involvement , 2010, Inf. Syst. J..

[57]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[58]  Hugh J. Watson,et al.  Building Executive Information Systems and Other Decision Support Applications , 1996 .

[59]  Mary Lacity,et al.  Understanding Qualitative Data: A Framework of Text Analysis Methods , 1994, J. Manag. Inf. Syst..

[60]  Antonio Fernández-Caballero,et al.  Modeling and implementing an agent-based environmental health impact decision support system , 2009, Expert Syst. Appl..

[61]  Paul R. Watkins.  PREFERENCE MAPPING OF PERCEIVED INFORMATION STRUCTURE: IMPLICATIONS FOR DECISION SUPPORT SYSTEMS DESIGN , 1984 .

[62]  Steven J. Plimpton,et al.  Massively parallel methods for engineering and science problems , 1994, CACM.

[63]  Fabrizio Sebastiani,et al.  Machine learning in automated text categorization , 2001, CSUR.

[64]  Susan Brewer,et al.  Information storage and retrieval , 1959, ACM '59.

[65]  Liisa von Hellens,et al.  A qualitative case study of the adoption and use of an agricultural decision support system in the Australian cotton industry: The socio-technical view , 2009, Decis. Support Syst..

[66]  Wen-Yau Liang,et al.  The agent-based negotiation process for B2C e-commerce , 2010, Expert Syst. Appl..