Limites de l'évaluation d'un Système d'Information : une analyse fondée sur l'expérience pratique

Un grand nombre de definitions du systeme d'information (SI) ont ete proposees dans la litterature. Il est maintenant bien accepte par les communautes manipulant ce concept que le systeme d'information combine un systeme d'information numerique et des activites humaines afin de servir de support aux branches operationnelles, a la gestion et a la prise de decision dans l'entreprise. Assurer la qualite du SI est donc crucial. Cependant, evaluer cette qualite est une tâche multidimensionnelle complexe, concernant differentes ressources (processus, donnees, artefacts, interfaces, ...), considerant differentes caracteristiques (utilisabilite, fonctionnalites, ...) et mettant en oeuvre differentes methodes pour effectuer l'evaluation. Apres plusieurs annees d'experience dans l'evaluation des SI, nous resumons dans ce papier les lecons que nous avons tirees des evaluations que nous avons menees, et exhibons les limites de l'evaluation d'un SI. Nous finissons le papier par une reflexion sur l'avenir de l'evaluation d'un SI.

[1]  Sandro Morasca,et al.  Property-Based Software Engineering Measurement , 1996, IEEE Trans. Software Eng..

[2]  Mark Staples,et al.  Two case studies on small enterprise motivation and readiness for CMMI , 2010, PROFES '10.

[3]  Virginie Thion,et al.  Évaluation de la qualité d'un processus métier à l'aide d'nformations issues de réseaux informels , 2010, Ingénierie des Systèmes d Inf..

[4]  Julie A. Jacko,et al.  Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, Third Edition , 2012 .

[5]  John Krogstie,et al.  Integrating the understanding of quality in requirements specification and conceptual modeling , 1998, SOEN.

[6]  Zahir Irani,et al.  Information systems evaluation: navigating through the problem domain , 2002, Inf. Manag..

[7]  José Barateiro,et al.  A Survey of Data Quality Tools , 2005, Datenbank-Spektrum.

[8]  Nadine Mandran,et al.  A Case Study for Improving a Collaborative Design Process , 2011, ME.

[9]  Geert Poels,et al.  DISTANCE: a framework for software measure construction , 1999 .

[10]  H. D. Rombach,et al.  The Goal Question Metric Approach , 1994 .

[11]  Christophe Kolski,et al.  Modelling of an interactive system with an agent-based architecture using Petri nets, application of the method to the supervision of a transport system , 2006, Math. Comput. Simul..

[12]  Samira Si-Said Cherfi,et al.  Assessment and analysis of information quality: a multidimensional model and case studies , 2011, Int. J. Inf. Qual..

[13]  Jean-Luc Hainaut,et al.  A Combined Global-Analytical Quality Framework for Data Models , 2008 .

[14]  Ning Wu,et al.  A New Model , 1998 .

[15]  Sophie Dupuy-Chessa,et al.  Using software metrics in the evaluation of a conceptual component model , 2010, RCIS 2010.

[16]  Christophe Kolski,et al.  State of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions , 2010, Int. J. Hum. Comput. Interact..

[17]  Isabelle Comyn-Wattiau,et al.  La qualité des systèmes d'information: Vers une vision plus intégrée , 2010 .

[18]  Sophie Dupuy-Chessa,et al.  Evaluating Choreographies in BPMN 2.0 Using an Extended Quality Framework , 2011, BPMN.

[19]  Silvia Mara Abrahão,et al.  Integrating a Usability Model into Model-Driven Web Development Processes , 2009, WISE.

[20]  Jörg Rech,et al.  Model-Driven Software Development - Integrating Quality Assurance , 2008 .

[21]  Someswar Kesh,et al.  Evaluating the quality of entity relationship models , 1995, Inf. Softw. Technol..

[22]  Nicolas Anquetil,et al.  Legacy software evaluation model for outsourced maintainer , 2004, Eighth European Conference on Software Maintenance and Reengineering, 2004. CSMR 2004. Proceedings..

[23]  Athanasia Pouloudi,et al.  Aspects of the stakeholder concept and their implications for information systems development , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[24]  Samira Si-Said Cherfi,et al.  A pattern-oriented methodology for conceptual modeling evaluation and improvement , 2011, 2011 FIFTH INTERNATIONAL CONFERENCE ON RESEARCH CHALLENGES IN INFORMATION SCIENCE.

[25]  Veda C. Storey,et al.  A Framework for Analysis of Data Quality Research , 1995, IEEE Trans. Knowl. Data Eng..

[26]  Mario Piattini,et al.  Evaluation measures for business process models , 2006, SAC.

[27]  Peter Rittgen.  Quality and perceived usefulness of process models , 2010, SAC '10.

[28]  Samira Si-Said Cherfi,et al.  Conceptual Modeling Quality - From EER to UML Schemas Evaluation , 2002, ER.

[29]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[30]  Nelly Condori-Fernández,et al.  Towards an Early Usability Evaluation for Web Applications , 2007, IWSM/Mensura.

[31]  Dominique L. Scapin,et al.  Ergonomic criteria for evaluating the ergonomic quality of interactive systems , 1997, Behav. Inf. Technol..

[32]  Ananya Kanjilal,et al.  Analysis of complexity of requirements: a metrics based approach , 2009, ISEC '09.

[33]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[34]  Fabio Stella,et al.  Dependency Discovery in Data Quality , 2010, CAiSE.

[35]  Sun Myung Hwang.  Process Quality Levels of ISO / IEC 15504 , CMMI and K-model , 2009 .

[36]  Giuseppe Visaggio,et al.  Evaluating Defect Detection Techniques for Software Requirements Inspections , 2000 .

[37]  Lu Zhang,et al.  Applying OO Metrics to Assess UML Meta-models , 2004, UML.

[38]  Káthia Marçal de Oliveira,et al.  Evaluating the Accessibility of Websites to Define Indicators in Service Level Agreements , 2009, ICEIS.

[39]  Mary Beth Chrissis,et al.  CMMI: Guidelines for Process Integration and Product Improvement , 2003 .

[40]  Arne Sølvberg,et al.  Understanding quality in conceptual modeling , 1994, IEEE Software.

[41]  Mordechai Ben-Menachem,et al.  Review of "CMMI: guidelines for process integration and product improvement by Mary Beth Chrissis, Mike Konrad and Sandy Shrum." Addison Wesley 2003 , 2004, SOEN.

[42]  Ida Solheim,et al.  Model Quality in the Context of Model-Driven Development , 2017, MDEIS.

[43]  Carlo Batini,et al.  Methodologies for data quality assessment and improvement , 2009, CSUR.

[44]  Joseph Moses Juran,et al.  Juran Institute's Six Sigma Breakthrough and Beyond , 2004 .

[45]  Thomas Redman,et al.  The impact of poor data quality on the typical enterprise , 1998, CACM.

[46]  J. M. Christian Bastien,et al.  Usability testing: a review of some methodological and technical aspects of the method , 2010, Int. J. Medical Informatics.

[47]  Christophe Kolski,et al.  Evaluation of Agent-based Interactive Systems: Proposal of an Electronic Informer Using Petri Nets , 2008, J. Univers. Comput. Sci..

[48]  Sun-myung Hwang,et al.  Analysis of Relationship among ISO/IEC 15504, CMMI and K-model , 2009, 2009 10th ACIS International Conference on Software Engineering, Artificial Intelligences, Networking and Parallel/Distributed Computing.

[49]  Jingde Cheng,et al.  A New Model of Software Life Cycle Processes for Consistent Design, Development, Management, and Maintenance of Secure Information Systems , 2009, 2009 Eighth IEEE/ACIS International Conference on Computer and Information Science.

[50]  Geert Poels,et al.  Evaluating Quality of Conceptual Models Based on User Perceptions , 2006, ER.

[51]  Richard Y. Wang,et al.  Anchoring data quality dimensions in ontological foundations , 1996, CACM.

[52]  Carlo Batini,et al.  Data Quality: Concepts, Methodologies and Techniques , 2006, Data-Centric Systems and Applications.

[53]  David Raffo,et al.  Software project management using PROMPT: A hybrid metrics, modeling and utility framework , 2005, Inf. Softw. Technol..

[54]  Káthia Marçal de Oliveira,et al.  Defining a catalog of indicators to support process performance analysis , 2011, J. Softw. Maintenance Res. Pract..

[55]  A. Némery.  Elaboration, validation et application de la grille de critères de persuasion interactive , 2012 .

[56]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[57]  Káthia Marçal de Oliveira,et al.  Evaluating the service quality of software providers appraised in CMM/CMMI , 2009, Software Quality Journal.

[58]  Reda Bendraou,et al.  Artifact or process guidance, an empirical study , 2010, MODELS'10.

[59]  Daniel L. Moody,et al.  Evaluating the quality of information models: empirical testing of a conceptual model quality framework , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[60]  Cesare Pautasso,et al.  Goals, questions and metrics for architectural decision models , 2011, SHARK '11.

[61]  Reda Bendraou,et al.  Deviation management during process execution , 2011, 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011).

[62]  Staðlaráð Íslands,et al.  Gæðastjórnunarkerfi : grunnatriði og íðorðasafn = Quality Management Systems : fundamentals and vocabulary. , 2006 .

[63]  Antonis C. Stylianou,et al.  An integrative framework for IS quality management , 2000, CACM.

[65]  Samira Si-Said Cherfi,et al.  Qualité perçue des schémas conceptuels. Etude comparée informaticiens vs. utilisateurs , 2009, Ingénierie des Systèmes d Inf..