An evaluation of novice end-user computing performance: Data modeling, query writing, and comprehension

End-user computing has become a well-established aspect of enterprise database systems today. End-user computing performance depends on the user-database interface, in which the data model and query language are major components. We examined three prominent data models - the relational model, the Extended-Entity-Relationship (EER) model, and the Object-Oriented (00) model - and their query languages in a rigorous and systematic experiment to evaluate their effects on novice end-user computing performance in the context of database design and data manipulation. In addition, relationships among the performances for different tasks (modeling, query writing, query comprehension) were postulated with the use of a cognitive model for the query process, and are tested in the experiment. Structural Equation Modeling (SEM) techniques were used to examine the multiple causal relationships simultaneously. The findings indicate that the EER and OO models overwhelmingly outperformed the relational model in terms of accuracy for both database design and data manipulation. The associations between tasks suggest that data modeling techniques would enhance query writing correctness, and query writing ability would contribute to query comprehension. This study provides a better and thorough understanding of the inter-relationships among these data modeling and task factors. Our findings have significant implications for novice end-user training and development.

[1]  Jo Ellen Moore,et al.  The Focus of Research in End User Computing: Where Have We Come Since the 1980s? , 2002, J. Organ. End User Comput..

[2]  Keng Siau,et al.  The effect of data model, system and task characteristics on user query performance: an empirical study , 1997, DATB.

[3]  Peretz Shoval,et al.  OO and EER Conceptual Schemas: A Comparison of User Comprehension , 1994 .

[4]  Vesper Owei.  Natural language querying of databases: an information extraction approach in the conceptual query language , 2000, Int. J. Hum. Comput. Stud..

[5]  Jefry J. Machesky,et al.  Data Analysis and Learning: An Experimental Study of Data Modeling Tools , 1989, Int. J. Man Mach. Stud..

[6]  Phyllis Reisner,et al.  Human Factors Studies of Database Query Languages: A Survey and Assessment , 1981, CSUR.

[7]  Timo Niemi,et al.  Multidimensional Data Model and Query Language for Informetrics , 2003, J. Assoc. Inf. Sci. Technol..

[8]  Don Fallis,et al.  Indicators of accuracy for answers to ready reference questions on the Internet , 2004, J. Assoc. Inf. Sci. Technol..

[9]  Iris Vessey,et al.  An empirical investigation of entity-based and object-oriented data modeling: a development life cycle approach , 1999, ICIS.

[10]  David W. Gerbing,et al.  An Updated Paradigm for Scale Development Incorporating Unidimensionality and Its Assessment , 1988 .

[11]  David A. Bradbard,et al.  The Effects of Relational and Entity-Relationship Data Models on Query Performance of End Users , 1989, Int. J. Man Mach. Stud..

[12]  Louis Raymond,et al.  Definition and Measurement of End User Computing Sophistication , 1996 .

[13]  Ron Weber,et al.  Are Attributes Entities? A Study of Database Designers' Memory Structures , 1996, Inf. Syst. Res..

[14]  David K. Hsiao,et al.  Towards a Better Understanding of Data Models Through the Multilingual Database System , 1988, IEEE Trans. Software Eng..

[15]  William Kent,et al.  Limitations of record-based information models , 1979, TODS.

[16]  Margaret M. Burnett,et al.  Exception Handling in the Spreadsheet Paradigm , 2000, IEEE Trans. Software Eng..

[17]  Keng Siau,et al.  The Effects of Conceptual and Logical Interfaces on Visual Query Performance of End Users , 1995, ICIS.

[18]  Robert P. Bostrom,et al.  Comparing representations with relational and EER models , 1990, Commun. ACM.

[19]  Douglas B. Bock,et al.  Accuracy in Modeling with Extended Entity Relationship and Object Oriented Data Models , 1993 .

[20]  Keng Siau,et al.  User-Database Interface: The Effect of Abstraction Levels on Query Performance , 1993, MIS Q..

[21]  Jean Underwood,et al.  Novice use of a relational database: A case study of a local history data file , 1990 .

[22]  Peretz Shoval,et al.  An Experimental Comparison of Entity-Relationship and Object-Oriented Model on Quality of Design , 1995, NGITS.

[23]  Tor Guimaraes,et al.  An exploratory assessment of the use and benefits of ESDLC in practice , 1996 .

[24]  Shamkant B. Navathe,et al.  Enriching the conceptual basis for query formulation through relationship semantics in databases , 2001, Inf. Syst..

[25]  Prashant Palvia,et al.  The Impact of Conceptual Data Models on End-User Performance , 1992 .

[26]  Alexander Hars,et al.  Web Based Knowledge Infrastructures for the Sciences: An Adaptive Document , 2000, Commun. Assoc. Inf. Syst..

[27]  William C. Ogden.  IMPLICATIONS OF A COGNITIVE MODEL OF DATABASE QUERY: COMPARISON OF A NATURAL LANGUAGE, FORMAL LANGUAGE AND DIRECT MANIPULATION INTERFACE , 1986, SGCH.

[28]  Heeseok Lee,et al.  A Comparative Study of Conceptual Data Modeling Techniques , 1998, J. Database Manag..

[29]  Bernard C. Y. Tan,et al.  Three important determinants of user performance for database retrieval , 1999, Int. J. Hum. Comput. Stud..

[30]  Stéphane Bressan,et al.  Introduction to Database Systems , 2005 .

[31]  Bill C. Hardgrave,et al.  Comparing Object-Oriented and Extended-Entity-Relationship Data Models , 1995 .

[32]  Peretz Shoval,et al.  Database schema design: an experimental comparison between normalization and information analysis , 1987, DATB.

[33]  Lerina Aversano,et al.  Understanding SQL through iconic interfaces , 2002, Proceedings 26th Annual International Computer Software and Applications.

[34]  William C. Perkins,et al.  The effects of a system echo in a restricted natural language database interface for novice users , 1994, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[35]  Paul L. Bowen,et al.  Further evidence of the effects of normalization on end-user query errors: an experimental evaluation , 2002, Int. J. Account. Inf. Syst..

[36]  Donald D. Cowan,et al.  Abstract Data Views: An Interface Specification Concept to Enhance Design for Reuse , 1995, IEEE Trans. Software Eng..

[37]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..

[38]  Ivar Jacobson,et al.  The unified modeling language reference manual , 2010 .

[39]  F. Bookstein,et al.  Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory: , 1982 .

[40]  Peter P. Chen.  The entity-relationship model: toward a unified view of data , 1975, VLDB '75.

[41]  John B. Smelcer,et al.  User errors in database query composition , 1995, Int. J. Hum. Comput. Stud..

[42]  Richard W. Scamell,et al.  A Human Factors Experimental Comparison of SQL and QBE , 1993, IEEE Trans. Software Eng..

[43]  Chechen Liao,et al.  The impact of data models and task complexity on end-user performance: an experimental investigation , 2000, Int. J. Hum. Comput. Stud..

[44]  Wynne W. Chin.  Issues and Opinion on Structural Equation Modeling by , 2009 .

[45]  Hock-Hai Teo,et al.  An Experimental Study of Object-Oriented Query Language and Relational Query Language for Novice Users , 1994 .

[46]  Phyllis Reisner,et al.  Use of Psychological Experimentation as an Aid to Development of a Query Language , 1977, IEEE Transactions on Software Engineering.

[47]  Donald R. Jones,et al.  The effects of information request ambiguity and construct incongruence on query development , 2001, Decis. Support Syst..

[48]  Radhika Santhanam,et al.  Introduction to the special issue: the human-computer interface in information system design , 1997, DATB.

[49]  Ben Shneiderman,et al.  Direct manipulation for comprehensible, predictable and controllable user interfaces , 1997, IUI '97.

[50]  David A. Carrington,et al.  UML Class Diagram Syntax: An Empirical Study of Comprehension , 2001, InVis.au.

[51]  Izak Benbasat,et al.  The Relative Importance of Structural Constraints and Surface Semantics in Information Modeling , 1997, Inf. Syst..

[52]  Justus D. Naumann,et al.  The Effectiveness of Data Representation Characteristics on User Validation , 1985, ICIS.

[53]  C. J. Date,et al.  A Guide to the SQL Standard: A User's Guide to the Standard Relational Language SQL , 1993 .

[54]  Leon A. Kappelman,et al.  Converging end-user and corporate computing , 1993, CACM.

[55]  Dinesh Batra,et al.  Effects of data model and task characteristics on designer performance: a laboratory study , 1994, Int. J. Hum. Comput. Stud..

[56]  Jong-Hyeok Lee,et al.  Database semantics representation for natural language access , 2002, First International Symposium on Cyber Worlds, 2002. Proceedings..

[57]  Radhika Santhanam,et al.  The Human-Computer Interface in Information Systems Design - Introductionto the Special Issue , 1998, Data Base.