Using Clickers in a Large Business Class

As more and more institutions are integrating new technologies (e.g., audience response systems such as clickers) into their teaching and learning systems, it is becoming increasingly necessary to have a detailed understanding of the underlying mechanisms of these advanced technologies and their outcomes on student learning perceptions. We proposed a conceptual model based on the technology acceptance model to understand students’ use behavior and satisfaction with clickers. The valid response from 138 second-year business students of Digital Marketing module taught in a British university, where clickers are extensively used in the teaching and learning process, made the basis for data analysis. The results provided a strong support for the proposed model with a reasonably adequate variance (i.e., adjusted R2) of 67% on behavioral intentions and sufficiently high variance on use behavior (i.e., 86%) and user satisfaction (i.e., 89%).

[1]  Ronald F. Premuroso,et al.  Does Using Clickers in the Classroom Matter to Student Performance and Satisfaction When Taking the Introductory Financial Accounting Course , 2011 .

[2]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[3]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[4]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[5]  Darren W. Dahl,et al.  Learning to Click , 2010 .

[6]  Meredith Lawley,et al.  Using Innovative Technology to Develop Sustainable Assessment Practices in Marketing Education , 2011 .

[7]  Irene C. L. Ng Photoessays in the Teaching of Marketing , 2006 .

[8]  W. Zikmund Business Research Methods , 1984 .

[9]  Education: Past, Present and Future , 1970, Nature.

[10]  Lorena Blasco-Arcas,et al.  Using clickers in class. The role of interactivity, active collaborative learning and engagement in learning performance , 2013, Comput. Educ..

[11]  Angel Hoekstra,et al.  How clicker use facilitates existing pedagogical practices in higher education: data from interdisciplinary research on student response systems , 2012 .

[12]  Ying Li,et al.  Using a Classroom Response System in an Introductory Business Statistics Course: Reflections and Lessons Learned , 2012 .

[13]  Jill A. Marshall,et al.  Classroom Response Systems: A Review of the Literature , 2006 .

[14]  Albert H. Segars,et al.  Re-examining perceived ease of use and usefulness , 1993 .

[15]  Steven Robbins,et al.  Beyond clickers: using ClassQue for multidimensional electronic classroom interaction , 2011, SIGCSE.

[16]  Detmar W. Straub,et al.  Trust and TAM in Online Shopping: An Integrated Model , 2003, MIS Q..

[17]  David J. Shernoff,et al.  Continuing motivation beyond the high school classroom. , 2001, New directions for child and adolescent development.

[18]  David F. Feldon,et al.  Five common but questionable principles ofmultimedia learning , 2005 .

[19]  Margaret I. Brown,et al.  Increasing interactivity in lectures using an electronic voting system , 2004, J. Comput. Assist. Learn..

[20]  Rod Sims,et al.  Promises of Interactivity: Aligning Learner Perceptions and Expectations With Strategies for Flexible and Online Learning , 2003 .

[21]  Jane E Caldwell,et al.  Clickers in the large classroom: current research and best-practice tips. , 2007, CBE life sciences education.

[22]  Matthew L. Meuter,et al.  A Student View of Technology in the Classroom , 2011 .

[23]  Yurong Yao,et al.  Remote electronic voting systems: an exploration of voters' perceptions and intention to use , 2007, Eur. J. Inf. Syst..

[24]  Viswanath Venkatesh,et al.  Why Don't Men Ever Stop to Ask for Directions? Gender, Social Influence, and Their Role in Technology Acceptance and Usage Behavior , 2000, MIS Q..

[25]  Blake Ives,et al.  An empirical study of the impact of user involvement on system usage and information satisfaction , 1986, CACM.

[26]  Tzu-Chien Liu,et al.  Embedding EduClick in Classroom to Enhance Interaction , 2004 .

[27]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[28]  Shawn M. Keough Clickers in the Classroom , 2012 .

[29]  Robin H. Kay,et al.  Examining the benefits and challenges of using audience response systems: A review of the literature , 2009, Comput. Educ..

[30]  Tiago Oliveira,et al.  Understanding the Internet banking adoption: A unified theory of acceptance and use of technology and perceived risk application , 2014, Int. J. Inf. Manag..

[31]  Shannon B. Rinaldo,et al.  Learning by Tweeting , 2011 .

[32]  Tom Buchanan,et al.  Factors affecting faculty use of learning technologies: implications for models of technology adoption , 2013, J. Comput. High. Educ..

[33]  Meghan D. McAuliffe,et al.  Efficacy of Personal Response Systems (“Clickers”) in Large, Introductory Psychology Classes , 2008 .

[34]  Gerald Albaum,et al.  Classroom Questioning with Immediate Electronic Response: Do Clickers Improve Learning?. , 2008 .

[35]  Byron J. Pike,et al.  A quasi-experimental assessment of interactive student response systems on student confidence, effort, and course performance , 2013 .

[36]  Adam Finkelstein,et al.  Understanding the effects of professors' pedagogical development with Clicker Assessment and Feedback technologies and the impact on students' engagement and learning in higher education , 2013, Comput. Educ..

[37]  B. Moely,et al.  Service-Learning and Engagement, Academic Challenge, and Retention , 2003 .

[38]  Szu-Yuan Sun,et al.  Usability, quality, value and e-learning continuance decisions , 2005, Comput. Educ..

[39]  J. Stowell,et al.  Benefits of Electronic Audience Response Systems on Student Participation, Learning, and Emotion , 2007 .

[40]  J. H. Steiger Statistically based tests for the number of common factors , 1980 .

[41]  S. Jeschke,et al.  Chances and risks of using clicker software in XL engineering classes - From theory to practice , 2013, 2013 3rd Interdisciplinary Engineering Design Education Conference.

[42]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[43]  William M. Hedgcock,et al.  Clicking Their Way to Success: Using Student Response Systems as a Tool for Feedback , 2014 .

[44]  Irvine Clarke,et al.  Teaching the Visual Learner: The Use of Visual Summaries in Marketing Education , 2006 .

[45]  Viswanath Venkatesh,et al.  Creation of Favorable User Perceptions: Exploring the Role of Intrinsic Motivation , 1999, MIS Q..

[46]  Lynn Vos,et al.  Effects of Participation in a Simulation Game on Marketing Students’ Numeracy and Financial Skills , 2013 .

[47]  Mark L. Berenson,et al.  Ask the audience...Using clickers to enhance introductory business statistics courses , 2008 .

[48]  Timothy Teo,et al.  An Assessment of Pre-Service Teachers’ Technology Acceptance in Turkey: A Structural Equation Modeling Approach , 2012 .

[49]  Rob Law,et al.  Re-examining perceived usefulness and ease of use in online booking: The case of Hong Kong online users , 2015 .

[50]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[51]  Peter B. Seddon A Respecification and Extension of the DeLone and McLean Model of IS Success , 1997, Inf. Syst. Res..

[52]  Tibert Verhagen,et al.  Satisfaction with virtual worlds: An integrated model of experiential value , 2011, Inf. Manag..

[53]  M. D. Roblyer,et al.  Design and Use of a Rubric to Assess and Encourage Interactive Qualities in Distance Courses , 2003 .

[54]  Anna Carlin,et al.  Waking the Dead: Using interactive technology to engage passive listeners in the classroom , 2004, AMCIS.

[55]  L. Leach,et al.  Improving student engagement: Ten proposals for action , 2010 .

[56]  John Ingham,et al.  Why do people use information technology? A critical review of the technology acceptance model , 2003, Inf. Manag..

[57]  Carla Carnaghan,et al.  Using student response systems in the accounting classroom: Strengths, strategies and limitations , 2011 .

[58]  Peter B. Seddon,et al.  A Partial Test and Development of Delone and Mclean's Model of IS Success , 1996, Australas. J. Inf. Syst..

[59]  Marjorie B. Platt,et al.  Class Participation inAccounting Courses: FactorsThatAffect Student Comfort and Learning , 2010 .

[60]  Shirley Taylor,et al.  Decomposition and crossover effects in the theory of planned behavior: A study of consumer adoption intentions , 1995 .

[61]  James C. Anderson,et al.  Monte Carlo Evaluations of Goodness of Fit Indices for Structural Equation Models , 1992 .

[62]  Carla Carnaghan,et al.  Investigating the Effects of Group Response Systems on Student Satisfaction, Learning and Engagement in Accounting Education , 2007 .

[63]  Meg Fryling,et al.  Click It and Ticket: Extending the benefits of clickers in small classrooms to increase non- anonymous class participation , 2013 .

[64]  Chen-Lin C. Kulik,et al.  Timing of Feedback and Verbal Learning , 1988 .

[65]  Peter B. Seddon,et al.  A Partial Test and Development of the DeLone and McLean Model of IS Success , 1994, ICIS.

[66]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[67]  Alvin C. Burns,et al.  Using the Madeline Hunter Direct Instruction Model to Improve Outcomes Assessments in Marketing Programs , 2010 .

[68]  Michael M. Pearson,et al.  Development of a Computerized In-Basket Exercise for the Classroom: A Sales Management Example , 2006 .

[69]  Claude Sicotte,et al.  Modeling factors explaining the acceptance, actual use and satisfaction of nurses using an Electronic Patient Record in acute care settings: An extension of the UTAUT , 2015, Int. J. Medical Informatics.

[70]  Diane M. Strong,et al.  Extending the technology acceptance model with task-technology fit constructs , 1999, Inf. Manag..

[71]  Mark R. Young The Art and Science of Fostering Engaged Learning , 2010 .

[72]  Il Im,et al.  An international comparison of technology adoption: Testing the UTAUT model , 2011, Inf. Manag..

[73]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[74]  C. Thoms,et al.  USING STUDENT RESPONSE SYSTEMS (CLICKERS) IN REDESIGNING A BLENDED LEARNING CURRICULUM , 2010 .

[75]  Alison B. Flynn,et al.  Developing Problem-Solving Skills through Retrosynthetic Analysis and Clickers in Organic Chemistry , 2011 .

[76]  Daniel Robey,et al.  User Attitudes and Management Information System Use , 1979 .

[77]  Maureen Lojo A Comparison of Clicker Effectiveness for Multiple Choice and Quantitative Questions , 2009 .

[78]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[79]  Lisa Zizzi Bain,et al.  THE IMPACT OF STUDENT RESPONSE SYSTEMS ON STUDENT BEHAVIOR AND PERFORMANCE IN A MANAGEMENT INFORMATION SYSTEMS COURSE , 2009 .

[80]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[81]  Bogdan Hoanca How well do clicker scores correlate with course performance? A case study in two MIS courses , 2013 .

[82]  James E. Gain,et al.  Using poll sheets and computer vision as an inexpensive alternative to clickers , 2013, SAICSIT '13.

[83]  D. W. Barclay,et al.  The Effects of Organizational Differences and Trust on the Effectiveness of Selling Partner Relationships , 1997 .

[84]  Roslin V. Hauck,et al.  Clicking to Learn: A Case Study of Embedding Radio-Frequency based Clickers in an Introductory Management Information Systems Course , 2008, J. Inf. Syst. Educ..

[85]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[86]  M. Ohland,et al.  Assessing Teamwork Skills for Assurance of Learning Using CATME Team Tools , 2014 .

[87]  Felicity Small,et al.  What Is the Impact of Online Resource Materials on Student Self-Learning Strategies? , 2011 .

[88]  R. Hoyle The structural equation modeling approach: Basic concepts and fundamental issues. , 1995 .

[89]  Vishanth Weerakkody,et al.  Investigating success of an e-government initiative: Validation of an integrated IS success model , 2014, Information Systems Frontiers.

[90]  Adam B. Butler,et al.  Active Learning within a Lecture: Assessing the Impact of Short, In-Class Writing Exercises , 2001 .

[91]  Roy Radner,et al.  On the allocation of effort , 1975 .

[92]  Jacqueline K. Eastman,et al.  Business Students’ Perceptions, Attitudes, and Satisfaction With Interactive Technology: An Exploratory Study , 2011 .

[93]  Yoojung Kim,et al.  Quality, Perceived Usefulness, User Satisfaction, and Intention to Use: An Empirical Study of Ubiquitous Personal Robot Service , 2014 .

[94]  Arun Rai,et al.  Assessing the Validity of IS Success Models: An Empirical Test and Theoretical Analysis , 2002, Inf. Syst. Res..

[95]  Leisa L. Marshall,et al.  An Empirical Investigation of Clicker Technology in Financial Accounting Principles. , 2012 .

[96]  L. Pitt,et al.  Using Cartoons to Teach Corporate Social Responsibility , 2013 .

[97]  Albert L. Lederer,et al.  A study of personal computer utilization by managers , 1990, Inf. Manag..

[98]  Ji Hee Song,et al.  Enhancing Student Learning in Marketing Courses , 2011 .

[99]  Rolph E. Anderson,et al.  Multivariate Data Analysis with Readings , 1979 .

[100]  D. Murphey,et al.  Academically Adrift: Limited Learning on College Campuses , 2011 .

[101]  Craig A. Kelley,et al.  Marketing Education in the Year 2000: Changes Observed and Challenges Anticipated , 1999 .

[102]  Nancy E. Perry,et al.  Investigating Teacher-Student Interactions That Foster Self-Regulated Learning , 2002 .

[103]  Pamela S. Schindler,et al.  Business research methods 12th ed. , 2014 .

[104]  Assessing Clicker Examples Versus Board Examples in Calculus , 2012 .

[105]  Des Laffey,et al.  Is Twitter for the Birds? , 2011 .

[106]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[107]  Olivia R. Liu Sheng,et al.  Examining the Technology Acceptance Model Using Physician Acceptance of Telemedicine Technology , 1999, J. Manag. Inf. Syst..

[108]  E. Pascarella,et al.  How Robust Are the Findings of Academically Adrift? , 2011 .

[109]  Wynne W. Chin,et al.  On the use, usefulness, and ease of use of structural equation modeling in MIS research: a note of caution , 1995 .

[110]  Victoria L. Crittenden,et al.  The Use of Digital Technologies in the Classroom , 2011 .

[111]  Margaret I. Brown,et al.  Using an electronic voting system in logic lectures: one practitioner's application , 2004, J. Comput. Assist. Learn..

[112]  Marie Kavanagh,et al.  Click Go the Students, Click-Click-Click: The Efficacy of a Student Response System for Engaging Students to Improve Feedback and Performance , 2009 .

[113]  Andrew B. Aylesworth,et al.  Improving Case Discussion With an Improv Mind-Set , 2008 .

[114]  Jared Keengwe,et al.  Students’ perceptions of clickers as an instructional tool to promote active learning , 2011, Education and Information Technologies.

[115]  S. Sutton Predicting and Explaining Intentions and Behavior: How Well Are We Doing? , 1998 .

[116]  Chao-Min Chiu,et al.  Understanding e-learning continuance intention: An extension of the Technology Acceptance Model , 2006, Int. J. Hum. Comput. Stud..

[117]  M. K. Mills Using the Jazz Metaphor to Enhance Student Learning and Skill Development in the Marketing Research Course , 2010 .

[118]  Fred D. Davis,et al.  A Model of the Antecedents of Perceived Ease of Use: Development and Test† , 1996 .

[119]  Terence M. Hancock,et al.  Use of audience response systems for summative assessment in large classes , 2010 .

[120]  Jiankun Hu,et al.  Wireless interactive teaching by using keypad-based ARS systems , 2006 .

[121]  Kyu Yon Lim,et al.  Online university students' satisfaction and persistence: Examining perceived level of presence, usefulness and ease of use as predictors in a structural model , 2011, Comput. Educ..

[122]  Kallol Das Using Participatory Photo Novels to Teach Marketing , 2012 .

[123]  Kumar Laxman,et al.  A study on the adoption of clickers in higher education , 2011 .

[124]  Richard E. Clark,et al.  The Cambridge Handbook of Multimedia Learning: Ten Common but Questionable Principles of Multimedia Learning , 2014 .

[125]  A. E. Bayraktaroglu,et al.  Predicting the Intention to Use a Web‐Based Learning System: Perceived Content Quality, Anxiety, Perceived System Quality, Image, and the Technology Acceptance Model , 2014 .

[126]  Donald R. Cooper,et al.  Business Research Methods , 1980 .

[127]  J. Donald Weinrauch,et al.  An Exploratory Use of Musical Metaphors to Enhance Student Learning , 2005 .

[128]  D. Gefen,et al.  E-commerce: the role of familiarity and trust , 2000 .

[129]  John G. Cullen,et al.  Student response systems and learner engagement in large classes , 2014 .

[130]  S. E. Colesca,et al.  Adoption and use of E-Government services: The case of Romania , 2008 .

[131]  Nick Lee,et al.  Using an Experiential Business Game to Stimulate Sustainable Thinking in Marketing Education , 2013 .

[132]  Mark W. Johnston,et al.  Analysis of role conflict and role ambiguity in a structural equations framework , 1990 .

[133]  Douglas R. Vogel,et al.  Predicting user acceptance of collaborative technologies: An extension of the technology acceptance model for e-learning , 2013, Comput. Educ..

[134]  John T. Guthrie,et al.  Feedback and sentence learning , 1971 .

[135]  Kevin C. Almeroth,et al.  Clickers in college classrooms: Fostering learning with questioning methods in large lecture classes , 2009 .